Image display system of work machine and image display method of work machine

The image display system for work machines integrates surrounding and setting images to streamline attachment setting adjustments, addressing the inefficiencies in existing systems by providing real-time confirmation and reducing operational effort.

JP2025142720APending Publication Date: 2025-10-01KOMATSU LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024042234
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-03-18
Publication Date
2025-10-01

AI Technical Summary

Technical Problem

Existing systems require significant effort to set the characteristics of attachments on work machines like hydraulic excavators during replacement, as they lack integration of surrounding conditions and attachment type recognition.

Method used

An image display system for work machines that includes a surrounding camera, monitor, and controller to simultaneously display setting images for attachment characteristics and surrounding images, allowing for real-time confirmation and adjustment of attachment settings based on the machine's environment and type.

Benefits of technology

Enables efficient and accurate confirmation of attachment settings by integrating surrounding conditions and attachment type recognition, reducing the need for repeated screen transitions and minimizing operational effort.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025142720000001_ABST
    Figure 2025142720000001_ABST
Patent Text Reader

Abstract

To provide an image display system of a work machine and an image display method of a work machine which can check setting of attachment characteristics after recognizing surrounding situation.SOLUTION: A surrounding camera 32 captures the surroundings of a work machine 100. A controller 20 controls so that a setting image 50B related to setting change of the characteristics of an attachment 8 and a surrounding image 50A of the work machine 100 captured by the surrounding camera 32 are simultaneously displayed on a monitor 21.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a work machine image display system and a work machine image display method. [Background technology]

[0002] BACKGROUND ART A technique for switching settings of a fluid pressure circuit for an attachment depending on the attachment when replacing an attachment in a work machine such as a hydraulic excavator is described, for example, in Japanese Patent Laid-Open Publication No. 2008-266975 (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-266975 Summary of the Invention [Problem to be solved by the invention]

[0004] As described in Patent Document 1, when replacing an attachment, it is necessary to set the characteristics of the attachment according to the replacement attachment, but there is a demand for reducing the effort required when setting the characteristics of the attachment.

[0005] An object of the present disclosure is to provide a work machine image display system and a work machine image display method that enable confirmation of attachment characteristic settings after recognizing the surrounding situation. [Means for solving the problem]

[0006] One image display system for a work machine disclosed herein is an image display system for a work machine to which an attachment can be attached, and includes a surrounding camera, a monitor, and a controller. The surrounding camera captures images of the surroundings of the work machine. The controller simultaneously displays on the monitor a setting image related to a setting change of the attachment's characteristics and an image of the surroundings of the work machine captured by the surrounding camera. The controller simultaneously displays on the monitor an image as a setting image for confirming whether or not a setting change of the attachment's characteristics is necessary.

[0007] Another work machine image display system disclosed herein is an image display system for a work machine to which an attachment can be attached, and includes a surrounding camera, a monitor, a type reader, and a controller. The surrounding camera captures images of the surroundings of the work machine. The type reader reads the type of attachment. The controller simultaneously displays on the monitor a display image for confirming whether or not settings of the attachment characteristics need to be changed according to the type of attachment read by the type reader, and an image of the surroundings of the work machine captured by the surrounding camera.

[0008] One work machine image display method disclosed herein is a method for displaying an image of a work machine to which an attachment can be attached, and includes the following steps.

[0009] Surrounding image information is acquired by capturing an image of the surroundings of the work machine. An image of the surroundings of the work machine is generated based on the surrounding image information. A setting image for confirming whether or not changes to attachment characteristic settings are required and the surrounding image are simultaneously displayed on the monitor.

[0010] Another work machine image display method disclosed herein is a method for displaying an image of a work machine to which an attachment can be attached, and includes the following steps.

[0011] Surrounding image information is acquired by capturing an image of the surroundings of the work machine. The type of attachment is acquired from a type reader that reads the type of attachment. An image of the surroundings of the work machine is generated based on the surrounding image information. A display image for confirming whether or not settings of the attachment characteristics need to be changed according to the acquired type of attachment and the surrounding image are simultaneously displayed on the monitor. [Effects of the Invention]

[0012] According to the present disclosure, it is possible to realize a work machine image display system and a work machine image display method that enable confirmation of attachment characteristic settings after recognizing the surrounding situation. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a diagram illustrating a configuration of a work machine according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a perspective view of the inside of the cab of the work machine. [Figure 3] 1 is a block diagram showing the configuration of an image display system for a work machine according to an embodiment of the present disclosure. [Figure 4] FIG. 4 is a diagram showing functional blocks of a controller shown in FIG. 3. [Figure 5] FIG. 2 is a diagram illustrating an example of an image displayed in an image display system for a work machine according to an embodiment of the present disclosure. [Figure 6] FIG. 1 is a flow chart showing one image display method for a work machine. [Figure 7] FIG. 10 is a flow chart showing another image display method for a work machine. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0015] In the specification and drawings, the same or corresponding components are designated by the same reference numerals, and redundant explanations will not be repeated. Furthermore, in the drawings, configurations may be omitted or simplified for the sake of convenience. While a hydraulic excavator will be described below as an example of the work machine 100, the work machine 100 may be any work machine to which an attachment, such as a wheel loader or motor grader, can be attached and detached.

[0016] <Work machine configuration>

[0017] Fig. 1 is a diagram schematically illustrating the configuration of a work machine according to one embodiment of the present disclosure. As shown in Fig. 1, the work machine 100 according to this embodiment is, for example, a hydraulic excavator. The work machine 100 has a main body 1 and a hydraulically operated work implement 2. The main body 1 has a revolving unit 3 and a traveling unit 5.

[0018] The rotating unit 3 is disposed on and supported by the running unit 5. The rotating unit 3 is capable of rotating relative to the running unit 5 about a rotation axis AX. The rotating unit 3 has a driver's cab 4. The driver's cab 4 is provided with a driver's seat 4S in which an operator sits. The operator can operate the work machine 100 in the driver's cab 4.

[0019] The revolving body 3 has an engine room 9. In the engine room 9, an engine 45, a main hydraulic pump 46, and the like shown in FIG.

[0020] The work implement 2 is supported by the rotating unit 3. The work implement 2 has a boom 6, an arm 7, and a bucket 8. The boom 6 is connected to the rotating unit 3. The arm 7 is connected to the boom 6. The bucket 8 is connected to the arm 7. The bucket 8 may be another attachment, such as a breaker. The bucket 8 can be attached to and detached from the arm 7. This makes it possible to replace the bucket 8 with a breaker, and also makes it possible to replace the bucket 8 with a bucket of a different size.

[0021] The work implement 2 has a boom cylinder 10, an arm cylinder 11, and a bucket cylinder 12. When the boom cylinder 10 extends and retracts, the boom 6 can rotate around a boom pin 13. When the arm cylinder 11 extends and retracts, the arm 7 can rotate around an arm pin 14. When the bucket cylinder 12 extends and retracts, the bucket 8 can rotate around a pin 15. Each of the boom cylinder 10, arm cylinder 11, and bucket cylinder 12 is a hydraulic cylinder driven by hydraulic oil.

[0022] Fig. 2 is a perspective view of the inside of the cab of the work machine. As shown in Fig. 2, inside the cab 4, there is arranged an operator's seat 4S where the operator sits.

[0023] A first operating lever 41 is provided to the right R of the driver's seat 4S, which the operator in the driver's cab 4 uses to operate the drive of the boom 6 and bucket 8 of the work implement 2. A switch panel 29 on which various switches are mounted is provided to the right R of the driver's seat 4S. A second operating lever 42 is provided to the left L of the driver's seat 4S, which the operator uses to operate the drive of the arm 7 of the work implement 2 and the rotation of the rotating body 3.

[0024] The lock lever 33 is disposed, for example, near the operating lever 42. The lock lever 33 is used to stop functions such as the operation of the work implement 2, the rotation of the revolving unit 3, and the travel of the traveling unit 5. The lock lever 33 can be switched between a locked state and an unlocked state by being operated by the operator.

[0025] A monitor 21 is installed at the front F inside the cab 4. The monitor 21 is located, for example, in a right front corner inside the cab 4, and is supported by a front pillar extending from the floor of the cab 4. The monitor 21 is located on the driver's seat 4S side with respect to the front pillar. The monitor 21 is located behind B (on the near side) of the front pillar as seen by the operator seated in the driver's seat 4S.

[0026] The monitor 21 has a flat display surface 21d. The display surface 21d is configured with a graphic display such as a liquid crystal display, an organic EL (Electro-Luminescence) display, etc. The display surface 21d of the monitor 21 may be either vertically or horizontally elongated.

[0027] The monitor 21 is attached to the right R front pillar of the pair of front pillars, which is the one closest to the work implement 2. The monitor 21 is located on the near side of the front pillar, within the line of sight to the right front of the operator seated in the driver's seat 4S. In a work machine 100 that has the work implement 2 on the right R of the driver's cab 4, by attaching the monitor 21 to the right R front pillar, the operator can see both the work implement 2 and the monitor 21 with a small amount of line of sight movement.

[0028] <Configuration of a work machine image display system>

[0029] Next, the configuration of the image display system of the work machine 100 will be described with reference to FIG.

[0030] Figure 3 is a block diagram showing the configuration of an image display system for a work machine according to one embodiment of the present disclosure. As shown in Figure 3, the image display system for a work machine 100 includes a controller 20, operation levers 41 and 42, an operation amount detection sensor 43, an engine 45, a main hydraulic pump 46, a relief valve 47, a directional control valve 48, and an actuator AC. The image display system for the work machine 100 also includes an input unit 31, a surrounding camera 32, a lock lever 33, a type reader 34, and a monitor 21.

[0031] A main hydraulic pump 46 is mechanically connected to the engine 45. This allows the driving force of the engine 45 to be transmitted to the main hydraulic pump 46. The main hydraulic pump 46 is driven by the driving force of the engine 45. When the main hydraulic pump 46 is driven, hydraulic oil is supplied to a directional control valve 48 via a relief valve 47. The relief valve 47 automatically and instantly operates to release the required amount of hydraulic oil when the pressure of the hydraulic oil exceeds a predetermined pressure, and closes completely when the pressure of the hydraulic oil drops to a normal range.

[0032] Each of the control levers 41, 42 is operated by an operator. The operation amount detection sensor 43 detects the operation amount of each of the control levers 41, 42 operated by the operator. The operation amount detection sensor 43 is, for example, a potentiometer. The operation amount detection sensor 43 outputs the detected operation amount to the controller 20 as an operation signal (electrical signal).

[0033] The directional control valve 48 has a rod-shaped spool. The spool of the directional control valve 48 is driven based on a command current from the controller 20. Driving the spool of the directional control valve 48 switches the flow direction of the hydraulic oil supplied from the directional control valve 48 to the actuator AC. Driving the spool of the directional control valve 48 also adjusts the supply amount of hydraulic oil supplied from the directional control valve 48 to the actuator AC.

[0034] The actuators AC include, for example, a boom cylinder 10, an arm cylinder 11, and a bucket cylinder 12. The extension and retraction of each of the hydraulic cylinders 10, 11, and 12 is controlled by switching the flow direction of hydraulic oil supplied from a directional control valve 48. The extension and retraction speed of each of the hydraulic cylinders 10, 11, and 12 is controlled by adjusting the amount of hydraulic oil supplied from the directional control valve 48.

[0035] As described above, when the operator operates the control levers 41 and 42, the operation of the actuator AC is controlled.

[0036] When the attachment 8 is replaced, it is necessary to set or change the characteristics of the attachment 8 according to the type of the replaced attachment 8. At this time, for example, the flow rate characteristics of the hydraulic oil supplied to the actuator AC, the relief pressure (valve opening pressure) of the relief valve 47, etc. are set. The flow rate characteristics of the hydraulic oil supplied to the actuator AC can be adjusted by a command current output from the controller 20 to the directional control valve 48.

[0037] The input unit 31 is a unit for setting and changing the characteristics of the attachment 8. The input unit 31 is a unit operated by an operator, and is, for example, the touch panel display surface 21d of the monitor 21. The input unit 31 may also be a physical button, a physical switch, or the like. The input unit 31 outputs information related to the characteristics of the attachment 8 input by the operator to the controller 20. The characteristics of the attachment 8 are setting values ​​for operating the attachment 8.

[0038] The surrounding camera 32 captures images of the surroundings of the work machine 100. The image captured by the surrounding camera 32 is, for example, a bird's-eye view image of the surroundings of the work machine 100 viewed from above downward. The surrounding camera 32 has multiple cameras, for example, four cameras. The bird's-eye view image may be constructed by combining images captured by the multiple cameras. The surrounding camera 32 is attached to the revolving bed 3, for example. The surrounding camera 32 outputs surrounding image information relating to the captured image of the surroundings of the work machine 100 to the controller 20.

[0039] When the lock lever 33 is placed in the locked state by the operator, functions such as operation of the work implement 2, rotation of the revolving unit 3, and travel of the running unit 5 are stopped. In this case, even if the operator performs drive operations on the work implement 2, the revolving unit 3, or the running unit 5, the work implement 2, the revolving unit 3, or the running unit 5 will not move. On the other hand, when the lock lever 33 is placed in the unlocked state by the operator, functions such as operation of the work implement 2, rotation of the revolving unit 3, and travel of the running unit 5 are not stopped. In this case, the work implement 2, the revolving unit 3, and the running unit 5 will move when the operator performs drive operations on the work implement 2, the revolving unit 3, or the running unit 5. The lock lever 33 outputs lock information to the controller 20, which indicates whether the lock lever 33 is in the locked state or the unlocked state.

[0040] The type reader 34 reads the type of the attachment 8. The type reader 34 detects the type of the attachment 8, for example, by reading an IC (Integrated Circuit) tag attached to the attachment 8. The type reader 34 may be a scanner dedicated to reading IC tags, or may be a mobile information terminal such as a smartphone. The type reader 34 may be attached to the work machine 100, or may be a separate device separate from the work machine 100. The type reader 34 outputs information indicating the type of the attachment 8 that it has detected to the controller 20.

[0041] The controller 20 controls the image displayed on the monitor 21 based on information from the input unit 31, the surrounding camera 32, the lock lever 33, the type reader 34, etc. The monitor 21 can switch the displayed image based on a control signal from the controller 20.

[0042] The controller 20 includes a processor, a main memory, and a storage. The processor is, for example, a CPU (Central Processing Unit). The main memory includes, for example, a non-volatile memory such as a ROM (Read Only Memory) and a volatile memory such as a RAM (Random Access Memory).

[0043] The controller 20 reads out a program stored in the storage, loads it into the main memory, and executes a predetermined process in accordance with the program. The program may be distributed to the controller 20 via a network.

[0044] Each of the controller 20, input unit 31, lock lever 33, operation levers 41, 42, operation amount detection sensor 43, and monitor 21 may be mounted on the work machine 100, or may be located remotely from the work machine 100. The controller 20 may be stored in a server remote from the work machine 100. When the controller 20 is located remotely outside the work machine 100, it may be connected wirelessly to the input unit 31, surrounding camera 32, lock lever 33, operation amount detection sensor 43, monitor 21, relief valve 47, directional control valve 48, etc. Also, the operator may operate the work machine 100 remotely without being inside the cab 4 of the work machine 100.

[0045] <Controller 20>

[0046] Next, the functional blocks of the controller 20 will be described with reference to FIG.

[0047] Fig. 4 is a diagram showing functional blocks of the controller shown in Fig. 3. As shown in Fig. 4, the controller 20 has an operation amount acquisition unit 20A, an input information acquisition unit 20B, a surrounding information acquisition unit 20C, a lock information acquisition unit 20D, and a type information acquisition unit 20E, and further has an operation control unit 20F, a display image generation unit 20G, a display control unit 20H, and a memory 20I.

[0048] The operation amount acquisition unit 20A acquires an operation signal detected by the operation amount detection sensor 43. The operation amount acquisition unit 20A outputs the acquired operation signal to the operation control unit 20F. The operation control unit 20F controls the directional control valve 48 based on the operation signal acquired from the operation amount acquisition unit 20A. As a result, the work machine 2 operates based on the operation of the operation levers 41, 42 by the operator.

[0049] The input information acquisition unit 20B acquires input information from the input unit 31. The surrounding information acquisition unit 20C acquires information on images captured by the surrounding camera 32. The lock information acquisition unit 20D acquires lock information indicating whether the lock lever 33 is in a locked state or an unlocked state. The type information acquisition unit 20E acquires type information of the attachment 8 read by the type reader 34.

[0050] The display image generation unit 20G acquires information from the input information acquisition unit 20B, the surrounding information acquisition unit 20C, the lock information acquisition unit 20D, the type information acquisition unit 20E, the memory 20I, etc., and based on the acquired information, the display image generation unit 20G generates an image to be displayed on the monitor 21. The display control unit 20H controls the display content of the monitor 21 based on the image information acquired from the display image generation unit 20G.

[0051] When the attachment 8 is replaced, the characteristics of the replaced attachment 8 (for example, the flow rate characteristics of the hydraulic oil, the relief pressure, etc.) are input from the input unit 31 and stored in the memory 20I via the input information acquisition unit 20B. The operation control unit 20F controls the operation of the relief valve 47 and the directional control valve 48 by referring to the characteristics of the replaced attachment stored in the memory 20I.

[0052] <Image displayed on display surface 21d of monitor 21>

[0053] Next, an image displayed on the display surface 21d of the monitor 21 in this embodiment will be described with reference to FIG.

[0054] Figure 5 is a diagram showing an example of an image displayed in an image display system for a work machine according to an embodiment of the present disclosure. As shown in Figures 5(B) to 5(F), a surrounding image 50A and a setting image 50B are simultaneously displayed on the display surface 21d of the monitor 21. The surrounding image 50A is an image captured by the surrounding camera 32, and is, for example, an overhead image. The surrounding image 50A displays a planar image 100I of the work machine and an image of the surroundings of the planar image 100I. The setting image 50B is an image related to changing the settings of the characteristics of the attachment 8.

[0055] The surrounding image 50A and the setting image 50B are displayed, for example, next to each other in the vertical direction on the display surface 21d. The surrounding image 50A is displayed above the setting image 50B. The surrounding image 50A may also be displayed below the setting image 50B. However, if the surrounding image 50A is displayed below the setting image 50B, when the operator touches the setting image 50B, the operator's hand operating the setting image 50B may get in the way, making it difficult for the operator to view the surrounding image. Therefore, from the perspective of ease of viewing when touching the setting image, it is preferable that the surrounding image 50A be displayed above the setting image 50B. Note that when the surrounding image 50A and the setting image 50B are displayed next to each other in the vertical direction, it is preferable that the display surface 21d of the monitor 21 is vertically long.

[0056] The surrounding image 50A and the setting image 50B may also be displayed side by side in the left-right direction on the display surface 21d. In this case, the surrounding image 50A may be displayed on either the left or right side of the setting image 50B. However, if the surrounding image 50A is displayed to the right of the setting image 50B, when the operator touches the setting image 50B with his or her right hand, the operator's right hand operating the setting image 50B may get in the way, making it difficult for the operator to view the surrounding image. For this reason, when the monitor 21 is mounted on the front pillar on the right side R, it is preferable that the surrounding image 50A be displayed to the left of the setting image 50B from the viewpoint of ease of viewing when touching the setting image. Note that when the surrounding image 50A and the setting image 50B are displayed side by side in the left-right direction, it is preferable that the display surface 21d of the monitor 21 be horizontally long.

[0057] The setting image 50B includes at least one of an attachment 8 selection image 50Ba (Figure 5(B)), an attachment 8 characteristic change necessity image 50Bb (Figures 5(C) and (D)), an attachment 8 characteristic selection image 50Bc (Figure 5(E)), and an attachment 8 characteristic input image 50Bd (Figure 5(F)).

[0058] The attachment 8 selection image 50Ba shown in FIG. 5(B) is an image for selecting the type of attachment 8. The selection image 50Ba displays a list of various types of attachments 8. The operator can select the type of attachment 8 to be replaced in the selection image 50Ba. As the type of attachment 8, for example, a bucket, a breaker, or other attachments is displayed.

[0059] The characteristic change necessity image 50Bb of the attachment 8 shown in FIGS. 5(C) and (D) is an image for confirming whether or not the characteristics of the attachment 8 need to be changed. The characteristic change necessity image 50Bb displays the characteristics currently set for the type of attachment 8 selected. The characteristic change necessity image 50Bb may also display button images such as a change button B1, a back button B2, and a confirm button B3. The change button B1, the back button B2, and the confirm button B3 correspond to examples of an operation unit. Operating the change button B1 allows the characteristics of the attachment 8 to be changed. Operating the back button B2 switches the characteristic change necessity image 50Bb to the previous image (for example, the selected image 50Ba). Operating the confirm button B3 confirms the changed characteristics of the attachment 8 and overwrites them.

[0060] The characteristic selection image 50Bc for the attachment 8 shown in Fig. 5(E) is an image for selecting a characteristic that the user wishes to change for the type of the selected attachment 8. The characteristic selection image 50Bc displays various characteristics that the user wishes to change for the type of the selected attachment 8. The displayed characteristics include, for example, the flow rate of hydraulic oil for operating the attachment 8, the relief pressure of the relief valve 47, etc.

[0061] The characteristic input image 50Bd of the attachment 8 shown in FIG. 5(F) is an image for inputting the characteristics of the attachment 8. The characteristic input image 50Bd allows the operator to change the characteristic of the attachment 8 selected in the characteristic selection image 50Bc. For example, if the flow rate of hydraulic oil is selected in the characteristic selection image 50Bc, the flow rate of hydraulic oil can be changed in the characteristic input image 50Bd. Furthermore, if the relief pressure is selected in the characteristic selection image 50Bc, the relief pressure can be changed in the characteristic input image 50Bd. An image such as a numeric keypad is displayed on the characteristic input image 50Bd. The operator can input specific numerical values ​​for the characteristics of the attachment 8 by operating the numeric keypad displayed on the characteristic input image 50Bd.

[0062] The operator can select one of the items displayed on each of the images 50Ba-Bd by, for example, touching the display surface 21d. Alternatively, the operator may select one of the items displayed on each of the images 50Ba-Bd by using a pointer image displayed on the characteristic selection image 50Bc instead of by touching the display surface 21d.

[0063] Next, an example of transition of an image displayed on the display surface 21d of the monitor 21 will be described.

[0064] 5(A), for example, a surrounding image 50A and a rear image 50C are displayed on the display surface 21d. The rear image 50C is an image captured behind the work machine 100. If the attachment 8 is replaced in this state, it is necessary to change the characteristics of the current attachment 8 to the characteristics of the replaced attachment 8. Therefore, the operator operates the input unit 31 to change the characteristics of the attachment 8.

[0065] As shown in Fig. 5(B), when the operator performs an operation to change the characteristics of the attachment 8, the rear image 50C transitions to a setting image 50B while the surrounding image 50A is maintained on the display surface 21d. The setting image 50B is, for example, a selection image 50Ba for the attachment 8. As a result, the surrounding image 50A and the selection image 50Ba are simultaneously displayed on the display surface 21d. The operator performs an operation to select the type of attachment 8 to be replaced with on the selection image 50Ba.

[0066] 5(C), when the operator performs an operation to select the type of attachment 8, the selection image 50Ba is changed to a characteristic change necessity image 50Bb of the attachment 8, while the surrounding image 50A is maintained on the display surface 21d. As a result, the surrounding image 50A and the characteristic change necessity image 50Bb are simultaneously displayed on the display surface 21d. The operator can change the characteristics of the attachment 8 by operating the change button B1 on the characteristic change necessity image 50Bb.

[0067] 5(D), when the operator operates the change button B1, the surrounding image 50A on the display surface 21d is maintained, and the characteristic change necessity image 50Bb is transitioned to a characteristic selection image 50Bc for the attachment 8. As a result, the surrounding image 50A and the characteristic selection image 50Bc are simultaneously displayed on the display surface 21d. The operator selects the characteristic of the attachment 8 that he or she wishes to change in the characteristic selection image 50Bc.

[0068] As shown in FIG. 5(E), when the operator selects the characteristic of the attachment 8 that he or she wishes to change, the characteristic selection image 50Bc transitions to a characteristic input image 50Bd for the attachment 8, while the surrounding image 50A is maintained on the display surface 21d. As a result, the surrounding image 50A and the characteristic input image 50Bd are simultaneously displayed on the display surface 21d. The operator inputs the numerical value of the characteristic of the attachment 8 selected in the characteristic input image 50Bd using a numeric keypad or the like. This makes it possible to change the characteristics of the attachment 8 after replacement, such as the flow rate of hydraulic oil or the relief pressure.

[0069] If the operator selects the type of attachment 8 to be replaced by long pressing from the state of FIG. 5(B), the screen may transition directly to the image of FIG. 5(E).

[0070] Furthermore, when the controller 20 acquires the type of the replaced attachment 8 from the type reader 34 in the state of Fig. 5(A), the image may transition directly to the image of Fig. 5(D). The transition of the images from Fig. 5(D) onwards is the same as the transition of the images from Fig. 5(C) onwards, and therefore the description thereof will not be repeated.

[0071] Furthermore, when the lock lever 33 is in the locked state, a setting image 50B for setting the characteristics of the attachment 8 may be displayed, and the surrounding image 50A may not be displayed. In this case, the surrounding image 50A may be displayed on the display surface 21d of the monitor 21 based on the switching of the lock lever 33 from the locked state to the unlocked state, as shown in FIG. 5(B). Also, in this case, the setting image 50B may be continuously displayed on the display surface 21d of the monitor 21 before and after the switching of the lock lever 33 from the locked state to the unlocked state. When the lock lever 33 is in the unlocked state, the surrounding image 50A and the setting image 50B may be simultaneously displayed on the display surface 21d of the monitor 21, as shown in FIG. 5(B).

[0072] <Method for displaying images of work machines>

[0073] Next, one image display method for a work machine in this embodiment will be described with reference to FIG.

[0074] Figure 6 is a flow diagram showing one image display method for a work machine. As shown in Figure 6, first, the surrounding camera 32 captures an image of the surroundings of the work machine 100. The surrounding camera 32 outputs surrounding image information obtained by capturing an image of the surroundings of the work machine 100 to the controller 20.

[0075] In step S11, the surrounding information acquisition unit 20C of the controller 20 acquires surrounding image information. The surrounding information acquisition unit 20C outputs the acquired surrounding image information to the display image generation unit 20G.

[0076] In step S12, the display image generation unit 20G of the controller 20 generates a surrounding image based on the acquired surrounding image information. At this time, the display image generation unit 20G generates the surrounding image by referencing various information stored in the memory 20I. For example, the memory 20I stores a planar image 100I of the work machine 100. The display image generation unit 20G generates the surrounding image 50A by combining the planar image 100I of the work machine 100 stored in the memory 20I with an image captured by the surrounding camera 32.

[0077] The display image generating unit 20G generates a combined image by combining the surrounding image 50A and the setting image 50B. For example, when information regarding a change in the setting of the characteristics of the attachment 8 is acquired from the input unit 31, or when information regarding switching to an unlocked state is acquired from the lock lever 33, the display image generating unit 20G generates the combined image.

[0078] When generating a combined image, the display image generation unit 20G generates a surrounding image by referring to various information stored in the memory 20I. The display image generation unit 20G selects a setting image 50B to be combined with the surrounding image 50A based on information regarding the setting change from the input unit 31, information regarding switching from the lock lever 33 to the unlocked state, and the like. The setting image 50B to be combined with the surrounding image 50A is selected from, for example, images 50Ba, 50Bb, 50Bc, and 50Bd shown in FIG. 5. The display image generation unit 20G outputs the generated combined image to the display control unit 20H.

[0079] In step S13, the display control unit 20H of the controller 20 controls the monitor 21 to display the combined image acquired from the display image generation unit 20G. As a result, images such as those shown in FIGS. 5(B) to 5(F) are displayed on the display surface 21d of the monitor 21.

[0080] As described above, in one image display method for a work machine, the surrounding image 50A and the setting image 50B are displayed on the monitor 21 simultaneously.

[0081] Next, another image display method for a work machine in this embodiment will be described with reference to FIG.

[0082] Fig. 7 is a flow diagram showing another method for displaying images of a work machine. As shown in Fig. 7, first, the surrounding camera 32 captures an image of the surroundings of the work machine 100. The surrounding camera 32 outputs surrounding image information obtained by capturing an image of the surroundings of the work machine 100 to the controller 20.

[0083] In step S21a, the surrounding information acquisition unit 20C of the controller 20 acquires surrounding image information. The surrounding information acquisition unit 20C outputs the acquired surrounding image information to the display image generation unit 20G.

[0084] In step S22, similarly to step S12 in FIG. 6, the display image generating unit 20G of the controller 20 generates a surrounding image based on the acquired surrounding image information.

[0085] In step S21b, the type information acquisition unit 20E of the controller 20 acquires information about the type of the attachment 8 from the type reader 34. The type information acquisition unit 20E outputs the acquired information about the type of the attachment 8 to the display image generation unit 20G.

[0086] The display image generation unit 20G generates a combined image by combining the surrounding image 50A with a display image 50B for displaying the characteristics of the attachment 8. When generating the combined image, the display image generation unit 20G refers to various information stored in the memory 20I to select the display image 50B to be combined with the surrounding image 50A. The display image 50B to be combined with the surrounding image 50A is, for example, the image 50Bb shown in FIG. 5(D). The display image generation unit 20G outputs the generated combined image to the display control unit 20H.

[0087] In step S23, the display control unit 20H of the controller 20 controls the monitor 21 to display the combined image acquired from the display image generation unit 20G. As a result, an image such as that shown in FIG. 5(B) is displayed on the display surface 21d of the monitor 21.

[0088] As described above, in this other image display method for a work machine, the surrounding image 50A and the display image 50B (50Bb) are displayed on the monitor 21 simultaneously.

[0089] <Effects>

[0090] Conventionally, the screen for setting the characteristics of the attachment 8 did not display an image of the surroundings of the work machine 100, such as an excavator. For this reason, in order to operate the attachment 8 after changing the characteristics of the attachment 8, such as the flow characteristics or relief pressure of the attachment 8, it was necessary to transition from the setting screen for setting the characteristics of the attachment 8 to a screen that displays an image of the surroundings. For this reason, when changing the settings of the characteristics of the attachment 8 multiple times, it was necessary to transition from the screen that displays the image of the surroundings to the setting screen each time, which was time-consuming.

[0091] According to one image display system for a work machine 100 of the present disclosure, as shown in FIGS. 5(B) to 5(F), a setting image 50B related to changes to the settings of the attachment 8 and a surrounding image 50A of the work machine 100 captured by the surrounding camera 32 are simultaneously displayed on the monitor 21. This allows the user to operate the attachment 8 while checking the settings of the attachment 8. Alternatively, the user can operate the attachment 8 while checking that the settings of the hydraulic oil flow characteristics, relief pressure, etc. of the attachment 8 have been changed by changing the settings. This eliminates the need to switch screens between the surrounding image 50A and the setting image 50B, thereby eliminating the effort required to set the characteristics of the attachment 8. Furthermore, the user can check the settings of the attachment 8 while being aware of the surrounding conditions.

[0092] 5(C), in the image display system of one of the work machines 100, setting image 50B is image 50Bb for confirming whether or not a change is required in the settings of the characteristics of the attachment 8. In this way, image 50Bb for confirming whether or not a change is required in the settings of the characteristics of the attachment 8 is also displayed on monitor 21 at the same time as surrounding image 50A, so that when confirming whether or not the setting needs to be changed, it is possible to avoid the trouble of switching screens between surrounding image 50A and setting image 50B, and it is also possible to omit the trouble of setting the characteristics of the attachment 8.

[0093] 5(C), in the image display system of one of the work machines 100, the image 50Bb for confirming whether or not the setting of the characteristics of the attachment 8 needs to be changed has a Confirm button B3 (operation unit) for completing the change of the characteristics of the attachment 8. This makes it possible to operate the Confirm button B3 while the surrounding image 50A is being displayed.

[0094] 5(F), in the image display system of one of the work machines 100, an image for inputting the characteristics of the attachment 8 (characteristics input image 50Bd) is displayed as a setting image 50B simultaneously with the surrounding image 50A on the monitor 21. This makes it possible to input the characteristics of the attachment 8 while displaying the surrounding image 50A.

[0095] Furthermore, in the image display system of one of the above-mentioned working machines 100, the surrounding image 50A is displayed on the monitor 21 when the lock lever 33 is switched from the locked state to the unlocked state. This makes it possible to automatically display the surrounding image 50A on the monitor 21 when the lock is released.

[0096] Furthermore, in the image display system of the above-described one working machine 100, the setting image 50B is continuously displayed on the monitor 21 before and after the lock lever 33 is switched from the locked state to the unlocked state. This allows the setting image 50B to be displayed on the monitor 21 in both the locked state and the unlocked state.

[0097] 5, in the image display system for one of the work machines 100, the surrounding image 50A is an overhead image that looks down from above the work machine 100 and the area around the work machine 100. This makes it possible to check the left, right, front, and rear conditions of the work machine 100 at a glance using the overhead image.

[0098] 5(A) and 5(D), according to another image display system for a work machine 100 of the present disclosure, a display image 50Bb for displaying the characteristics of the attachment 8 according to the type of attachment 8 read by the type reader 34 and a surrounding image 50A of the work machine 100 captured by the surrounding camera 32 are simultaneously displayed on the monitor 21. Because the display image 50Bb according to the type of attachment 8 is displayed in this way, no operation is required to transition to the display image 50Bb, saving time and effort. Furthermore, because the display image 50Bb according to the type of attachment 8 is displayed, it becomes possible to accurately select the type of attachment 8.

[0099] 5(D), in the image display system of the other working machine 100, the displayed image 50Bb is an image 50Bb for confirming whether or not a change is required in the settings of the characteristics of the attachment 8. In this way, the image 50Bb for confirming whether or not a change is required in the settings of the characteristics of the attachment 8 is also displayed on the monitor 21 at the same time as the surrounding image 50A, so that when confirming whether or not the setting needs to be changed, it is possible to save the trouble of switching screens between the surrounding image 50A and the setting image 50B, and it is also possible to save the trouble of setting the characteristics of the attachment 8.

[0100] 5(D), in the image display system of the other work machine 100, the image 50Bb for confirming whether or not the setting of the characteristics of the attachment 8 needs to be changed has a Confirm button B3 (operation unit) for completing the change of the characteristics of the attachment 8. This makes it possible to operate the Confirm button B3 while the surrounding image 50A is being displayed.

[0101] <Additional Notes>

[0102] The above-described embodiment includes the following technical idea.

[0103] (Appendix 1) An image display system for a work machine to which an attachment can be attached, a surroundings camera that captures images of the surroundings of the work machine; The monitor and a controller that simultaneously displays on the monitor a setting image relating to changes to the settings of the attachment characteristics and an image of the surroundings of the work machine captured by the surrounding camera, The controller displays an image for confirming whether or not a setting change is required for the characteristic of the attachment as the setting image on the monitor simultaneously with the surrounding image.

[0104] (Appendix 2) 2. The image display system for a work machine according to claim 1, wherein the image for confirming whether or not a change to the setting of the characteristic of the attachment is required has an operation unit for completing the change of the characteristic of the attachment.

[0105] (Appendix 3) The image display system for a work machine according to claim 1 or 2, wherein the controller displays an image for inputting the characteristics of the attachment as the setting image on the monitor simultaneously with the surrounding image.

[0106] (Appendix 4) Further provided with a lock lever that can be switched between a locked state and an unlocked state, 4. The image display system for a work machine according to claim 1, wherein the controller displays the surrounding image on the monitor based on switching of the lock lever from the locked state to the unlocked state.

[0107] (Appendix 5) Further provided with a lock lever that can be switched between a locked state and an unlocked state, 5. The image display system for a work machine according to claim 1, wherein the controller continuously displays the setting image on the monitor before and after switching the lock lever from the locked state to the unlocked state.

[0108] (Appendix 6) 6. A work machine image display system according to any one of Supplementary Note 1 to Supplementary Note 5, wherein the surrounding image is an overhead image of the work machine and the surroundings of the work machine viewed from above downward.

[0109] (Appendix 7) An image display system for a work machine to which an attachment can be attached, a surroundings camera that captures images of the surroundings of the work machine; The monitor and a type reader that reads the type of the attachment; and a controller that simultaneously displays on the monitor a display image for confirming whether or not settings of the attachment characteristics need to be changed in accordance with the type of attachment read by the type reader, and an image of the surroundings of the work machine captured by the surrounding camera.

[0110] (Appendix 8) 8. The image display system for a work machine according to claim 7, wherein the image for confirming whether or not a change to the setting of the characteristic of the attachment is required has an operation unit for completing the change of the characteristic of the attachment.

[0111] (Appendix 9) A method for displaying an image of a work machine to which an attachment can be attached, comprising: acquiring surrounding image information obtained by capturing an image of the surroundings of the work machine; generating a surrounding image of the work machine based on the surrounding image information; a step of simultaneously displaying on a monitor a setting image for confirming whether or not a setting change is required for the characteristics of the attachment and the surrounding image.

[0112] (Appendix 10) A method for displaying an image of a work machine to which an attachment can be attached, comprising: acquiring surrounding image information obtained by capturing an image of the surroundings of the work machine; acquiring the type of the attachment from a type reader that reads the type of the attachment; generating a surrounding image of the work machine based on the surrounding image information; a step of simultaneously displaying on a monitor a display image for confirming whether or not a setting change is required for the characteristics of the attachment according to the acquired type of the attachment, and the surrounding image.

[0113] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0114] 1 main body, 2 work equipment, 3 swivel body, 4 operator's cab, 4S operator's seat, 5 travel body, 6 boom, 7 arm, 8 attachment (bucket), 9 engine room, 10 boom cylinder, 11 arm cylinder, 12 bucket cylinder, 13 boom pin, 14 arm pin, 20 controller, 20A operation amount acquisition unit, 20B input information acquisition unit, 20C surrounding information acquisition unit, 20D lock information acquisition unit, 20E type information acquisition unit, 20F operation control unit, 20G display image generation unit, 20H display control unit, 20I memory, 21 monitor, 21d display surface, 29 switch panel, 31 input unit, 32 surrounding camera, 33 lock lever, 34 type reader, 41, 42 operation lever, 43 operation amount detection sensor, 45 engine, 46 main hydraulic pump, 47 relief valve, 48 Directional control valve, 50A surrounding image, 50B setting image, 50Ba selection image, 50Bb characteristic change necessity image (display image), 50Bc characteristic selection image, 50Bd characteristic input image, 50C rear image, 100 work machine, 100I plan image, AC actuator, AX rotation axis, B1 change button, B2 button, B3 confirmation button.

Claims

1. An image display system for a work machine to which an attachment can be attached, a surroundings camera that captures images of the surroundings of the work machine; The monitor and a controller that simultaneously displays on the monitor a setting image relating to changes to the settings of the attachment characteristics and an image of the surroundings of the work machine captured by the surrounding camera, The controller displays an image for confirming whether or not a setting change is required for the characteristic of the attachment as the setting image on the monitor simultaneously with the surrounding image.

2. 2. The image display system for a work machine according to claim 1, wherein the image for confirming whether or not a change to the setting of the characteristic of the attachment is required has an operation unit for completing the change of the characteristic of the attachment.

3. 2. The image display system for a work machine according to claim 1, wherein the controller displays an image for inputting the characteristics of the attachment as the setting image on the monitor simultaneously with the surrounding image.

4. Further provided with a lock lever that can be switched between a locked state and an unlocked state, The image display system for a work machine according to claim 1 , wherein the controller displays the surrounding image on the monitor based on switching of the lock lever from the locked state to the unlocked state.

5. Further provided with a lock lever that can be switched between a locked state and an unlocked state, The image display system for a work machine according to claim 1 , wherein the controller continuously displays the setting image on the monitor before and after the lock lever is switched from the locked state to the unlocked state.

6. 2. The image display system for a work machine according to claim 1, wherein the surrounding image is an overhead image of the work machine and the surroundings of the work machine viewed from above downward.

7. An image display system for a work machine to which an attachment can be attached, a surroundings camera that captures images of the surroundings of the work machine; The monitor and a type reader that reads the type of the attachment; and a controller that simultaneously displays on the monitor a display image for confirming whether or not settings of the attachment characteristics need to be changed in accordance with the type of attachment read by the type reader, and an image of the surroundings of the work machine captured by the surrounding camera.

8. 8. The image display system for a work machine according to claim 7, wherein the image for confirming whether or not a change to the setting of the characteristic of the attachment is required has an operation section for completing the change of the characteristic of the attachment.

9. A method for displaying an image of a work machine to which an attachment can be attached, comprising: acquiring surrounding image information obtained by capturing an image of the surroundings of the work machine; generating a surrounding image of the work machine based on the surrounding image information; a step of simultaneously displaying on a monitor a setting image for confirming whether or not a setting change is required for the characteristics of the attachment and the surrounding image.

10. A method for displaying an image of a work machine to which an attachment can be attached, comprising: acquiring surrounding image information obtained by capturing an image of the surroundings of the work machine; acquiring the type of the attachment from a type reader that reads the type of the attachment; generating a surrounding image of the work machine based on the surrounding image information; a step of simultaneously displaying on a monitor a display image for confirming whether or not a setting change is required for the characteristics of the attachment according to the acquired type of the attachment, and the surrounding image.

Citation Information

Patent Citations

  • Control unit of working machine

    JP2008266975A