Image display system of work machine and image display method of work machine

Abstract

A surrounding camera (32) takes pictures of the area around the work machine (100). A controller (20) controls the display of a setting image (50B) and an image of the area around the work machine (100) (50A) on a monitor (21). The setting image (50B) is related to the setting change of the characteristics of the accessory (8), and the image of the area around the work machine (100) (50A) is taken by the surrounding camera (32).

Description

Technical Field

[0001] This disclosure relates to an image display system for operating machinery and a method for displaying images of operating machinery. Background Technology

[0002] When changing parts in hydraulic excavators and other working machinery, the technology of setting up a fluid pressure circuit for switching parts according to the parts is described, for example, in Japanese Patent Application Publication No. 2008-266975 (Patent Document 1).

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2008-266975 Summary of the Invention

[0006] The problem that the invention aims to solve

[0007] As described in Patent Document 1, when replacing parts, it is necessary to set the characteristics of the parts according to the replacement parts, but it is desirable to reduce the time spent setting the characteristics of the parts.

[0008] The purpose of this disclosure is to provide an image display system and method for operating machinery that can confirm the settings of accessories based on the recognition of the surrounding conditions.

[0009] Methods for solving problems

[0010] This disclosure discloses an image display system for a work machinery capable of mounting accessories, comprising a surrounding camera, a monitor, and a controller. The surrounding camera captures images of the area around the work machinery. The controller simultaneously displays a setting image and the surrounding image of the work machinery on the monitor. The setting image is related to changes in the setting of the accessory's characteristics, and the surrounding image of the work machinery is captured by the surrounding camera. The controller simultaneously displays an image confirming whether the setting change of the accessory's characteristics is necessary, as the setting image, on the monitor along with the surrounding image.

[0011] Another image display system for operating machinery disclosed herein is an image display system for operating machinery capable of installing accessories, comprising a surrounding camera, a monitor, a category reader, and a controller. The surrounding camera captures images of the area around the operating machinery. The category reader reads the category of the accessories. The controller simultaneously displays the display image and the surrounding image of the operating machinery on the monitor, the display image being used to confirm whether a setting change of the accessory characteristics corresponding to the accessory category read by the category reader is required, the surrounding image of the operating machinery being captured by the surrounding camera.

[0012] The present disclosure provides an image display method for a work machinery capable of installing accessories, comprising the following steps.

[0013] Acquire surrounding camera information obtained by capturing images of the area around the operating machinery. Generate an image of the area around the operating machinery based on the surrounding camera information. A setting image and the surrounding image, used to confirm whether setting changes to accessory characteristics are necessary, are simultaneously displayed on the monitor.

[0014] Another image display method for operating machinery disclosed herein is an image display method for operating machinery capable of installing accessories, comprising the following steps.

[0015] Acquire surrounding camera information obtained by capturing images of the area around the operating machinery. Obtain the category of the parts from a category reader that reads the category of the parts. Generate an image of the area around the operating machinery based on the surrounding camera information. Display the image and the surrounding image simultaneously on the monitor to confirm whether setting changes to the characteristics of the parts corresponding to the acquired part categories are necessary.

[0016] Invention Effects

[0017] According to this disclosure, an image display system and a method for displaying images of work machinery are available, enabling the setting of accessories to be confirmed based on the recognition of the surrounding conditions. Attached Figure Description

[0018] Figure 1 This is a diagram showing the structure of a working machine according to one embodiment of the present disclosure.

[0019] Figure 2 It is a 3D view of the interior of the cab of the operating machinery.

[0020] Figure 3 This is a block diagram illustrating the structure of an image display system for a work machine according to one embodiment of the present disclosure.

[0021] Figure 4 It means Figure 3 The diagram shows the functional blocks of the controller.

[0022] Figure 5 This is a diagram showing an example of an image displayed in the image display system of a work machine according to one embodiment of this disclosure.

[0023] Figure 6 This is a flowchart illustrating a method for displaying images of operating machinery.

[0024] Figure 7 This is a flowchart illustrating another method of displaying images of operating machinery. Detailed Implementation

[0025] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0026] In the instruction manual and accompanying drawings, the same or corresponding components are labeled with the same reference numerals and are not described repeatedly. Additionally, in the accompanying drawings, structures are sometimes omitted or simplified for ease of explanation. It should be noted that, as an example of work machinery 100, a hydraulic excavator will be described below; however, work machinery 100 can be any work machinery capable of installing and disassembling parts, such as a wheel loader or motorized grader.

[0027] <Structure of Operating Machinery>

[0028] Figure 1 This is a diagram that schematically illustrates the structure of the working machinery in one embodiment of this disclosure. (See diagram for example.) Figure 1 As shown, the work machine 100 in this embodiment is, for example, a hydraulic excavator. The work machine 100 has a main body 1 and a working device 2 that operates hydraulically. The main body 1 has a rotating body 3 and a traveling body 5.

[0029] The slewing body 3 is mounted on and supported by the traveling body 5. The slewing body 3 is capable of rotating relative to the traveling body 5 about the slewing axis AX. The slewing body 3 has a cab 4. An operator's seat 4S is provided in the cab 4 for the operator to sit in. The operator can operate the work machinery 100 from the cab 4.

[0030] The rotating body 3 has an engine compartment 9. The engine compartment 9 is equipped with... Figure 3 The engine 45 and main hydraulic pump 46 are shown.

[0031] The working device 2 is supported on the rotating body 3. The working device 2 has a boom 6, a stick 7, and a bucket 8. The boom 6 is connected to the rotating body 3. The stick 7 is connected to the boom 6. The bucket 8 is connected to the stick 7. The bucket 8 can be, for example, a crusher or other accessories. The bucket 8 can be installed and removed relative to the stick 7. Thus, the bucket 8 can be replaced with a crusher, and also with a bucket of a different size.

[0032] The working device 2 includes a boom cylinder 10, a stick cylinder 11, and a bucket cylinder 12. By extending and retracting the boom cylinder 10, the boom 6 can rotate around the boom pin 13. By extending and retracting the stick cylinder 11, the stick 7 can rotate around the stick pin 14. By extending and retracting the bucket cylinder 12, the bucket 8 can rotate around the pin 15. The boom cylinder 10, stick cylinder 11, and bucket cylinder 12 are all hydraulic cylinders driven by hydraulic fluid.

[0033] Figure 2 It is a 3D view of the interior of the operator's cab of the operating machinery. For example... Figure 2As shown, the cab 4 is equipped with a driver's seat 4S for the operator to sit in.

[0034] A first operating lever 41 is located to the right (R) of the operator's cab 4S. This first operating lever 41 is used by the operator, seated in the cab 4, to operate the boom 6 and bucket 8 of the working device 2. A switch panel 29 equipped with various switches is located to the right (R) of the operator's cab 4S. A second operating lever 42 is located to the left (L) of the operator's cab 4S. This second operating lever 42 is used by the operator to operate the stick 7 and rotate the slewing body 3 of the working device 2.

[0035] The locking lever 33 is, for example, located near the operating lever 42. The locking lever 33 is used to stop the operation of the working device 2, the rotation of the rotating body 3, and the movement of the traveling body 5. The locking lever 33 can be switched between a locked state and a locked-out state by the operator.

[0036] A monitor 21 is installed at the front F inside the cab 4. The monitor 21 is, for example, located at the right front corner inside the cab 4 and supported by a front pillar extending from the floor of the cab 4. The monitor 21 is positioned relative to the front pillar on the driver's seat 4S side. From the perspective of the operator seated in the driver's seat 4S, the monitor 21 is positioned behind the front pillar B (near the front).

[0037] The monitor 21 has a planar display surface 21d. The display surface 21d is composed of a graphic display such as a liquid crystal display or an organic EL (electro-Luminescence) display. The display surface 21d of the monitor 21 can be either vertically elongated or horizontally elongated.

[0038] Monitor 21 is mounted on the right-hand front pillar of a pair of front pillars, near the working device 2. Monitor 21 is positioned near the front of the front pillar in the right-forward line of sight of the operator seated in the cab 4S. In the working machine 100 with the working device 2 located on the right-hand side of the cab 4, by mounting monitor 21 on the front pillar of the right-hand side, the operator can observe both the working device 2 and monitor 21 with minimal line-of-sight movement.

[0039] <Structure of the Image Display System for Operating Machinery>

[0040] Next, use Figure 3 The structure of the image display system of the operating machinery 100 is described.

[0041] Figure 3 This is a block diagram illustrating the structure of an image display system for a work machine according to one embodiment of this disclosure. For example... Figure 3As shown, the image display system of the work machinery 100 includes a controller 20, operating levers 41 and 42, an operation quantity detection sensor 43, an engine 45, a main hydraulic pump 46, an overflow valve 47, a directional control valve 48, and an actuator AC. Additionally, the image display system of the work machinery 100 also includes an input unit 31, a peripheral camera 32, a locking lever 33, a category reader (reader) 34, and a monitor 21.

[0042] The main hydraulic pump 46 is mechanically connected to the engine 45. Thus, the driving force of the engine 45 can be transmitted to the main hydraulic pump 46. The main hydraulic pump 46 is driven by the driving force of the engine 45. Driven by the main hydraulic pump 46, working oil is supplied to the directional control valve 48 through the relief valve 47. The relief valve 47 automatically and momentarily releases the required amount of working oil when the pressure of the working oil exceeds a specified pressure, and completely closes when the pressure of the working oil drops to the normal range.

[0043] The levers 41 and 42 receive operations from the operator. An operation amount detection sensor 43 detects the operation amount of each lever 41 and 42 operated by the operator. The operation amount detection sensor 43 is, for example, a potentiometer. The operation amount detection sensor 43 outputs the detected operation amount as an operation signal (electrical signal) to the controller 20.

[0044] The directional control valve 48 has a rod-shaped valve stem. The valve stem of the directional control valve 48 is driven based on a command current from the controller 20. By driving the valve stem of the directional control valve 48, the flow direction of the working oil supplied from the directional control valve 48 to the actuator AC is switched. Furthermore, by driving the valve stem of the directional control valve 48, the supply amount of working oil supplied from the directional control valve 48 to the actuator AC is adjusted.

[0045] The actuator AC is, for example, boom cylinder 10, stick cylinder 11, bucket cylinder 12, etc. Hydraulic cylinders 10, 11, and 12 control extension and retraction by switching the flow direction of the working oil supplied from the directional control valve 48. Furthermore, hydraulic cylinders 10, 11, and 12 control the extension and retraction speed by adjusting the supply amount of working oil from the directional control valve 48.

[0046] Thus, the operator controls the action of actuator AC by operating levers 41 and 42.

[0047] When replacing part 8, it is necessary to set and change the characteristics of part 8 according to the type of the replaced part 8. At this time, for example, the flow characteristics of the working oil supplied to the actuator AC and the overflow pressure (opening pressure) of the relief valve 47 are set. It should be noted that the flow characteristics of the working oil supplied to the actuator AC can be adjusted by the command current output from the controller 20 to the directional control valve 48.

[0048] Input unit 31 is used to set and change the characteristics of accessory 8. Input unit 31 is operated by the operator, and may be, for example, a touch panel display 21d of monitor 21. Alternatively, input unit 31 may be a physical button, physical switch, etc. Input unit 31 outputs information related to the characteristics of accessory 8 input by the operator to controller 20. The characteristics of accessory 8 are the setting values ​​used to make accessory 8 operate.

[0049] The surrounding camera 32 captures images of the area around the working machine 100. The images captured by the surrounding camera 32 are, for example, overhead views of the area around the working machine 100 from above. The surrounding camera 32 may have multiple cameras, for example, four cameras. The overhead view may also be a combination of images captured by multiple cameras. The surrounding camera 32 is mounted, for example, on the rotating body 3. The surrounding camera 32 outputs surrounding camera information related to the captured images of the area around the working machine 100 to the controller 20.

[0050] When the locking lever 33 is locked by the operator, the operation of the working device 2, the rotation of the rotating body 3, and the movement of the traveling body 5 cease. In this state, even if the operator performs drive operations on the working device 2, the rotating body 3, and the traveling body 5, they will not move. On the other hand, when the locking lever 33 is unlocked by the operator, the operation of the working device 2, the rotation of the rotating body 3, and the movement of the traveling body 5 do not cease. In this state, the working device 2, the rotating body 3, and the traveling body 5 will move when the operator performs drive operations on them. The locking lever 33 outputs locking information to the controller 20, indicating whether the locking lever 33 is in the locked or unlocked state.

[0051] The category reader 34 reads the category of accessory 8. The category reader 34 detects the category of accessory 8, for example, by reading an IC (Integrated Circuit) tag attached to accessory 8. The category reader 34 can be a dedicated scanner for IC tag reading or a portable information terminal such as a smartphone. The category reader 34 can be installed in the operating machine 100, or it can be a separate device independent of the operating machine 100. The category reader 34 outputs information indicating the detected category of accessory 8 to the controller 20.

[0052] The controller 20 controls the image displayed on the monitor 21 based on information from the input unit 31, the surrounding camera 32, the locking lever 33, the category reader 34, etc. The monitor 21 can switch the displayed image based on the control signals from the controller 20.

[0053] The controller 20 described above includes a processor, main memory, and storage. The processor is, for example, a CPU (Central Processing Unit). The main memory includes, for example, non-volatile memory such as ROM (Read Only Memory) and volatile memory such as RAM (Random Access Memory).

[0054] The controller 20 reads the program stored in the memory and expands it in the main memory, then executes the prescribed processing according to the program. The program can also be distributed to the controller 20 via a network.

[0055] The controller 20, input unit 31, locking lever 33, operating levers 41 and 42, operation amount detection sensor 43, and monitor 21 can be mounted on the work machine 100 or configured separately from it. The controller 20 can also be stored on a server located away from the work machine 100. When the controller 20 is configured externally to the work machine 100, it can be wirelessly connected to the input unit 31, ambient camera 32, locking lever 33, operation amount detection sensor 43, monitor 21, overflow valve 47, and directional control valve 48. Furthermore, the operator can remotely operate the work machine 100 without being inside the cab 4 of the work machine 100.

[0056] <Controller 20>

[0057] Next, use Figure 4 The function blocks of controller 20 are described.

[0058] Figure 4 It means Figure 3 The diagram shows the function blocks of the controller. (As shown) Figure 4 As shown, the controller 20 has an operation quantity acquisition unit 20A, an input information acquisition unit 20B, a surrounding information acquisition unit 20C, a lock information acquisition unit 20D, and a category information acquisition unit 20E. The controller 20 also has an action control unit 20F, a display image generation unit 20G, a display control unit 20H, and a memory 20I.

[0059] The operation quantity acquisition unit 20A acquires the operation signal detected by the operation quantity detection sensor 43. The operation quantity acquisition unit 20A outputs the acquired operation signal to the motion control unit 20F. The motion control unit 20F controls the directional control valve 48 based on the operation signal acquired from the operation quantity acquisition unit 20A. As a result, the working device 2 operates based on the operator's operation of the operating levers 41 and 42.

[0060] Input information acquisition unit 20B acquires input information from input unit 31. Surrounding information acquisition unit 20C acquires information from images captured by surrounding camera 32. Locking information acquisition unit 20D acquires locking information indicating whether locking lever 33 is in a locked or unlocked state. Category information acquisition unit 20E acquires category information for accessory 8 read by category reader 34.

[0061] The display image generation unit 20G acquires information from the input information acquisition unit 20B, the surrounding information acquisition unit 20C, the lock information acquisition unit 20D, the category information acquisition unit 20E, the memory 20I, etc., and generates an image for display on the monitor 21 based on the acquired information. The display control unit 20H controls the display content of the monitor 21 based on the information from the image acquired by the display image generation unit 20G.

[0062] When part 8 is replaced, the characteristics of the replaced part 8 (such as the flow characteristics of the working oil, overflow pressure, etc.) are input from the input unit 31 and stored in the memory 20I via the input information acquisition unit 20B. The operation control unit 20F controls the operation of the overflow valve 47 and the directional control valve 48 by referring to the characteristics of the replaced part stored in the memory 20I.

[0063] <Image displayed on display surface 21d of monitor 21>

[0064] Next, use Figure 5 The image displayed on the display surface 21d of the monitor 21 in this embodiment will be described.

[0065] Figure 5 This diagram illustrates an example of an image displayed in an image display system for a work machine according to one embodiment of this disclosure. For example... Figure 5 (B) ~ Figure 5 As shown in (F), a surrounding image 50A and a setting image 50B are simultaneously displayed on the display surface 21d of the monitor 21. The surrounding image 50A is an image captured by the surrounding camera 32, such as an overhead view. The surrounding image 50A displays a planar image 100I of the operating machinery and an image surrounding the planar image 100I. The setting image 50B is an image related to setting changes of the characteristics of the accessory 8.

[0066] The surrounding image 50A and the setting image 50B are displayed, for example, arranged vertically in the display surface 21d. The surrounding image 50A is displayed above the setting image 50B. The surrounding image 50A may also be displayed below the setting image 50B. However, when the surrounding image 50A is displayed below the setting image 50B, the operator's hand becomes an obstacle when touching the setting image 50B, making it sometimes difficult to visually recognize the surrounding image. Therefore, from the viewpoint of ease of visual recognition during touch operation of the setting image, it is preferable to display the surrounding image 50A above the setting image 50B. It should be noted that when the surrounding image 50A and the setting image 50B are arranged vertically, the display surface 21d of the monitor 21 is preferably elongated.

[0067] Alternatively, the surrounding image 50A and the setting image 50B can be arranged and displayed along the left-right direction on the display surface 21d. In this case, the surrounding image 50A can be displayed on either the left or right side of the setting image 50B. However, when the surrounding image 50A is displayed to the right of the setting image 50B, the operator's right hand becomes an obstacle when touching the setting image 50B, making it sometimes difficult to visually recognize the surrounding image. Therefore, when the monitor 21 is mounted on the front pillar on the right R, from the viewpoint of ease of visual recognition during touch operation of the setting image, it is preferable that the surrounding image 50A is displayed to the left of the setting image 50B. It should be noted that when the surrounding image 50A and the setting image 50B are arranged and displayed along the left-right direction, the display surface 21d of the monitor 21 is preferably horizontally elongated.

[0068] Image 50B includes the selection image 50Ba of accessory 8. Figure 5 (B) , Whether or not a change in the characteristics of accessory 8 is required (Image 50Bb) Figure 5 (C), (D)), Feature selection image 50Bc of accessory 8 Figure 5 The input image of the characteristics of (E) and accessories 8 is 50Bd. Figure 5 At least one of (F)).

[0069] Figure 5 Image 50Ba, shown in (B), is an image used to select the category of accessory 8. In image 50Ba, various categories of accessory 8 are displayed as a list. The operator can select the category of the replaced accessory 8 in image 50Ba. Categories of accessory 8 include, for example, buckets, crushers, other accessories, etc.

[0070] Figure 5The feature change requirement image 50Bb shown in (C) and (D) is used to confirm whether the feature of accessory 8 needs to be changed. The feature change requirement image 50Bb displays the currently set feature in the selected accessory 8 category. Additionally, the feature change requirement image 50Bb may also display button images such as Change button B1, Return button B2, and Confirm button B3. Change button B1, Return button B2, and Confirm button B3 correspond to an example of the operation section. The feature of accessory 8 can be changed by operating the Change button B1. By operating the Return button B2, the feature change requirement image 50Bb switches to the previous image (e.g., selection image 50Ba). By operating the Confirm button B3, the changed feature of accessory 8 is determined and overridden.

[0071] Figure 5 Image 50Bc, shown in (E), is an image for selecting the characteristics of accessory 8 that you wish to change within the selected category of accessory 8. Image 50Bc displays various characteristics that you wish to change within the selected category of accessory 8. The displayed characteristics include, for example, the flow rate of the working oil used to operate accessory 8, the overflow pressure of the overflow valve 47, etc.

[0072] Figure 5 The characteristic input image 50Bd of accessory 8 shown in (F) is an image used for inputting the characteristics of accessory 8. In characteristic input image 50Bd, the characteristics of accessory 8 selected in characteristic selection image 50Bc can be changed. For example, if the flow rate of working oil is selected in characteristic selection image 50Bc, the flow rate of working oil can be changed in characteristic input image 50Bd. Similarly, if the overflow pressure is selected in characteristic selection image 50Bc, the overflow pressure can be changed in characteristic input image 50Bd. The characteristic input image 50Bd displays an image such as a numeric keypad. By operating the numeric keypad displayed in characteristic input image 50Bd, the operator can specifically input the characteristics of accessory 8 numerically.

[0073] For example, the operator can select any item displayed in each of the images 50Ba~Bd by touching the display surface 21d. In addition to touch operation, the operator can also select any item displayed in each of the images 50Ba~Bd by using the pointer image displayed on the feature selection image 50Bc.

[0074] Next, an example of the transformation of the image displayed on the display surface 21d of the monitor 21 will be described.

[0075] like Figure 5As shown in (A), the display surface 21d displays, for example, a surrounding image 50A and a rear image 50C. The rear image 50C is an image obtained by taking a picture of the rear of the working machine 100. In this state, when the part 8 is replaced, it is necessary to change the characteristics of the current part 8 to the characteristics of the replaced part 8. Therefore, the operator operates the input unit 31 to change the characteristics of the part 8.

[0076] like Figure 5 As shown in (B), when the operator changes the characteristics of accessory 8, while maintaining the surrounding image 50A on the display surface 21d, the rear image 50C changes to the setting image 50B. The setting image 50B is, for example, the selection image 50Ba of accessory 8. Thus, the surrounding image 50A and the selection image 50Ba are displayed simultaneously on the display surface 21d. The operator selects the category of the replaced accessory 8 in the selection image 50Ba.

[0077] like Figure 5 As shown in (C), when the operator selects the category of accessory 8, while maintaining the surrounding image 50A on the display surface 21d, the selection image 50Ba changes to the accessory 8 characteristic change requirement image 50Bb. Thus, the surrounding image 50A and the characteristic change requirement image 50Bb are simultaneously displayed on the display surface 21d. If the operator operates the change button B1 in the characteristic change requirement image 50Bb, the characteristics of accessory 8 can be changed.

[0078] like Figure 5 As shown in (D), when the operator operates the change button B1, while maintaining the surrounding image 50A in the display surface 21d, the feature change requirement image 50Bb changes to the feature selection image 50Bc for accessory 8. Thus, the surrounding image 50A and the feature selection image 50Bc are simultaneously displayed on the display surface 21d. The operator selects the feature of accessory 8 that they wish to change from the feature selection image 50Bc.

[0079] like Figure 5 As shown in (E), when the operator selects a characteristic of the part 8 that they wish to change, while maintaining the surrounding image 50A in the display surface 21d, the characteristic selection image 50Bc transforms into the characteristic input image 50Bd of the part 8. Thus, both the surrounding image 50A and the characteristic input image 50Bd are simultaneously displayed on the display surface 21d. The operator uses a numeric keypad or similar device to input the value of the characteristic of the part 8 selected in the characteristic input image 50Bd. Therefore, the characteristics of the replaced part 8 can be changed, for example, the flow rate of the working oil, the overflow pressure, etc.

[0080] It should be noted that when the operator from Figure 5If you long-press and select the category of the replaced accessory 8 in state (B), you can also directly switch to Figure 5 The image of (E).

[0081] In addition, from Figure 5 In state (A), if the controller 20 obtains the category of the replaced accessory 8 from the category reader 34, it can also directly switch to... Figure 5 The image of (D). Figure 5 The transformation of the image after (D) and Figure 5 The transformation of the image after (C) is the same, so its description will not be repeated.

[0082] Additionally, when the locking lever 33 is in the locked state, a setting image 50B for setting the characteristics of accessory 8 can be displayed instead of the surrounding image 50A. In this case, the switching from the locked state to the unlocked state can also be based on the locking lever 33, such as... Figure 5 As shown in (B), the surrounding image 50A is displayed on the display surface 21d of the monitor 21. Furthermore, in this case, before and after the locking lever 33 switches from the locked state to the unlocked state, the setting image 50B can also be continuously displayed on the display surface 21d of the monitor 21. When the locking lever 33 is in the unlocked state, as... Figure 5 As shown in (B), the surrounding image 50A and the setting image 50B can also be displayed simultaneously on the display surface 21d of the monitor 21.

[0083] <Image Display Methods for Operating Machinery>

[0084] Next, use Figure 6 An image display method for the operating machinery in this embodiment will be described.

[0085] Figure 6 This is a flowchart illustrating a method for displaying images of operating machinery. For example... Figure 6 As shown, firstly, the ambient camera 32 captures images of the area surrounding the working machine 100. The ambient camera 32 then outputs the ambient image information obtained from capturing images of the area surrounding the working machine 100 to the controller 20.

[0086] In step S11, the ambient information acquisition unit 20C of the controller 20 acquires ambient camera information. The ambient information acquisition unit 20C outputs the acquired ambient camera information to the display image generation unit 20G.

[0087] In step S12, the display image generation unit 20G of the controller 20 generates a surrounding image based on the acquired surrounding camera information. At this time, the display image generation unit 20G generates the surrounding image by referring to various information stored in the memory 20I. For example, a planar image 100I of the working machine 100 is stored in the memory 20I. The display image generation unit 20G generates the surrounding image 50A by combining the planar image 100I of the working machine 100 stored in the memory 20I with the image captured by the surrounding camera 32.

[0088] The display image generation unit 20G generates a combined image that combines the surrounding image 50A and the setting image 50B. For example, when information related to setting changes of the characteristics of accessory 8 is obtained from the input unit 31, or when information to switch to the unlocked state is obtained from the locking lever 33, the display image generation unit 20G generates the combined image.

[0089] When generating the combined image, the display image generation unit 20G generates the surrounding image by referring to various information stored in the memory 20I. The display image generation unit 20G selects a setting image 50B to be combined with the surrounding image 50A based on information related to the aforementioned setting change from the input unit 31, switching information to the unlocked state from the locking lever 33, etc. The setting image 50B to be combined with the surrounding image 50A is, for example, selected from... Figure 5 Select from the images 50Ba, 50Bb, 50Bc, and 50Bd shown. The display image generation unit 20G outputs the generated combined image to the display control unit 20H.

[0090] In step S13, the display control unit 20H of the controller 20 controls the monitor 21 to display the combined image obtained from the display image generation unit 20G. Thus, the image is displayed on the display surface 21d of the monitor 21. Figure 5 Images shown in (B) to (F).

[0091] As described above, in one image display method for the operating machinery, the surrounding image 50A and the setting image 50B are simultaneously displayed on the monitor 21.

[0092] Next, use Figure 7 Another image display method for the operating machinery in this embodiment will be described.

[0093] Figure 7 This is a flowchart illustrating another method of displaying images of operating machinery. For example... Figure 7 As shown, firstly, the ambient camera 32 captures images of the area surrounding the working machine 100. The ambient camera 32 then outputs the ambient image information obtained from capturing images of the area surrounding the working machine 100 to the controller 20.

[0094] In step S21a, the ambient information acquisition unit 20C of the controller 20 acquires ambient camera information. The ambient information acquisition unit 20C outputs the acquired ambient camera information to the display image generation unit 20G.

[0095] In step S22, with Figure 6 Similarly, in step S12, the display image generation unit 20G of the controller 20 generates a surrounding image based on the acquired surrounding camera information.

[0096] In step S21b, the category information acquisition unit 20E of the controller 20 acquires information related to the category of the accessory 8 from the category reader 34. The category information acquisition unit 20E outputs the acquired information related to the category of the accessory 8 to the display image generation unit 20G.

[0097] The display image generation unit 20G generates a composite image that combines the surrounding image 50A and a display image 50B for displaying the characteristics of the accessory 8. When generating the composite image, the display image generation unit 20G refers to various information stored in the memory 20I and selects the display image 50B that is combined with the surrounding image 50A. The display image 50B combined with the surrounding image 50A is, for example,... Figure 5 Image 50Bb is shown in (D). The display image generation unit 20G outputs the generated composite image to the display control unit 20H.

[0098] In step S23, the display control unit 20H of the controller 20 controls the monitor 21 to display the combined image obtained from the display image generation unit 20G. Thus, the image is displayed on the display surface 21d of the monitor 21. Figure 5 Image (B) is shown.

[0099] As described above, in another image display method for the working machinery, the surrounding image 50A and the display image 50B (50Bb) are simultaneously displayed on the monitor 21.

[0100] <Effect>

[0101] Previously, the screen for setting the characteristics of component 8 did not display an image of the surrounding machinery 100, such as an excavator. Therefore, after changing the settings of component 8, such as its flow rate or overflow pressure, it was necessary to switch from the setting screen (for setting the characteristics of component 8) to the screen displaying the surrounding image in order to operate component 8. Consequently, when repeatedly changing the characteristics of component 8, it was time-consuming to switch from the screen displaying the surrounding image to the setting screen each time.

[0102] According to the image display system of a working machine 100 disclosed herein, such as Figure 5As shown in (B) to (F), the setting image 50B and the surrounding image 50A of the working machine 100 are simultaneously displayed on the monitor 21. The setting image 50B is related to the setting change of the characteristics of the accessory 8, and the surrounding image 50A of the working machine 100 is captured by the surrounding camera 32. Therefore, the accessory 8 can be operated while checking its settings. Alternatively, the accessory 8 can be operated while checking the changes in the flow characteristics, overflow pressure, and other settings of the working oil of the accessory 8 due to setting changes. This saves the time spent switching between the surrounding image 50A and the setting image 50B, and saves time related to the setting of the characteristics of the accessory 8. In addition, the setting of the characteristics of the accessory 8 can be confirmed based on the recognition of the surrounding conditions.

[0103] In addition, in the image display system of the aforementioned operating machinery 100, such as Figure 5 As shown in (C), the setting image 50B is an image 50Bb used to confirm whether a setting change for the characteristics of accessory 8 is necessary. Thus, the image 50Bb confirming whether a setting change for the characteristics of accessory 8 is necessary is also displayed on the monitor 21 simultaneously with the surrounding image 50A. Therefore, when confirming whether a setting change is necessary, the time spent switching between the surrounding image 50A and the setting image 50B can be saved, thus saving time related to setting the characteristics of accessory 8.

[0104] In addition, in the image display system of the aforementioned operating machinery 100, such as Figure 5 As shown in (C), the image 50Bb, which confirms whether a change to the characteristic setting of accessory 8 is required, has a confirmation button B3 (operation unit) for completing the change of the characteristic of accessory 8. Therefore, the confirmation button B3 can be operated while the surrounding image 50A is displayed.

[0105] In addition, in the image display system of the aforementioned operating machinery 100, such as Figure 5 As shown in (F), an image of the characteristics of the input accessory 8 (characteristic input image 50Bd) is simultaneously displayed on the monitor 21 as a setting image 50B and an surrounding image 50A. Therefore, the input operation of the characteristics of the accessory 8 can be performed while the surrounding image 50A is being displayed.

[0106] Furthermore, in the image display system of the aforementioned work machinery 100, the surrounding image 50A is displayed on the monitor 21 based on the switching of the locking lever 33 from the locked state to the unlocked state. Thus, the surrounding image 50A can be automatically displayed on the monitor 21 simultaneously with the unlocking.

[0107] Furthermore, in the image display system of the aforementioned machine tool 100, the setting image 50B is continuously displayed on the monitor 21 before and after the locking lever 33 is switched from the locked state to the unlocked state. Thus, the setting image 50B can be displayed on the monitor 21 in both the locked and unlocked states.

[0108] In addition, in the image display system of the aforementioned operating machinery 100, such as Figure 5 As shown, the surrounding image 50A is an overhead view of the machine 100 and its surroundings, obtained from above looking down. This allows for a clear view of the machine 100's left, right, front, and back positions.

[0109] According to another image display system of the operating machinery 100 disclosed herein, such as Figure 5 As shown in (A) and (D), display image 50Bb and surrounding image 50A of the working machine 100 are simultaneously displayed on monitor 21. Display image 50Bb is used to display the characteristics of accessory 8 corresponding to the category of accessory 8 read by category reader 34, and surrounding image 50A of the working machine 100 is captured by surrounding camera 32. Thus, display image 50Bb corresponding to the category of accessory 8 is displayed, eliminating the need for switching to display image 50Bb, saving time. Furthermore, since display image 50Bb corresponding to the category of accessory 8 is displayed, the category of accessory 8 can be accurately selected.

[0110] Additionally, in the image display system of the other operating machine 100 mentioned above, such as Figure 5 As shown in (D), the display image 50Bb is an image 50Bb used to confirm whether a setting change for the characteristics of accessory 8 is required. Thus, the image 50Bb confirming whether a setting change for the characteristics of accessory 8 is required is also displayed on the monitor 21 simultaneously with the surrounding image 50A. Therefore, when confirming whether the setting change is required, the time spent switching between the surrounding image 50A and the setting image 50B can be saved, thus saving time related to setting the characteristics of accessory 8.

[0111] Additionally, in the image display system of the other operating machine 100 mentioned above, such as Figure 5 As shown in (D), the image 50Bb, which confirms whether a change to the characteristic setting of accessory 8 is required, has a confirmation button B3 (operation unit) for completing the change of the characteristic of accessory 8. Therefore, the confirmation button B3 can be operated while the surrounding image 50A is displayed.

[0112] <Postscript>

[0113] The above-described implementation methods incorporate the following technical concepts.

[0114] (Note 1)

[0115] An image display system for a work machinery, the work machinery being capable of mounting accessories, wherein...

[0116] The image display system of the operating machinery has the following features:

[0117] Surrounding cameras that capture images of the area around the operating machinery;

[0118] Monitors; and

[0119] The controller simultaneously displays a setting image and an image of the surrounding environment of the working machine on the monitor. The setting image is related to changes in the settings of the accessory's characteristics, and the image of the surrounding environment of the working machine is captured by the surrounding camera.

[0120] The controller will simultaneously display an image on the monitor, along with the surrounding image, confirming whether the setting change of the accessory's characteristics is required.

[0121] (Note 2)

[0122] According to the image display system of the working machinery described in Appendix 1, the image confirms whether or not the setting change of the characteristic of the accessory is required, and has an operation unit for completing the change of the characteristic of the accessory.

[0123] (Note 3)

[0124] According to the image display system for the operating machinery described in Appendix 1 or Appendix 2, wherein,

[0125] The controller displays an image of the characteristics of the input accessory as the setting image, simultaneously with the surrounding image, on the monitor.

[0126] (Note 4)

[0127] The image display system for the operating machinery according to any one of Annexes 1 to 3, wherein,

[0128] The image display system of the operating machinery also has a locking lever that can switch between locked and unlocked states.

[0129] The controller displays the surrounding image on the monitor based on the switching of the locking lever from the locked state to the unlocked state.

[0130] (Note 5)

[0131] The image display system for the operating machinery according to any one of Annexes 1 to 4, wherein,

[0132] The image display system of the operating machinery also has a locking lever that can switch between locked and unlocked states.

[0133] Before and after the controller switches the locking lever from the locked state to the unlocked state, it continuously displays the set image on the monitor.

[0134] (Note 6)

[0135] The image display system for the operating machinery according to any one of Appendices 1 to 5, wherein,

[0136] The surrounding image is an overhead view of the machine and its surroundings, taken from above and looking down.

[0137] The embodiments disclosed herein should be considered illustrative in all respects and not restrictive. The scope of the invention is not defined by the foregoing description, but by the technical solutions, and is intended to include all equivalent meanings and modifications within that scope.

[0138] Explanation of reference numerals in the attached figures:

[0139] 1 Main body, 2 Working device, 3 Slewing body, 4 Cab, 4S Driver's seat, 5 Traveling body, 6 Boom, 7 Stick, 8 Accessories (bucket), 9 Engine compartment, 10 Boom cylinder, 11 Stick cylinder, 12 Bucket cylinder, 13 Boom pin, 14 Stick pin, 20 Controller, 20A Operation amount acquisition unit, 20B Input information acquisition unit, 20C Surrounding information acquisition unit, 20D Locking information acquisition unit, 20E Category information acquisition unit, 20F Motion control unit, 20G Display image generation unit, 20H Display control unit, 20I Memory, 21 Monitor, 21d Display surface, 29 Switch panel, 31 Input unit, 32 Surrounding camera, 33 Locking lever, 34 Category reader, 41, 42 Operating lever, 43 Operation amount detection sensor, 45 Engine, 46 Main hydraulic pump, 47 Overflow valve, 48 directional control valve, 50A surrounding image, 50B setting image, 50Ba selection image, 50Bb characteristic change required / not required image (display image), 50Bc characteristic selection image, 50Bd characteristic input image, 50C rear image, 100 working machinery, 100I planar image, AC actuator, AX rotary axis, B1 change button, B2 button, B3 confirm button.

Claims

1. An image display system for a work machinery, wherein the work machinery is capable of installing accessories, wherein, The image display system of the operating machinery has the following features: Surrounding cameras that capture images of the area around the operating machinery; Monitor; as well as The controller simultaneously displays a setting image and an image of the surrounding environment of the working machine on the monitor. The setting image is related to changes in the settings of the accessory's characteristics, and the image of the surrounding environment of the working machine is captured by the surrounding camera. The controller will simultaneously display an image on the monitor, along with the surrounding image, confirming whether the setting change of the accessory's characteristics is required.

2. The image display system for the operating machinery according to claim 1, wherein, The image confirms whether a setting change for the characteristic of the accessory is required, and has an operation unit for completing the change of the characteristic of the accessory.

3. The image display system for the operating machinery according to claim 1, wherein, The controller displays an image of the characteristics of the input accessory as the setting image, simultaneously with the surrounding image, on the monitor.

4. The image display system for the operating machinery according to claim 1, wherein, The image display system of the operating machinery also has a locking lever that can switch between locked and unlocked states. The controller displays the surrounding image on the monitor based on the switching of the locking lever from the locked state to the unlocked state.

5. The image display system for the operating machinery according to claim 1, wherein, The image display system of the operating machinery also has a locking lever that can switch between locked and unlocked states. Before and after the controller switches the locking lever from the locked state to the unlocked state, it continuously displays the set image on the monitor.

6. The image display system for operating machinery according to claim 1, wherein, The surrounding image is an overhead view of the machine and its surroundings, taken from above and looking down.

7. An image display system for a work machinery, wherein the work machinery is capable of installing accessories, wherein... The image display system of the operating machinery has the following features: Surrounding cameras that capture images of the area around the operating machinery; Monitor; A category reader that reads the category of the accessory; as well as The controller simultaneously displays a display image and an image of the surrounding area of ​​the working machine on the monitor. The display image is used to confirm whether a setting change of the accessory's characteristics corresponding to the accessory's category read by the category reader is required. The image of the surrounding area of ​​the working machine is captured by the surrounding camera.

8. The image display system for operating machinery according to claim 7, wherein, The display image confirms whether a setting change for the characteristic of the accessory is required, and has an operation unit for completing the change of the characteristic of the accessory.

9. A method for displaying images of a work-operated machine, wherein the work-operated machine is capable of installing accessories, wherein... The image display method for the operating machinery includes the following steps: Obtain surrounding camera information by taking pictures of the area around the operating machinery; An image of the surroundings of the operating machinery is generated based on the surrounding camera information; and The setting image and the surrounding image are simultaneously displayed on the monitor. The setting image is used to confirm whether a setting change for the accessory's characteristics is required.

10. A method for displaying images of a work-operated machine, wherein the work-operated machine is capable of installing accessories, wherein... The image display method for the operating machinery includes the following steps: Obtain surrounding camera information by taking pictures of the area around the operating machinery; The category of the accessory is obtained from the category reader that reads the category of the accessory; An image of the surroundings of the operating machinery is generated based on the surrounding camera information; as well as The display image and the surrounding image are simultaneously displayed on the monitor. The display image is used to confirm whether a setting change of the accessory's characteristics corresponding to the category of the acquired accessory is required.

Images