Display control apparatus, work machine, program, and recording medium
The display control device integrates aerial views with supplementary device information and environmental/guidance data to enhance operator understanding of work machine surroundings and conditions.
Patent Information
- Application Number
- JP2023214094
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-19
- Publication Date
- 2025-07-01
AI Technical Summary
Existing display control devices for work machines fail to intuitively present environmental and guidance information alongside device states, making it difficult for operators to grasp the surroundings and device conditions.
A display control device that simultaneously displays an aerial view of the work machine with supplementary device information in the lower region and environmental/guidance information in the upper region of the screen, enhancing intuitive understanding.
Enables operators to easily comprehend the machine's surroundings and device states, reducing operational burden by integrating comprehensive information display.
Smart Images

Figure 2025097738000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a display control device that performs display control of a display device provided in a work machine, a work machine including the same, a program for operating the display control device, and a recording medium thereof.
Background Art
[0002] Conventionally, a display control device that displays an image indicating the state of a work machine, an imaging image obtained by photographing the surroundings of the work machine, is known (for example, Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, with the technology of Patent Document 1, it has been difficult to intuitively grasp which device the image indicating the state of the work machine corresponds to.
[0005] The present invention has been made to solve such problems of the prior art, and an object thereof is to provide a display control device that allows an operator to appropriately and intuitively grasp environmental information and / or guidance information around the work machine and the state of the devices of the work machine.
Means for Solving the Problems
[0006] A display control device according to an aspect of the present invention is a display control device that controls the display of a display device provided in a work machine, and includes a display control unit that displays information about the work machine on a display screen of the display device. The display control unit simultaneously displays, in a lower region of the display screen, an aerial view image of the work machine viewed from above and supplementary information that supplements and shows the states of one or more devices provided in the work machine in the aerial view image, and simultaneously displays, in an upper region of the display screen above the lower region, environmental information indicating information around the work machine and / or guidance information of the work machine.
Effect of the Invention
[0007] According to the above display control device, since the environmental information and / or guidance information around the work machine and the information indicating the states of the devices of the work machine are simultaneously displayed, each of these pieces of information can be appropriately grasped. Further, since the supplementary information indicating the states of the devices of the work machine is superimposed and displayed on the aerial view image of the work machine, the states of the devices of the work machine can be intuitively grasped.
Brief Description of the Drawings
[0008]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10A
Figure 10B
Figure 11A
Figure 11B
Figure 11C
Figure 11D
Figure 12A
Figure 12B
Figure 12C
Figure 12D
Figure 12E
Figure 13
Figure 14A
Figure 14B
Figure 14C
Figure 14D
Embodiments for Carrying Out the Invention
[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [First Embodiment] FIG. 1 is a schematic side view showing the overall configuration of the work machine 1 according to the present embodiment. In the present embodiment, a backhoe, which is a swing work machine, is exemplified as the work machine 1. As shown in FIG. 1, the work machine 1 includes a machine body (swing platform) 2, a traveling device 3, and a working device 4. A protection mechanism (for example, a cabin, a canopy, etc.) 5 is mounted on the machine body 2. A driver's seat 6 is provided inside the cabin 5.
[0010] In the present embodiment, the front side (in the direction of arrow A1 in FIG. 1) of the operator (driver) U1 sitting on the driver's seat 6 of the work machine 1 is defined as the front, the rear side (in the direction of arrow A2 in FIG. 1) of the operator U1 is defined as the rear, the left side (the near side in FIG. 1) of the operator U1 is defined as the left, and the right side (the far side in FIG. 1) of the operator U1 is defined as the right for explanation. Also, the horizontal direction, which is perpendicular to the front-rear direction, is defined as the width direction for explanation.
[0011] The machine body 2 is rotatably supported about a vertical axis (an axis extending in the up-and-down direction) via a slewing bearing 8 on the traveling device 3. The machine body 2 is rotationally driven by a slewing motor MT composed of a hydraulic motor (hydraulic actuator). The machine body 2 has a slewing base plate 9 that rotates about a vertical axis and a weight 10, and a prime mover Eg is mounted on the slewing base plate 9. The prime mover Eg is an engine (for example, a diesel engine) or an electric motor (electric machine) driven by a battery provided in the work machine 1, and in the present embodiment, it is a diesel engine.
[0012] The traveling device 3 is a crawler-type or wheel-type traveling device that supports the machine body 2 to be travelable, and includes a traveling frame (track frame) 3A that supports the machine body 2 and a traveling mechanism 3B that is driven by traveling motors (a first traveling motor ML and a second traveling motor MR).
[0013] At the front part of the traveling device 3, a dozer device 7, which is an example of the working device 4, is mounted.
[0014] The machine body 2 has a support bracket 13 that supports a swing bracket 14 so as to be swingable about a vertical axis. A working device 4 is attached to the swing bracket 14. The working device 4 has a boom 15, an arm 16, and an attachment 17. The base of the boom 15 is pivotally attached to the swing bracket 14 so as to be swingable about a horizontal axis (axis extending in the width direction). The arm 16 is pivotally attached to the tip side of the boom 15 so as to be rotatable about a horizontal axis in the arm dump direction (direction of arrow R1 in FIG. 1) and the arm crowd direction (direction of arrow R2 in FIG. 1). The attachment 17 is provided on the tip side of the arm 16.
[0015] In FIG. 1, a bucket X1 is provided as an example of the attachment 17. Note that the attachment 17 may be another attachment 17 that can be driven by a hydraulic actuator other than the bucket X1. Examples of other attachments 17 include a tilt bucket, a breaker, a clam shell, an auger, a grapple, a rotary grapple, a brush cutter, and a thumb.
[0016] The dozer device 7 is made vertically movable by the extension and contraction of a dozer cylinder C1, the swing bracket 14 is made swingable by the extension and contraction of a swing cylinder C2, and the boom 15 is made swingable by the extension and contraction of a boom cylinder C3. The arm 16 is made swingable by the extension and contraction of an arm cylinder C4, and the attachment 17 is made swingable by the extension and contraction of an attachment cylinder C5. These cylinders C1 to C5 are constituted by, for example, hydraulic cylinders (hydraulic actuators).
[0017] Figure 2 shows a schematic diagram of the control block of the working machine 1. As shown in Figure 2, the working machine 1 includes a control unit 70 and a vehicle body storage unit 71. The control unit 70 performs various controls related to the working machine 1. The control unit 70 may be realized by hardware formed on an integrated circuit (IC chip) or the like, or may be realized by software using a computer. In the latter case, the computer has a program which is software for realizing each function of the control unit 70 and a recording medium on which various data related to the working machine 1 are recordable in a readable manner by the computer, an arithmetic circuit such as a CPU (Central Processing Unit) for executing the instructions of the program, a RAM (Random Access Memory) for expanding the program and various data, and the like. Then, when the arithmetic circuit reads and executes the program from the recording medium, the functions of the control unit 70 are realized. The control unit 70 is connected to other devices (for example, a prime mover Eg, a control device 12, etc.) mounted on the working machine 1 via an in-vehicle communication network N such as a communication cable, a CAN (Controller Area Network), or a FlexRay.
[0018] The vehicle body storage unit 71 is composed of a non-volatile memory or the like. The vehicle body storage unit 71 stores various information related to the working machine 1. The vehicle body storage unit 71 stores an operating system and various application software.
[0019] The working machine 1 has a plurality of operation modes, and the control unit 70 can perform control based on the plurality of operation modes. For example, the vehicle body storage unit 71 stores a conversion table associating an operation mode with a control signal corresponding to the operation mode. The control unit 70 refers to the vehicle body storage unit 71 according to a predetermined condition and performs control based on the corresponding operation mode. In the present embodiment, the working machine 1 has an auto idle function, a crane mode function, and a slow mode function as operation modes.
[0020] The auto-idle function is a function that sets the rotational speed of the prime mover Eg to a predetermined rotational speed (idling rotational speed) when the operation of the control device 12 is not performed for a predetermined time or more while the prime mover Eg is operating. The crane mode function is a function that switches the rotational speed of the prime mover Eg and the rotational speed of the slewing motor MT to a predetermined rotational speed (crane mode rotational speed) suitable for the lifting operation when performing the lifting operation using the hook provided on the attachment 17. The slow mode function is a function that switches the operating speed of the working device 4 to a predetermined speed. Note that the operating modes of the working machine 1 are not limited to the above-described modes, and may be appropriately added or changed.
[0021] Figure 3 is a diagram showing the hydraulic system of the working machine 1. The hydraulic system of the working machine 1 includes service ports 41 and 42 to which various hydraulic actuators can be connected, the above-described hydraulic actuators C1 to C5, MT, ML, and MR, control valves 31 to 40 that control the hydraulic oil supplied to these, and adjustment valves 43 and 44 that adjust (change) the supply amount of the hydraulic oil supplied to the traveling motors ML and MR.
[0022] The control valves 31 to 40 are each connected to the hydraulic pump P1 via an oil passage. Further, the control valves 31 to 40 are each connected to the service ports 41 and 42, the hydraulic actuators C1 to C5, MT, ML, and MR via an oil passage.
[0023] The control valves 31 to 40 are, for example, electromagnetic three-position switching valves. Specifically, the control valves 31 to 40 are, for example, direct-acting spool-type switching valves. The control valves 31 to 40 are switched to the first to third positions V1 to V3 by switching the excitation and demagnetization of each solenoid. Thereby, the control valves 31 to 40 control the direction of the hydraulic oil supplied to the respective connected hydraulic actuators, the flow rate of the hydraulic oil, and the like.
[0024] The adjustment valve 43 is provided in the oil passage connecting the first traveling motor ML and the control valve 39, and adjusts the supply amount of the hydraulic oil from the control valve 39 to the first traveling motor ML. Further, the adjustment valve 44 is provided in the oil passage connecting the second traveling motor MR and the control valve 40, and adjusts the supply amount of the hydraulic oil from the control valve 40 to the second traveling motor MR.
[0025] The control unit 70 controls the control valves 31 to 40 and the adjustment valves 43 and 44 according to the operation of the operating device 12. As shown in FIG. 1, the operating device 12 is provided, for example, on the consoles 11L and 11R arranged on both sides in the width direction of the driver's seat 6, and as shown in FIG. 3, has the operating members 25L, 25R, and 45a to 45i. The operating members 25L and 25R are, for example, slide switches such as slide volumes, and are variable resistors capable of detecting the amount of movement (operation amount). The operating members 25L and 25R input signals of the operation amount and the operation direction to the control unit 70 according to the operation of the operator U1.
[0026] The operating members 25L and 25R include a first operating member 25L provided on the operating device 12L of the console 11L and a second operating member 25R provided on the operating device 12R of the console 11R. The first operating member 25L can be operated in a first operation direction (one direction) or a second operation direction (the other direction), and the second operating member 25R can be operated in a third operation direction (one direction) or a fourth operation direction (the other direction).
[0027] The operating members 45a to 45h include, for example, levers, slide switches, seesaw switches, dials, pedals, etc. The operating members 45a to 45h have sensors for detecting the operation direction and the operation amount, and the sensors of the respective operating members 45a to 45h input detection signals to the control unit 70 according to the operations of the corresponding operating members 45a to 45h.
[0028] The control unit 70 controls the corresponding control valves 31 to 40 based on the signals from the operating members 25L and 25R and the signals from the sensors of the operating members 45a to 45h. Thereby, the flow rate etc. of the hydraulic oil supplied from the control valves 31 to 40 to each hydraulic actuator are controlled.
[0029] The operation member 45i is an operation member that can change the traveling speed of the work machine 1 (traveling device 3) in multiple steps separately from the operation members 45g and 45h. For example, the operation member 45i is a switch that can be set to a plurality of steps (for example, three steps). In the body storage unit 71, a conversion table associating the steps (shift steps) that can be set by the operation member 45i with the control signals input to the regulating valves 43 and 44 is stored in advance.
[0030] The sensor of the operation member 45i inputs a detection signal of the shift step to the control unit 70 according to the operation of the operation member 45i. The control unit 70 refers to the conversion table and controls the regulating valves 43 and 44 with the control signals corresponding to the shift steps. Thereby, the supply amount of the hydraulic oil supplied to the first traveling motor ML and the second traveling motor MR is changed, and the traveling speed can be changed in multiple steps.
[0031] In addition, in the present embodiment, the operation of the solenoids provided in the control valves 31 to 40 is controlled based on the signals from the sensors of the operation members 25L and 25R or the operation members 45a to 45h, but it is not limited thereto. For example, pilot control valves 31 to 40 may be used, and the pilot pressure supplied to the control valves 31 to 40 may be controlled by a pilot valve or a solenoid valve provided in a pilot oil passage that interlocks with the operation members 45a to 45h according to the operation on the operation members 45a to 45h. Alternatively, the operation on the operation members 45a to 45h may be transmitted to the control valves 31 to 40 by a link mechanism or the like to control the control valves 31 to 40.
[0032] Further, as shown in FIG. 2, the control unit 70 may have a flow rate setting unit 70a that variably sets the maximum flow rate level (the maximum value of the flow rate of the hydraulic oil) of the hydraulic oil supplied to and discharged from the attachment 17 from the control valves 31 and 32. The flow rate setting unit 70a is a program stored in the recording medium of the control unit 70. For example, the maximum flow rate level is variably set using a predetermined control map. For example, the flow rate setting unit 70a can set each maximum flow rate level (first to fourth supply flow rates) when the operation members 25L and 25R are operated in each operation direction (first to fourth operation directions) by a predetermined stroke or more.
[0033] As shown in FIGS. 1 and 2, the work machine 1 includes a plurality of devices X. Examples of the plurality of devices X include a plurality of imaging devices 26, a lighting device 30, a rotating lamp 22, an air conditioner 74, an audio device 75, a wiper device 76, a defogging device 77, and a locking device 78. The control unit 70 is communicably connected to these devices X via the in-vehicle communication network N, and controls these devices X by analog voltage or analog current, or digital communication.
[0034] The plurality of imaging devices 26 are cameras or the like provided at a plurality of locations on the work machine 1, and can image the periphery of the work machine 1. The plurality of imaging devices 26 include, for example, a first imaging device 26A that images the front of the work machine 1 and a second imaging device 26B that images the rear. The imaging information (information of the captured image 102) by the imaging device 26 is input to the control unit 70, and the control unit 70 stores the imaging information in the aircraft storage unit 71.
[0035] The lighting device 30 includes, for example, a boom light 18, a headlight 19, a side light 20, and a rear light 21. The boom light 18 is provided on the boom 15 and illuminates the work area around the boom 15. The headlight 19 is a lighting lamp that illuminates the front of the machine body 2, and includes, for example, a left headlight 19L and a right headlight 19R at the lower front side of the driver's seat 6. The side light 20 is a lighting lamp that illuminates the side of the machine body 2, and includes, for example, a left side light 20L and a right side light 20R on the left side of the driver's seat 6. The rear light 21 is a lighting lamp that illuminates the rear of the machine body 2, and is provided, for example, behind the cabin 5.
[0036] The rotating lamp 22 lights up and rotates when a predetermined condition is satisfied, for example, when the crane mode is selected as the operation mode of the work machine 1. Further, it may light up and rotate by a predetermined operation performed by the operator U1.
[0037] The air conditioner 74 is a device for air-conditioning the cabin 5. The air conditioner 74 has an air conditioner main body 50 provided in the interior of the cabin 5 and a switching mechanism for switching between taking in outside air and taking in indoor air (inside air). The air conditioner main body 50 has a blower, an evaporator, etc., and circulates conditioned air from the first air duct 51A and the second air duct 51B in the cabin 5.
[0038] FIG. 4 is a schematic side view of the protection mechanism (cabin) 5. As shown in FIG. 4, the first air duct 51A has a blowing portion 52A provided at the lower front inside the cabin 5 and blowing conditioned air toward the feet of the driver's seat 6, and a blowing portion 53A provided in the front inside the cabin 5 and blowing conditioned air toward the front panel (front window portion) of the front surface of the cabin 5 and having a function as a defroster (FIG. 2: anti-fogging device 77).
[0039] As shown in FIG. 4, the second air duct 51B has a blowing portion 52B provided behind the driver's seat 6 and blowing conditioned air toward the back of the operator U1 sitting on the driver's seat 6, and a blowing portion 53B blowing conditioned air toward the rear panel (rear window portion) of the rear surface of the cabin 5.
[0040] Partition plates and actuators (for example, servo motors) are respectively provided in the first air duct 51A and the second air duct 51B, and the air conditioner 74 can switch the blowing (ON) and stopping (OFF) of the conditioned air from each of the blowing portions 52A to 53B by changing the position of the partition plate by the actuator.
[0041] In this embodiment, the air conditioner 74 also serves as a defogging device 77 for removing fog on the front panel. However, it may also serve as a defogging device 77 for removing fog on the front panel and / or the rear panel. Alternatively, the defogging device 77 may be separate from the air conditioner 74.
[0042] The audio device 75 is, for example, an audio unit having a radio unit. The audio device 75 switches the frequency of the radio waves received from the radio antenna and converts the radio wave information received from the radio antenna into an electrical signal that becomes sound. Further, the audio device 75 may refer to music information stored in the internal memory of the audio device 75 and convert it into an electrical signal that becomes sound. The audio device 75 outputs an electrical signal to a speaker provided around the driver's seat 6, and the speaker converts the electrical signal into physical vibrations (sound) and outputs sound and music.
[0043] The wiper device 76 is a device that operates the front wiper 76a and / or the rear wiper 76b. As shown in FIG. 1, the front wiper 76a is provided on the front panel of the cabin 5, and the rear wiper 76b is provided on the rear panel of the cabin 5. The front wiper 76a and the rear wiper 76b are each driven by an actuator (electric motor) and can switch between the operation (ON) and stop (OFF) of the wiping function.
[0044] The locking device 78 is a device that switches between locking and unlocking the cabin 5. The locking device 78 includes, for example, a locking mechanism provided on the door of the cabin 5 and an actuator (electric motor) that drives the locking mechanism.
[0045] Further, as shown in FIG. 2, the working machine 1 includes a detection device 73 that acquires various information of the devices provided in the working machine 1, including the above-described device X. The detection device 73 includes, for example, sensors that detect information such as the rotational speed of the prime mover Eg, the temperature of the cooling water (water temperature), the remaining fuel amount, the battery charge state, the state of the working device 4 (for example, the current position and posture of the boom 15, the arm 16, and the attachment 17), the gear position, and the temperature of the hydraulic oil. The detection device 73 inputs the information to the control unit 70, and the control unit 70 performs predetermined processing on the input information and outputs the processed information to the display control devices 72A and 72B. Note that the configuration of each of these detection units is not limited to the above configuration, and various conventionally known detection means can be used.
[0046] Further, as shown in FIG. 2, the control unit 70 has an abnormality detection unit 70b that detects preset warning conditions, and the abnormality detection unit 70b detects, for example, an abnormality (failure) of the device X mounted on the working machine 1 as a warning condition. The abnormality detection unit 70b is a program stored in the recording medium of the control unit 70.
[0047] The abnormality detection unit 70b determines that a warning condition (warning event) has occurred in the working machine 1 when a predetermined warning condition is satisfied, such as when the value output from electronic components such as the device X and the detection device 73 exceeds a predetermined threshold range. For example, the abnormality detection unit 70b detects an abnormality (overheat) of the prime mover Eg as a warning condition when an abnormality such as a disconnection or short circuit of a sensor or a switch occurs, or when the water temperature exceeds a predetermined range. The warning condition detected by the abnormality detection unit 70b is input to the control unit 70.
[0048] As shown in FIGS. 2 and 4, etc., the working machine 1 includes display devices 60A and 60B, an operating tool 62, a first display control device 72A, and a second display control device 72B. The display devices 60A and 60B can perform various displays regarding the working machine 1 and various settings related to the working machine 1. The display devices 60A and 60B include a first display device 60A and a second display device 60B, and these are located at positions visible to the operator U1 seated on the driver's seat 6 in the cabin 5 and are arranged in the vicinity of the control device 12.
[0049] As shown in FIG. 2, the first display device 60A has a first display screen 61A, and the second display device 60B has a second display screen 61B. The first display screen 61A and the second display screen 61B are rectangular touch panels having a function of receiving touch operation inputs (such as tap operations and swipe operations, etc.) on the screen. Therefore, the operator U1 can visually recognize the display devices 60A and 60B while sitting on the driver's seat 6 and placing a hand on the operating device 12, and can operate the display devices 60A and 60B by extending the hand placed on the operating device 12 forward. In the following description, the operation on the screens of the first display screen 61A and the second display screen 61B will be described by taking the tap operation as an example.
[0050] As shown in FIG. 4 and the like, the second display device 60B is arranged side by side below the first display device 60A. The vertical length of the first display device 60A is longer than the vertical length of the second display device 60B. The first display device 60A has a vertically long rectangular shape, and the second display device 60B has a horizontally long rectangular shape. The area of the first display device 60A is larger than the area of the second display device 60B. Also, in the present embodiment, the lengths of the adjacent sides of the first display device 60A and the second display device 60B are substantially the same (within ±5%).
[0051] The operating tool 62 is a member for performing operations related to work. The operating tool 62 is provided on the second display screen 61B so as to protrude from the second display screen 61B. For example, the operating tool 62 is a dial-type operating member that can rotate in the circumferential direction around an axis extending in the orthogonal direction of the second display screen 61B. The operating tool 62 is a cylindrical dial having a through hole formed in the central portion. Therefore, the operator U1 can visually recognize the display inside the cylinder of the operating tool 62 on the second display screen 61B.
[0052] Note that it is only necessary that the display inside the operating tool 62 on the second display screen 61B be visible, and a transparent member (transparent member) may be provided in the through hole of the operating tool 62.
[0053] Further, the operating tool 62 only needs to be a physical operating member provided at least on the second display screen 61B, and may be a dial-type operating member that rotates around an axis in a direction extending horizontally on the second display screen 61B, or may be a slide-type operating member provided on the second display screen 61B.
[0054] As shown in FIG. 4 and the like, in this embodiment, a plurality of (62L, 62R) operating tools 62 are provided on the second display screen 61B. As shown in FIG. 10A, the operating tool 62 is disposed in the lower second lower region 110B of the second display screen 61B. Further, a pair of operating tools 62 are provided on the second display screen 61B, and the pair of operating tools 62 are spaced apart from each other on one side and the other side in the width direction of the second lower region 110B. The left operating tool 62L is provided above the region 110F, and the right operating tool 62R is provided above the region 110G. Note that the number of operating tools 62 provided on the second display screen 61B may be plural and is not limited to the above-described number (a pair).
[0055] The first display control device 72A is a device that controls the display of the first display device 60A. The second display control device 72B is a device that controls the display of the second display device 60B. The first display control device 72A and the second display control device 72B are realized by hardware or software, similar to the control unit 70.
[0056] The first display control device 72A and the second display control device 72B are provided in a common or separate housing together with the first display device 60A and the second display device 60B, respectively. Note that the first display control device 72A and the second display control device 72B may be part of the control unit 70, or may be provided separately from the control unit 70 and configured to exchange various information with the control unit 70.
[0057] As shown in FIG. 2, the first display control device 72A includes a display control unit (controller, first display control unit) 72A1, an operation reception unit (event handler) 72A2, and a storage unit 72A3.
[0058] The controller 72A1 performs various controls related to the first display device 60A, and mainly performs control to display information related to the working machine 1 on the first display device 60A. The control unit 70 inputs the information stored in the aircraft storage unit 71, the detection device 73, the abnormality detection unit 70b, and the information acquired from the imaging device 26 into the controller 72A1. The controller 72A1 displays the information acquired from the control unit 70 on the first display screen 61A of the first display device 60A.
[0059] The event handler 72A2 detects the operations performed by the operator U1 on the first display device 60A, inputs an instruction signal for performing an operation related to the working machine 1 to the control unit 70, and inputs an instruction signal related to the control of the first display device 60A to the controller 72A1. The control unit 70 controls various operations related to the working machine 1 according to the instruction signal input by the event handler 72A2.
[0060] The storage unit 72A3 stores various information related to the first display device 60A.
[0061] As shown in FIG. 2, the second display control device 72B includes a display control unit (controller, second display control unit) 72B1, an operation reception unit (event handler) 72B2, and a storage unit 72B3.
[0062] The controller 72B1 performs various controls related to the second display device 60B, and mainly causes the second display device 60B to display an operation unit 120 for receiving an operation on the device X provided in the working machine 1 (in other words, for performing an operation input). The operation unit 120 is an electronic interface. That is, it can be said that the working machine 1 of the present embodiment includes an operation device (second display device) 60B including the operation unit 120 and the operating tool 62.
[0063] As shown in FIG. 10A, the operation unit 120 is arranged in the second upper area 110A above the second display screen 61B. Further, in addition to the second upper area 110A, the operation unit 120 is arranged in the third display area 110C between a pair of operation tools 62 in the second lower area 110B. That is, the controller 72B1 causes the operation unit 120 to be displayed in the second upper area 110A of the second display screen 61B and in the area 110C between a pair of operation tools 62 in the second lower area 110B, which are areas different from the area where the operation tools 62 are provided.
[0064] The event handler 72B2 detects an operation performed by the operator U1 on the second display device 60B, inputs an instruction signal mainly for operating the devices of the working machine 1 to the control unit 70, and inputs an instruction signal regarding the control of the second display device 60B to the controller 72B1. The event handler 72B2 can detect the operation amount, rotation direction, and operation speed of the operation tool 62, as well as the operation of the operation unit 120. The control unit 70 controls various operations related to the working machine 1 according to the instruction signal input by the event handler 72B2.
[0065] The storage unit 72B3 stores various information regarding the second display device 60B.
[0066] Hereinafter, a specific example of the control unit 70 operating the device X based on the instruction signal input by the event handler 72B2 will be described. For example, when the operator U1 operates the operation unit 120 related to the air conditioner 74 displayed on the second display screen 61B, the event handler 72B2 detects the operation and inputs an instruction signal for operating the air conditioner 74 to the control unit 70. The control unit 70 performs control (for example, switching between blowing (ON) and stopping (OFF) of the conditioned air from the blowing units 52A and 52B) to operate the air conditioner 74 based on this instruction signal.
[0067] Also, when the operator U1 operates the operation unit 120 related to the audio device 75 displayed on the second display screen 61B, the event handler 72B2 detects the operation and inputs an instruction signal for operating the audio device 75 to the control unit 70. Based on this instruction signal, the control unit 70 performs control to operate the audio device 75 (for example, conversion of radio wave information and music information into electrical signals and output to the speaker).
[0068] Also, when the operator U1 operates the operation unit 120 related to the wiper device 76 displayed on the second display screen 61B, the event handler 72B2 detects the operation and inputs an instruction signal for operating the wiper device 76 to the control unit 70. Based on this instruction signal, the control unit 70 performs control to operate the wiper device 76 (for example, switching between the operation (ON) and stop (OFF) of wiping water droplets).
[0069] Also, when the operator U1 operates the operation unit 120 related to the defogging device 77 displayed on the second display screen 61B, the event handler 72B2 detects the operation and inputs an instruction signal for operating the defogging device 77 to the control unit 70. Based on this instruction signal, the control unit 70 performs control to operate the defogging device 77 (air conditioner 74) (for example, switching between the blowing (ON) and stop (OFF) of conditioned air from the blowing unit 53A and the blowing unit 53B).
[0070] Also, when the operator U1 operates the operation unit 120 related to the locking device 78 displayed on the second display screen 61B, the event handler 72B2 detects the operation and inputs an instruction signal for operating the locking device 78 to the control unit 70. Also, when the operator U1 operates the supplementary information 92 indicating the operating status of the locking device 78 displayed on the display screen 61A (the first display screen 61A), the event handler 72A2 detects the operation and inputs an instruction signal for operating the locking device 78 to the control unit 70. Based on these instruction signals, the control unit 70 performs control to operate the locking device 78 (for example, locking and unlocking).
[0071] When the operator U1 operates the operation unit 120 related to the lighting device 30 displayed on the second display screen 61B, the event handler 72B2 detects the operation and inputs an instruction signal for operating the lighting device 30 to the control unit 70. Based on this instruction signal, the control unit 70 performs control to operate the lighting device 30 (for example, turning on and off).
[0072] When the operator U1 operates the operation unit 120 related to the crane mode displayed on the second display screen 61B, the event handler 72B2 detects the operation and inputs an instruction signal for operating the crane mode to the control unit 70. Based on this instruction signal, the control unit 70 performs control to change the prime mover Eg, etc. to a predetermined rotational speed and control to operate (turn on or off) the rotating lamp 22.
[0073] In the above-described example, the case where the control unit 70 operates the device X based on the instruction signal from the event handler 72B2 has been described as an example. However, the control unit 70 may operate the device X based on the instruction signal from the event handler 72A2. Specifically, the event handler 72A2 detects an operation of supplementary information 92 described later, and the control unit 70 operates the device X based on the instruction signal from the event handler 72A2.
[0074] Also, the operating state (operating situation) of each device X is displayed on the display devices 60A and 60B. In such a case, the control unit 70 detects the operating state of each device X and inputs it as the current operating state to the controllers 72A1 and 72B1. The controllers 72A1 and 72B1 cause the operating state to be displayed on the display devices 60A and 60B.
[0075] Hereinafter, with reference to FIGS. 5 to 8, the screen to be displayed on the first display screen 61A provided in the first display device 60A by the first display control device 72A (controller 72A1) will be described.
[0076] As shown in FIGS. 5 and 6, the controller 72A1 causes information regarding the work machine 1 to be displayed on the first display screen (display screen) 61A of the first display device 60A. The controller 72A1 simultaneously displays different information in the first upper region (upper region) 80A above the first display screen 61A and the first lower region (lower region) 80B below it. The upper region 80A is larger than the lower region 80B.
[0077] As information regarding the work machine 1, the controller 72A1 causes environmental information 100 (FIG. 5) indicating the environment around the work machine 1 and / or guidance information 101 (FIG. 6) of the work machine 1 to be displayed in the first upper region 80A, and causes state information 90 indicating the state of the work machine 1 to be displayed in the first lower region 80B. In the present embodiment, the environmental information 100 is a plurality of captured images 102 acquired by a plurality of imaging devices 26A and 26B provided on the work machine 1, and is displayed on the first display device 60A. The guidance information 101 of the work machine 1 is information that supports the operation of the work machine 1 by the operator U1.
[0078] The controller 72A1 displays a first switching operation unit 103 and a second switching operation unit 104 at the upper part of the upper region 80A. The first switching operation unit 103 receives an operation for switching the display of a plurality of captured images 102 acquired by a plurality of imaging devices 26A and 26B. The event handler 72A2 receives an operation for switching the display of a plurality of captured images 102 when the first switching operation unit 103 is operated.
[0079] The second switching operation unit 104 receives an operation for switching the display between the environmental information 100 and / or the guidance information 101 of the work machine 1 and the setting operation unit 105. The event handler 72A2 receives an input of an operation for switching the display between the environmental information 100 and / or the guidance information 101 of the work machine 1 and the setting operation unit 105 when the second switching operation unit 104 is operated, and the controller 72A1 causes the setting operation unit 105 to be displayed in the upper region 80A. The setting operation unit 105 receives an input of setting information of the work machine 1.
[0080] As shown in FIG. 7, the controller 72A1 causes the lower region 80B of the first display screen 61A to display, as status information 90, an overhead image 91 of the work machine 1 viewed from above and supplementary information 92 that supplements and shows the status of one or more devices X provided in the work machine 1 in the overhead image 91. The status information 90 includes the overhead image 91 and the supplementary information 92. The controller 72A1 causes the overhead image 91 to be displayed in a region 80C that is the center of the lower region 80B.
[0081] For example, as shown in FIG. 7, the supplementary information 92 shows the operating status of the lighting device 30, the rotating lamp 22, the wiper device 76, the defogging device 77, and the locking device 78. Also, the arrangement position of the supplementary information 92 corresponds to the position of each device X in the overhead image 91. For example, as shown in FIG. 7, the supplementary information 92 is a figure that is displayed superimposed on the overhead image 91. Note that the shape of the supplementary information 92 is not limited. For example, the supplementary information 92 may be a figure in the shape of a speech bubble, and by arranging a speech bubble line in the overhead image 91, the arrangement position of the device X on the aircraft 2 may be indicated.
[0082] The controller 72A1 causes the first display device 60A to display, as supplementary information 92, the operating status of the device X input by the control unit 70. The supplementary information 92 indicates the operating status of each device X by varying the display form. For example, the controller 72A1 switches the display and non-display of each supplementary information 92 according to the status of each device X.
[0083] The controller 72A1 causes the supplementary information 92 corresponding to the case where the status (lighting status) of the lighting device 30 and the rotating lamp 22 is lit to be displayed, and causes it to be non-displayed when extinguished. The supplementary information 92a to 92g respectively correspond to the boom lamp 18, the headlamp 19L, the headlamp 19R, the side lamp 20L, the side lamp 20R, the rear lamp 21, and the rotating lamp 22.
[0084] The controller 72A1 causes the supplementary information 92 corresponding to the case where the status of the wiper device 76 is operating (ON) to be displayed, and causes it to be non-displayed when stopped (OFF). The supplementary information 92h and 92i respectively correspond to the front wiper 76a and the rear wiper 76b of the wiper device 76.
[0085] When the state of the defogging device 77 is blowing (ON), the controller 72A1 displays supplementary information 92 corresponding thereto, and when it is stopped (OFF), the controller 72A1 makes the supplementary information non-displayed. As shown in FIG. 4, the supplementary information 92j and 92k respectively correspond to the blowing part 53A and the blowing part 53B of the defogging device 77.
[0086] When the state (locking status) of the locking device 78 is locked, the controller 72A1 displays supplementary information 92l corresponding thereto, and when the locking is released, the controller 72A1 makes the supplementary information 92l non-displayed.
[0087] Note that it is sufficient if the state of the device X can be indicated by the display of the supplementary information 92, and the controller 72A1 may vary the display color and illuminance of the supplementary information 92 according to the state of the device X. For example, when the lighting device 30 is a device capable of changing the illuminance, the illuminance of the supplementary information 92 may be varied based on the illuminance of the lighting device 30.
[0088] The controller 72A1 displays first information 93 regarding the machine body 2 of the working machine 1 in one of the width directions of the overhead image 91 and the supplementary information 92 in the lower region 80B. The state information 90 includes the first information 93.
[0089] For example, as shown in FIG. 7, the controller 72A1 displays the first information 93 in a region 80D which is one of the width directions (right side) of the region 80C where the overhead image 91 and the supplementary information 92 are displayed. The first information 93 includes information regarding the machine body 2 (travel device 3) acquired by the detection device 73. The first information 93 includes any one or more of the remaining amount of fuel, the charge state of the battery, the rotation speed of the prime mover Eg, the operating state of the auto-idle function, and the shift state (shift stage information) of the travel device 3.
[0090] The control unit 70 inputs information on the current fuel remaining amount acquired by the detection device 73 and information on the rotational speed of the prime mover Eg, as well as the shift state of the traveling device 3, into the first display control device 72A. The controller 72A1 converts this information input by the control unit 70 into images 93a to 93c that are displayable information, and causes them to be displayed in the area 80D.
[0091] When the prime mover Eg is an electric motor, the controller 72A1 may cause an image 93a indicating the battery charge state to be displayed in the area 80D as the first information 93.
[0092] Also, the first information 93 is not limited to the above-described images 93a to 93c, and may be other information. For example, the control unit 70 inputs the operating state of the auto idle function (whether or not the auto idle function is being executed) into the first display control device 72A, and the controller 72A1 may cause an image 93d to be displayed in the area 80D when the auto idle function is being executed, and may cause the image 93d to be hidden when the auto idle function is not being executed.
[0093] The controller 72A1 causes second information 94 regarding the working device 4 of the work implement 1 to be displayed in the other side in the width direction of the overhead image 91 and the supplementary information 92 in the lower area 80B. The status information 90 includes the second information 94. The second information 94 includes one or more of the type of the attachment 17 attached to the working device 4, the operation mode of the working device 4, the setting status regarding the operation limit of the working device 4, and the flow rate setting status of the working device 4.
[0094] For example, as shown in FIG. 7, the controller 72A1 causes the second information 94 to be displayed in the area 80E, which is the other side (left side) in the width direction of the area 80C where the overhead image 91 and the supplementary information 92 are displayed. The second information 94 includes information 94a regarding the operation mode or operation limit of the working device 4, type information 94b of the attachment 17, flow rate setting mode information 94c of the attachment 17, and information 94e regarding the operation mode of the working device 4.
[0095] Specifically, the control unit 70 inputs information regarding the operation restrictions of the working device 4 to the first display control device 72A. The controller 72A1 causes the information regarding the operation restrictions to be displayed in the area 80E. For example, when there are respective operation restrictions, the controller 72A1 causes images 94a1 to 94a3 corresponding to the respective operation restrictions to be displayed in the area 80E, and causes the images 94a1 to 94a3 corresponding to the case where there are no operation restrictions to be hidden. The information regarding the operation restrictions of the working device 4 includes operation restrictions in the height direction with respect to the boom 15, operation restrictions in the arm dump direction with respect to the arm 16, operation restrictions in the arm cloud direction with respect to the arm 16, and the like.
[0096] The control unit 70 inputs the type of the attachment 17 to the first display control device 72A, and the controller 72A1 causes an icon image 94b (the icon image corresponding to the bucket X1 in FIG. 7) corresponding to the type of the attachment 17 to be displayed in the area 80E.
[0097] The control unit 70 inputs the flow rate setting mode of the attachment 17 acquired by the flow rate setting unit 70a to the first display control device 72A, and the controller 72A1 causes an icon image 94c corresponding to the flow rate setting mode to be displayed in the area 80E.
[0098] The control unit 70 inputs the operation mode of the working device 4 to the first display control device 72A, and the controller 72A1 causes information 94e regarding the operation mode to be displayed in the area 80. For example, when the operation mode of the working device 4 is the slow mode, the controller 72A1 displays the information 94e "Slow Mode". When the operation mode of the working device 4 is not the slow mode, the controller 72A1 hides the information 94e.
[0099] As shown in FIG. 5, the controller 72A1 causes the environmental information 100 to be displayed in the upper region 80A, and as the environmental information 100, the captured image 102 acquired by the imaging device 26 provided in the working machine 1 is displayed. Specifically, the control unit 70 controls the imaging device 26 to acquire the captured image 102. The control unit 70 inputs the captured image 102 as the environmental information 100 to the first display control device 72A1. The controller 72A1 causes the captured image 102 input by the control unit 70 to be displayed in the upper region 80A on the first display screen 61A of the first display device 60A.
[0100] The controller 72A1 causes a first switching operation unit 103 that receives an operation for switching the display of a plurality of captured images 102 (102A, 102B) acquired by a plurality of imaging devices 26 (26A, 26B) provided in the working machine 1 to be displayed above the upper region 80A of the first display screen 61A. The controller 72A1 causes the first switching operation unit 103 to be displayed in the upper region 80A where the captured image 102 is displayed. The first switching operation unit 103 is displayed above the upper region 80A of the first display screen 61A.
[0101] Specifically, a circular list indicating the imaging device 26 to be the display target is stored in the storage unit 72A3 in advance. When the event handler 72A2 receives an input operation of the first switching operation unit 103, it refers to the circular list in the storage unit 72A3 and inputs an instruction signal for designating the imaging device 26 to the control unit 70. The circular list may define an instruction signal for each individual imaging device 26A, 26B as the display target, or may define an instruction signal for simultaneously making a plurality of imaging devices 26A, 26B the display target. Further, it may be defined that the guidance information 101 described later is the display target.
[0102] When the controller 72A1 is displaying the captured image 102A of the imaging device 26A, if the operator U1 operates the first switching operation unit 103, the event handler 72A2 receives the operation on the first switching operation unit 103. The event handler 72A2 refers to the circular list and inputs an instruction signal for acquiring the captured image 102B from the imaging device 26 (26B) to the control unit 70. Based on the instruction signal, the control unit 70 inputs the captured image 102B to the first display control device 72A, and the controller 72A1 displays the input captured image 102B in the upper area 80A.
[0103] As shown in FIG. 6, the controller 72A1 displays the guidance information 101 of the working machine 1 in the first upper area 80A as information regarding the working machine 1. For example, as shown in FIG. 6, the guidance information 101 includes a posture image 101a indicating the current position and posture of the working machine 1 (boom 15, arm 16, and attachment 17) and a cross-sectional image 101b of the construction data. The display of the guidance information 101 in the upper area 80A is started when the operator U1 performs a predetermined operation on the first display device 60A. Also, the operator U1 may start the display of the guidance information 101 by operating the first switching operation unit 103.
[0104] Specifically, the control unit 70 detects the current position and posture of the boom 15, arm 16, and attachment 17 and inputs them to the first display control device 72A. For example, the control unit 70 detects the current position and posture of the boom 15, arm 16, and attachment 17 based on the information acquired from the detection device 73.
[0105] The controller 72A1 converts the input positions and postures of the boom 15, arm 16, and attachment 17 into a posture image 101a, which is information that can be displayed on the first display screen 61A. Also, the control unit 70 inputs the construction data stored in the aircraft storage unit 71 to the first display control device 72A. The construction data is, for example, data indicating the state of the construction location after the work is completed.
[0106] The controller 72A1 converts the input construction data into a cross-sectional image 101b. The controller 72A1 causes the guidance information 101 including the attitude image 101a and the cross-sectional image 101b to be displayed in the upper region 80A on the first display screen 61A of the first display device 60A.
[0107] Note that the display format of the guidance information 101 is not limited to the above configuration, and a conventionally known display format can be used. Also, the current positions and postures of the boom 15, the arm 16, and the attachment 17, and the method for acquiring the construction data are not limited to the above configuration, and a conventionally known acquisition format can be used.
[0108] The controller 72A1 causes the status information 90 to be displayed in the lower region 80B of the first display screen 61A, and at the same time causes the environment information 100 to be displayed in the upper region 80A. Further, the controller 72A1 may cause the status information 90 to be displayed in the lower region 80B of the first display screen 61A, and at the same time cause the guidance information 101 to be displayed in the upper region 80A. The controller 72A1 may cause the status information 90 to be displayed in the lower region 80B of the first display screen 61A, and at the same time cause the status information 90 and the guidance information 101 to be displayed in the upper region 80A.
[0109] As shown in FIG. 5, when an abnormality occurs, the controller 72A1 causes warning information 81 regarding a warning condition corresponding to the abnormality to be displayed. The warning information 81 includes a message image 81a indicating the content regarding the warning condition and an icon image 81b indicating the type regarding the warning condition. When an abnormality occurs, the controller 72A1 causes the warning information 81 to be displayed between the first upper region 80A and the first lower region 80B or in the first lower region 80B. The message image 81a is a character image capable of displaying the content of the warning information 81 on the display screens 61A and 61B. The icon image 81b is an icon in which a figure associating the content of the warning information 81 is omitted and simplified, and indicates the type of the warning information 81. In the storage unit 72A3, a table associating the message image 81a corresponding to the warning information 81 and the icon image 81b is stored in advance.
[0110] When the abnormality detection unit 70b detects warning information 81 corresponding to a warning condition, the control unit 70 inputs the warning information 81 to the controller 72A1 of the first display control device 72A. The controller 72A1 refers to the storage unit 72A3 and converts the input warning information 81 into a message image 81a and an icon image 81b. The controller 72A1 causes the message image 81a and the icon image 81b to be displayed on the first display screen 61A. The message image 81a is arranged in a region 80F that is a position close to the lower region 80B in the upper region 80A. Also, the icon image 81b is displayed in the lower region 80B.
[0111] Note that the message image 81a and the icon image 81b may have their display colors, display sizes, display times, etc. changed according to the warning condition. Also, the time for which the message image 81a is displayed on the first display screen 61A and the time for which the icon image 81b is displayed on the first display screen 61A may be made different. For example, the controller 72A1 causes the message image 81a to be displayed for a predetermined time or more and then causes the message image 81a to be made non-displayed. On the other hand, the controller 72A1 continuously displays the icon image 81b while the abnormality detection unit 70b is detecting the warning condition.
[0112] As shown in FIG. 8, the controller 72A1 causes a setting operation unit 105 that accepts input of setting information of the work machine 1 to be displayed in the upper region 80A instead of the environment information 100 and / or the guidance information 101 of the work machine 1. The setting operation unit 105 enables various settings regarding the display devices 60A and 60B and setting operations regarding maintenance of the work machine 1. The setting operation unit 105 includes a setting category selection unit 106 that can select a category of the setting information and a setting information input unit 107.
[0113] For example, as shown in FIG. 8, when the operator U1 operates the "Display" category (106a) on the setting category selection unit 106, the controller 72A1 displays the setting information input unit 107a corresponding to "Display". Also, when the operator U1 operates "Display mode: daytime" (107a1), the event handler 72A2 refers to the storage unit 72A3 and acquires the setting values of the illuminance of the first display device 60A and the second display device 60B corresponding to "Display mode: daytime". The event handler 72A2 inputs the setting value of the illuminance of the first display device 60A to the controller 72A1. The controller 72A1 controls the illuminance of the first display device 60A based on the input setting value. The event handler 72A2 inputs the setting value of the illuminance to the second display control device 72B. The second display control device 72B (controller 72B1) controls the illuminance of the second display device 60B based on the input setting value.
[0114] As shown in FIG. 5, the controller 72A1 displays a second switching operation unit 104 in the upper region 80A for receiving a switching operation of the display between the environmental information 100 and / or the guidance information 101 of the working machine 1 and the setting operation unit 105. When the operator U1 operates on the second switching operation unit 104, the event handler 72A2 inputs an instruction signal for displaying the setting operation unit 105 to the controller 72A1. The controller 72A1 displays the setting operation unit 105 in the upper region 80A of the first display screen 61A.
[0115] Hereinafter, the screen that the second display control device 72B (controller 72B1) causes to be displayed on the second display screen 61B provided in the second display device 60B will be described.
[0116] The second display control device 72B accepts operations of a plurality of applications related to the work machine 1. The plurality of applications include, for example, a first application (air conditioning application) for operating the air conditioner 74, a second application (Music application) for operating the audio device 75, a third application (flow rate setting application) for performing an operation of setting the flow rate to the first service port 41 and the second service port 42, and the like.
[0117] As shown in FIGS. 5 and 11A to 11D, the controller 72B1 causes the second display screen 61B to display a home screen Q1, a first setting screen (air conditioning setting screen) Q2, a second setting screen (Music setting screen) Q3, and a third setting screen (flow rate setting screen) Q4. In the following description, a state in which no application selection operation is performed and the controller 72B1 displays the home screen Q1 on the second display screen 61B is referred to as a first display state S1, and a state in which an application selection operation is performed and the controller 72B1 displays the first setting screen Q2, the second setting screen Q3, and the third setting screen Q4 on the second display screen 61B is referred to as a second display state S2. The application only needs to be an application related to the work machine 1, and the types and numbers of the applications described above are not limited.
[0118] As shown in FIG. 11A, in the first display state S1 (home screen Q1), the controller 72B1 causes the first operation unit 121 that receives a selection operation of an application to be operated, out of a plurality of applications related to the work machine 1, to be displayed on the second display screen 61B. As shown in FIGS. 10A and 11A, the controller 72B1 causes the first operation unit 121 to be displayed in the area 110A including the first display area 110E and the second display area 110D of the second display screen 61B. The first operation unit 121 is displayed at the center of the area 110A. In the area 110A, a plurality of application icons (images) that receive a selection operation of an application to be operated are arranged side by side. As shown in FIG. 11A, the application icon 121a is an icon indicating the first application, the application icon 121b is an icon indicating the second application, and the application icon 121c is an icon indicating the third application.
[0119] As shown in FIGS. 11B and 11C, in the second display state S2, the controller 72B1 causes the second operation unit 122 and the first operation unit 121 for operating the application to be operated to be displayed on the second display screen 61B. As shown in FIGS. 10A, 11B, and 11C, the controller 72B1 causes the second operation unit 122 to be displayed in the second display area 110D, which is the upper area on the second display screen 61B. The second operation unit 122 is a screen on which an application can be operated. For example, as shown in FIGS. 11B to 11D, the application screen 122a (FIG. 11B) is an operation screen for operating the first application, the application screen 122b (FIG. 11C) is an operation screen for operating the second application, and the application screen 122c (FIG. 11D) is an operation screen for operating the third application. The controller 72B1 causes the first operation unit 121 to be displayed in the first display area 110E, which is the upper area on the second display screen 61B. In the second display state S2, the controller 72B1 causes the fourth operation unit 124 for receiving an operation for transitioning to the first display state S1 (home screen Q1) to be displayed. For example, the fourth operation unit 124 is a home icon and is arranged in the first display area 110E next to the first operation unit 121 as shown in FIG. 11B. That is, when a selection operation of an application is performed, the controller 72B1 causes the first operation unit 121, the second operation unit 122, and the fourth operation unit 124 to be displayed on the second display screen 61B as the second display state S2.
[0120] Subsequently, the state transition of the second display screen 61B will be described.
[0121] As shown in FIGS. 11A to 11D, the controller 72B1 causes the first operation unit 121 (application icons 121a to 121c) for receiving a selection operation of an application to be operated among a plurality of applications related to the work machine 1 to be displayed on the second display screen 61B of the second display device 60B. When the application to be operated is selected by the first operation unit 121 (when a selection operation of an application is performed), the controller 72B1 causes the second display screen 61B to transition to the second display state S2 for operating the application.
[0122] When the operator U1 operates any one of the application icons 121a to 121c included in the first operation unit 121, the second display screen 61B transitions to a second display state S2 for operating the application touched by the operator U1.
[0123] In the second display state S2, the controller 72B1 causes the first operation unit 121 for performing a selection operation of an application other than the application corresponding to the second operation unit 122 among the plurality of applications to be displayed. The controller 72B1 causes the application icons 121a to 121c other than the application selected by the operator U1 to be displayed on the second display screen 61B as the first operation unit 121.
[0124] The controller 72B1 can transition the second display screen 61B to the first display state S1. In the second display screen 61B in the second display state S2, the controller 72B1 causes the fourth operation unit 124 for receiving an operation to transition to the first display state S1 to be displayed, and when the fourth operation unit 124 is operated, the second display screen 61B is transitioned from the second display state S2 to the first display state S1. When transitioning from the second display state S2 to the first display state S1, the controller 72B1 causes the second operation unit 122 to be hidden from the second display area 110D.
[0125] FIG. 9 is a state transition diagram of the second display screen 61B. Events E1 to E4 represent operations of the operator U1 that trigger the controller 72B1 to transition the screen of the second display screen 61B. When any of the events E1 to E4 occurs, the controller 72B1 transitions the screen of the second display screen 61B. Events E1 to E4 respectively indicate that the operator U1 has operated the app icon 121a (air conditioner), app icon 121b (Music), app icon 121c (AUX), and the fourth operation unit 124 (home icon). When event E1 occurs, the controller 72B1 transitions the second display screen 61B to the first setting screen Q2 in the second display state S2. When event E2 occurs, the controller 72B1 transitions the second display screen 61B to the second setting screen Q3 in the second display state S2. Further, when event E3 occurs, the controller 72B1 transitions the second display screen 61B to the third setting screen Q4 in the second display state S2. When event E4 occurs, the controller 72B1 transitions the second display screen 61B to the home screen Q1 in the first display state S1.
[0126] Subsequently, with reference to FIGS. 11A to 11D, the state transition (screen transition) of the second display screen 61B will be described. FIG. 11B shows the first setting screen Q2 in the second display state S2. When the operator U1 operates the app icon 121a (FIGS. 11A, 11C, 11D) (event E1 occurs), the controller 72B1 causes the first setting screen Q2 to be displayed on the second display screen 61B.
[0127] The controller 72B1 displays an app screen 122a on the second display area 110D of the second display screen 61B as the second operation unit 122, which can operate the first application. Also, the controller 72B1 displays app icons 121b, 121c, etc. on the first display area 110E of the second display screen 61B as the first operation unit 121. When the second display screen 61B is displaying the first setting screen Q2, the controller 72B1 does not display the app icon 121a, which is the application, and instead displays the fourth operation unit 124 on the second display screen 61B.
[0128] Figure 11C shows the second setting screen Q3 in the second display state S2. When the operator U1 operates the app icon 121b (Figs. 11A, 11B, 11D) (event E2 occurs), the controller 72B1 causes the second setting screen Q3 to be displayed on the second display screen 61B. The controller 72B1 causes an app screen 122b that can operate a second application to be displayed as the second operation unit 122 in the second display area 110D of the second display screen 61B. Further, the controller 72B1 causes app icons 121a, 121c, etc. to be displayed as the first operation unit 121 in the first display area 110E of the second display screen 61B. When the second display screen 61B is displaying the second setting screen Q3, the controller 72B1 does not display the app icon 121b that is the application, and causes the fourth operation unit 124 to be displayed on the second display screen 61B.
[0129] Figure 11D shows the third setting screen Q4 in the second display state S2. When the operator U1 operates the app icon 121c (Figs. 11A, 11B, 11D) (event E3 occurs), the controller 72B1 causes the third setting screen Q4 to be displayed on the second display screen 61B. The controller 72B1 causes an app screen 122c that can operate a third application to be displayed as the second operation unit 122 in the second display area 110D of the second display screen 61B. Further, the controller 72B1 causes app icons 121a, 121b, etc. to be displayed as the first operation unit 121 in the first display area 110E of the second display screen 61B. When the second display screen 61B is displaying the third setting screen Q4, the controller 72B1 does not display the app icon 121c that is the application, and causes the fourth operation unit 124 to be displayed on the second display screen 61B.
[0130] Figure 11A shows the home screen Q1 in the first display state S1. When the operator U1 operates the fourth operation unit 124 (Figs. 11B, 11C, 11D) (event E4 occurs), the controller 72B1 causes the home screen Q1 to be displayed on the second display screen 61B. The controller 72B1 does not display the fourth operation unit 124 in the area 110A of the second display screen 61B, but instead displays app icons 121a, 121b, 121c, etc. as the first operation unit 121.
[0131] As described above, when the operator U1 operates the first operation unit 121 or the fourth operation unit 124, the controller 72B1 can switch (transition) between the home screen Q1 in the first display state S1 and the first setting screen Q2, the second setting screen Q3, and the third setting screen Q4 in the second display state S2 and display them on the second display screen 61B. Also, the first setting screen Q2, the second setting screen Q3, and the third setting screen Q4 can be switched without going through the home screen Q1.
[0132] Details of the second operation unit 122 and the third operation unit 123 operated on the second display screen 61B will be described below.
[0133] As shown in Figs. 10A, 11B to 11D, in the second display state S2 (the first setting screen Q2 to the third setting screen Q4), the controller 72B1, in addition to the first operation unit 121 and the second operation unit 122, displays a third operation unit 123 for operating the functions of the application in the third display area 110C of the second display screen 61B. As shown in Figs. 10A, 11A, the controller 72B1 displays the third operation unit 123 in the third display area 110C in the first display state S1 (the home screen Q1) in addition to the first operation unit 121. The third operation unit 123 includes function icons (images) 123a to 123o indicating the functions of the application. Function icons 123a to 123o for operating the functions of the application are arranged side by side in the third display area 110C.
[0134] The function icon 123a indicates the function of switching between the start (ON) and stop (OFF) of the air conditioner 74. The function icon 123b indicates the function of switching between starting (ON) the air conditioner 74 to maximize the air volume of the conditioned air and stopping (OFF) the air conditioner 74. The function icon 123c indicates the function of switching between the internal air circulation and the introduction of outside air of the air conditioner 74.
[0135] The function icon 123d indicates the function of switching between the blowing (ON) and stopping (OFF) of the conditioned air to the front panel of the defogging device 77. The function icon 123e indicates the function of switching between the blowing (ON) and stopping (OFF) of the conditioned air to the rear panel of the defogging device 77.
[0136] The function icon 123f indicates the function of switching between starting (ON) the air conditioner 74 to automatically control the air volume and temperature of the conditioned air and stopping (OFF) the air conditioner 74.
[0137] The function icon 123g indicates the function of switching between turning on (ON) and turning off (OFF) the lighting devices 30 (for example, boom lights 18, headlamps 19) that can illuminate the front of the machine body 2. The function icon 123h indicates the function of switching between turning on (ON) and turning off (OFF) the lighting devices 30 (for example, side lights 20L, 20R, rear lights 21) that are arranged on the main body of the machine body 2 and can illuminate the vicinity of the main body of the machine body 2.
[0138] The function icon 123i indicates the function of switching whether to set the operation limit in the arm dump direction for the arm 16 in the control unit 70. The function icon 123j indicates the function of switching whether to set the operation limits in the arm dump direction and the arm cloud direction for the arm 16 in the control unit 70.
[0139] The function icon 123k indicates the function of switching between the operation (ON) and the operation stop (OFF) of the front wiper 76a in the wiper device 76. The function icon 123l indicates the function of switching between the operation (ON) and the operation stop (OFF) of the rear wiper 76b in the wiper device 76.
[0140] The function icon 123m indicates the function of switching between the operation (ON) and the operation stop (OFF) of the crane mode in the control unit 70.
[0141] The function icon 123n indicates the function of switching between the operation (ON) and the operation stop (OFF) of the rotating lamp 22.
[0142] The function icon 123o indicates the function of switching between locking and unlocking in the locking device 78.
[0143] The controller 72B1 can cause the third operation unit 123 to display a function different from the application displayed on the second operation unit 122. For example, as shown in FIG. 11C (second setting screen Q3), the controller 72A1 displays an application screen 122b for operating the second application as the second operation unit 122, and displays a function icon 123a (third operation unit 123) for operating the start (ON) and stop (OFF) of the air conditioner 74, which is a function of the first application.
[0144] Note that the controller 72A1 may vary the display of the third operation unit 123 (function icons 123a to 123o) according to the setting screen. For example, as shown in FIG. 11A (home screen Q1), the controller 72A1 displays the function icon 123o. As shown in FIG. 12B (first setting screen Q2), the controller 72A1 does not display the function icon 123o.
[0145] The controller 72B1 causes the second operation unit 122 to display a plurality of function operation members (images) for operating a plurality of functions of the selected application respectively.
[0146] As shown in FIG. 11B, the controller 72B1 causes the function operation members 122a1 and 122a2 to be displayed on the application screen 122a. The function operation member 122a1 indicates an operation for switching between the start (ON) and stop (OFF) of the operation of the air conditioner 74 of the air conditioner 74. The function operation member 122a1 indicates an operation for switching between the start (ON) and stop (OFF) of the automatic control of the air conditioner 74.
[0147] As shown in FIG. 11C, the controller 72B1 causes the function operation members 122b1 and 122b2 to be displayed on the application screen 122b. The function operation member 122b1 indicates an operation for switching the reception frequency of the radio of the audio device 75. The function operation member 122b2 indicates an operation for switching the operation of the audio device 75 to any one of AM broadcast, FM broadcast, and connection to an external terminal.
[0148] As shown in FIG. 11D, the controller 72B1 causes the function operation members 122c1 and 122c2 to be displayed on the application screen 122c. Operations of the function operation members 122c1 and 122c2 will be described later.
[0149] The controller 72B1 causes the operation unit 120 for operating the selected application to be displayed as the second operation unit 122 on the third operation unit 123, and displays the same functions operably. For example, as shown in FIG. 11B (the first setting screen Q2), the function operation member 122a1 of the second operation unit 122 and the function icon 123a of the third operation unit 123 indicate the same function of switching between the start (ON) and stop (OFF) of the operation of the air conditioner 74. The controller 72B1 causes the function operation member 122a1 and the function icon 123a to be simultaneously displayed on the second display screen 61B.
[0150] Note that the controller 72B1 may simultaneously display on the second operation unit 122 a function operation member for operating the same function as the operation content (function) received by the operating tool 62. For example, as shown in FIG. 11C (second setting screen Q3), the function operation member 122c1 and the operating tool 62L indicate the function of switching the reception frequency of the radio.
[0151] Hereinafter, the operations received by the event handler 72B2 will be described. The event handler 72B2 receives operation inputs related to the device X. Specifically, when the operator U1 operates the operation unit 120 (the first operation unit 121, the second operation unit 122, the third operation unit 123, the fourth operation unit 124), the event handler 72B2 detects that the operation unit 120 has been operated (an event has occurred). When the event handler 72B2 detects that the operation unit 120 has been operated, it inputs an instruction signal for performing an operation process on the device X corresponding to the operation unit 120 to the control unit 70 or the controller 72B1.
[0152] Specifically, when the operator U1 operates the app icon 121a (FIG. 5), the event handler 72B2 detects that the app icon 121a has been operated. Subsequently, the event handler 72B2 inputs an instruction signal for displaying the first setting screen Q2 to the controller 72B1. The controller 72B1 displays the first setting screen Q2 (FIG. 11B) on the second display screen 61B.
[0153] Also, when the operator U1 operates the function icon 123a, the event handler 72B2 detects that the function icon 123a has been operated. Subsequently, the event handler 72B2 inputs an instruction signal for switching between the start (ON) and stop (OFF) of the operation of the air conditioner 74 to the control unit 70. The control unit 70 controls the operation of the air conditioner 74 according to the instruction signal input by the event handler 72B2.
[0154] Also, on the first setting screen Q2, when the operator U1 operates the function operation member 122a1, the event handler 72B2 detects that the function operation member 122a1 has been operated. Subsequently, the event handler 72B2 inputs an instruction signal for switching between the blowing (ON) and stopping (OFF) of the conditioned air from the blowing unit 52A (Fig. 4) to the control unit 70. The control unit 70 controls the operation of the air conditioner 74 according to the instruction signal input by the event handler 72B2.
[0155] In addition to the operation unit 120, the event handler 72B2 accepts an operation on the operation tool 62 provided on the second display screen 61B as an operation input related to the device X. The operation target by the operation tool 62 can be selectively switched (changed) from among the devices X according to the operation on the operation unit 120 (the first operation unit 121, the second operation unit 122, the third operation unit 123, the fourth operation unit 124). The controller 72B1 displays a second image (application icons 121a to 121c, function operation members 122a1, 122a2, 122b1, 122b2, 122c1, 122c2, function icons 123a to 123o) indicating the operation target (a plurality of devices X) on the second display image (second display screen) 61B as the operation unit 120. When the operation unit 120 is operated (when the second image is selected), the event handler 72B2 changes the operation input received by the operation tool 62 according to the application or the device X that is the operation target selected by the operation unit 120.
[0156] When the event handler 72B2 changes the operation target of the operation tool 62, it inputs an instruction signal for changing the display of the operation target of the operation tool 62 to the controller 72A1. The controller 72A1 changes the display indicating the operation target of the operation tool 62 on the second display screen 61B based on the instruction signal input from the event handler 72B2 (according to the selected device X).
[0157] For example, as shown in FIG. 11D, the controller 72A1 displays first images 62L1, 62L2, 62R1, and 62R2 indicating the operation content (operation target) received by the operating tool 62 in the vicinity of the operating tool 62. When an instruction signal from the event handler 72B2 is input, the controller 72B1 performs control to switch (change) the display of the first images 62L1, 62L2, 62R1, and 62R2 located in the vicinity of the operating tool 62 based on the instruction signal.
[0158] As described above, a through hole is formed in the central portion of the operating tool 62, and the operator U1 can visually recognize the display inside the cylinder of the operating tool 62 on the second display screen 61B. Specifically, the central portion of the operating tool 62L is the region 110F (FIG. 10A), and the operator U1 can visually recognize the display of the region 110F. The controller 72B1 displays a first image 62L1 indicating the operation target received by the operating tool 62L in the region 110F of the second display screen 61B.
[0159] The central portion of the operating tool 62R is the region 110G (FIG. 10A), and the operator U1 can visually recognize the region 110G. The controller 72B1 displays a first image 62R1 indicating the operation target received by the operating tool 62R in the region 110G of the second display screen 61B.
[0160] As shown in FIGS. 10A, 11A (home screen Q1), and 11B (first setting screen Q2), the controller 72B1 displays a first image 62L1 indicating an air volume adjustment operation in the region 110F where the operating tool 62L is arranged. The controller 72B1 displays a first image 62R1 indicating a temperature adjustment operation in the region 110G where the operating tool 62R is arranged.
[0161] Note that the controller 72B1 may also display current information regarding the function received by the operating tool 62 together with the operation target by the operating tool 62. For example, as shown in FIGS. 11A (home screen Q1) and 11B (first setting screen Q2), the controller 72B1 displays the current set temperature information set in the air conditioner 74 as a first image 62R1 in the region 110F of the second display screen 61B.
[0162] The controller 72B1 displays first images 62L2 and 62R2 indicating an operation target by the operating tool 62 in an area near the operating tool 62. For example, as shown in FIGS. 10A and 11D (third setting screen Q4), the controller 72B1 displays the first images 62L2 and 62R2 indicating that the control valve 31 for adjusting the first supply flow rate and the second supply flow rate is the operation target in areas 110Fa and 110Ga of the second display screen 61B near the operating tool 62.
[0163] As shown in FIG. 12A, the storage unit 72B3 stores a table T1 associated with an operation target that accepts an operation input by the operating tool 62 for each operation screen, and first images 62L1, 62L2, 62R1, and 62R2 indicating the operation target. For example, the event handler 72B2 refers to the table T1 according to the application selected by the first operation unit 121 and switches the operation target accepted by the operating tool 62. When the operator U1 rotates the operating tool 62, the event handler 72B2 detects the rotation direction and the operation amount of the operating tool 62. The event handler 72B2 converts the detected operation amount into an instruction signal according to the table T1 and inputs it to the control unit 70. The control unit 70 performs control according to the input instruction signal.
[0164] Specifically, when the operator U1 operates the app icon 121a (when the first application is selected and operated by the first operation unit 121), the event handler 72B2 refers to the table T1 and changes the operation target received by the operating tool 62L to an operation for adjusting the air volume of the air conditioner, and changes the operation target received by the operating tool 62R to an operation for adjusting the temperature of the air conditioner. The event handler 72B2 inputs an instruction signal for causing the controller 72B1 to display the first setting screen Q2. Based on the instruction signal of the event handler 72B2 and the table T1, the controller 72B1 causes the first setting screen Q2 to be displayed on the second display screen 61B. Specifically, the controller 72B1 displays a first image 62L1 indicating an operation for adjusting the air volume of the air conditioner in the area 110F of the second display screen 61B. The controller 72B1 displays a first image 62R1 indicating an operation for adjusting the temperature of the air conditioner in the area 110G of the second display screen 61B.
[0165] On the first setting screen Q2, when the operator U1 rotates the operating tool 62L, the event handler 72B2 detects the rotation direction and the operation amount of the operating tool 62L. The event handler 72B2 converts the rotation direction and the operation amount detected by the operating tool 62L into an instruction signal for controlling the air volume of the air conditioner 74. The event handler 72B2 inputs an instruction signal for controlling the air volume of the air conditioner 74 to the control unit 70.
[0166] On the first setting screen Q2, when the operator U1 rotates the operating tool 62R, the event handler 72B2 detects the rotation direction and the operation amount of the operating tool 62R. The event handler 72B2 converts the rotation direction and the operation amount detected by the operating tool 62R into an instruction signal for controlling the temperature of the air conditioner 74. The event handler 72B2 inputs an instruction signal for controlling the temperature of the air conditioner 74 to the control unit 70.
[0167] When the operator U1 operates the application icon 121b (when the second application is selected and operated by the first operation unit 121), the event handler 72B2 refers to the table T1, changes the operation target received by the operation tool 62L to an operation for switching the reception frequency of the radio, and changes the operation target received by the operation tool 62R to an operation for adjusting the volume output to the speaker. The event handler 72B2 inputs an instruction signal for causing the controller 72B1 to display the second setting screen Q3. Based on the instruction signal of the event handler 72B2 and the table T1, the controller 72B1 causes the second setting screen Q3 to be displayed on the second display screen 61B. Specifically, the controller 72B1 displays a first image 62L1 indicating an operation for switching the reception frequency of the radio in the area 110F of the second display screen 61B. The controller 72B1 displays a first image 62R1 indicating an operation for adjusting the volume output to the speaker in the area 110G of the second display screen 61B.
[0168] Note that the event handler 72B2 may change the operation target received by the operation tool 62 according to the operation of the second operation unit 122.
[0169] As shown in FIG. 11D (the third setting screen Q4), when the operator U1 operates the function operation member 122c1 which is the second operation unit 122, the event handler 72B2 refers to the table T1, changes the operation received by the operation tool 62L to an operation for adjusting the first supply flow rate, and changes the operation target received by the operation tool 62R to an operation for adjusting the second supply flow rate.
[0170] When the operator U1 operates the function operation member 122c2 which is the second operation unit 122, the event handler 72B2 refers to the table T1, changes the operation received by the operation tool 62L to an operation for adjusting the third supply flow rate, and changes the operation content received by the operation tool 62R to an operation for adjusting the fourth supply flow rate.
[0171] In addition, the controller 72B1 refers to the table T1 in response to the operation of the second operation unit 122 (in response to the instruction signal from the event handler 72B2), and controls the switching of the first images 62L1, 62L2, 62R1, and 62R2 to be displayed on the second display screen 61B.
[0172] In the present embodiment, the case where the supply flow rate of the hydraulic oil to the first service port 41 and the second service port 42 is adjusted by the operating tools 62L and 62R has been described. However, the present invention is not limited to this, and the supply flow rate to actuators such as the dozer cylinder C1, the swing cylinder C2, the boom cylinder C3, the arm cylinder C4, the attachment cylinder C5, the swing motor MT, the first travel motor ML, and the second travel motor MR may be adjusted by the operating tools 62L and 62R.
[0173] In addition, when the event handler 72B2 and the controller 72B1 receive an operation on the fourth operation unit 124, they may switch between the operation target received by the operating tool 62 and the first image indicating the operation target of the operating tool 62. For example, as shown in FIG. 11A (home screen Q1) and FIG. 9, when the controller 72B1 displays the home screen Q1 on the second display screen 61B, the controller 72B1 displays the first images 62L1 and 62R1 indicating the air conditioning operation of the air conditioner 74 on the second display screen 61B. The event handler 72B2 switches the operation target received by the operating tool 62 to the operation of the air volume and temperature of the air conditioner 74.
[0174] As shown in FIG. 5, the second display device 60B has a vibration element 63. The event handler 72B2 controls the vibration element 63 to vibrate in response to an operation input to at least one of the operation unit 120 and the operating tool 62.
[0175] Specifically, when the operator U1 touches the operation unit 120 with a fingertip, the event handler 72B2 detects that the operation unit 120 has been operated. The event handler 72B2 inputs an operation instruction signal regarding the working machine 1 corresponding to the operation unit 120 to the control unit 70 and vibrates the vibration element 63 for a predetermined time. The predetermined time for vibrating the vibration element 63 is, for example, approximately 0.1 second, which is a relatively short time.
[0176] Note that the predetermined time for vibrating the vibration element 63 may be any time as long as the operator U1 can recognize that the operation input on the second display device 60B has been received, and it is not limited.
[0177] Also, while the operator U1 is pressing and holding the operation unit 120, the event handler 72B2 may continuously vibrate the vibration element 63. Specifically, when the event handler 72B2 detects contact with the operation unit 120, it starts (turns ON) the vibration of the vibration element 63. Also, when the event handler 72B2 no longer detects contact with the operation unit 120, it ends (turns OFF) the vibration of the vibration element 63.
[0178] While the operator U1 is operating the operating tool 62, the event handler 72B2 vibrates the vibration element 63. Specifically, when the operator U1 performs an operation of rotating the operating tool 62, the event handler 72B2 detects the operation amount and operation speed of the operating tool 62. The event handler 72B2 inputs an operation instruction signal regarding the working machine 1 corresponding to the operating tool 62 to the control unit 70 and vibrates the vibration element 63.
[0179] When an operation input is performed on the operating tool 62, the event handler 72B2 changes the vibration mode of the vibration element 63 with respect to the operation amount of the operating tool 62 according to the operation target of the operating tool 62. In the storage unit 72B3, a plurality of vibration modes with different vibration frequencies, vibration amplitudes, and vibration patterns are stored in advance as vibration modes.
[0180] Figs. 12B to 12E are diagrams showing the vibration states of the vibration element 63. As shown in Figs. 12B and 12C, the vibration mode M1 and the vibration mode M2 have different vibration frequencies. As shown in Figs. 12B and 12D, the vibration mode M1 and the vibration mode M3 have different vibration amplitudes. As shown in Figs. 12B and 12E, the vibration mode M4 vibrates (vibration ON) at substantially the same vibration frequency and vibration amplitude as the vibration mode M1 for a predetermined time t1, and periodically repeats stopping the vibration (vibration OFF) for a predetermined time t2. That is, the vibration pattern of the vibration mode M1 and the vibration mode M4 is different.
[0181] For example, as shown in Fig. 12A, the table T1 stores the operation targets for the operating tool 62 and the vibration modes M1 to M4 in association with each other. When the operator U1 rotates the operating tool 62, the event handler 72B2 refers to the table T1 and acquires the vibration mode corresponding to the operation target (device) selected as the operation target. The event handler 72B2 vibrates the vibration element 63 based on the acquired vibration mode.
[0182] The event handler 72B2 changes the vibration frequency or the vibration amplitude of the vibration element 63 according to at least one of the operation speed and the operation amount with respect to the operating tool 62.
[0183] For example, the event handler 72B2 switches the vibration mode in two stages when the operation speed with respect to the operating tool 62 is less than a predetermined value v1 and when it is v1 or more. The event handler 72B2 switches the vibration mode in two stages when the operation amount with respect to the operating tool 62 is less than a predetermined value n1 and when it is n1 or more. Note that the number of stages described above is an example and is not limited.
[0184] As shown in FIG. 12A, on the table T1, the operating speed and operating amount for the operating tool 62 are associated with and stored together with the vibration mode. When the operator U1 operates to rotate the operating tool 62, the event handler 72B2 detects the operating amount and operating speed of the operating tool 62. The event handler 72B2 refers to the table T1, obtains the vibration mode corresponding to the operation target of the operating tool 62, the operating amount of the operating tool 62, and the operating speed of the operating tool 62, and vibrates the vibration element 63.
[0185] Note that the event handler 72B2 may continuously change the vibration frequency and / or vibration amplitude of the vibration element 63 according to the operating speed and / or operating amount. For example, in advance, in the storage unit 72B3, as one of the vibration modes, an arithmetic expression using the operating speed and / or operating amount for the operating tool 62 as weighted values is stored in association with the table T1. When the operator U1 operates to rotate the operating tool 62, the event handler 72B2 refers to the table T1 to obtain the arithmetic expression (vibration mode). The event handler 72B2 calculates the vibration frequency and / or vibration amplitude using the operating speed and / or operating amount and the arithmetic expression. The event handler 72B2 vibrates the vibration element 63 based on the calculated vibration frequency and / or vibration amplitude.
[0186] [Second Embodiment] In the above-described first embodiment, the case where the working machine 1 includes the first display device 60A and the second display device 60B has been described. However, when the working machine 1 has only the second display device 60B, information regarding the working machine 1 may be displayed on the second display screen 61B (display screen 61B). Hereinafter, regarding the working machine 1 of the second embodiment, the description will focus on the configuration different from the above-described embodiment (first embodiment), and the same reference numerals will be given to the configurations common to the first embodiment, and the detailed description thereof will be omitted.
[0187] FIG. 13 is a control block diagram in the second embodiment. The working machine 1 in the second embodiment includes a display device 60B (second display device 60B) having a display screen 61B, and a display control device 72B (controller 72B1, event handler 72B2, storage unit 72B3) that controls the display of the display device 60B.
[0188] The controller 72B1 can transition the display screen 61B from the first display state S1 to the second display state S2. For example, when the controller 72B1 is displaying the home screen Q1 in the first display state S1 on the display screen 61B (FIG. 14A), if the operator U1 operates the app icon 121b of the first operation unit 121, the controller 72B1 will transition the display screen 61B from the first display state S1 to the second setting screen Q3 in the second display state S2 (FIG. 14B).
[0189] The controller 72B1 can transition the display screen 61B from the second display state S2 to the first display state S1. For example, when the controller 72B1 is displaying the second setting screen Q3 in the second display state S2 (FIG. 14B), if the operator U1 operates the fourth operation unit 124, the controller 72B1 will transition the display screen 61B from the second display state S2 to the home screen Q1 in the first display state S1 (FIG. 14A).
[0190] As shown in FIGS. 14A and 10B, in the first display state S1, the controller 72B1 displays the first operation unit 121 in the first display area 110E and displays the status information 90 of the working machine 1 in the second display area 110D.
[0191] In the first display area 110E of the display screen 61B, a plurality of app icons for receiving selection of the application to be operated are arranged side by side. In the second display area 110D, status information 90 indicating the status of the working machine 1 is arranged. Note that the sizes of the app icons do not have to be the same. For example, app icons with relatively high usage frequency may be displayed larger than those with relatively low usage frequency.
[0192] As shown in FIG. 14C, in the second display state S2, the controller 72B1 causes the first operation unit 121 to be displayed in the first display area 110E, and causes the second operation unit 122 to be superimposed and displayed on the state information 90 of the working machine 1 in the first display state S1 in the second display area 110D. For example, the controller 72B1 continues to display the state information 90 and causes the second operation unit 122 to be displayed. Further, the controller 72B1 may cause the second operation unit 122 subjected to a transparency process (making the background part transparent) to be displayed in the second display area 110D.
[0193] As shown in FIGS. 14A and 10B, when a warning condition occurs in the working machine 1, the controller 72B1 causes warning information 81 (message image 81a) regarding the warning condition to be displayed in the fourth display area 110H, which is an area above the operating tool 62. Note that the warning information 81 may be arranged at a position overlapping the first display area 110E and the second display area 110D. As shown in FIG. 14A, the controller 72B1 causes an icon image 81b indicating the type of abnormality to be displayed in the second display area 110D.
[0194] Further, the display control device 72B may arrange a setting operation unit 105 for receiving an input of the setting information of the working machine 1 in the first embodiment on the display screen 61B. The controller 72B1 causes a second switching operation unit 104 for selecting the display of the setting operation unit 105 to be displayed in the display area 110E as the first operation unit 121. As shown in FIG. 14D, when the operator U1 operates the second switching operation unit 104, the controller 72B1 causes a setting operation screen Q5 to be displayed on the display screen 61B. The controller 72B1 causes a setting operation unit 105 into which the setting information of the working machine 1 can be input to be displayed. The event handler 72B2 receives the setting information. The controller 72B1 causes a setting operation unit 105 for receiving an input of the setting information of the working machine 1 to be displayed in the second display area 110D. Note that the controller 72B1 may continue to display the state information 90 or the second operation unit 122 and superimpose and display the setting operation unit 105.
[0195] Note that the first display area 110E and the second display area 110D only need to be included in the second upper area 110A which is different from the area where the operating tool 62 is provided, and the ratio of the areas of the first display area 110E and the second display area 110D may be different between the second display state S2 and the first display state S1. As shown in FIGS. 14A and 14B, the first display area 110E where the first operation unit 121 is arranged in the second display state S2 is narrower than the first display area 110E in the first display state S1. Also, the second display area 110D where the second operation unit 122 is arranged in the second display state S2 is wider than the second display area 110D where the state information 90 is arranged in the first display state S1.
[0196] When the controller 72B1 transitions from the second display state S2 to the first display state S1, it narrows the second display area 110D where the state information 90 is arranged and widens the first display area 110E where the first operation unit 121 is arranged. When the controller 72B1 transitions from the first display state S1 to the second display state S2, it widens the second display area 110D where the second operation unit 122 is arranged and narrows the first display area 110E where the first operation unit 121 is arranged.
[0197] A preferred embodiment of the present invention provides the first display device 60A, the second display device 60B, the first display control device 72A, the second display control device 72B, the work machine 1, the program, and the recording medium thereof described in the following items.
[0198] (Item A1) A work machine 1 including a first display device 60A that displays information related to the work machine 1, and a second display device 60B that displays an operation unit 120 for performing an operation input on one or more devices X provided in the work machine 1 and receives an operation input to the operation unit 120, wherein the second display device 60B and the first display device 60A are arranged adjacent to each other.
[0199] According to the working machine 1 related to this item A1, since an operation can be performed on the operation unit 120 displayed on the second display device 60B arranged adjacent to the first display device 60A, the line-of-sight movement during operation can be reduced, and the convenience of the operator U1 can be improved. When the operator U1 checks the information on the first display device 60A while operating the operation unit 120 of the second display device 60B in his hand, the line-of-sight movement can be reduced, and the operation burden on the operator U1 can be alleviated. By separating the first display device 60A mainly for displaying information and the second display device 60B for displaying the operation unit 120 mainly for performing operations, the displayable area increases, and a lot of information can be displayed. In addition, the operator U1 can intuitively grasp whether it is information related to the working machine 1 or an interface for performing operations.
[0200] (Item A2) The first display device 60A is the working machine 1 described in item A1 that displays the status information 90 indicating the status of the working machine 1 as information related to the working machine 1. According to the working machine 1 related to this item A2, by displaying the information that can vary depending on the work near the second display device 60B on which the operator U1 is operating, the operator U1 can easily grasp the change in the status of the working machine 1 due to his own operation without moving his line of sight.
[0201] (Item A3) The first display device 60A is the working machine 1 described in item A2 that displays, as information related to the working machine 1, the status information 90 and the environmental information 100 indicating the environment around the working machine 1 and / or the guidance information 101 of the working machine 1. According to the working machine 1 related to this item A3, when visual recognition is performed by the driver's seat 6 while checking the situation around the working machine 1 and the guidance information 101 of the working machine 1, the movement of the line of sight can be suppressed, and the operation burden on the operator U1 can be alleviated.
[0202] (Item A4) The second display device 60B is the work machine 1 described in Item A1 that displays, as the operation unit 120, an operation unit 120 for performing an operation input for at least one or more devices X among the air conditioner 74, the audio device 75, the lighting device 30, the rotating lamp 22, the locking device 78, the wiper device 76, and the defogging device 77. According to the work machine 1 according to this Item A4, the worker U1 can perform an operation on at least one or more devices X among the air conditioner 74, the audio device 75, the lighting device 30, the rotating lamp 22, the locking device 78, the wiper device 76, and the defogging device 77 by operating the second display device 60B.
[0203] (Item A5) The second display device 60B is the work machine 1 described in any one of Items A1 to A4 in which a physical operating tool 62 for receiving an operation input protrudes from the second display device 60B. According to the work machine 1 according to this Item A5, the worker U1 can intuitively grasp that he / she is performing an operation and that the second display device 60B is receiving an operation.
[0204] (Item A6) The second display device 60B is the work machine 1 described in Item A5 that can receive operation inputs for a plurality of devices X and can selectively switch the operation target by the operating tool 62 among the plurality of devices X. According to the work machine 1 according to this Item A6, the worker U1 can perform an operation input by the operating tool 62 on different operation targets (devices).
[0205] (Item A7) The second display device 60B is the work machine 1 described in Item A6 that displays, as the operation unit 120, images indicating a plurality of devices X in a region different from the region where the operating tool 62 is provided, and selects, as the operation target by the operating tool 62, the device X corresponding to the image selected by the operation input. According to the work machine 1 according to this Item A7, the worker U1 can perform an operation input by the operating tool 62 on the device selected by the operation of the operation unit 120.
[0206] (Item A8) The operating tool 62 is a cylindrical dial provided rotatably in the circumferential direction, and the second display device 60B is the working machine 1 described in any one of Items A5 to A7 that receives the rotation direction and operation amount of the dial as operation inputs. According to the working machine 1 related to this Item A8, the operator U1 can perform operation inputs by rotating the operating tool 62.
[0207] (Item A9) The second display device 60B can receive operation inputs for a plurality of devices X, and can selectively switch the operation target by the operating tool 62, and is the working machine 1 described in Item A8 that displays an image indicating the operation target by the operating tool 62 inside the cylindrical tube. According to the working machine 1 related to this Item A9, the operation target of the operating tool 62 can be made recognizable to the operator U1.
[0208] (Item A10) A plurality of operating tools 62 are provided in the display screen 61B of the second display device 60B, which is the working machine 1 described in Item A9. According to the working machine 1 related to this Item A10, since operation targets can be assigned to the plurality of operating tools 62, the second display device 60B can receive more operation inputs. Thereby, the operator U1 can operate various devices X on the same display screen 61B.
[0209] (Item A11) The vertical length of the first display device 60A is longer than the vertical length of the second display device 60B, which is the working machine 1 described in Item A1. According to the working machine 1 related to this Item A11, by making the vertical length of the first display device 60A longer than the vertical length of the second display device 60B, the first display device 60A can be emphasized. That is, it can be made recognizable to the operator U1 that the first display device 60A is the main screen for displaying information, and the second display device 60B is the auxiliary screen mainly having the function of receiving operations.
[0210] (Item A12) The first display device 60A has a vertically long rectangular shape, and the second display device 60B has a horizontally long rectangular shape, which is the working machine 1 described in Item A11. According to the working machine 1 related to this Item A12, the operator U1 can perform a wide range of operations on the second display device 60B only by moving the wrist horizontally without stretching the arm. On the other hand, since the first display device 60A is vertically long and adjacent to the second display device 60B that receives operations, and is located on the line of sight of the operator U1, not only can the visibility be improved, but also a lot of information can be displayed.
[0211] (Item A13) The length of the side of the second display device 60B adjacent to the first display device 60A is substantially the same as the length of the side of the first display device 60A adjacent to the second display device 60B, which is the working machine 1 described in Item A12. According to the working machine 1 related to this Item A13, since the horizontal movement range of the operator U1's wrist is substantially the same for the first display device 60A and the second display device 60B, the working burden is reduced.
[0212] (Item A14) The first display device 60A has a function of receiving operation inputs by touch operations on the first display device 60A, and the second display device 60B has a function of receiving operation inputs by touch operations on the second display device 60B, which is the working machine 1 described in Item A1. According to the working machine 1 related to this Item A14, the operability of the first display device 60A and the second display device 60B is improved.
[0213] (Item A15) It is provided around the driver's seat 6 and includes a control device 12 that receives operations. The first display device 60A and the second display device 60B are arranged in front of the control device 12, which is the working machine 1 described in Item A1. According to the working machine 1 related to this Item A15, since the first display device 60A and the second display device 60B are located in front of the control device 12 such as a lever, the first display device 60A and the second display device 60B and the control device 12 can be arranged close to each other, and the area where the operator U1 moves the hand or arm to operate the working machine 1 can be reduced. Thereby, the operation burden of the operator U1 can be reduced, and the operability of the working machine 1 can be improved.
[0214] (Item B1) A display control device (second display control device) 72B including a display control unit (second display control unit) 72B1 that controls the display of a display device (second display device) 60B provided in the work machine 1. When a selection operation for selecting an application to be an operation target is not performed among a plurality of applications, the display control unit 72B1 displays a first operation unit 121 for performing the selection operation on a display screen (second display screen) 61B of the display device 60B as a first display state S1. When the selection operation is performed, as a second display state S2, the display control device 72B that displays a second operation unit 122 for operating the selected application and the first operation unit 121 on the display screen 61B.
[0215] According to the display control device 72B according to this Item B1, the first operation unit 121 for performing the selection operation of the application is displayed on the display device 60B both when the selection operation of the application to be the operation target is not performed and when the selection operation is performed. Therefore, the selection operation of the application can be easily performed regardless of the display state at that time, and the operability of the display device 60B of the work machine 1 can be improved.
[0216] (Item B2) The display control unit 72B1 is the display control device 72B according to Item B1 that displays the first operation unit 121 for performing the selection operation of an application other than the application corresponding to the second operation unit 122 among a plurality of applications in the second display state S2. According to the display control device 72B according to this Item B2, in the second display state S2 (application operation state) after the selection operation of the application is performed, the operator U1 can switch to a screen for operating another application by operating the first operation unit 121. For this reason, the operator U1 can select an application to be operated without performing a plurality of screen transition operations, and the operation burden can be reduced.
[0217] (Item B3) The display control unit 72B1 is the display control device described in Item B1 or Item B2 that, in the second display state S2, in addition to the first operation unit 121 and the second operation unit 122, displays a third operation unit 123 for operating an application different from the application corresponding to the second operation unit 122. According to the display control device 72B according to this Item B3, since a function different from the application operable by the second operation unit 122 can be operated, the operator U1 can execute the operation of the function without performing a selection operation of the application in order to execute the function, reducing the operation burden on the operator U1.
[0218] (Item B4) The display control unit 72B1 is the display control device 72B described in Item B1 that, as the second operation unit 122, displays a plurality of function operation members (122a1, 122a2, 122b1, 122b2, 122c1, 122c2) for respectively operating a plurality of functions of the selected application. According to the display control device 72B according to this Item B4, the operator U1 can operate a plurality of functions included in the application selected by the first operation unit 121 in parallel.
[0219] (Item B5) The display control unit 72B1 is the display control device 72B described in Item B3 that, when displaying a plurality of function operation members (122a1, 122a2, 122b1, 122b2, 122c1, 122c2) for respectively operating a plurality of functions of the selected application on the second operation unit 122 and displaying the operation unit for operating the application as the third operation unit 123, displays the operation unit for operating the application to be operable with the same function as when the operation unit for operating the application is displayed as the second operation unit 122.
[0220] According to the display control device 72B according to this Item B5, since the second operation unit 122 includes an interface for operating the same function as a one-touch button, the operator U1 can call a function by both the second operation unit 122 and the third operation unit 123. Therefore, the operator U1 can select and operate a desired function according to the line of sight and the state of the operator U1's hands.
[0221] (Item B6) The display control unit 72B1 in the display screen 61B of the second display state S2 displays a fourth operation unit 124 that accepts an operation for transition to the first display state S1. When the fourth operation unit 124 is operated, the display control device 72B described in any one of Items B1 to B5 that causes the display screen 61B to transition from the second display state S2 to the first display state S1. According to the display control device 72B related to this Item B6, the screen can be easily switched between the case of operating an application and the case of selecting an application.
[0222] (Item B7) The work machine 1 includes the display control device 72B described in any one of Items B1 to 6 and a display device 60B whose display is controlled by the display control device 72B. According to the work machine 1 related to this Item B7, the work machine 1 that exhibits the above-described advantageous effects can be realized.
[0223] (Item B8) A program for causing a computer to execute the processing of the display control unit 72B1 in the display control device 72B described in any one of Items B1 to 7. According to the program related to this Item B8, by causing the computer to execute the program, the display control device 72B that exhibits the above-described advantageous effects can be realized.
[0224] (Item B9) A storage medium in which the program described in Item B8 is recorded in a computer-readable manner. According to the storage medium related to this Item B9, by causing a computer to read and execute the program from the storage medium, the display control device 72B that exhibits the above-described advantageous effects can be realized.
[0225] (Item C1) A display control device (first display control device) 72A that controls the display of a display device (first display device) 60A provided in the work machine 1, comprising a display control unit (controller) 72A1 that causes information about the work machine 1 to be displayed on a display screen (first display screen) 61A of the display device 60A. The display control unit 72A1 simultaneously displays, in a lower region 80B of the display screen 61A, an aerial view image 91 of the work machine 1 viewed from above, and supplementary information 92 that supplements and shows the state of one or more devices X provided in the work machine 1 in the aerial view image 91, and at the same time, in an upper region 80A above the lower region 80B of the display screen 61A, environmental information 100 indicating information around the work machine 1 and / or guidance information 101 of the work machine 1. Display control device 72A.
[0226] According to the display control device 72A according to this Item C1, while operator U1 checks the state of device X of work machine 1, since the upper region 80A is located above the lower region 80B, the operator U1 can pay attention to the relatively more important environmental information 100 and / or guidance information 101. Also, by displaying the supplementary information 92 together with the aerial view image 91 showing the work machine 1, the operator U1 can intuitively grasp the state of the device X provided in the work machine 1.
[0227] (Item C2) The display control device 72A according to Item C1, wherein the display control unit 72A1 superimposes and displays the supplementary information 92 at a position corresponding to the position of the work machine 1 provided with the device X corresponding to the supplementary information 92 in the aerial view image 91. According to the display control device 72A according to this Item C2, the information indicating the state of the device X can be compactly arranged on the display screen 61A. Also, since the operator U1 can simultaneously visually recognize the state of the device X and the arrangement of the device X, the operator U1 can intuitively grasp the state of the device provided in the work machine 1.
[0228] (Item C3) The display control device 72A described in Item C1, where the supplementary information 92 includes at least one of the lighting status of the lighting device 30, the operation status of the wiper device 76, the operation status of the defogging device 77, the operation status of the rotating light 22, and the locking status of the locking device 78. According to the display control device 72A related to this Item C3, the operator U1 can grasp the status of at least one of the lighting device 30, the wiper device 76, the defogging device 77, the rotating light 22, and the locking device 78.
[0229] (Item C4) The display control device 72A described in Item C1, where the display control unit 72A1 overlays and displays an image (92a~92l) indicating the supplementary information 92 on the bird's-eye view image 91. According to the display control device 72A related to this Item C4, information indicating the status of the airframe 2 can be compactly arranged on the display screen 61A.
[0230] (Item C5) The display screen 61A is a vertically long rectangular shape, and the upper region 80A is larger than the lower region 80B in the display control device 72A described in Item C1. According to the display control device 72A related to this Item C5, while the operator U1 can check the status of the device X of the work machine 1, the operator U1 can pay attention to the relatively important environmental information 100 and / or guidance information 101.
[0231] (Item C6) The display control device 72A described in Item C1 or C2, where the display control unit 72A1 displays the first information 93 regarding the airframe 2 of the work machine 1 in one of the width directions (region 80D) of the bird's-eye view image 91 and the supplementary information 92 in the lower region 80B, and displays the second information 94 regarding the working device 4 of the work machine 1 in the other width direction (region 80E) of the bird's-eye view image 91 and the supplementary information 92 in the lower region 80B. According to the display control device 72A related to this Item C6, since the information displayed in the lower region 80B is partitioned by the bird's-eye view image 91 for each category of information, the operator U1 can appropriately grasp the information displayed in the lower region 80B.
[0232] (Item C7) The first information 93 is the display control device 72A described in Item C6 that includes any one or more of the remaining fuel quantity, battery charge state, engine or motor rotation speed, operating state of the auto - idle function, and shift state of the traveling device 3. According to the display control device 72A related to this Item C7, the operator U1 can grasp any one or more of the remaining fuel quantity, battery charge state, engine or motor rotation speed, operating state of the auto - idle function, and shift state of the traveling device 3 by visually recognizing the display device 60A.
[0233] (Item C8) The second information 94 is the display control device 72A described in Item 6 that includes any one or more of the type of the attachment 17 mounted on the working device 4, the setting status regarding the operation limit of the working device 4, and the flow rate setting status of the hydraulic oil supplied to the working device 4. According to the display control device 72A related to this Item C8, the operator U1 can grasp any one or more of the type of the attachment 17, the setting status regarding the operation limit of the working device 4, and the flow rate setting status of the hydraulic oil supplied to the working device 4 by visually recognizing the display device 60A.
[0234] (Item C9) The display control unit 72A1 is the display control device 72A described in any one of Items C1 - C8 that causes the warning information 81 related to the warning condition to be displayed between the lower region 80B and the upper region 80A or in the lower region 80B when a warning condition occurs in the working machine 1. According to the display control device 72A related to this Item C4, since the warning information 81 is displayed on the line of sight where the operator U1 moves the line of sight between the lower region 80B and the upper region 80A, the discriminability of the warning information 81 can be improved.
[0235] (Item C10) The display control unit 72A1 is the display control device 72A described in any one of Items C1 to C9 that causes the upper region 80A to display the environmental information 100, and causes the captured image 102 acquired by the imaging device 26 provided in the work machine 1 to be displayed as the environmental information 100. According to the display control device 72A according to this Item C5, since the bird's-eye view image 91 of the work machine 1 is displayed near the upper region 80A where the captured image 102 is displayed, the operator U1 can accurately recognize the state of the work machine 1 based on the bird's-eye view image 91 and the captured image 102.
[0236] (Item C11) The display control unit 72A1 is the display control device 72A described in any one of Items C1 to C10 that causes the first switching operation unit 103 that accepts an operation for switching the display of a plurality of captured images 102 acquired by a plurality of imaging devices 26 provided in the work machine 1 to be displayed. The first switching operation unit 103 is displayed above the upper region 80A. According to the display control device 72A according to this Item C11, by causing the first switching operation unit 103 for switching the imaging device 26 to be displayed in the upper region 80A where the captured image 102 is displayed, the operator U1 can intuitively understand that the first switching operation unit 103 has the function of switching the imaging device 26 and can perform the operation.
[0237] (Item C12) The display control unit 72A1 is the display control device 72A described in any one of Items C1 to C12 that can display the setting operation unit 105 that accepts the input of the setting information of the work machine 1 in the upper region 80A instead of the environmental information 100 and / or the guidance information 101 of the work machine 1, and causes the second switching operation unit 104 that accepts the switching operation of the display between the environmental information 100 and / or the guidance information 101 of the work machine 1 and the setting operation unit 105 to be displayed in the upper region 80A. According to the display control device 72A according to this Item C12, by causing the setting operation unit 105 that requires a detailed input operation to be displayed in the upper region 80A at the upper part of the display screen 61A and which is a large area, the operator U1 can easily perform the input.
[0238] (Item C13) The display control device 72A described in any one of Items C1 to C12, wherein an operation input to the device corresponding to the supplementary information 92 displayed on the display screen 61A can be performed by a touch operation on the supplementary information 92. According to the display control device 72A according to this Item C13, the operator U1 can easily perform the operation on the device indicated by the supplementary information 92.
[0239] (Item C14) The display control device 72A described in any one of Items C1 to C13, wherein an operation input of the setting information corresponding to the setting operation unit 105 can be performed by a touch operation on the setting operation unit 105 displayed on the display screen 61A. According to the display control device 72A according to this Item C13, the operator U1 can easily perform the operation input of the setting information.
[0240] (Item C15) The working machine 1 including the display control device 72A described in any one of Items C1 to 14 and the display device 60A whose display is controlled by the display control device 72A. According to the working machine 1 according to this Item C15, the working machine 1 having the above-described advantageous effects can be realized.
[0241] (Item C16) The working machine 1 described in Item C15, which is provided with an operation device 60B that is arranged below the display device 60A and receives the operation of the working machine 1. According to the working machine 1 according to Item C15, since the line-of-sight movement between the display device 60A and the operation device 60B is reduced, the operability is improved.
[0242] (Item C17) A program for causing a computer to execute the processing of the display control unit 72A1 in the display control device 72A described in any one of Items C1 to 4. According to the program according to this Item C17, by causing the computer to execute the program, the display control device 72A having the above-described advantageous effects can be realized.
[0243] (Item C18) A storage medium storing the program according to Item C17 in a computer-readable manner. According to the storage medium according to this Item C18, by causing a computer to read and execute the program from the storage medium, the display control device 72A that exhibits the above-described advantageous effects can be realized.
[0244] (Item D1) A working machine 1 including a first display device 60A and a second display device 60B arranged adjacent to each other, wherein the first display device 60A has a first display screen 61A for displaying information regarding the working machine 1 and a first display control unit (controller) 72A1 for controlling the display on the first display screen 61A, and the second display device 60B has a second display screen 61B for displaying information regarding one or more devices X provided in the working machine 1, a second display control unit (controller) 72B1 for controlling the display on the second display screen 61B, and an operation reception unit (event handler) 72B2 for receiving an operation input regarding the one or more devices X.
[0245] According to the working machine 1 according to this Item D1, the operator U1 can operate one or more devices X provided in the working machine 1 using the second display device 60B arranged adjacent to the first display device 60A. Therefore, the operator U1 does not need to greatly move the line of sight when operating the device X, and the operability of the operator U1 can be improved.
[0246] (Item D2) The working machine 1 according to Item D1, further including a physical operation tool 62 provided to protrude from the second display screen 61B on the second display screen 61B, and the operation reception unit 72B2 receives an operation on the operation tool 62 as an operation input. According to the working machine 1 according to this Item D2, the operator U1 can intuitively grasp that he / she is performing an operation and that the second display device 60B is receiving the operation, and the operability of the working machine 1 is improved.
[0247] (Item D3) The operation reception unit 72B2 receives a touch operation on the second display screen 61B as an operation input for the work machine 1 described in Item D1 or D2. According to the work machine 1 related to this Item D3, the operator U1 can easily perform operations on various devices X by touching the second display screen 61B, and the operability of the work machine 1 is improved.
[0248] (Item D4) The second display control unit 72B1 causes the second display screen 61B to display an operation unit 120 for performing a selection operation to select a device X to be an operation target by the operation tool 62 from among a plurality of devices X. The operation reception unit 72B2 receives an operation input to the operation unit 120 and changes the operation target by the operation tool 62 according to the device X selected by the operation unit 120, which is the work machine 1 described in Item D2. According to the work machine 1 related to this Item D4, according to the device X selected by the operation unit 120, the operator U1 can perform various operations using the operation tool 62. Therefore, the versatility of the operation tool 62 can be improved.
[0249] (Item D5) The second display control unit 72B1 is the work machine 1 described in D4 that changes the display in the vicinity of the operation tool 62 on the second display screen 61B according to the selected device X. According to the work machine 1 related to this Item D5, since the operator U1 can grasp the operation target of the operation tool 62, not only can the versatility of the operation tool 62 be improved, but also the operability can be improved.
[0250] (Item D6) The operation tool 62 is the work machine 1 described in any one of Items D2 to D5, which is a cylindrical dial rotatably provided in the circumferential direction. According to the work machine 1 related to this Item D6, since the operation amount can be adjusted by rotating the dial, the adjustment of the operation on the device X can be performed continuously or in multiple steps.
[0251] (Item D7) The operating tool 62 is a cylindrical dial rotatably provided in the circumferential direction, and the second display control unit 72B1 changes the display of the first images 62L1 and 62R1 indicating the operation target of the operating tool 62 located inside the cylindrical part of the operating tool 62 on the second display screen 61B according to the selected device X. According to the working machine 1 related to this item D7, not only can the operation on the device X be performed continuously or in multiple steps, but also the operator U1 can easily grasp the operation target of the operating tool 62 by visually recognizing the operating tool 62, so the operability of the working machine 1 is improved.
[0252] (Item D8) The second display control unit 72B1 changes the display of the first images 62L2 and 62R2 near the operating tool 62 according to the selected device X. According to the working machine 1 related to this item D8, not only can the operation on the device X be performed continuously or in multiple steps, but also the operator U1 can easily grasp the operation target of the operating tool 62 by visually recognizing the vicinity of the operating tool 62, so the operability of the working machine 1 is improved.
[0253] (Item D9) The second display control unit 72B1 causes the operation unit 120 to display a second image indicating one or more devices X in an area different from the area where the operating tool 62 is provided on the second display screen 61B, and the operation reception unit 72B2 selects the device X corresponding to the selected image as the operation target by the operating tool 62. According to the working machine 1 related to this item D9, various operations can be performed using the operating tool 62 according to the selected device X. Therefore, the versatility of the operating tool 62 can be improved.
[0254] (Item D10) The working machine 1 described in Items D2 to D9 having a plurality of operating tools 62. According to the working machine 1 related to this item D10, since the operation target can be assigned to the plurality of operating tools 62, the second display device 60B can receive more operation inputs. As a result, the operator U1 can operate various devices X on the second display screen 61B.
[0255] (Item D11) The second display device 60B has a vibration element 63, and the operation reception unit 72B2 vibrates the vibration element 63 in accordance with an operation input to the operating tool 62 according to any one of Items D2 to D10 of the working machine 1. According to the working machine 1 related to this Item D11, the operator U1 can easily grasp that the operation by the operating tool 62 has been received by the vibration of the vibration element 63.
[0256] (Item D12) The operation reception unit 72B2 can select a device X to be an operation target by the operating tool 62 from among a plurality of devices X, and when an operation input to the operating tool 62 is performed, the vibration element 63 is vibrated in a manner corresponding to the device X selected as the operation target by the operating tool 62 according to Item D11 of the working machine 1. According to the working machine 1 related to this Item D12, in addition to the operator U1 being able to intuitively understand that the operation by the operating tool 62 has been received, the operator U1 can easily grasp which operation target (device X) the operation has been performed on by the difference in the vibration state of the vibration element 63.
[0257] (Item D13) The operation reception unit 72B2 changes the vibration frequency or vibration amplitude of the vibration element 63 according to at least one of the operation speed and operation amount of the operating tool 62 according to any one of Claims D11 or D12 of the working machine 1. According to the working machine 1 related to this Item D13, in addition to the operator U1 being able to intuitively understand that the operation by the operating tool 62 has been received, the operator U1 can grasp the operation amount received by the operating tool 62 by the difference in the vibration of the vibration element 63.
[0258] (Item D14) The operation reception unit 72B2 changes the vibration frequency or vibration amplitude of the vibration element 63 according to the device selected as the operation target by the operating tool 62 according to the working machine 1 of Item E12. According to the working machine 1 related to this Item D14, in addition to the operator U1 being able to intuitively understand that the operation by the operating tool 62 has been received, the operator U1 can easily grasp which working target (device X) the operation has been performed on by the difference in the vibration of the vibration element 63.
[0259] (Item D15) The working machine 1 according to any one of Items D1 to D14 includes one or more devices X among the air conditioner 74, the audio device 75, the lighting device 30, the rotating lamp 22, the wiper device 76, the defogging device 77, and the locking device 78. According to the working machine 1 related to this Item D15, the operator U1 can operate one or more of the devices among the air conditioner 74, the audio device 75, the lighting device 30, the rotating lamp 22, the wiper device 76, the defogging device 77, and the locking device 78 by operating the second display device 60B.
[0260] (Item D16) The first display control unit 72A1 is the working machine 1 according to any one of Items D1 to D15 that causes the first display screen 61A to display the state information 90 indicating the state of the working machine 1, the environmental information 100 indicating the information around the working machine 1, and / or the guidance information 101 of the working machine 1. According to the working machine 1 related to this Item D16, when the operator U1 checks the information displayed on the first display screen 61A while operating the second display device 60B in hand, the line-of-sight movement can be reduced, and the operation burden on the operator U1 can be reduced.
[0261] (Item D17) A program for causing a computer to execute the processing of the first display control unit 72A1, the second display control unit 72B1, and the operation reception unit 72B2 in the working machine 1 according to any one of Items D1 to D16. According to the program related to this Item D17, by causing the computer to execute the program, a working machine 1 having the above-described advantageous effects can be realized.
[0262] (Item D18) A storage medium in which the program described in Item D17 is recorded in a computer-readable manner. According to the storage medium related to this Item D18, by causing the computer to read and execute the program from the storage medium, a working machine 1 having the above-described advantageous effects can be realized.
[0263] Working machine 1 including a display device (second display device) 60B, wherein the display device 60B has a display control unit 72B1 that causes an operation unit 120 for performing operations on information regarding the working machine 1 and one or more devices X provided in the working machine 1 to be displayed on a display screen 61B of the display device 60B, and an operation reception unit 72B2 that receives operation inputs to the operation unit 120.
[0264] According to the working machine 1 according to this item E1, since the operator U1 can perform operations on one or more devices X provided in the working machine 1 using the display device 60B on which information regarding the working machine 1 is displayed, there is no need to greatly move the line of sight when operating the device X, and the operability of the working machine 1 can be improved.
[0265] (Item E2) The working machine 1 according to item E1, including a physical operation tool 62 provided protruding from the display screen 61B on the display screen 61B, and the operation reception unit 72B2 receives an operation on the operation tool 62 as an operation input. According to the working machine 1 according to this item E2, the operator U1 can intuitively grasp that he / she is performing an operation and that the display device 60B is receiving the operation, and the operability of the working machine 1 is improved.
[0266] (Item E3) The working machine 1 according to item E1 or E2, wherein the operation reception unit 72B2 receives a touch operation on the display screen 61B as the operation input. According to the working machine 1 according to this item E3, the operator U1 can easily perform operations on various devices X by touching the display screen 61B, and the operability of the working machine 1 is improved.
[0267] (Item E4) The display control unit 72B1 causes the operation unit 120 for performing a selection operation to select a device X to be an operation target by the operation tool 62 from among a plurality of devices X to be displayed on the display screen 61B. The operation reception unit 72B2 receives an operation input to the operation unit 120 and changes the operation target by the operation tool 62 according to the device X selected by the operation unit 120, which is the working machine 1 described in Item E2. According to the working machine 1 according to this Item E4, the operator U1 can perform various operations using the operation tool 62 according to the device X selected by the operation unit 120. Therefore, the versatility of the operation tool 62 can be improved.
[0268] (Item E5) The display control unit 72B1 is the working machine 1 described in E4 that changes the display near the operation tool 62 on the display screen 61B according to the selected device X. According to the working machine 1 according to this Item E5, since the operator U1 can grasp the operation target of the operation tool 62, not only can the versatility of the operation tool 62 be improved, but also the operability can be improved.
[0269] (Item E6) The operation tool 62 is the working machine 1 described in any one of Items E2 to E5, which is a cylindrical dial rotatably provided in the circumferential direction. According to the working machine 1 according to this Item E6, since the operation amount can be adjusted by rotating the dial, the operation on the device X can be performed continuously or in multiple steps.
[0270] (Item E7) The operation tool 62 is a cylindrical dial rotatably provided in the circumferential direction, and the display control unit 72B1 is the working machine 1 described in Item E5 that changes the display of the first images 62L1 and 62R1 indicating the operation target of the operation tool 62 located inside the cylindrical tube of the operation tool 62 on the second display screen 61B according to the selected device X. According to the working machine 1 according to this Item E7, not only can the operation on the device X be performed continuously or in multiple steps, but also since the operator U1 can easily grasp the operation target of the operation tool 62 by visually recognizing the operation tool 62, the operability of the working machine 1 is improved.
[0271] (Item E8) The display control unit 72B1 is the working machine 1 described in Item E5 that changes the display of the first images 62L2 and 62R2 indicating the operation target of the operating tool 62 located near the operating tool 62 according to the selected device X. According to the working machine 1 according to this Item E8, not only can the operation on the device X be performed continuously or in multiple steps, but also the operator U1 can easily grasp the operation target of the operating tool 62 by visually recognizing the vicinity of the operating tool 62. Therefore, the operability of the working machine 1 is improved.
[0272] (Item E9) The display control unit 72B1 displays a second image indicating one or more devices X as an operation unit 120 in an area different from the area where the operating tool 62 is provided on the display screen 61B, and the operation reception unit 72B2 selects the device X corresponding to the selected image as an operation target by the operating tool 62. This is the working machine 1 described in Item E4. According to the working machine 1 according to this Item E9, various operations can be performed using the operating tool 62 according to the selected device X. Therefore, the versatility of the operating tool 62 can be improved.
[0273] (Item E10) The working machine 1 described in any one of Items E2 to E9 having a plurality of operating tools 62. According to the working machine 1 according to this Item E10, since the operation target can be assigned to the plurality of operating tools 62, the display device 60B can receive more operation inputs. As a result, the operator U1 can operate various devices X on the display screen 61B.
[0274] (Item E11) The display device 60B has a vibration element 63, and the operation reception unit 72B2 vibrates the vibration element 63 according to an operation input to the operating tool 62. This is the working machine 1 described in any one of Items E2 to E10. According to the working machine 1 according to this Item E11, the operator U1 can easily grasp that the operation by the operating tool 62 has been received by the vibration of the vibration element 63.
[0275] (Item E12) The operation reception unit 72B2 can select a device X to be an operation target by the operating tool 62 from among a plurality of devices X, and when an operation input to the operating tool 62 is performed, the vibration element 63 is vibrated in a manner corresponding to the device X selected as the operation target by the operating tool 62, which is the working machine 1 described in Item E11. According to the working machine 1 according to this Item E12, in addition to the operator U1 being able to intuitively understand that the operation by the operating tool 62 has been received, the operator U1 can easily grasp which operation target (device X) the operation has been performed on based on the difference in the vibration state of the vibration element 63.
[0276] (Item E13) The operation reception unit 72B2 changes the vibration frequency or vibration amplitude of the vibration element 63 according to at least one of the operation speed and operation amount with respect to the operating tool 62, which is the working machine 1 described in Claim E11. According to the working machine 1 according to this Item E13, in addition to the operator U1 being able to intuitively understand that the operation by the operating tool 62 has been received, the operator U1 can grasp the operation amount received by the operating tool 62 based on the difference in the vibration of the vibration element 63.
[0277] (Item E14) The operation reception unit 72B2 changes the vibration frequency or vibration amplitude of the vibration element 63 according to the device selected as the operation target by the operating tool 62, which is the working machine 1 described in Item E12. According to the working machine 1 according to this Item E14, in addition to the operator U1 being able to intuitively understand that the operation by the operating tool 62 has been received, the operator U1 can easily grasp which working target (device X) the operation has been performed on based on the difference in the vibration of the vibration element 63.
[0278] (Item E15) One or more devices X include one or more of an air conditioner 74, an audio device 75, a lighting device 30, a rotating lamp 22, a wiper device 76, a defogging device 77, and a locking device 78, which is the working machine 1 described in any one of Items E1 to E14. According to the working machine 1 according to this Item E15, the operator U1 can operate one or more of the devices including the air conditioner 74, the audio device 75, the lighting device 30, the rotating lamp 22, the wiper device 76, the defogging device 77, and the locking device 78 by operating the second display device 60B.
[0279] (Item E16) A program for causing a computer to execute the processes of the display control unit 72B1 and the operation reception unit 72B2 in the working machine 1 according to any one of Items E1 to E15. According to the program according to this Item E16, by causing the computer to execute this program, the working machine 1 that exhibits the above-described advantageous effects can be realized.
[0280] (Item E17) A storage medium in which the program according to Item E16 is recorded in a computer-readable manner. According to the storage medium according to this Item E17, by causing the computer to read and execute the program from the storage medium, the working machine 1 that exhibits the above-described advantageous effects can be realized.
[0281] As described above, the present invention has been explained. However, it should be considered that the embodiments disclosed this time are illustrative in all respects and not restrictive. The scope of the present invention is indicated not by the above description but by the claims, and it is intended that all modifications within the meaning and scope equivalent to the claims are included.
Explanation of Reference Numerals
[0282] 1: Working machine 2: Machine body 4: Working device 3: Traveling device 17: Attachment 22: Rotating lamp 26(26A, 26B): Imaging device 30: Lighting device 60A: Display device (first display device) 60B: Operating device (second display device) 61A: Display screen (first display screen) 72A: Display control device (first display control device) 72A1: Display control unit (controller) 76: Wiper device 77: Defogging device 78: Locking device 80A: Upper region 80B: Lower region 81(80a, 80b): Warning information 91: Overhead image 92(92a~92l): Supplementary information 93: First information 94: Second information 100: Environmental information 101: Guidance information 102(102A, 102B): Captured image 103: First switching operation unit 104: Second switching operation unit 105: Setting operation unit
Claims
1. A display control device for controlling the display of a display device provided in a work machine, comprising: a display control unit that causes information regarding the work machine to be displayed on a display screen of the display device; while causing the display control unit to display, in a lower region of the display screen, an aerial view image of the work machine viewed from above and supplementary information that supplements and shows the states of one or more devices provided in the work machine in the aerial view image, a display control device that causes environmental information indicating information around the work machine and / or guidance information of the work machine to be displayed in an upper region above the lower region of the display screen.
2. The display control device according to claim 1, wherein the display control unit causes the supplementary information to be displayed superimposed at a position corresponding to the position of the work machine provided with the device corresponding to the supplementary information in the aerial view image.
3. The display control device according to claim 1, wherein the supplementary information includes at least one of a lighting state of a lighting device, an operating state of a wiper device, an operating state of a defogging device, an operating state of a rotating light, and a locking state of a locking device.
4. The display control device according to claim 1, wherein the display control unit causes an image indicating the supplementary information to be displayed superimposed on the aerial view image.
5. The display screen is a vertically long rectangular shape, The display control device according to claim 1, wherein the upper region is larger than the lower region.
6. The display control unit causes first information regarding the body of the work machine to be displayed in one of the width directions of the aerial view image and the supplementary information in the lower region, The display control device according to claim 1, wherein second information regarding a working device of the work machine is displayed in the other of the width directions of the aerial view image and the supplementary information in the lower region.
7. The display control device according to claim 6, wherein the first information includes any one or more of a remaining fuel amount, a battery charge state, a rotational speed of an engine or a motor, an operating state of an auto-idle function, and a shift state of a traveling device.
8. The display control device according to claim 6, wherein the second information includes any one or more of a type of an attachment attached to the working device, an operation mode of the working device, a setting state regarding an operation limit of the working device, and a flow rate setting state of hydraulic oil supplied to the working device.
9. The display control unit according to claim 1, wherein when a warning condition occurs in the work machine, warning information regarding the warning condition is displayed between the lower region and the upper region, or in the lower region.
10. The display control unit according to claim 1, wherein the environmental information is displayed in the upper region, and as the environmental information, an imaging image acquired by an imaging device provided in the work machine is displayed.
11. The display control unit causes a first switching operation unit that receives an operation for switching the display of a plurality of imaging images acquired by a plurality of imaging devices provided in the work machine to be displayed, The first switching operation unit is the display control device according to claim 1, which is displayed above the upper region.
12. The display control unit, In the upper region, it is possible to display a setting operation unit that receives an input of setting information of the work machine instead of the environmental information and / or the guidance information of the work machine, The display control unit according to claim 1, wherein a second switching operation unit that receives an operation for switching the display between the environmental information and / or the guidance information of the work machine and the setting operation unit is displayed in the upper region.
13. The display control device according to claim 1, wherein an operation input to a device corresponding to the supplementary information is possible by a touch operation on the supplementary information displayed on the display screen.
14. The display control device according to claim 12, wherein an operation input of the setting information corresponding to the setting operation unit is possible by a touch operation on the setting operation unit displayed on the display screen.
15. A work machine comprising the display control device according to any one of claims 1 to 14, And a display device whose display is controlled by the display control device.
16. The work machine according to claim 14, further comprising an operation device that is disposed below the display device and receives an operation of the work machine.
17. A program for causing a computer to execute the processing of the display control unit in the display control device according to any one of claims 1 to 14.
18. A storage medium in which the program according to claim 17 is recorded in a computer-readable manner.
Citation Information
Patent Citations
Display control device, work machine, program, and recording medium for the program
JP2020104810A