Work machinery and monitoring control systems

Abstract

To provide a work machine and monitor control system that can prevent accidental operation during cleaning of multi-touch monitors for work machines, while also enabling touch operation by moving the point of press. [Solution] The system includes a touch panel monitor 302 that displays information about the work machine and can detect input operations involving pressing at multiple points, and a control device 400 that controls the display on the touch panel monitor 302 and the detection of input operations involving pressing. The control device 400 switches to a normal operation mode that enables detection of input operations involving movement of the pressed points when the area or number of pressed points on the touch panel monitor 302 is less than a predetermined value, and switches to a cleaning mode that disables detection of input operations involving movement of the pressed points when the area or number of pressed points on the touch panel monitor 302 is greater than or equal to a predetermined value.

Description

Technical Field

[0001] The present invention relates to a working machine and a monitor control system.

Background Art

[0002] In a working machine such as a hydraulic excavator, there is a device that displays a camera image reflecting the situation around the working machine on the screen of a monitor. On the other hand, since the work site where the working machine operates is an environment where dust is likely to be generated, for example, dust adheres to and easily soils the monitor installed in the cab of the hydraulic excavator, and when the screen is soiled, the visibility of the camera image decreases, making it difficult to check the surroundings of the hydraulic excavator. Therefore, the operator of the hydraulic excavator has to clean the screen daily, for example, by wiping the dirt on the screen with a cloth or the like, or by wiping the screen with the gloves on his hands.

[0003] On the other hand, some monitors for working machines employ monitors with touch panels. When cleaning the screen of a monitor with a touch panel, a touch operation may react, leading to a risk of accidental operation. As a technique for preventing accidental operation during cleaning of a monitor with a touch panel, for example, the one described in Patent Document 1 is known. Patent Document 1 discloses a touch panel control device including: detection means for detecting information on whether or not a screen of a touch panel is pressed and position information of a pressing point; determination means for determining whether or not the pressing point has moved in a state where the screen of the touch panel is pressed based on the detected information on whether or not the screen is pressed and the position information of the pressing point; and switching means for switching the operation of the touch panel to a cleaning mode when the pressing point has moved in a state where the screen of the touch panel is pressed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

[0005] Incidentally, as seen in the widespread adoption of smartphones, all touch-panel monitors are increasingly becoming multi-touch compatible. For example, it is now possible to perform operations that move the point of contact on the screen, such as swiping (moving a finger in a predetermined direction while touching the screen), flicking (swiping a finger across the screen in a predetermined direction), and pinch-in / pinch-out (narrowing or widening the distance between multiple fingers while touching the screen). In particular, swipe and flick operations are widely used in smartphones and in-car infotainment systems as methods for switching screen display patterns, and are also effective as means of switching between multiple displays in increasingly multi-functional work machines.

[0006] In the conventional technology described above, accidental operation during touch panel cleaning is prevented by switching to cleaning mode when the touched point moves while it remains pressed. In other words, since moving the touch point while touching the screen puts the system into cleaning mode, if the conventional technology is used on a multi-touch compatible monitor, even if specific functions are assigned to swipe or flick operations, the system will switch to cleaning mode against the user's intention.

[0007] The present invention has been made in view of the above, and aims to provide a work machine and monitor control system that can prevent erroneous operation during cleaning work on a multi-touch compatible monitor for work machines and enable touch operation that moves the point of press. [Means for solving the problem]

[0008] The present invention includes several means for solving the above-mentioned problems, but one example is a monitor with a touch panel that displays information about a work machine and can detect input operations involving pressing at multiple points, and a control device that controls the display on the monitor with the touch panel and the detection of input operations involving pressing, wherein the control device switches to a normal operation mode that enables detection of input operations involving movement of the pressed points when the area or number of pressed points on the monitor with the touch panel is less than a predetermined value, and switches to a cleaning mode that disables detection of input operations involving movement of the pressed points when the area or number of pressed points on the monitor with the touch panel is greater than or equal to a predetermined value. [Effects of the Invention]

[0009] According to the present invention, it is possible to prevent accidental operation during cleaning of a multi-touch monitor for industrial machinery and to achieve both the prevention of accidental operation and the ability to move the point of press during touch operation. [Brief explanation of the drawing]

[0010] [Figure 1] This is a schematic side view showing the external appearance of a hydraulic excavator, which is an example of a work machine. [Figure 2] This is a diagram showing the interior of a hydraulic excavator's cab. [Figure 3] This diagram shows the hydraulic circuit system of a hydraulic excavator, along with its control unit. [Figure 4] This diagram shows the monitor control system along with its related components. [Figure 5] This flowchart shows the transition to cleaning mode for cleaning a monitor with a touch panel. [Figure 6] This flowchart shows the transitions that occur when a predetermined time has elapsed since the point at which the touch panel monitor stopped detecting a pressed point during cleaning mode. [Figure 7] This flowchart shows the transition when the pilot shut-off lever is released while in cleaning mode. [Figure 8]It is a flowchart showing the transition when the lever is operated after switching to the cleaning mode during the release of the pilot shut-off lever. [Figure 9] It is a flowchart showing the transition of the display on the monitor with a touch panel when switching to the cleaning mode. [Figure 10] It is a flowchart showing the transition when a warning is notified to the hydraulic excavator during the cleaning mode. [Figure 11] It is a flowchart showing the transition when the camera image displayed on the monitor with a touch panel is swiped. [Figure 12] It is a flowchart showing the transition of the display when the pressing point is moved while the screen is being pressed during the cleaning mode with the pilot shut-off lever locked. [Figure 13] It is a diagram showing the state where the image captured by the camera is displayed on the monitor with a touch panel. [Figure 14] It is a diagram showing the state where the brightness of the display on the monitor with a touch panel is darkened. [Figure 15] It is a diagram showing the state where a display for selecting the transition to the cleaning mode is made on the screen of the monitor with a touch panel. [Figure 16] It is a diagram showing the state where a part of the display on the monitor with a touch panel is darkened. [Figure 17] It is a diagram showing the state where a warning message is displayed on the screen of the monitor with a touch panel. [Figure 18] It is a diagram showing the state of the display when the pressing point is moved while the screen is being pressed. [Figure 19] It is a diagram showing the state where a one-finger swipe operation is performed when the image captured by the camera is displayed on the screen of the monitor with a touch panel. [Figure 20] It is a diagram showing the state where another pattern of the image is displayed. [Figure 21] It is a diagram showing the state where a multi-finger swipe operation is performed when the image captured by the camera is displayed on the screen of the monitor with a touch panel. [Figure 22] It is a diagram showing the state of display of a monitor with a touch panel when the operation mode is switched to the cleaning mode. [Figure 23] It is a diagram schematically showing the state of pressing at a plurality of pressing points. [Figure 24] It is a diagram schematically showing the state of movement of a plurality of pressing points in the same direction.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0012] In this embodiment, a hydraulic excavator is exemplified as an example of a working machine and described, but the present invention can also be applied to other working machines. Further, in the following description, when there are a plurality of identical components, an alphabet may be attached to the end of the reference numeral (number), but the plurality of components may be collectively represented by omitting the alphabet. That is, for example, when there are a plurality of flow control valves 5a to 5f, these may be collectively represented as the flow control valve 5. In addition, for signal lines and the like whose connection relationship is clear from the description, illustration may be omitted for simplicity.

[0013] FIG. 1 is a diagram schematically showing the appearance of a hydraulic excavator according to this embodiment. Further, FIG. 2 is a diagram showing the state of the cab of the hydraulic excavator, and FIG. 3 is a diagram showing the hydraulic circuit system of the hydraulic excavator together with its control unit.

[0014] In FIGS. 1 to 3, the hydraulic excavator 100 includes a vehicle body (working machine main body) 1B composed of an upper swing body 1d and a lower traveling body 1e, and a multi-joint type working device 1A composed of a boom 1a, an arm 1b, and a bucket 1c that respectively rotate in the vertical direction. The base end of the boom 1a is attached in front of the upper swing body 1d.

[0015] The operator's cab 9, where the hydraulic excavator 100 operator sits, is located at the upper front of the upper rotating body 1d, which constitutes the vehicle body 1B. Cameras 2a, 2b, and 2c are installed on the left, right, and rear of the upper rotating body 1d to capture images of the area around the hydraulic excavator 100.

[0016] The boom 1a, arm 1b, and bucket 1c of the hydraulic actuator work device 1A, as well as the upper slewing body 1d and lower traveling body 1e, are driven by the boom cylinder 3a, arm cylinder 3b, bucket cylinder 3c, slewing motor 3d, and left and right traveling motors 3e and 3f, respectively. In Figure 1, only one traveling motor 3e is shown, and the other traveling motor 3f is omitted from the illustration and only its symbol in parentheses is shown.

[0017] In Figure 2, the cab 9 is equipped with operating lever devices 4a, 4b, 4e, and 4f for operating the boom cylinder 3a, arm cylinder 3b, bucket cylinder 3c, and slewing motor 3d of the working device 1A, as well as operating lever devices 4c and 4d for operating the left and right travel motors 3e and 3f, respectively. The operating lever devices 301 are a switch that enables (allows) and disables (prohibits) the operation of the hydraulic excavator 100 in response to the operation of the operating lever devices 4a to 4f. The cab 9 is also equipped with a touch panel monitor 302 for displaying various information about the hydraulic excavator 100, images captured by cameras 2a, 2b, and 2c, and for inputting operations to use the various functions of the hydraulic excavator 100.

[0018] Figure 13 shows an example of the display on the screen of a touch panel monitor. As shown in Figure 13, the screen of the touch panel monitor 302 displays information about the hydraulic excavator 100, which is the work machine, including an operating time display unit 302a showing the current time and operating time of the hydraulic excavator 100, a coolant temperature gauge 302b showing the engine coolant temperature, a hydraulic oil temperature gauge 302c showing the hydraulic oil temperature, a fuel gauge 302d showing the remaining fuel level, a set temperature display 302e showing the set temperature and operating status of the air conditioner, a set frequency display 302f showing the set frequency and volume of radio broadcasts, and video 131 of the surroundings of the hydraulic excavator 100 taken by cameras 2a, 2b, and 2c.

[0019] The touch panel monitor 302, for example, is equipped with a capacitive touch panel and detects the touch position (position and range of the pressed point) from the slight change in capacitance that occurs between the finger and the touch panel. In addition, the touch panel monitor 302 has a multi-touch detection function and supports input operations involving pressing at multiple points (so-called multi-touch operations).

[0020] In Figure 3, the upper rotating body 1d contains an engine 7, which is the prime mover; a hydraulic pump 2 driven by the engine 7; flow control valves 5a, 5b, 5c, 5d, 5e, 5f that control the direction and flow rate of pressurized oil discharged from the hydraulic pump 2 and supplied to hydraulic actuators 3a, 3b, 3c, 3d, 3e, 3f; a relief valve 6 that controls the discharge pressure of the hydraulic pump 2 to be below a predetermined set value; and a control unit 8 (mechanical control device) that controls the flow control valves 5 in response to operation signals from the operating lever device 4.

[0021] Figure 4 shows the monitor control system according to this embodiment, along with its related components.

[0022] In Figure 4, the monitor control system consists of a touch panel monitor 302 and a control device 400.

[0023] In addition to the touch panel monitor 302, which controls the input and display of command signals associated with input operations, the control unit 8 (machine control device) and cameras 2a, 2b, and 2c are connected to the control device 400.

[0024] The control device 400 includes a touch detection unit 401, a cleaning mode transition determination unit 402 comprising a touch area determination unit 403, a touch time determination unit 404, and a touch point movement determination unit 405, a touch operation mode selection determination unit 406, a cleaning mode assignment unit 407, a touch input control unit 408, and a monitor display processing unit 409.

[0025] The touch detection unit 401 detects touch operations on the touch panel monitor 302 based on the detection results from the touch panel monitor 302 (position and range of the pressed point), and outputs the touch operation detection results along with information such as the position and range of the pressed point to the cleaning mode transition determination unit 402 and the monitor display processing unit 409.

[0026] The touch area determination unit 403 of the cleaning mode transition determination unit 402 determines the area of ​​the pressed point on the touch panel monitor 302 based on the position and range of the pressed point. The touch time determination unit 404 determines the time the screen is touched (pressed). The touch point movement determination unit 405 determines the distance and direction of movement of the pressed point that touched the screen.

[0027] The touch operation mode selection determination unit 406 determines the selected state of the touch operation mode based on the command signal from the monitor display processing unit 409.

[0028] The cleaning mode assignment unit 407 assigns the cleaning mode to the operation mode of the touch panel monitor 302 based on the determination result from the touch operation mode selection determination unit 406 and the determination result from the touch point movement determination unit 405 (the distance and direction of movement of the pressed point). The operation mode of the touch panel monitor 302 includes a normal operation mode that enables the detection of input operations involving movement of the pressed point, and a cleaning mode that disables the detection of input operations involving movement of the pressed point, and these can be selectively switched between.

[0029] The touch input control unit 408 controls whether input operations on the touch panel monitor 302 are enabled (allowed) or disabled (prohibited) according to the assignment result of the cleaning mode assignment unit 407.

[0030] The monitor display processing unit 409 performs display processing for the touch panel monitor 302 based on the detection result of the touch detection unit 401, the determination result of the touch time determination unit 404, the assignment result of the cleaning mode assignment unit, the control signals from the pilot shut-off lever state management unit 81 and the warning notification unit 82 of the control unit 8 (machine control device), and the camera images from the camera image output unit 21 of the cameras 2a, 2b, and 2c.

[0031] The pilot shut-off lever state management unit 81 of the control unit 8 (machine control device) manages the state of the pilot shut-off lever 301 and outputs a control signal indicating the state of the pilot shut-off lever 301, that is, whether the operation of the hydraulic excavator 100 has been switched to enabled or disabled.

[0032] The warning notification unit 82 outputs an abnormality signal to the monitor display processing unit 409 of the control device 400 when an abnormality occurs in the hydraulic excavator 100, and notifies the warning to the touch panel monitor 302, etc., via the control device 400. The hydraulic excavator 100 is equipped with an obstacle detection system as the warning notification unit 82, which detects obstacles near the vehicle body (operating range) based on images from cameras 2a, 2b, 2c (imaging devices) and outputs a predetermined abnormality signal to the control device 400. Here, the hydraulic fluid temperature sensor and cameras 2a, 2b, 2c (imaging devices) are examples of abnormality detection devices that constitute the obstacle detection system. In addition, the signals related to temperature information detected by the hydraulic fluid temperature sensor and the signals related to images captured by cameras 2a, 2b, 2c (imaging devices) are examples of abnormality signals. Furthermore, the control device 400 may determine whether or not an abnormality has occurred based on signals related to temperature information detected by the hydraulic fluid temperature sensor and signals related to images captured by cameras 2a, 2b, and 2c (imaging devices). In other words, warnings notified to the hydraulic excavator 100 include, for example, a warning notified when an obstacle is detected near the vehicle body (within the operating range), and a warning notified when the hydraulic fluid temperature is higher than the standard value, resulting in an overheating condition.

[0033] The monitor control system of this embodiment, configured as described above, namely the touch panel monitor 302 and the control device 400, can switch from normal operation mode to cleaning mode based on the area of ​​the pressed point when the screen is touched, the elapsed time from the start of pressing (holding time of the pressed state), and whether or not the pressed point has moved and the distance it has moved. In cleaning mode, the display processing of the touch panel monitor 302 is controlled according to the state of the pilot shut-off lever 301, the state of the images from cameras 2a, 2b, and 2c, and the state of warning notifications.

[0034] The operation of this embodiment, configured as described above, will now be explained.

[0035] Figure 5 is a flowchart showing the transition from step S100 to S180 in which the system enters cleaning mode for cleaning the touch panel monitor 302.

[0036] S100: When the touch panel monitor 302 is powered on and the screen is displaying normally, the touch operation acceptance mode is normally set to normal operation mode.

[0037] S110: The touch detection unit 401 determines whether the touch panel monitor 302 has been pressed at multiple points, i.e., multi-touch. If the determination result is YES, that is, if the touch detection unit 401 has detected a multi-touch press, the process proceeds to S120. If the determination result is NO, that is, if the touch detection unit 401 has detected a single-point press, the process proceeds to S180.

[0038] S120: The touch area determination unit 403 determines whether the pressed point is stopped and whether the area of ​​the pressed point is greater than or equal to a predetermined area. If the determination result is YES, the process proceeds to S130. If the determination result is NO, the process proceeds to S180.

[0039] S130: The touch time determination unit 404 determines whether a predetermined time has elapsed since it determined in S120 that the area was pressed to a predetermined size or larger. If the determination result is YES, the process proceeds to S140. If the determination result is NO, the process proceeds to S170.

[0040] S140: The touch panel monitor 302 displays a message on its screen prompting the user to choose whether or not to switch to cleaning mode. Figure 15 shows the screen of the touch panel monitor 302 prompting the user to choose whether or not to switch to cleaning mode. As shown in Figure 15, the touch panel monitor 302 displays a message confirming the switch to cleaning mode, along with an execute button 132a to select whether or not to switch to cleaning mode, and a cancel button 132b to select whether or not to switch.

[0041] In S150:S140, it is determined whether or not the option to switch to cleaning mode has been selected. If the result is YES, i.e., if the execution button 132a has been pressed, the process proceeds to S160. If the result is NO, the process proceeds to S180.

[0042] S160: Switch the operation mode to cleaning mode and terminate the process.

[0043] S170: The touch point movement determination unit 405 determines whether multiple press points whose area is determined to be greater than or equal to a predetermined area by the touch area determination unit 403 have moved in the same direction. If the determination result is YES, proceed to S160. If the determination result is NO, proceed to S180. Figures 23 and 24 are schematic diagrams showing how multiple press points move in the same direction.

[0044] S180: Switch the operation mode to normal operation mode and terminate the process.

[0045] According to the above process, for example, in the case of a swipe or flick operation with one finger, i.e., one point of pressure, the system enters normal operation mode, and the function assigned to the swipe operation can be executed. Also, in operations where two points of pressure move in different directions, such as pinch-in and pinch-out operations, the system enters normal operation mode, and the function assigned to the pinch-in and pinch-out operations can be executed. On the other hand, if the predetermined area (number of points of pressure) defined in S120 is set to 3 points, and the user wipes the screen by moving three fingers, i.e., three points of pressure back and forth, the system enters cleaning mode, allowing the screen to be cleaned without accidental operation.

[0046] Figure 6 is a flowchart showing the transitions that occur when a predetermined time has elapsed from the point at which the touch panel monitor no longer detects a pressed point during cleaning mode, as described in steps S200 to S240.

[0047] S200: Determine whether cleaning mode is active. If the result is YES, proceed to S210. If the result is NO, repeat the process in S200 until the result becomes YES.

[0048] S210: Determine whether the touch detection unit 401 has detected a press point. If the result is YES, proceed to S220. If the result is NO, proceed to S240.

[0049] S220: Determine whether a predetermined time has elapsed since the touch detection unit 401 stopped detecting the press point and the touch area determination unit 403 determined that the area of ​​the press point had disappeared. If the determination result is YES, proceed to S230. If the determination result is NO, proceed to S240.

[0050] S230: Switch the operation mode to normal operation mode and terminate the process.

[0051] S240: Switch the operation mode to cleaning mode and terminate the process.

[0052] Through the above process, the operator can switch from cleaning mode to normal operation mode without performing any special operations.

[0053] Figure 7 is a flowchart showing the transition when the pilot shut-off lever is released during cleaning mode, as described in steps S300 to S330.

[0054] S300: Determine whether or not cleaning mode is in progress. If the result is YES, proceed to S310. If the result is NO, repeat the process in S300 until the result becomes YES.

[0055] S310: Determine whether the pilot shut-off lever 301 has been released. If the result is YES, that is, if the drive of the hydraulic excavator 100 has been effectively switched in response to the operation of the operating lever devices 4a to 4f, proceed to S320. If the result is NO, proceed to S330.

[0056] S320: Switch the operation mode to normal operation mode and terminate the process.

[0057] S330: Switch the operation mode to cleaning mode and terminate the process.

[0058] With the above procedure, even while in cleaning mode, the operator can switch from cleaning mode to normal operation mode without any special operation, simply by releasing the pilot shut-off lever as an action to move the shovel.

[0059] Figure 8 is a flowchart showing the transition when the pilot shut-off lever is released, and then the lever is operated after the system has entered cleaning mode, as described in steps S400 to S430.

[0060] S400: Determine whether the pilot shut-off lever 301 is released. If the result is YES, proceed to S410. If the result is NO, repeat the process in S400 until the result becomes YES. S410: Determine whether cleaning mode is active. If the result is YES, proceed to S420. If the result is NO, repeat the process in S410 until the result becomes YES. S420: Determine whether the operating lever devices 4a to 4f have been operated. If the result is YES, proceed to S430. If the result is NO, repeat S420 until the result becomes YES.

[0061] S430: Switch the operation mode to normal operation mode and terminate the process.

[0062] According to the above procedure, in cleaning mode, where the pilot shut-off lever 301 is released, i.e., when the operating lever devices 4a to 4f are moved, the operator can switch to normal operation mode simply by moving the operating lever devices 4a to 4f without performing any special operations.

[0063] Figure 9 is a flowchart showing the display transitions of the touch panel monitor when switching to cleaning mode, as described in steps S500 to S550.

[0064] S500: Determine whether the touch panel monitor 302 displays video footage captured by at least one of the multiple cameras 2a, 2b, and 2c installed on the hydraulic excavator 100. If the result is YES, proceed to S510. If the result is NO, repeat the process in S500 until the result is YES. Figure 13 shows the video footage captured by cameras 2a, 2b, and 2c displayed on the touch panel monitor 302. As shown in Figure 13, a portion of the screen of the touch panel monitor 302 displays video footage 131 captured by cameras 2a, 2b, and 2c.

[0065] S510: Determine whether the pilot shut-off lever 301 is in the locked state. If the result is YES, proceed to S520. If the result is NO, proceed to S540.

[0066] S520: Determine whether the operating mode is cleaning mode. If the result is YES, proceed to S530. If the result is NO, repeat the process in S520 until the result becomes YES.

[0067] S530: The brightness of the display on the touch panel monitor 302 is dimmed to a degree that allows the original display to be seen. Specifically, a semi-transparent black mask 303 is displayed across the entire screen to a degree that allows the original display content to be seen, or the brightness of the entire screen is reduced from the first brightness in normal operation mode to the second brightness in cleaning mode. In normal operation mode (for example, when the judgment result in S520 is NO), the brightness of the touch panel monitor 302 is set to a predetermined brightness (first brightness). The first brightness is a brightness that is set in advance by the operator, and is a brightness that allows the operator to clearly see the information displayed on the touch panel monitor 302. The second brightness is a brightness that is set lower than the first brightness, and is a brightness that is low enough for the operator to easily recognize that the operation mode of the touch panel monitor 302 is different from the normal operation mode (i.e., it is cleaning mode). Figure 14 shows the state when the brightness of the display on the touch panel monitor 302 is dimmed. As shown in Figure 14, the overall brightness of the display screen of the touch panel monitor 302 is reduced to the second brightness level.

[0068] S540: Determine whether the operating mode is cleaning mode. If the result is YES, proceed to S550. If the result is NO, proceed to S510.

[0069] S550: The brightness of a portion of the display screen of the touch panel monitor 302 is set to a second brightness level, making it dark enough to allow the original display to be seen, while the brightness of the area corresponding to the location of the pressed point is set to a first brightness level. Specifically, a semi-transparent black mask 303 is displayed on a portion of the display screen of the touch panel monitor 302 to the extent that the original display content can be seen, or the brightness of a portion of the display screen is reduced to a second brightness level, and the brightness of the rest of the display screen (the area other than the portion set to second brightness) is set to a first brightness level. Figure 16 shows the state in which the brightness of a portion of the display of the touch panel monitor 302 is darkened. As shown in Figure 16, the brightness of a portion of the display screen of the touch panel monitor 302 is reduced to a second brightness level, while the original first brightness level is maintained for the other parts where the pressed point is located (images 131 captured by cameras 2a, 2b, and 2c).

[0070] With the above processing, during cleaning mode, the touch panel monitor is dimmed, making it easier to check how well the dirt has been wiped away. However, as shown in Figure 16, even during cleaning, the camera image is displayed as it normally would, allowing for safety checks around the shovel to be performed as usual.

[0071] Figure 10 is a flowchart showing the transitions when a warning is notified to the hydraulic excavator 100 during cleaning mode, as described in steps S600 to S630. Here, warnings notified to the hydraulic excavator 100 include, for example, a warning notified when an obstacle is detected near the vehicle body (operating range), and a warning notified when the hydraulic fluid temperature is higher than the standard value, resulting in an overheating condition.

[0072] S600: Determine whether the operating mode is cleaning mode. If the result is YES, proceed to S610. If the result is NO, repeat the process in S600 until the result becomes YES.

[0073] S610: Determine whether a warning has been issued for hydraulic excavator 100. If the result is YES, proceed to S620. If the result is NO, proceed to S630.

[0074] S620: The operation mode is switched to normal operation mode, a warning message is displayed on the screen of the touch panel monitor 302, and the process is terminated. Figure 17 shows the screen of the touch panel monitor 302 with the warning message displayed. As shown in Figure 17, the screen of the touch panel monitor 302 displays the warning message along with an execute button 133a to select to perform detailed confirmation and a cancel button 133b to select not to perform.

[0075] S630: Switch the operation mode to cleaning mode and end the process.

[0076] According to the above process, if an abnormality occurs in the hydraulic excavator 100 while in cleaning mode and a warning is issued for the hydraulic excavator 100, that is, if a predetermined abnormality signal is input to the control device 400, the process of dimming the screen as shown in Figure 9 is canceled when the system returns from cleaning mode to normal operation mode, and the system immediately becomes able to confirm the warning and perform touch operations.

[0077] Figure 11 is a flowchart showing the transitions when swiping the camera image displayed on a touch panel monitor, as described in steps S700 to S740.

[0078] S700: The touchscreen monitor 302 displays video footage 131 captured by at least one of the multiple cameras 2a, 2b, and 2c installed on the hydraulic excavator 100.

[0079] S710: Determines whether a swipe operation was performed by moving the image 131 from cameras 2a, 2b, and 2c with one finger, i.e., with a single point of pressure. If the result is YES, proceed to S720. If the result is NO, proceed to S730. Figure 19 shows how a swipe operation is performed with one finger when the image 131 captured by cameras 2a, 2b, and 2c is displayed on the screen of the touch panel monitor 302.

[0080] S720: A different pattern of video 131A from the camera video 131 displayed in S700 is displayed on the screen of the touch panel monitor 302. Figure 20 shows the display of the different pattern of video.

[0081] S730: Determines whether a swipe operation was performed using two or more fingers, i.e., moving between two or more points of contact, on the images from cameras 2a, 2b, and 2c. If the result is YES, proceed to S740. If the result is NO, proceed to S710. Figure 21 shows how a swipe operation is performed with two or more fingers when the images 131 captured by cameras 2a, 2b, and 2c are displayed on the screen of the touch panel monitor 302.

[0082] S740: Switch the operation mode to cleaning mode and terminate the process. Figure 22 shows the display on the touch panel monitor 302 when the operation mode is switched to cleaning mode.

[0083] According to the above process, the display pattern of the camera image can usually be switched with a single-finger swipe. Swiping with one finger is efficient and is a common action for swiping on smartphones. On the other hand, when wiping a touchscreen monitor, whether using gloved hands or a cloth, it is more efficient to have two or more fingers touching the touchscreen monitor. Performing such an operation switches to cleaning mode, thus preventing accidental operation.

[0084] Figure 12 is a flowchart showing the display transitions when the screen is pressed and the point of pressure is moved while the pilot shut-off lever is locked during cleaning mode, as described in steps S800 to S830.

[0085] S800: Determine whether the pilot shut-off lever 301 is locked or not. If the result is YES, proceed to S810. If the result is NO, repeat the process in S800 until the result becomes YES.

[0086] S810: Determines whether the brightness of the entire screen of the touch panel monitor 302 has been dimmed (i.e., whether it is in cleaning mode). Specifically, it determines whether a semi-transparent black mask 303 is displayed across the entire screen to the extent that the original display content can be seen, or whether the brightness of the entire screen has been reduced from the first brightness level in normal operation mode to the second brightness level in cleaning mode. If the result of the determination is YES, proceed to S820. If the result of the determination is NO, the process of S810 is repeated until the result of the determination becomes YES.

[0087] S820: Determines whether the point of pressure was moved while the screen was pressed. If the result is YES, proceed to S830. If the result is NO, repeat the process in S820 until the result becomes YES.

[0088] S830: The black semi-transparent mask 303 on the screen is released or the brightness is increased from the second brightness level to the first brightness level, in conjunction with the trajectory of the pressed point while the touch panel monitor 302 is pressed down.Specific methods for releasing the semi-transparency of the display screen of the touch panel monitor 302 include, for example, hiding the mask 303 in the range (trajectory) where the pressed point has moved from the semi-transparent black mask 303 displayed across the entire screen to display the original screen, or increasing the brightness of the range (trajectory) where the pressed point has moved from the display screen, which has been reduced to the second brightness level, to the first brightness level.Figure 18 shows the display when the pressed point is moved while the screen is pressed down.As shown in Figure 18, the black semi-transparent mask 303 in the display area 302g of the range (trajectory) where the pressed point has moved is released (or the brightness is increased). Furthermore, the brightness of the area of ​​the touchscreen monitor 302 where semi-transparency has been removed may be set to a third brightness level (i.e., second brightness < third brightness < first brightness) which is brighter than the brightness level in cleaning mode (second brightness level) and darker than the brightness level in normal operation mode (first brightness level).

[0089] The above process allows you to clean the screen while checking how well it's being wiped.

[0090] The effects of this embodiment, configured as described above, will now be explained.

[0091] As seen with the widespread adoption of smartphones, all touchscreen monitors are increasingly becoming multi-touch compatible. For example, they allow operations that move the point of contact on the screen, such as swiping (moving a finger in a predetermined direction while touching the screen), flicking (swiping a finger across the screen in a predetermined direction), and pinch-in / pinch-out (narrowing or widening the distance between multiple fingers while touching the screen). In particular, swipe and flick operations are widely used in smartphones and in-car infotainment systems as methods for switching screen display patterns, and are also effective for switching between multiple displays in increasingly multi-functional work machines. However, even with multi-touch compatible monitors, operation using a maximum of two fingers is practical in terms of usability, and swipe and flick operations, in particular, are generally performed using one finger.

[0092] In conventional technology, accidental operation during touch panel cleaning is prevented by switching to cleaning mode when the touched point is moved while still being pressed. However, in this conventional technology, since moving the touched point while touching the screen enters cleaning mode, if this conventional technology is used on a multi-touch compatible monitor, even if specific functions are assigned to swipe or flick operations, the system will switch to cleaning mode against the user's intention.

[0093] In contrast, this embodiment includes a monitor with a touch panel that displays information about the work machine and can detect input operations involving pressing at multiple points, and a control device that controls the display on the monitor with the touch panel and the detection of input operations involving pressing. The control device is configured to switch to a normal operation mode that enables detection of input operations involving movement of the pressed points when the area or number of pressed points on the monitor with the touch panel is less than a predetermined value, and to switch to a cleaning mode that disables detection of input operations involving movement of the pressed points when the area or number of pressed points on the monitor with the touch panel is greater than or equal to a predetermined value. Thus, it is possible to prevent erroneous operation during cleaning of a multi-touch compatible monitor for work machines and to enable touch operations that involve moving the pressed points.

[0094] <Note> It should be noted that the present invention is not limited to the embodiments described above, and various modifications are included. For example, the embodiments described above are described in detail to make the present invention easier to understand, and are not necessarily limited to those having all the configurations described. Furthermore, it is possible to replace parts of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add configurations from other embodiments to the configuration of one embodiment. In addition, it is possible to add, delete, or replace parts of the configuration of each embodiment with other configurations. [Explanation of Symbols]

[0095] 1a...Boom, 1b...Arm, 1c...Bucket, 1d...Upper slewing body, 1e...Lower traveling body, 1A...Working device, 1B...Vehicle body, 2...Hydraulic pump, 2a, 2b, 2c...Camera (imaging device, anomaly detection device), 3a...Boom cylinder, 3b...Arm cylinder, 3c...Bucket cylinder, 3d...Slewing motor, 3e...Travel motor, 3f...Travel motor, 4a, 4b, 4c, 4d, 4e, 4f...Operating lever device, 5a, 5b, 5c, 5d, 5e, 5f...Flow control valve, 6...Relief valve, 7...Engine, 8...Control unit, 9...Operator's cab, 21...Camera video output unit, 81...Pilot shut-off lever status management unit 82…Warning notification unit, 100…Hydraulic excavator, 131,131A…Video, 132a…Execute button, 132b…Cancel button, 133a…Execute button, 133b…Cancel button, 301…Pilot shut-off lever (switching device), 302…Monitor with touch panel, 400…Control device, 401…Touch detection unit, 402…Cleaning mode transition determination unit, 403…Touch area determination unit, 404…Touch time determination unit, 405…Touch point movement determination unit, 406…Touch operation mode selection determination unit, 407…Cleaning mode assignment unit, 408…Touch input control unit, 409…Monitor display processing unit

Claims

1. A monitor with a touch panel that displays information about the work machine and can detect input operations involving pressing at multiple points, The system includes a control device that controls the display on the touch panel monitor and the detection of input operations involving pressing buttons. The control device is If the area or number of points pressed on the touch panel monitor is less than a predetermined value, the system switches to a normal operation mode that enables detection of input operations involving movement of the pressed points. A monitor control system characterized by switching to a cleaning mode that disables detection of input operations involving movement of the pressed point when the area or number of pressed points on the touch panel monitor exceeds a predetermined value.

2. In the monitor control system according to claim 1, The monitor control system is characterized in that the control device switches to the cleaning mode when a predetermined time has elapsed while the area of ​​the pressed point on the touch panel monitor is maintained at or above a predetermined area.

3. In the monitor control system according to claim 1, The control device is characterized in that, while the number of points pressed on the touch panel monitor is maintained at a predetermined number of points, if multiple points move in the same direction by a predetermined distance or more, the control device switches to the cleaning mode.

4. In the monitor control system according to claim 1, The control device is characterized in that, when a predetermined time has elapsed while the area of ​​the pressed point on the touch panel monitor is maintained at or above a predetermined area, it displays an operation screen on the touch panel monitor that allows switching to the cleaning mode, and switches to the cleaning mode when an operation on the operation screen is performed.

5. In the monitor control system according to claim 1, The monitor control system is characterized in that the control device switches to the normal operation mode after a predetermined time has elapsed since the touch panel monitor stopped detecting a pressed point while switched to the cleaning mode.

6. In the monitor control system according to claim 1, The control device is characterized in that, when in the normal operation mode, it sets the brightness of the display screen of the touch panel monitor to a predetermined first brightness, and when in the cleaning mode, it sets the brightness of the display screen of the touch panel monitor to a second brightness that is lower than the first brightness, while maintaining the display that was displayed on the touch panel monitor immediately before switching to the cleaning mode.

7. In the monitor control system according to claim 6, The control device is characterized in that, when in cleaning mode, it sets the brightness of a range of the display screen of the touch panel monitor to the first brightness level, and sets the brightness of other ranges to the second brightness level.

8. A self-propelled vehicle, A work device attached to the vehicle body, A work machine equipped with a driver's cab attached to the vehicle body, The monitor control system according to claim 1, The touch panel monitor is located inside the driver's cab. A work machine characterized by the following features.

9. In the work machine according to claim 8, The vehicle body is equipped with an imaging device that is attached to the vehicle body and photographs the area around the vehicle body, The work machine is characterized in that the monitor with a touch panel displays the image of the imaging device as information about the work machine.

10. In the work machine according to claim 8, The machine is equipped with an abnormality detection device for detecting abnormalities in the aforementioned work machine, The control device is characterized in that, when a predetermined abnormal signal is input by the abnormality detection device while in the cleaning mode, it displays a warning on the touch panel monitor and switches to the normal operation mode.

11. In the work machine according to claim 8, The device includes a switching device for switching between allowing and prohibiting the operation of the aforementioned work device. The control device is characterized in that, when in the cleaning mode state, the switching device switches to a state that allows the operation of the work device, it switches from the cleaning mode to the normal operation mode.

12. In the work machine according to claim 9, The device includes a switching device for switching between allowing and prohibiting the operation of the aforementioned work device. The control device, when in the normal operation mode, sets the brightness of the display screen of the touch panel monitor to a predetermined first brightness, and when in the cleaning mode, while maintaining the display on the touch panel monitor that was displayed immediately before switching to the cleaning mode, sets the brightness of the display screen to a second brightness lower than the first brightness. The control device, in the cleaning mode, When the image from the imaging device is displayed on the touch panel monitor, and the switching device is switched to a state that allows the operation of the work device, The touch panel monitor retains the display immediately before switching to the cleaning mode. A work machine characterized in that, while maintaining the brightness of the area on the display screen of the touch panel monitor in which the image from the imaging device is displayed at the first brightness level, the brightness of other areas is set to the second brightness level.

13. In the work machine according to claim 9, The control device of the monitor control system is characterized in that, when the image of the imaging device is displayed on the touch panel monitor, the control device switches the image of the imaging device to a different display pattern by pressing the portion on which the image of the imaging device is displayed and moving the point of pressing.

Images