Work machine, management system of work machine, and management device of work machine

The work machine management system addresses communication failures by constructing a virtual space to detect and alert operators to unstable areas, enhancing remote control stability.

JP2024168698APending Publication Date: 2024-12-05SUMITOMO HEAVY IND LTD

Patent Information

Application Number
JP2023085590
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-24
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Communication failures occur in work machines due to obstacles at the work site, disrupting remote control and management systems.

Method used

A work machine management system that utilizes environmental and operating information to construct a virtual space, detect unstable communication areas, and output alerts to avoid these areas, using a management device with a virtual space construction unit, unstable area detection, and output unit.

Benefits of technology

Suppresses communication failures by enabling operators to avoid unstable communication regions, ensuring stable remote control and management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168698000001_ABST
    Figure 2024168698000001_ABST
Patent Text Reader

Abstract

To suppress occurrence of communication failures.SOLUTION: A work machine that communicates with a management device comprises: a virtual space construction section, based on environmental information regarding an environment around the work machine and operation information indicating an operating status of the work machine, constructing a virtual space that reproduces the environment around the work machine; an unstable area detection section detecting unstable areas where communication with the management device becomes unstable through a simulation using the virtual space; and an output section outputting information indicating the detected unstable areas.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a work machine, a work machine management system, and a work machine management device. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there has been known a technique for remotely operating a work machine from a control center by performing wireless communication between the control center and the work machine working at a work site remote from the control center. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-013554 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the conventional technology described above, for example, when there is an obstacle at the work site, communication failure may occur.

[0005] The present disclosure aims to suppress the occurrence of communication failures. [Means for solving the problem]

[0006] A work machine according to an embodiment of the present invention is a work machine that communicates with a management device, and has a virtual space construction unit that constructs a virtual space that reproduces the surrounding environment based on environmental information relating to the environment around the work machine and operation information that indicates the operating status of the work machine, an unstable area detection unit that detects unstable areas where communication with the management device becomes unstable through a simulation using the virtual space, and an output unit that outputs information indicating the detected unstable area.

[0007] A work machine management system according to an embodiment of the present invention is a work machine management system including a work machine and a management device that communicates with the work machine, the management device having a virtual space construction unit that constructs a virtual space that reproduces the surrounding environment based on environmental information relating to the environment around the work machine and operation information that indicates the operating status of the work machine, an unstable area detection unit that detects unstable areas where communication with the management device becomes unstable through a simulation using the virtual space, and an output unit that outputs information indicating the detected unstable area.

[0008] A work machine management device according to an embodiment of the present invention is a work machine management device that communicates with a work machine, and has: a virtual space construction unit that constructs a virtual space that reproduces the surrounding environment based on environmental information relating to the environment around the work machine and operation information that indicates the operating status of the work machine; an unstable area detection unit that detects unstable areas where communication with the management device becomes unstable through a simulation using the virtual space; and an output unit that outputs information indicating the detected unstable area. Effect of the Invention

[0009] The occurrence of communication failures can be suppressed. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of a system configuration of a management system for a shovel. [Diagram 2] FIG. 2 is a diagram illustrating the hardware configuration of each device in the excavator management system. [Diagram 3] FIG. 2 is a diagram illustrating a functional configuration of a management apparatus according to the first embodiment. [Figure 4] FIG. 4 is a first sequence diagram illustrating the operation of the work machine management system of the first embodiment. [Diagram 5] FIG. 2 is a diagram for explaining the operation of the work machine management system of the first embodiment. [Figure 6] FIG. 13 is a diagram showing a display example of a display device of a shovel. [Figure 7] FIG. 13 is a diagram showing a display example of AR glasses. [Figure 8] FIG. 11 is a diagram illustrating the operation of a work machine management system according to a second embodiment. [Figure 9] FIG. 11 is a sequence diagram illustrating the operation of a work machine management system according to a second embodiment. [Figure 10] FIG. 13 is a diagram illustrating the operation of a work machine management system according to a third embodiment. [Figure 11] FIG. 13 is a diagram illustrating functions of a management device according to a third embodiment. [Figure 12] FIG. 13 is a sequence diagram illustrating the operation of a work machine management system according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] First Embodiment Hereinafter, a management system for an excavator according to the present embodiment will be described with reference to the drawings. Fig. 1 is a diagram showing an example of a system configuration of a management system for an excavator. In this embodiment, a shovel 100 will be described as an example of a work machine.

[0012] The excavator management system SYS of the present embodiment includes an excavator 100 and a management device 200. In the following description, the work machine management system SYS will be simply referred to as the management system SYS.

[0013] In the management system SYS of this embodiment, the shovel 100 and the management device 200 are connected by wireless communication via a wireless antenna 310. Note that the management system SYS of this embodiment may include a support device that supports the shovel 100, in addition to the shovel 100 and the management device 200. Also, the wireless antenna 310 may or may not be included in the management system SYS as a part of the management system SYS.

[0014] The shovel 100 of this embodiment is an example of a work machine. When the shovel 100 acquires operation information indicating the operation status of the shovel 100, the shovel 100 transmits the operation information to the management device 200 via the wireless antenna 310. In addition, the shovel 100 receives various types of information from the management device 200 via the wireless antenna 310.

[0015] Specifically, the operation information of the excavator 100 includes position information indicating the current position of the excavator, orientation information indicating the orientation of the excavator, attitude information indicating the attitude of the excavator, work content information indicating the work content, load rate information indicating the load rate, cumulative time information indicating the cumulative operating time, fuel information including the amount of fuel injected, CO2 emissions, work volume, etc.

[0016] The wireless antenna 310 has a communication function and realizes wireless communication between the shovel 100 and the management device 200. The wireless communication may be, for example, wireless communication that satisfies the "IMT-2020" standard, and the management system SYS may be a fifth-generation mobile communication system.

[0017] Moreover, the wireless antenna 310 has a positioning device 311. The positioning device 311 acquires environmental information related to the surrounding environment where the wireless antenna 310 is installed. The environmental information includes, for example, information indicating the position where the wireless antenna 310 is installed, information indicating the presence or absence of obstacles in the work site where the shovel 100 performs work, information indicating the positions of the obstacles, information indicating the topography of the work site, and the like.

[0018] The positioning device 311 of this embodiment may be, for example, a GNSS compass, an imaging device, Lidar, or the like.

[0019] The management device 200 of this embodiment receives operation information from the shovel 100 via the wireless antenna 310. In addition, the management device 200 of this embodiment receives environmental information of the work site from the wireless antenna 310.

[0020] The management device 200 of this embodiment uses the operation information and the environmental information to generate a virtual space that reproduces the work site. More specifically, the management device 200 collects operation information and environmental information as information on the physical space (work site), and reproduces the work site, which is a physical space, in the virtual space based on the collected information.

[0021] In addition, the management device 200 detects areas at the work site where communication between the shovel 100 and the management device 200 becomes unstable by simulating communication between the shovel 100 and the management device 200 via the wireless antenna 310 in the recreated virtual space.

[0022] When an area where communication is unstable is detected by a simulation in a virtual space, the management device 200 notifies the operator of the shovel 100 of the presence of an area where communication is unstable at the work site and the location of that area.

[0023] In this embodiment, by performing a simulation in a virtual space that recreates a work site, areas in the work site, which is a physical space, where communication between the management device 200 and the shovel 100 becomes unstable are detected, and the operator of the shovel 100 is notified of the detected areas.

[0024] Therefore, the operator of the shovel 100 can avoid entering an area where communication is unstable. Furthermore, when the shovel 100 is performing work in an area where communication is unstable, the operator of the shovel 100 can take measures such as moving outside the area where communication is unstable when communicating with the management device 200. Therefore, according to this embodiment, the occurrence of communication failures can be suppressed.

[0025] In the following description, an area in which communication between the shovel 100 and the management device 200 becomes unstable is referred to as an unstable area.

[0026] 1, the management device 200 is realized by one information processing device, but is not limited to this. The management device 200 may be realized by multiple information processing devices. In other words, the functions realized by the management device 200 may be realized by multiple information processing devices.

[0027] Next, a configuration of the shovel 100 of this embodiment will be described.

[0028] The excavator 100 has a lower traveling body 1, a slewing mechanism 2, and an upper rotating body 3. In the excavator 100, the upper rotating body 3 is rotatably mounted on the lower traveling body 1 via the slewing mechanism 2. A boom 4 is attached to the upper rotating body 3. An arm 5 is attached to the tip of the boom 4, and a bucket 6 is attached to the tip of the arm 5 as an end attachment.

[0029] The boom 4, arm 5, and bucket 6 constitute an excavation attachment, which is an example of an attachment. The boom 4 is driven by a boom cylinder 7, the arm 5 is driven by an arm cylinder 8, and the bucket 6 is driven by a bucket cylinder 9. A boom angle sensor S1 is attached to the boom 4, an arm angle sensor S2 is attached to the arm 5, and a bucket angle sensor S3 is attached to the bucket 6.

[0030] The boom angle sensor S1 is configured to detect the rotation angle of the boom 4. In this embodiment, the boom angle sensor S1 is an acceleration sensor, and can detect the rotation angle of the boom 4 relative to the upper rotating body 3 (hereinafter referred to as the "boom angle"). For example, the boom angle is at its minimum when the boom 4 is lowered to the lowest and increases as the boom 4 is raised.

[0031] The arm angle sensor S2 is configured to detect the rotation angle of the arm 5. In this embodiment, the arm angle sensor S2 is an acceleration sensor, and can detect the rotation angle of the arm 5 relative to the boom 4 (hereinafter referred to as the "arm angle"). For example, the arm angle is at its minimum when the arm 5 is fully closed, and increases as the arm 5 is opened.

[0032] The bucket angle sensor S3 is configured to detect the rotation angle of the bucket 6. In this embodiment, the bucket angle sensor S3 is an acceleration sensor, and can detect the rotation angle of the bucket 6 relative to the arm 5 (hereinafter referred to as the "bucket angle"). For example, the bucket angle is at its minimum when the bucket 6 is fully closed, and increases as the bucket 6 is opened.

[0033] The boom angle sensor S1, the arm angle sensor S2, and the bucket angle sensor S3 may each be a potentiometer using a variable resistor, a stroke sensor that detects the stroke amount of the corresponding hydraulic cylinder, a rotary encoder that detects the rotation angle around the connecting pin, a gyro sensor, or a combination of an acceleration sensor and a gyro sensor, etc.

[0034] A boom rod pressure sensor S7R and a boom bottom pressure sensor S7B are attached to the boom cylinder 7. An arm rod pressure sensor S8R and an arm bottom pressure sensor S8B are attached to the arm cylinder 8.

[0035] A bucket rod pressure sensor S9R and a bucket bottom pressure sensor S9B are attached to the bucket cylinder 9. The boom rod pressure sensor S7R, the boom bottom pressure sensor S7B, the arm rod pressure sensor S8R, the arm bottom pressure sensor S8B, the bucket rod pressure sensor S9R and the bucket bottom pressure sensor S9B are also collectively referred to as the "cylinder pressure sensors."

[0036] The boom rod pressure sensor S7R detects the pressure in the rod-side oil chamber of the boom cylinder 7 (hereinafter referred to as the "boom rod pressure"), and the boom bottom pressure sensor S7B detects the pressure in the bottom-side oil chamber of the boom cylinder 7 (hereinafter referred to as the "boom bottom pressure"). The arm rod pressure sensor S8R detects the pressure in the rod-side oil chamber of the arm cylinder 8 (hereinafter referred to as the "arm rod pressure"), and the arm bottom pressure sensor S8B detects the pressure in the bottom-side oil chamber of the arm cylinder 8 (hereinafter referred to as the "arm bottom pressure").

[0037] The bucket rod pressure sensor S9R detects the pressure in the rod side oil chamber of the bucket cylinder 9 (hereinafter referred to as the "bucket rod pressure"), and the bucket bottom pressure sensor S9B detects the pressure in the bottom side oil chamber of the bucket cylinder 9 (hereinafter referred to as the "bucket bottom pressure").

[0038] The upper rotating body 3 is provided with a cabin 10 serving as a driver's cab, and is equipped with a power source such as an engine 11. In addition, a sensor for detecting the amount of CO2 emissions may be provided near the exhaust mechanism of the engine 11.

[0039] Furthermore, the upper rotating body 3 is equipped with a controller 30, a display device 40, an operation unit 42, an audio output device 43, a storage device 47, a positioning device P1, an aircraft tilt sensor S4, a rotation angular velocity sensor S5, an imaging device S6, and a communication device T1.

[0040] The upper rotating body 3 may be equipped with a power storage unit that supplies electric power, and a motor generator that generates electric power using the rotational driving force of the engine 11. The power storage unit is, for example, a capacitor or a lithium ion battery. The motor generator may function as an electric motor to drive a mechanical load, or may function as a generator to supply electric power to an electric load.

[0041] The controller 30 functions as a main control unit that controls the drive of the shovel 100. In this embodiment, the controller 30 is configured by a computer including a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The various functions of the controller 30 are realized, for example, by the CPU executing a program stored in the ROM. The various functions may include, for example, at least one of a machine guidance function that guides (guides) the manual operation of the shovel 100 by the operator, and a machine control function that automatically assists the manual operation of the shovel 100 by the operator.

[0042] The display device 40 is configured to display various information. The display device 40 may be connected to the controller 30 via a communication network such as a Controller Area Network (CAN), or may be connected to the controller 30 via a dedicated line.

[0043] The operation unit 42 is configured to enable an operator to input various information to the controller 30. The operation unit 42 includes at least one of a touch panel, a knob switch, a membrane switch, and the like installed in the cabin 10.

[0044] The audio output device 43 is configured to output audio. The audio output device 43 may be, for example, an in-vehicle speaker connected to the controller 30, or an alarm such as a buzzer. In this embodiment, the audio output device 43 is configured to output various information by audio in response to an audio output command from the controller 30.

[0045] The storage device 47 is configured to store various information. The storage device 47 is, for example, a non-volatile storage medium such as a semiconductor memory. The storage device 47 may store information output by various devices during operation of the shovel 100, or may store information acquired via various devices before the operation of the shovel 100 is started.

[0046] The positioning device P1 is configured to measure the position of the upper rotating body 3. The positioning device P1 may be configured to measure the orientation of the upper rotating body 3. In this embodiment, the positioning device P1 is, for example, a GNSS compass, detects the position and orientation of the upper rotating body 3, and outputs the detected value to the controller 30. Therefore, the positioning device P1 can also function as an orientation detection device that detects the orientation of the upper rotating body 3. The orientation detection device may be a direction sensor attached to the upper rotating body 3.

[0047] The machine body inclination sensor S4 is configured to detect the inclination of the upper rotating body 3. In this embodiment, the machine body inclination sensor S4 is an acceleration sensor that detects the longitudinal inclination angle about the longitudinal axis and the lateral inclination angle about the lateral axis of the upper rotating body 3 with respect to a virtual horizontal plane. The longitudinal axis and the lateral axis of the upper rotating body 3 are perpendicular to each other at, for example, the shovel center point, which is a point on the rotation axis of the shovel 100.

[0048] The rotation angular velocity sensor S5 is configured to detect the rotation angular velocity of the upper rotating body 3. The rotation angular velocity sensor S5 may be configured to detect or calculate the rotation angle of the upper rotating body 3. In this embodiment, the rotation angular velocity sensor S5 is a gyro sensor. The rotation angular velocity sensor S5 may be a resolver, a rotary encoder, or the like.

[0049] The imaging device S6 is an example of a spatial recognition device, and is configured to acquire an image of the periphery of the shovel 100. In this embodiment, the imaging device S6 includes a front camera S6F that images the space in front of the shovel 100, a left camera S6L that images the space to the left of the shovel 100, a right camera S6R that images the space to the right of the shovel 100, and a rear camera S6B that images the space behind the shovel 100.

[0050] The imaging device S6 is, for example, a monocular camera having an imaging element such as a CCD or CMOS, and outputs a captured image to the display device 40. The imaging device S6 may be a stereo camera, a distance image camera, or the like. The imaging device S6 may be replaced with other spatial recognition devices such as a three-dimensional distance image sensor, an ultrasonic sensor, a millimeter wave radar, a LIDAR, or an infrared sensor, or may be replaced with a combination of another spatial recognition device and a camera.

[0051] The front camera S6F is attached, for example, to the ceiling of the cabin 10, i.e., inside the cabin 10. However, the front camera S6F may be attached to the outside of the cabin 10, such as the roof of the cabin 10 or the side of the boom 4. The left camera S6L is attached to the left end of the upper surface of the upper rotating body 3, the right camera S6R is attached to the right end of the upper surface of the upper rotating body 3, and the rear camera S6B is attached to the rear end of the upper surface of the upper rotating body 3.

[0052] The communication device T1 is configured to control communication with an external device outside the shovel 100 via a wireless antenna 310. In this embodiment, the communication device T1 controls communication with the external device via a satellite communication network, a mobile phone communication network, an Internet network, or the like. The external device is, for example, a management device 200 such as a server installed in an external facility, or a support device such as a smartphone carried by a worker in the vicinity of the shovel 100.

[0053] Next, the hardware configuration of each device in the management system SYS will be described with reference to Fig. 2. Fig. 2 is a diagram for explaining the hardware configuration of each device in the management system for an excavator.

[0054] First, a description will be given of the basic system mounted on the excavator 100. In Fig. 2, mechanical power transmission lines are indicated by double lines, hydraulic oil lines by thick solid lines, pilot lines by dashed lines, power lines by thin solid lines, and electrical control lines by dashed lines.

[0055] As shown in FIG. 2, the basic system of the excavator 100 mainly includes the engine 11, the main pump 14, the pilot pump 15, the control valve 17, the operating device 26, the operating pressure sensor 29, the controller 30, the switching valve 60, the display device 40, the engine speed adjustment dial 75, the output characteristics changeover switch 76, and the like.

[0056] The engine 11 is a diesel engine that employs isochronous control for maintaining a constant engine speed regardless of changes in the load. The amount of fuel injected into the engine 11, the timing of fuel injection, the boost pressure, and the like are controlled by an engine control unit (ECU 74).

[0057] The engine 11 is connected to a main pump 14 and a pilot pump 15, which serve as hydraulic pumps. The main pump 14 is connected to a control valve 17 via a hydraulic oil line.

[0058] The control valve 17 is a hydraulic control device that controls the hydraulic system of the excavator 100. The control valve 17 is connected to hydraulic actuators such as the left traveling hydraulic motor, the right traveling hydraulic motor, the boom cylinder 7, the arm cylinder 8, the bucket cylinder 9, and the swing hydraulic motor.

[0059] Specifically, the control valve 17 includes a plurality of spool valves corresponding to the respective hydraulic actuators. Each spool valve is configured to be displaceable in response to the pilot pressure so that the opening area of ​​the PC port and the opening area of ​​the CT port can be increased or decreased. The PC port is a port that communicates between the main pump 14 and the hydraulic actuators. The CT port is a port that communicates between the hydraulic actuators and the hydraulic oil tank.

[0060] The pilot pump 15 is connected to the operating devices 26 via a pilot line. The operating devices 26 include, for example, a left operating lever, a right operating lever, and a travel operating device. The travel operating device includes, for example, a travel lever and a travel pedal. In this embodiment, each of the operating devices 26 is a hydraulic operating device and is connected to a pilot port of a corresponding spool valve in the control valve 17 via a pilot line. However, the operating devices 26 may be electric operating devices.

[0061] The operation pressure sensor 29 detects the operation of the operation device 26 in the form of pressure. The operation pressure sensor 29 outputs a detected value to the controller 30. However, the operation of the operation device 26 may be detected electrically.

[0062] The switching valve 60 is configured to be able to switch between an enabled state and an disabled state of the operating device 26. The enabled state of the operating device 26 is a state in which the operator can operate the hydraulic actuator using the operating device 26. The disabled state of the operating device 26 is a state in which the operator cannot operate the hydraulic actuator using the operating device 26. In this embodiment, the switching valve 60 is a gate lock valve configured to operate in response to a command from the controller 30.

[0063] Specifically, the switching valve 60 is disposed in a pilot line connecting the pilot pump 15 and the operating device 26, and is configured to be able to switch between open and closed states of the pilot line in response to a command from the controller 30. The operating device 26 is enabled, for example, when the gate lock lever D4 is pulled up to open the switching valve 60 (gate lock valve), and disabled, when the gate lock lever D4 is pushed down to close the switching valve 60 (gate lock valve).

[0064] The display device 40 is configured to display various types of information. The display device 40 may be connected to the controller 30 via a communication network such as a CAN, or may be connected to the controller 30 via a dedicated line. In this embodiment, the display device 40 is configured to display one or more captured images captured by the imaging device S6 and a menu screen. The display device 40 operates by receiving power supply from the storage battery 70. The display device 40 has a control unit 40a, an image display unit 41, and an operation unit 42.

[0065] The control unit 40a controls the image displayed on the image display unit 41. In this embodiment, the control unit 40a is configured as a computer equipped with a CPU, RAM, NVRAM, ROM, etc. In this case, the control unit 40a reads out a program corresponding to each functional element from the ROM and loads it into the RAM, and causes the CPU to execute the corresponding process. However, each functional element may be configured as hardware, or may be configured as a combination of software and hardware. In addition, the image displayed on the image display unit 41 may be controlled by the controller 30 or the imaging device S6.

[0066] The image display unit 41 displays a captured image captured by at least one of the imaging devices S6 and a menu screen. The captured image may be, for example, any one of a rear image captured by the rear camera S6B, a left image captured by the left camera S6L, and a right image captured by the right camera S6R. The captured image may be, for example, an overhead image obtained by combining captured images captured by the rear camera S6B, the left camera S6L, and the right camera S6R. The captured image may be two or more images selected from a rear image, a left image, a right image, and an overhead image. The menu screen includes a status screen showing a status of the shovel 100 and a setting screen showing various settings of the shovel 100.

[0067] The operation unit 42 is a switch panel including hardware switches. The operation unit 42 may be a touch panel. In this embodiment, the operation unit 42 is disposed below the image display unit 41, and includes a switch (e.g., a menu switch) for changing an image displayed by the image display unit 41. However, the arrangement of the operation unit 42 is not limited to the above example, and may be disposed, for example, on an operation lever, or on a seat left console or seat right console on both the left and right sides of the driver's seat. Here, in addition to the operation unit 42 provided on the display device 40, a driver's seat side operation unit 50 having the same function as the operation unit 42 may be disposed on at least one of the operation lever, the seat left console, and the seat right console.

[0068] In this embodiment, when a menu switch of the operation unit 42 is operated while the overhead image FV and rearward image CBT captured by the imaging device S6 are displayed, the image display unit 41 displays a menu screen. For example, the image display unit 41 reduces the size of the rearward image CBT without changing the size of the overhead image FV before and after the menu switch of the operation unit 42 is operated, and displays a screen for selecting a detailed menu item. Then, when a predetermined switch of the operation unit 42 is operated while the screen for selecting a detailed menu item is displayed, the image display unit 41 switches the rearward image CBT to a menu screen such as a status screen showing the status of the shovel 100 and a setting screen showing various settings of the shovel 100. At this time, the image display unit 41 displays the overhead image FV in a state where the size is maintained without being changed.

[0069] Furthermore, the image display unit 41 may be configured to display a menu screen when a menu switch of the operation unit 42 is operated, regardless of whether the shovel 100 is in an operable state or an inoperable state. Furthermore, the image display unit 41 may be configured to display a menu screen when a menu switch of the operation unit 42 is operated, only when the shovel 100 is in an inoperable state.

[0070] Also, for example, these may be configured to be switchable by a switching means such as a change-over switch. The state in which the shovel 100 is operable is, for example, a state in which the gate lock lever D4 is pulled up and the change-over valve 60 is opened, thereby enabling the operation device 26. The state in which the shovel 100 is inoperable is, for example, a state in which the gate lock lever D4 is pushed down and the change-over valve 60 is closed, thereby disabling the operation device 26.

[0071] The storage battery 70 is charged with electricity generated by, for example, the alternator 11a. The power of the storage battery 70 is also supplied to the controller 30, etc. For example, the starter 11b of the engine 11 is driven by the power from the storage battery 70 to start the engine 11.

[0072] The ECU 74 transmits data relating to the state of the engine 11, such as the coolant temperature, to the controller 30. The regulator 14a of the main pump 14 transmits data relating to the swash plate tilt angle to the controller 30. The discharge pressure sensor 14b transmits data relating to the discharge pressure of the main pump 14 to the controller 30. The oil temperature sensor 14c provided in the pipeline between the hydraulic oil tank and the main pump 14 transmits data relating to the temperature of the hydraulic oil flowing through that pipeline to the controller 30. The operating pressure sensor 29 transmits data relating to the pilot pressure generated when the operating device 26 is operated to the controller 30. The controller 30 stores these data in a temporary storage unit (memory) and can transmit them to the display device 40 when necessary.

[0073] The engine speed adjustment dial 75 is a dial for adjusting the speed of the engine 11. The engine speed adjustment dial 75 transmits data related to the setting state of the engine speed to the controller 30. The engine speed adjustment dial 75 is configured to be able to switch the engine speed among four stages: SP mode, H mode, A mode, and IDLE mode.

[0074] The SP mode is a rotation speed mode selected when the amount of work is to be prioritized, and uses the highest engine rotation speed. The H mode is a rotation speed mode selected when both the amount of work and fuel efficiency are to be achieved, and uses the second highest engine rotation speed. The A mode is a rotation speed mode selected when the excavator 100 is to be operated quietly while giving priority to fuel efficiency, and uses the third highest engine rotation speed.

[0075] The IDLE mode is a rotation speed mode selected when it is desired to put the engine 11 into an idling state, and utilizes the lowest engine rotation speed. The engine 11 is controlled so as to be constant at an engine rotation speed corresponding to the rotation speed mode set by the engine rotation speed adjustment dial 75. The engine rotation speed adjustment dial 75 is provided with an output characteristics changeover switch 76, and the output characteristics of the excavator 100 can be changed by pressing the output characteristics changeover switch 76. The output characteristics changeover switch 76 may, for example, change the engine output torque diagram, or may reduce the engine rotation speed of each stage on the engine rotation speed adjustment dial 75 by a predetermined value.

[0076] The alarm device 49 is a device for attracting the attention of people involved in the work of the shovel 100. The alarm device 49 is configured, for example, by a combination of an indoor alarm device and an outdoor alarm device. The indoor alarm device is a device for attracting the attention of an operator of the shovel 100 in the cabin 10, and includes, for example, at least one of a sound output device, a vibration generating device, and a light emitting device provided in the cabin 10. The indoor alarm device may be the display device 40.

[0077] The exterior alarm device is a device for calling the attention of workers working around the excavator 100, and includes, for example, at least one of a sound output device and a light emitting device provided outside the cabin 10. The sound output device as the exterior alarm device includes, for example, a traveling alarm device attached to the bottom surface of the upper rotating body 3. The exterior alarm device may also be a light emitting device provided on the upper rotating body 3. However, the exterior alarm device may be omitted. The alarm device 49 may, for example, when the imaging device S6 functioning as an object detection device detects a predetermined object, notify a person involved in the work of the excavator 100 of that fact.

[0078] Next, a description will be given of the hardware configuration of the management device 200 of this embodiment. The management device 200 of this embodiment is a computer having a CPU (Central Processing Unit) 201, a storage device 202, a communication device 203, an input device 204, and a display device 205, which are all connected to each other via a bus.

[0079] The CPU 201 controls the overall operation of the management device 200. The storage device 202 stores programs executed by the CPU 201 and various information related to the shovel 100. The communication device 203 communicates with the shovel 100 and the like via a network.

[0080] The input device 204 is for inputting information to the management device 200, and is realized by, for example, a keyboard, a pointing device, etc. The display device 205 is for displaying various information output from the management device 200, and is realized by a display, etc.

[0081] Next, the functional configuration of the management device 200 of this embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram for explaining the functional configuration of the management device of the first embodiment. Each unit shown in Fig. 3 is realized by the CPU 201 reading and executing a program stored in the storage device 202.

[0082] The management device 200 of this embodiment includes an information acquisition unit 31, a virtual space construction unit 32, an unstable area detection unit 33, and a notification output unit .

[0083] The information acquiring unit 31 acquires various types of information. Specifically, the information acquiring unit 31 acquires operation information transmitted from the shovel 100. In addition, the information acquiring unit 31 acquires environmental information transmitted from the wireless antenna 310.

[0084] The operation information acquired by the information acquisition unit 31 is, in other words, the result of measuring the internal state of the shovel 100 by various sensors possessed by the shovel 100, and specifically may include, for example, output values ​​of a pressure gauge, a cylinder displacement sensor, and an IMU (Inertial Measurement Unit).

[0085] In other words, the environmental information acquired by the information acquisition unit 31 may include an output value of a positioning device 311 included in the wireless antenna 310. The output value of the positioning device 311 is, in other words, an output value of a GNSS compass, an imaging device, Lidar, and the like.

[0086] The virtual space construction unit 32 constructs a three-dimensional virtual space that reproduces a work site based on the operation information and environmental information acquired by the information acquisition unit 31.

[0087] The unstable area detection unit 33 performs a simulation in the virtual space constructed by the virtual space construction unit 32 to detect an unstable area in the work site. In other words, the unstable area detection unit 33 performs a simulation to detect an unstable area in the virtual space that reproduces the work site.

[0088] In this embodiment, when communication between the shovel 100 and the wireless antenna 310 becomes unstable, communication between the shovel 100 and the management device 200 via the wireless antenna 310 also becomes unstable. Therefore, the unstable area detection unit 33 of this embodiment may use, for example, a virtual space to detect an area where the shovel 100 and the wireless antenna 310 cannot be connected in a straight line as an unstable area.

[0089] The notification output unit 34 generates and outputs a notification indicating the unstable area when the unstable area detection unit 33 detects the unstable area. The notification may be output to the display device 40 of the shovel 100.

[0090] Next, the operation of the management system SYS of this embodiment will be described with reference to Fig. 4. Fig. 4 is a first sequence diagram illustrating the operation of the management system for a work machine of the first embodiment.

[0091] In the management system SYS, the wireless antenna 310 transmits environmental information to the management device 200 (step S401). In the present embodiment, the environmental information is acquired from the wireless antenna 310, but is not limited to this. The management device 200 of the present embodiment may acquire the environmental information in advance.

[0092] Moreover, in the management system SYS, the excavator 100 transmits operation information to the management device 200 (step S402).

[0093] The wireless antenna 310 and the shovel 100 may each transmit the environmental information and the operation information to the management device 200 at an arbitrary timing. The timing at which the wireless antenna 310 transmits the environmental information to the management device 200 and the timing at which the shovel 100 transmits the operation information to the management device 200 may be set in advance.

[0094] When the management device 200 receives the environmental information and operation information, the information acquisition unit 31 acquires the environmental information and operation information (step S403), and the virtual space construction unit 32 constructs a three-dimensional virtual space that reproduces the work site 300 (step S404).

[0095] Next, the management device 200 detects an unstable area in the work site by the unstable area detection unit 33 (step S405).

[0096] Specifically, the unstable area detection unit 33 moves the shovel 100 in the virtual space, and detects an area in which a straight line cannot be drawn between the shovel 100 and the wireless antenna 310. In other words, the unstable area detection unit 33 moves the shovel 100 in the virtual space, and detects an area in which a straight line connecting the shovel 100 and the wireless antenna 310 is blocked by an obstacle.

[0097] In step S405, when an unstable area is detected, the management device 200 causes the notification output unit 34 to output a notification indicating that an unstable area has been detected to the shovel 100 (step S406). Upon receiving the notification from the management device 200, the shovel 100 causes the display device 40 to display the notification (step S407).

[0098] In addition, if no unstable area is detected in the virtual space, the management device 200 may terminate the processing as is, or may output a notification to the shovel 100 indicating that no unstable area exists in the work site 300.

[0099] Furthermore, in the management system SYS of this embodiment, the operation shown in Fig. 4 may be performed at regular time intervals. Furthermore, in the management system SYS, the processing shown in Fig. 4 may be performed each time the position of the shovel 100 changes. In other words, in the management system SYS of this embodiment, the unstable area may be updated each time the shovel 100 moves. In this manner, the latest unstable area can be notified to the operator according to the position of the shovel 100. Furthermore, in this embodiment, since the management device 200 performs various processes, it is possible to notify the operator of the unstable area without increasing the processing load on the shovel 100.

[0100] Next, the operation of the management device 200 of this embodiment will be specifically described with reference to Fig. 5. Fig. 5 is a diagram for explaining the operation of the work machine management system of the first embodiment.

[0101] 5 shows a case where a wireless antenna 310 and an obstacle 320 are placed at a work site 300 where a shovel 100 is working. In the example of FIG. 5, the management device 200 may be installed at a location away from the work site 300.

[0102] The management device 200 of this embodiment acquires environmental information from the positioning device 311 of the wireless antenna 310 and acquires operation information from the shovel 100 by the information acquisition unit 31 .

[0103] The environmental information of the work site 300 may include the topography of the work site 300, the positions of obstacles 320 placed at the work site 300, information indicating the type and material of the obstacles 320, information indicating the frequency band of radio waves used in wireless communication at the work site 300, information indicating the directivity of the wireless antenna 310, information indicating the weather at the work site 300 on the day the work was performed, etc. The type and material of the obstacle 320 may be information indicating, for example, whether the obstacle 320 is made of metal, whether the obstacle 320 is made of wood, etc.

[0104] In this embodiment, by acquiring environmental information collected by the wireless antenna 310 provided at the work site 300 of the shovel 100 in this manner, a virtual space that reproduces the work site 300 can be constructed.

[0105] The management device 200 generates a virtual space that reproduces the work site 300 based on the operation information and the environmental information using the virtual space construction unit 32.

[0106] In addition, the management device 200 performs a simulation using the unstable area detection unit 33 in a virtual space that reproduces the work site 300, assuming wireless communication between the shovel 100 and the management device 200, and detects unstable areas in the work site 300.

[0107] 5, when the shovel 100 advances in the current direction of the arrow Y1 and enters the area 350, a straight line cannot be drawn between the shovel 100 and the wireless antenna 310. Therefore, the unstable area detection unit 33 detects the area 350 as an unstable area.

[0108] The unstable area detection unit 33 of this embodiment may detect an unstable area by a method other than the above-mentioned method. For example, the unstable area detection unit 33 may use information indicating the directivity of the wireless antenna 310, information indicating the frequency band of the radio waves, information indicating the material of the obstacle 320, etc., included in the environmental information, to simulate whether communication is possible when the shovel 100 moves within the work site 300, and detect the unstable area according to the simulation result.

[0109] When the management device 200 detects that the area 350 is an unstable area, the notification output unit 34 generates a notification indicating that the area 350 is an unstable area, and outputs the notification to the display device 40 of the shovel 100. Note that, for example, in a case where the operator of the shovel 100 is wearing AR (Augmented Reality) glasses 340 having an augmented reality function, the notification output unit 34 may transfer the notification received from the management device 200 by the display device 40 of the shovel 100 to the AR glasses 340.

[0110] In this case, an image showing the area 350 may be displayed on a display unit of the AR glasses 340 so that the operator can visually recognize the position of the unstable area.

[0111] A display example of the display device 40 of the shovel 100 will be described below. Fig. 6 is a diagram showing a display example of the display device of the shovel. The image display unit 41 shown in Fig. 6 is an example of a screen displayed on the display device 40 of the shovel 100 in step S407 of Fig. 4.

[0112] 6 includes an image display unit 41 and an operation unit 42. The image display unit 41 is a screen on which various images are displayed. The operation unit 42 includes various menu switches.

[0113] First, a description will be given of the image display unit 41. As shown in Fig. 6, the image display unit 41 includes a date and time display area 41a, a driving mode display area 41b, an attachment display area 41c, a fuel efficiency display area 41d, an engine control state display area 41e, an engine operating time display area 41f, a coolant temperature display area 41g, a remaining fuel amount display area 41h, a rotation speed mode display area 41i, a remaining urea water amount display area 41j, a hydraulic oil temperature display area 41k, an air conditioner operating state display area 41m, an image display area 41n, and a menu display area 41p.

[0114] The travel mode display area 41b, the attachment display area 41c, the engine control state display area 41e, the rotation speed mode display area 41i, and the air conditioner operation state display area 41m are areas that display setting information related to the setting state of the excavator 100. The fuel consumption display area 41d, the engine operation time display area 41f, the coolant temperature display area 41g, the remaining fuel amount display area 41h, the remaining urea water amount display area 41j, and the hydraulic oil temperature display area 41k are areas that display operation information related to the operating state of the excavator 100.

[0115] Specifically, the date and time display area 41a is an area for displaying the current date and time. The driving mode display area 41b is an area for displaying the current driving mode. The attachment display area 41c is an area for displaying an image representing the currently attached attachment. The fuel efficiency display area 41d is an area for displaying fuel efficiency information calculated by the controller 30. The fuel efficiency display area 41d includes an average fuel efficiency display area 41d1 for displaying lifetime average fuel efficiency or section average fuel efficiency, and an instantaneous fuel efficiency display area 41d2 for displaying instantaneous fuel efficiency.

[0116] The engine control status display area 41e is an area that displays the control status of the engine 11. The engine operating time display area 41f is an area that displays the accumulated operating time of the engine 11. The coolant temperature display area 41g is an area that displays the current temperature state of the engine coolant. The remaining fuel amount display area 41h is an area that displays the remaining amount of fuel stored in the fuel tank.

[0117] The rotation speed mode display area 41i is an area that displays, by an image, the current rotation speed mode set by the engine rotation speed adjustment dial 75. The urea water remaining amount display area 41j is an area that displays, by an image, the remaining amount of urea water stored in the urea water tank. The hydraulic oil temperature display area 41k is an area that displays the temperature state of the hydraulic oil in the hydraulic oil tank.

[0118] The air conditioner operation status display area 41m includes an air outlet display area 41m1 that displays the current air outlet position, an operation mode display area 41m2 that displays the current operation mode, a temperature display area 41m3 that displays the current set temperature, and an air volume display area 41m4 that displays the current set air volume.

[0119] The image display area 41n is an area for displaying an image captured by the imaging device S6. In the example of Fig. 6, the image display area 41n displays the image FV1 including the image 350A showing the detected unstable area and the rear image CBT.

[0120] Image FV1 is, for example, an image obtained by superimposing image 350A showing the unstable area on an image captured by front camera S6F. Image 350A showing the unstable area is, for example, an image generated as an AR image by notification output unit 34 based on information showing the position of area 350 in work site 300, position information showing the current position of shovel 100, and the orientation of shovel 100.

[0121] Further, the image display area 41n has a first image display area 41n1 located at the top and a second image display area 41n2 located at the bottom. In the example of Fig. 6, the image FV1 including the image 350A showing the unstable area is arranged in the first image display area 41n1, and the rear image CBT is arranged in the second image display area 41n2. However, the image display area 41n may arrange the image FV1 including the image 350A showing the unstable area in the second image display area 41n2, and the rear image CBT in the first image display area 41n1.

[0122] In the image display area 41n, the image displayed in the first image display area 41n1 can be switched from the image FV1 including the image 350A showing the unstable area to an overhead image, or from the overhead image to the image FV1 including the image 350A showing the unstable area. The switching operation may be performed by any switch of the operation unit 42.

[0123] The overhead image in this embodiment is, for example, a virtual viewpoint image generated by the controller 30 or the control unit 40a, and is generated based on images captured by the rear camera S6B, the left camera S6L, and the right camera S6R.

[0124] In addition, in the example of Fig. 6, the image FV1 or the overhead image including the image 350A showing the unstable region and the rear image CBT are arranged adjacent to each other vertically, but they may be arranged with a gap therebetween. In addition, in the example of Fig. 6, the image display area 41n is a vertically elongated area, but the image display area 41n may be a horizontally elongated area.

[0125] When the image display area 41n is a horizontally long area, the image display area 41n may arrange the image FV1 including the image 350A indicating the unstable area or the overhead image as the first image display area 41n1 on the left side, and arrange the rear image CBT as the second image display area 41n2 on the right side. In this case, they may be arranged with a space between them, or the positions of the image FV1 including the image 350A indicating the unstable area or the overhead image and the rear image CBT may be interchanged.

[0126] Furthermore, in this embodiment, an icon image 41x is displayed in each of the first image display area 41n1 and the second image display area 41n2. The icon image 41x is an image that represents the relative relationship between the position of the imaging device S6 and the orientation of the attachment of the upper rotating body 3.

[0127] The icon image 41x of this embodiment includes an image 41xM of the shovel 100, an image 41xF showing the front of the shovel 100, and an image 41xB showing the rear of the shovel 100. The icon image 41x also includes an image 41xL showing the left side of the shovel 100, an image 41xR showing the right side of the shovel 100, and an image 41xI showing the inside of the cabin 10.

[0128] The images 41xF, 41xB, 41xL, 41xR, and 41xI correspond to the front camera S6F that images the front of the shovel 100, the rear camera S6B that images the rear of the shovel 100, the left camera S6L that images the left side of the shovel 100, and the right camera S6R that images the right side of the shovel 100. In addition, the image 41xI corresponds to the camera inside the cabin 10.

[0129] In this embodiment, when an image associated with a camera is selected in the icon image 41x, image data captured by the camera corresponding to the selected image is displayed in the image display area 41n.

[0130] 6, in the first image display area 41n1, the display manner of the image 41xF is different from the display manner of the images 41xB, 41xL, 41xR, and 41xI. Therefore, it can be seen that the image FV1 based on the image data captured by the front camera S6F corresponding to the image 41xF is displayed in the first image display area 41n1.

[0131] In addition, in the second image display region 41n2, the display mode of the image 41xB is different from the display modes of the images 41xF, 41xL, 41xR, and 41xI. Therefore, it can be seen that the image represented by the image data captured by the rear camera S6B corresponding to the image 41xB is displayed in the second image display region 41n2.

[0132] The menu display area 41p has tabs 41p1 to 41p7. In the example of Fig. 6, the tabs 41p1 to 41p7 are arranged at intervals from each other on the left and right at the bottom of the image display section 41. Icon images for displaying various types of information are displayed on the tabs 41p1 to 41p7.

[0133] In the tab 41p1, a menu detailed item icon image for displaying a menu detailed item is displayed. When the operator selects the tab 41p1, the icon images displayed in the tabs 41p2 to 41p7 are switched to icon images associated with the menu detailed items.

[0134] An icon image for displaying information related to the digital level is displayed on the tab 41p4. When the operator selects the tab 41p4, the rear image CBT is switched to a screen showing information related to the digital level. However, the screen showing information related to the digital level may be displayed by superimposing the information on the rear image CBT or by reducing the rear image CBT.

[0135] In addition, in this embodiment, when an overhead image is displayed, the overhead image may be switched to a screen showing information related to the digital level, or a screen showing information related to the digital level may be displayed by superimposing it on the overhead image or by reducing the overhead image.

[0136] The tab 41p5 displays an icon image for transitioning the main screen displayed on the image display unit 41 to a loading work screen. When the operator selects the operation unit 42 corresponding to the tab 41p5 (described later), the main screen displayed on the image display unit 41 transitions to the loading work screen. At this time, the image display area 41n continues to be displayed, and the menu display area 41p switches to an area for displaying information related to the loading work.

[0137] The tab 41p6 displays an icon image for displaying information on information-based construction. When the operator selects the tab 41p6, the rear image CBT is switched to a screen showing information on information-based construction. However, the rear image CBT may be superimposed on the rear image CBT or the rear image CBT may be reduced to display a screen showing information on information-based construction. In addition, the image FV1 including the image 350A showing the unstable area or the overhead image may be switched to a screen showing information on information-based construction, and the image FV1 including the image 350A showing the unstable area or the overhead image may be superimposed on the image FV1 including the image 350A showing the unstable area or the overhead image, or the image FV1 including the image 350A showing the unstable area or the overhead image may be reduced to display a screen showing information on the digital level.

[0138] An icon image for displaying information related to the crane mode is displayed on the tab 41p7. When the operator selects the tab 41p7, the rear image CBT is switched to a screen showing information related to the crane mode. However, the screen showing information related to the crane mode may be displayed by superimposing the information on the rear image CBT or by reducing the rear image CBT.

[0139] Also, the image FV1 or the overhead image including the image 350A showing the unstable area may be switched to a screen showing information about the crane mode, or the image FV1 or the overhead image including the image 350A showing the unstable area may be superimposed on the image FV1 or the overhead image including the image 350A showing the unstable area, or the image FV1 or the overhead image including the image 350A showing the unstable area may be reduced to display a screen showing information about the crane mode. No icon image is displayed on the tabs 41p2 and 41p3. Therefore, even if the operator operates the tabs 41p2 and 41p3, no change occurs in the image displayed on the image display unit 41.

[0140] The icon images displayed on the tabs 41p1 to 41p7 are not limited to the above examples, and icon images for displaying other information may be displayed.

[0141] Next, a description will be given of the operation unit 42. As shown in Fig. 6, the operation unit 42 is composed of one or more button-type switches with which the operator selects tabs 41p1 to 41p7, inputs settings, and the like.

[0142] 6, operation unit 42 includes seven switches 42a1 to 42a7 arranged in an upper row and seven switches 42b1 to 42b7 arranged in a lower row. Switches 42b1 to 42b7 are arranged below switches 42a1 to 42a7, respectively.

[0143] However, the number, type, and arrangement of the switches of the operation unit 42 are not limited to the above example, and may be, for example, a jog wheel, a jog switch, or the like that combines the functions of multiple button-type switches into one, or the operation unit 42 may be separate from the display device 40. Also, a touch panel in which the image display unit 41 and the operation unit 42 are integrated may be used to directly operate the tabs 41p1 to 41p7.

[0144] The switches 42a1 to 42a7 are arranged below the tabs 41p1 to 41p7 in correspondence with the tabs 41p1 to 41p7, and function as switches for selecting the tabs 41p1 to 41p7, respectively.

[0145] Since the switches 42a1 to 42a7 are arranged below the tabs 41p1 to 41p7 in correspondence with the tabs 41p1 to 41p7, respectively, the operator can intuitively select the tabs 41p1 to 41p7.

[0146] In Fig. 6, for example, when the switch 42a1 is operated, the tab 41p1 is selected, the menu display area 41p is changed from a single-row display to a double-row display, and icon images corresponding to the first menu are displayed in the tabs 41p2 to 41p7. In addition, in response to the menu display area 41p being changed from a single-row display to a double-row display, the size of the rear image CBT is reduced. At this time, the size of the image FV1 or the overhead image including the image 350A showing the unstable area is maintained without being changed, so that visibility when the operator checks the surroundings of the excavator 100 is not deteriorated.

[0147] Furthermore, when the switch 42a5 is operated, the control unit 40a determines that the tab 41p5 is selected, and transitions the display on the image display unit 41 to a loading operation screen.

[0148] Specifically, when the switch 42a5 is operated, the control unit 40a changes the menu display area 41p to a work information display area that displays information related to the loading work, while maintaining the image display area 41n.

[0149] In this manner, in this embodiment, since the captured image continues to be displayed in the image display area 41n even on the loading operation screen, the visibility when the operator checks the surroundings of the excavator 100 is not impaired.

[0150] The switch 42b1 is a switch that switches the captured image displayed in the image display region 41n. Each time the switch 42b1 is operated, the captured image displayed in the first image display region 41n1 of the image display region 41n is switched, for example, among a rear image, a left image, a right image, and an overhead image.

[0151] In addition, each time the switch 42b1 is operated, the captured image displayed in the second image display area 41n2 of the image display area 41n may be configured to switch between, for example, a rear image, a left image, a right image, and an overhead image.

[0152] Furthermore, the control unit 40a may change the display manner of the images 41xF, 41xB, 41xL, 41xR, and 41xI in the icon image 41x in response to an operation of the switch 42b1.

[0153] Moreover, the image display area 41n may be configured such that the captured image displayed in the first image display area 41n1 and the captured image displayed in the second image display area 41n2 of the image display area 41n are switched every time the switch 42b1 is operated.

[0154] In this way, the switch 42b1 serving as the operation unit 42 may switch the screen displayed in the first image display area 41n1 or the second image display area 41n2, or may switch the screen displayed in the first image display area 41n1 and the second image display area 41n2. Also, a separate switch may be provided for switching the screen displayed in the second image display area 41n2.

[0155] The switches 42b2 and 42b3 are switches for adjusting the air volume of the air conditioner. In the example of Fig. 6, the air volume of the air conditioner is configured to decrease when the switch 42b2 is operated, and to increase when the switch 42b3 is operated.

[0156] The switch 42b4 is a switch for switching the cooling / heating function ON / OFF. In the example of Fig. 6, the switch 42b4 is configured to switch the cooling / heating function ON / OFF every time it is operated.

[0157] The switches 42b5 and 42b6 are used to adjust the set temperature of the air conditioner. In the example of Fig. 6, the set temperature is lowered when the switch 42b5 is operated, and is raised when the switch 42b6 is operated.

[0158] The switch 42b7 is a switch capable of switching the display of the engine operating time display area 41f.

[0159] The switches 42a2 to 42a6 and 42b2 to 42b6 are configured to allow input of numbers displayed on or near the respective switches. The switches 42a3, 42a4, 42a5 and 42b4 are configured to allow the cursor to be moved left, up, right and down, respectively, when the cursor is displayed on the menu screen.

[0160] The functions given to the switches 42a1 to 42a7 and 42b1 to 42b7 are merely examples, and the switches 42a1 to 42a7 may be configured to execute other functions.

[0161] In this manner, in this embodiment, when the tab 41p1 is selected in a state in which the image FV1 (or the overhead image) including the image 350A indicating the unstable region and the rear image CBT are displayed in the image display area 41n, the menu detail items are displayed in the tabs 41p2 to 41p7 with these images displayed. Therefore, the operator can check the menu detail items while checking the image FV1 (or the overhead image) including the image 350A indicating the unstable region and the rear image CBT.

[0162] Furthermore, in the image display region 41n, the image FV1 including the image 350A indicating the unstable region or the overhead image is displayed without changing in size before and after the tab 41p1 is selected. This does not deteriorate the visibility when the operator checks the surroundings of the excavator 100.

[0163] As described above, in this embodiment, the image FV1 including the image 350A indicating the unstable area is displayed on the display device 40 of the shovel 100, so that the operator of the shovel 100 can It is possible to make the presence of unstable areas known.

[0164] In addition, in this embodiment, for example, the operation of the shovel 100 may be controlled by the controller 30 so that the shovel 100 does not enter an unstable area.

[0165] Specifically, for example, when the shovel 100 travels toward the unstable area, the controller 30 may display a notification instructing the shovel 100 to stop traveling before entering the unstable area together with the image 350A showing the unstable area.

[0166] Furthermore, the controller 30 may stop the operation of the shovel 100 when the shovel 100 approaches an unstable area by a predetermined distance or more.

[0167] In this embodiment, by controlling the shovel 100 in this manner, it is possible to suppress the occurrence of communication failures caused by the shovel 100 entering an unstable area.

[0168] Next, a case where an image showing an unstable region is displayed on the AR glasses 340 will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of display on the AR glasses.

[0169] When the shovel 100 receives a notification indicating an unstable area from the management device 200, the AR glasses 340 of this embodiment may display an image 350A indicating the unstable area on the display unit 341 of the AR glasses 340.

[0170] In FIG. 7, the AR glasses 340 are of a monocular type, and the display unit 341 is a lens located in front of one eye, on which a display function is provided.

[0171] An image 350A indicating the unstable region is displayed on the display unit 341. The image 350A indicating the unstable region is displayed so as to be superimposed on the field of view of the operator wearing the AR glasses 340 and visually recognized.

[0172] Specifically, the image 350A indicating the unstable region is displayed on the display unit 341 at a position overlapping with the obstacle 320 visually recognized by the operator.

[0173] In this embodiment, by displaying an image indicating an unstable area on the AR glasses 340 in this manner, the operator can intuitively recognize the presence of the unstable area.

[0174] In this embodiment, the AR glasses 340 do not have to be monocular. The AR glasses 340 are an example of a head mounted display, and the head mounted display may include a retinal scanning head mounted display.

[0175] Second Embodiment The second embodiment will be described below with reference to the drawings. The second embodiment differs from the first embodiment in that the shovel 100 is remotely controlled and that the obstacle moves. In the following description of the second embodiment, the differences from the first embodiment will be described, and the same reference numerals as those used in the description of the first embodiment will be given to components having the same functional configuration as the first embodiment, and the description thereof will be omitted.

[0176] Fig. 8 is a diagram for explaining the operation of the management system for a work machine according to the second embodiment. In Fig. 8, the excavator 100 is remotely operated from a remote operation room 500 that is located at a location physically separated from the work site 300.

[0177] 8, a dump truck 330 is assumed to be traveling in the direction of an arrow Y2 in the work site 300. The dump truck 330 is an example of an obstacle.

[0178] In this case, the unstable area detection unit 33 of the management device 200 may update the unstable area instantly (in real time) in response to the movement of the dump truck 330.

[0179] In Fig. 8, it is assumed that the unstable area detected when the dump truck 330 is at point P is area 360A. In this case, when the dump truck 330 travels in the direction of arrow Y2, the management device 200 detects the unstable area again in accordance with the movement of the dump truck 330, and updates the unstable area. In Fig. 8, the unstable area after the movement of the dump truck 330 is updated to area 360B.

[0180] In this embodiment, the unstable region may be updated even when the position of the obstacle does not change but the position of the shovel 100 changes. That is, in this embodiment, the unstable region may be updated when at least one of the obstacle and the shovel 100 moves.

[0181] In this embodiment, even if an obstacle moves in the work site 300, it is possible to detect an unstable area based on the positional relationship between the shovel 100 and the obstacle 320. In addition, it is possible to notify the operator of the latest unstable area according to the position of the shovel 100.

[0182] Furthermore, when an unstable area is detected, the management device 200 of this embodiment notifies the remote operation room 500 of a notification indicating the unstable area. The remote operation room 500 displays an image indicating the unstable area on a display device or the like provided in the remote operation room 500, so that the operator who remotely operates the shovel 100 is made aware of the unstable area.

[0183] The operation of the management system SYS of this embodiment will be described below with reference to Fig. 9. Fig. 9 is a sequence diagram illustrating the operation of the work machine management system of the second embodiment.

[0184] The processing from step S901 to step S905 in FIG. 9 is similar to the processing from step S401 to step S405 in FIG. 4, and therefore the description thereof will be omitted.

[0185] When the management device 200 of this embodiment detects an unstable area, the notification output unit 34 transmits a notification indicating that the unstable area has been detected to the remote operation room 500 (step S906). When the remote operation room 500 receives the notification from the management device 200, it causes the display device to display the notification indicating that the unstable area has been detected (step S907).

[0186] Specifically, in the remote control room 500, an image showing the detected unstable area may be displayed on a display device.

[0187] In this embodiment, even if an obstacle moves at the work site 300, an unstable area can be detected in response to the movement of the obstacle. Furthermore, according to this embodiment, even if the shovel 100 is remotely operated, the operator performing the remote operation can be made to recognize the unstable area. Furthermore, according to this embodiment, since the management device 200 performs various processes, the operator performing the remote operation can be made to recognize the unstable area without increasing the processing load of the control device in the remote operation room 500.

[0188] Therefore, according to this embodiment, the occurrence of communication failures can be suppressed.

[0189] This embodiment can also be applied to a case where the dump truck 330 moves along a target trajectory by automatic control. In this case, the management device 200 may acquire trajectory information indicating a target trajectory of the dump truck 330, and predict an unstable area in the work site 300 in advance based on the target trajectory. Then, the management device 200 may notify the remote operation room 500 of the predicted result in advance. In this way, for example, the operator can be made aware of the unstable area before starting work by the excavator 100, which can contribute to improving work efficiency.

[0190] Third embodiment The third embodiment will be described below with reference to the drawings. The third embodiment differs from the first embodiment in that the third embodiment has a mobile object 400 that relays communication between the shovel 100 and the wireless antenna 310. In the following description of the third embodiment, differences from the first embodiment will be described, and components having the same functional configuration as the first embodiment will be given the same reference numerals as those used in the description of the first embodiment, and descriptions thereof will be omitted.

[0191] Fig. 10 is a diagram for explaining the operation of the management system for a work machine according to the third embodiment. In Fig. 10, a mobile body 400 having a communication function is placed at a work site 300, and relays communication between the shovel 100 and a wireless antenna 310. The mobile body 400 may be, for example, an air vehicle such as a drone, or may be a robot that moves on the ground.

[0192] In the management system SYS of this embodiment, the management device 200A moves the mobile body 400 according to the positional relationship between the obstacle 320 and the shovel 100 at the work site 300, and causes the shovel 100 and the management device 200 to communicate with each other via the mobile body 400.

[0193] 10, an obstacle 320 is placed at the work site 300. In this case, when the shovel 100 moves from point P11 to point P12, an unstable area is formed at the work site 300, in which it is not possible to connect the wireless antenna 310 and the shovel 100 in a straight line.

[0194] Therefore, in this embodiment, when the shovel 100 starts moving from point P11 to point P12, the management device 200A moves the mobile body 400, which has been waiting at point P21, to point P22 and relays communication between the wireless antenna 310 and the shovel 100.

[0195] In other words, when the management device 200A detects signs that the shovel 100 is entering an unstable area, it sets the target position of the moving body 400, which is waiting at point P21, to point P22, moves the moving body 400 to the target position, and relays communication between the wireless antenna 310 and the shovel 100.

[0196] In this way, by moving the mobile object 400 to the point P22 and relaying communication between the shovel 100 and the wireless antenna 310 through the mobile object 400, the shovel 100 can stably communicate with the management device 200 via the wireless antenna 310 even at the point P12 included in the unstable area. That is, in this embodiment, by using the mobile object 400 as a relay point, it is possible to change the unstable area into an area where stable communication can be performed. In the following description, an area where stable communication can be performed may be referred to as a stable area.

[0197] The functions of the management device 200A of this embodiment will be described below with reference to Fig. 11. Fig. 11 is a diagram for explaining the functions of the management device of the third embodiment.

[0198] The management device 200A of this embodiment includes an information acquisition unit 31, a virtual space construction unit 32, an unstable area detection unit 33, a notification output unit , and a position calculation unit .

[0199] When the position calculation unit 35 of this embodiment detects an indication that the shovel 100 is entering an unstable area, it calculates a destination position of the moving body 400. In other words, the destination position of the moving body 400 may be a three-dimensional coordinate indicating a target position of the moving body 400.

[0200] The position calculation unit 35 of this embodiment may calculate, for example, a position where a straight line can be drawn between the wireless antenna 310 and the moving body 400, and between the shovel 100 and the moving body 400, as the destination position (target position) of the moving body 400.

[0201] More specifically, the position calculation unit 35 may calculate as the target position of the moving body 400 the position where the sum of the straight line connecting the wireless antenna 310 and the moving body 400 and the straight line connecting the shovel 100 and the moving body 400 is shortest.

[0202] The method of calculating the target position by the position calculation unit 35 is not limited to the above example. The position calculation unit 35 may calculate the target position by using, for example, a pre-given evaluation function or the like.

[0203] Furthermore, a sign of entering the unstable area may be that the shovel 100 starts traveling toward the unstable area, or that the distance from the shovel 100 to the unstable area becomes less than a predetermined distance.

[0204] Next, the operation of the management system SYS of this embodiment will be described with reference to Fig. 12. Fig. 12 is a sequence diagram illustrating the operation of the work machine management system of the third embodiment.

[0205] The processing from step S1201 to step S1205 in FIG. 12 is similar to the processing from step S401 to step S405 in FIG. 4, and therefore the description thereof will be omitted.

[0206] In the management device 200A of this embodiment, when the position calculation unit 35 detects a sign that the shovel 100 is entering an unstable area, it specifies the destination of the moving body 400 (step S1206). In other words, the position calculation unit 35 calculates three-dimensional coordinates indicating the target position of the moving body 400.

[0207] Next, the management device 200A outputs a movement instruction to the moving object 400 to move to the movement destination through the notification output unit 34 (step S1207). This movement instruction may include three-dimensional coordinates indicating the target position.

[0208] When the moving object 400 receives the movement instruction, the moving object 400 moves to the target position indicated by the three-dimensional coordinates included in the movement instruction (step S1208).

[0209] Thus, according to this embodiment, when a sign that the shovel 100 is entering an unstable area is detected, the unstable area can be changed to a stable area according to the position of the shovel 100 by using the moving body 400 as a relay point. Also, in this embodiment, since various processes are performed in the management device 200, it is possible to change the unstable area to a stable area according to the position of the shovel 100 without increasing the processing load on the shovel 100.

[0210] In this embodiment, the shovel 100 may be automatically controlled. In this case, the management device 200A acquires information indicating a target trajectory of the shovel 100 in advance, and controls the position of the moving body 400 based on the target trajectory of the shovel 100 so that stable communication is always performed between the shovel 100 and the wireless antenna 310.

[0211] In this way, no unstable areas are generated in the work site 300, and the occurrence of communication failures can be suppressed.

[0212] The functions of the management device 200 described in each of the above-mentioned embodiments may be provided in the controller 30 of the shovel 100.

[0213] In this case, the shovel 100 can function as the management device 200. That is, the controller 30 of the shovel 100 acquires operation information of the shovel itself and environmental information transmitted from the wireless antenna 310, constructs a virtual space that reproduces the work site 300, and detects an unstable area by performing a simulation in the virtual space. Then, when the controller 30 detects an unstable area, it notifies the display device 40 and the AR glasses 340 of information indicating that an unstable area has been detected.

[0214] Furthermore, when the controller 30 detects a sign that the shovel 100 is entering an unstable area, the controller 30 may calculate a target position for the moving body 400 and output a movement instruction to the moving body 400 to the target position.

[0215] In this way, by providing the controller 30 of the shovel 100 with the functions of the management device 200 described above, the shovel 100 does not need to communicate with the management device 200. Therefore, by providing the controller 30 of the shovel 100 with the functions of the management device 200 described above, in addition to the effects of each of the above-mentioned embodiments, the communication load of the shovel 100 can be further reduced.

[0216] In addition, in each of the above-described embodiments, the shovel 100 is taken as an example of a work machine, but the work machine is not limited to the shovel 100. The work machine may be any machine having an attachment, such as a forklift or a crane.

[0217] The preferred embodiments of the present invention have been described above in detail. However, the present invention is not limited to the above-described embodiments. Various modifications, substitutions, etc. may be applied to the above-described embodiments without departing from the scope of the present invention. Furthermore, features described separately may be combined unless technical contradictions arise. [Explanation of symbols]

[0218] 1 Undercarriage 2 Swivel mechanism 3. Upper rotating body 4. Boom 5 Arm 6 Bucket 30 Controller 31 Information Acquisition Department 32 Virtual Space Construction Department 33 Unstable area detection unit 34 Notification output section 35 Position calculation section 100 Shovel 200 Management device 310 Radio Antenna 400 Mobile

Claims

1. A work machine that communicates with a management device, a virtual space constructing unit that constructs a virtual space that reproduces the surrounding environment based on environmental information related to the surrounding environment of the work machine and operation information that indicates the operating status of the work machine; an unstable area detection unit that detects an unstable area in which communication with the management device becomes unstable by a simulation using the virtual space; and an output unit that outputs information indicating the detected unstable region.

2. The communication with the management device is wireless communication via a wireless antenna installed in the vicinity of the work machine, The environmental information is The work machine of claim 1 , further comprising information acquired by a positioning device provided in the wireless antenna.

3. the environmental information includes information indicating positions of obstacles disposed around the work machine, and the operation information includes information indicating a current position of the work machine, The unstable region detection unit The work machine according to claim 1 , wherein the unstable region is updated when at least one of the obstacle and the work machine moves.

4. a position calculation unit that calculates a target position indicating a destination of a moving body that relays communication between the wireless antenna and the work machine when a sign of the work machine entering the unstable area is detected, The work machine according to claim 2 , wherein the output unit transmits a movement instruction including the target position to the moving body.

5. The output unit is The work machine according to claim 1 , wherein an image indicating the unstable region is displayed on a display device.

6. A work machine management system including a work machine and a management device that communicates with the work machine, The management device includes: a virtual space constructing unit that constructs a virtual space that reproduces the surrounding environment based on environmental information related to the surrounding environment of the work machine and operation information that indicates the operating status of the work machine; an unstable area detection unit that detects an unstable area in which communication with the management device becomes unstable by a simulation using the virtual space; and an output unit that outputs information indicating the detected unstable area.

7. A work machine management device that communicates with a work machine, a virtual space constructing unit that constructs a virtual space that reproduces the surrounding environment based on environmental information related to the surrounding environment of the work machine and operation information that indicates the operating status of the work machine; an unstable area detection unit that detects an unstable area in which communication with the management device becomes unstable by a simulation using the virtual space; and an output unit that outputs information indicating the detected unstable region.

Citation Information

Patent Citations

  • Automatic traveling device for mobile vehicle

    JP1994028028A

  • Method and equipment for operating geomorphologic modifying machine on construction site

    JP1999036373A

  • Unattended working system of construction equipment and tool for radio repeating vehicle

    JP2007013319A

  • Communication state notification system of work machine

    JP2019062439A

  • Work vehicle monitoring system

    JP2022065386A

Cited By

  • Remote operation system for work machine and remote operation method for work machine

    WO2026141449A1