Excavator management system, portable terminal for excavator, and program used in portable terminal for excavator

The excavator management system allows real-time monitoring and data access using a mobile terminal, addressing the limitations of conventional systems by providing synchronized video and data recording for detailed excavator status evaluation.

JP7609529B2Active Publication Date: 2025-01-07SUMITOMO CONSTRUCTION MACHINERY
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2021553724
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-10-31
Filing Date
2020-10-30
Publication Date
2025-01-07
Estimated Expiration
2040-10-30

AI Technical Summary

Technical Problem

Conventional excavator management systems allow users to check images only after an abnormality occurs and do not enable real-time monitoring or data access using a mobile terminal at the work site.

Method used

An excavator management system that includes a mobile terminal capable of acquiring and synchronizing state quantity information from sensors, allowing real-time video and data recording, and displaying this information alongside moving images.

Benefits of technology

Enables users to confirm the operating status of excavators in real-time, including audio and video data, facilitating detailed evaluation and preventive maintenance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007609529000001
    Figure 0007609529000001
  • Figure 0007609529000002
    Figure 0007609529000002
  • Figure 0007609529000003
    Figure 0007609529000003
Patent Text Reader

Abstract

This shovel management system comprises a portable terminal and a shovel that acquires state quantity information representing a state quantity for the shovel detected by a plurality of sensors, the portable terminal having a communication control unit that transmits to the shovel a request signal for requesting transmission of the state quantity information.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an excavator management system, a portable terminal for an excavator, and a program used in the portable terminal for an excavator. [Background technology]

[0002] Patent Document 1 discloses a technology in which image data of a hydraulic excavator captured by an imaging device, when a detection value detected by a sensor is determined to be abnormal, is stored in a storage device, and the image data can be confirmed on an output device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2012 / 157603 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the conventional technology allows users such as operators and managers to check only images from the period before and after the time when an abnormality was determined. In other words, the conventional technology allows users to check images only when an abnormality occurs. Furthermore, the conventional technology does not allow users to check the operation data of the excavator on a mobile device at the work site.

[0005] The present disclosure aims to make it possible to check the state when the shovel was in operation. [Means for solving the problem]

[0006] The shovel management system according to the embodiment includes an shovel that acquires state quantity information representing state quantities of the shovel detected by a plurality of sensors, and a mobile terminal, and the mobile terminal includes a communication control unit that transmits a request signal to the shovel to request transmission of the state quantity information.and a display control unit that displays, on a display device, the state quantity information received from the shovel and a video of the shovel synchronized with a period during which the state quantity information is received. , an excavator management system. Effect of the Invention

[0007] You can check the state of the shovel when it was in operation. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram illustrating a configuration example of an excavator management system according to an embodiment. [Diagram 2] FIG. 1 is a diagram showing a configuration example of a hydraulic system mounted on a shovel. [Diagram 3] FIG. 1 is a diagram illustrating an example of the configuration of an electric operation system for a shovel. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a mobile terminal. [Diagram 5] FIG. 2 is a diagram illustrating functions of a mobile terminal. [Figure 6] 11 is a first flowchart illustrating a process of the mobile terminal. [Figure 7] FIG. 13 is a diagram showing an example of a list screen of excavators. [Figure 8] FIG. 13 is a diagram showing an example of an item designation screen for designating an item of state quantity information. [Figure 9] FIG. 13 is a diagram showing an example of a selection screen for manned or unmanned operation. [Figure 10] FIG. 13 is a diagram showing an example of a confirmation screen. [Figure 11] FIG. 13 is a diagram showing an example of a list screen of shovel operations. [Figure 12] FIG. 2 is a first diagram showing an example of a moving image capture screen. [Figure 13] FIG. 13 is a second diagram showing an example of a moving image capture screen. [Figure 14] 13 is a second flowchart illustrating the processing of the mobile terminal. [Figure 15] FIG. 11 is a first diagram showing an example of a playback screen. [Figure 16] FIG. 13 is a second diagram showing an example of the playback screen. [Figure 17]FIG. 13 is a third diagram showing an example of a playback screen. [Figure 18] FIG. 13 is a schematic diagram illustrating a configuration example of a shovel management system according to another embodiment. [Figure 19] FIG. 2 illustrates an example of a hardware configuration of a management apparatus. [Figure 20] FIG. 2 illustrates an example of a functional configuration of a management device. [Figure 21] FIG. 4 is a sequence diagram illustrating an operation of the management system. [Figure 22] FIG. 11 is a first diagram showing an example of a playback screen of diagnostic video data. [Diagram 23] FIG. 13 is a second diagram showing an example of a playback screen of diagnostic video data. [Figure 24] FIG. 13 is a third diagram showing an example of a playback screen of diagnostic video data. [Diagram 25] FIG. 4 is a fourth diagram showing an example of a playback screen of diagnostic video data. [Figure 26] FIG. 11 is a first diagram showing an example of a display example of an evaluation result. [Figure 27] FIG. 11 is a second diagram showing an example of a display of the evaluation results. [Figure 28] FIG. 11 is a third diagram showing an example of a display of evaluation results. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment will be described with reference to the drawings.

[0010] (Embodiment) Fig. 1 is a schematic diagram showing a configuration example of an excavator management system according to an embodiment. The excavator management system SYS shown in Fig. 1 is a system that manages the state quantities of an excavator by using a mobile terminal 200 (an example of an "excavator mobile terminal"). The excavator management system SYS includes an excavator 100 and the mobile terminal 200.

[0011] The excavator 100 includes a lower traveling body 1, a rotating mechanism 2, an upper rotating body 3, a boom 4, an arm 5, a bucket 6, a boom cylinder 7, an arm cylinder 8, a bucket cylinder 9, a cabin 10, and an engine 11.

[0012] The upper rotating body 3 is rotatably mounted on the lower traveling body 1 via a rotating mechanism 2. The boom 4 is attached to the upper rotating body 3. The arm 5 is attached to the tip of the boom 4. The bucket 6 is attached to the tip of the arm 5.

[0013] The boom 4, the arm 5, and the bucket 6 constitute an excavation attachment. The boom 4, the arm 5, and the bucket 6 are hydraulically driven by a boom cylinder 7, an arm cylinder 8, and a bucket cylinder 9, respectively. A cabin 10 and an engine 11 are mounted on the upper rotating body 3.

[0014] The shovel 100 also includes a transmitting device S1, a receiving device S2, a positioning device S3, a posture detecting device S4, a direction detecting device S5, a camera S6, a microphone S7, an object detecting device S8 and a display device 45.

[0015] The transmission device S1 transmits information to a device external to the shovel 100 by wireless communication. For example, in response to a request from the mobile terminal 200, the transmission device S1 transmits state quantity information indicating state quantities of the shovel 100 to the mobile terminal 200. The state quantity information indicates, in time series, a plurality of state quantities continuously acquired at regular time intervals by a sensor. More specifically, the state quantity information in this embodiment is transmitted to the mobile terminal 200 via the attitude detection device S4, the orientation detection device S5, the camera S6 as a peripheral management device, the microphone S7, and the like. 7 , which includes the values ​​output from each of the object detectors S8.

[0016] Furthermore, the transmitting device S1 of this embodiment may transmit operation data including state quantity information to the mobile terminal 200. The operation data includes state quantity information, setting condition information indicating various setting conditions set in the shovel 100, a model number for identifying the shovel 100, and the like.

[0017] The receiving device S2 receives information by wireless communication from a device external to the shovel 100. For example, the receiving device S2 receives a request signal transmitted from the mobile terminal 200 for requesting state quantity information representing the state quantity of the shovel 100.

[0018] The positioning device S3 acquires information related to the position of the shovel 100. In this embodiment, the positioning device S3 is a GNSS (GPS) receiver, and can measure the latitude, longitude, and altitude of the location of the shovel 100.

[0019] The attitude detection device S4 detects the attitude of the excavation attachment equipped on the shovel 100. In this embodiment, a boom angle sensor that detects a boom angle, an arm angle sensor that detects an arm angle, a bucket angle sensor that detects a bucket angle, and a machine body inclination sensor that detects the inclination angle of the upper rotating body 3 are used as the attitude detection device S4. The boom angle sensor may include, for example, a rotary encoder, an acceleration sensor, a six-axis sensor, an IMU (Inertial Measurement Unit), etc., and the same applies to the arm angle sensor, bucket angle sensor, and machine body inclination sensor hereinafter. A detection signal detected by the attitude detection device S4 is taken into the controller 30.

[0020] The orientation detection device S5 detects the orientation of the shovel 100. For example, a geomagnetic sensor, a resolver or encoder related to the rotation axis of the rotation mechanism 2, or a gyro sensor is used as the orientation detection device S5. In this manner, the toe position and back position of the bucket as the working part can be calculated. For example, the world geodetic system may be used as the reference coordinate system used for the position information of the working part.

[0021] The camera S6 as a perimeter monitoring device is configured to detect objects present within a predetermined distance around the excavator 100. The objects include, for example, people, animals, vehicles, construction machines, buildings, walls, fences, holes, etc. Hmm.The perimeter monitoring device includes, for example, an ultrasonic sensor, a millimeter wave radar, a stereo camera, a LIDAR, a distance image sensor, or an infrared sensor. In this embodiment, a camera S6 is shown as the perimeter monitoring device. The camera S6 is provided on the upper rotating body 3 and captures images of the periphery of the shovel 100. The shovel 100 of this embodiment is equipped with multiple cameras S6, and the multiple cameras S6 can capture images in multiple directions (for example, the front, rear, right side, and left side) of the shovel 100.

[0022] The microphone S7 is provided on the upper rotating body 3 and acquires operation sounds generated by the excavator 100. The microphone S7 may be provided at each of a plurality of locations on the upper rotating body 3.

[0023] The object detection device S8 is configured to detect an object present around the shovel 100. The object detection device S8 may also be configured to calculate a distance from the object detection device S8 or the shovel 100 to a recognized object. The object includes, for example, a person, an animal, a vehicle, a construction machine, a building, a hole, and the like. The object detection device S8 includes, for example, an ultrasonic sensor, a millimeter wave radar, a stereo camera, a LIDAR, a distance image sensor, an infrared sensor, and the like. In this embodiment, the object detection device S8 is attached to the front end of the upper surface of the cabin 10, the rear end of the upper surface of the upper rotating body 3, the left end of the upper surface of the upper rotating body 3, and the right end of the upper surface of the upper rotating body 3.

[0024] The object detection device S8 may be configured to detect a predetermined object within a predetermined area set around the shovel 100. For example, it may be configured to be able to distinguish between a human and an object other than a human.

[0025] The display device 45 is disposed near the driver's seat in the cabin 10, and displays various information. For example, the display device 45 displays an image captured by the camera S6. The display device 45 can also display a composite image of a plurality of images captured by the plurality of cameras S6. The display device 45 can also display a composite image that has been subjected to various image processing such as viewpoint conversion processing.

[0026] The mobile terminal 200 is an electronic device carried by a user. Examples of the mobile terminal 200 include a smartphone, a video camera, a mobile phone, a notebook computer, a tablet terminal, and smart glasses. In this embodiment, a smartphone is used as the mobile terminal 200.

[0027] In the shovel management system SYS of this embodiment, the mobile terminal 200 captures a video of the shovel 100 in operation. Moreover, the mobile terminal 200 of this embodiment transmits a request to acquire state quantity information to the shovel 100, and receives state quantity information from the shovel 100.

[0028] At this time, the mobile terminal 200 determines the timing to start capturing the video and the timing to start capturing the video from the shovel 100. Rolled Quantitative information of The timing of reception is synchronized, and moving image data showing the captured moving image is stored as state record data in which the state quantity information is associated with the moving image data.

[0029] Furthermore, the mobile terminal 200 of this embodiment may record audio input simultaneously with capturing a moving image by the audio input / output device 203. Furthermore, audio data indicating the recorded audio may be stored in association with the moving image data and the state quantity information.

[0030] That is, the status record data includes operation data including status quantity information and design condition information of the shovel 100, video data capturing an image of the shovel 100 operating, and audio data recorded when the shovel 100 operates. In other words, the status record data includes status quantity information, a video of the shovel 100 and audio recorded during the video capture. of and video data showing the video including the video.

[0031] Therefore, the condition record data in this embodiment is information including state quantity information when the shovel 100 was operating, setting condition information, video data capturing an image of the shovel 100 in operation, and audio data, and can be said to be information indicating the state of the shovel 100 when it was operating.

[0032] In this embodiment, the video data may include audio data recorded by the audio input / output device 203. In the following description, the video data is assumed to be data including audio data input from the audio input / output device 203, but the video data and audio data may be managed as separate data. The details of the mobile terminal 200 will be described later.

[0033] Next, a configuration example of a hydraulic system mounted on the shovel 100 will be described with reference to Fig. 2. Fig. 2 is a diagram showing a configuration example of a hydraulic system mounted on the shovel. In Fig. 2, a mechanical power transmission system, a hydraulic oil line, a pilot line, and an electric control system are respectively indicated by double lines, solid lines, dashed lines, and dotted lines.

[0034] The hydraulic system of the excavator 100 mainly includes an engine 11, a regulator 13, a main pump 14, a pilot pump 15, a control valve 17, an operating device 26, a discharge pressure sensor 28, an operating pressure sensor 29, a controller 30, and the like.

[0035] In FIG. 2, the hydraulic system circulates hydraulic oil from a main pump 14 driven by an engine 11 through a center bypass line 40 or a parallel line 42 to a hydraulic oil tank.

[0036] The engine 11 is a drive source of the excavator 100. In this embodiment, the engine 11 is, for example, a diesel engine that operates to maintain a predetermined rotation speed. An output shaft of the engine 11 is connected to input shafts of the main pump 14 and the pilot pump 15.

[0037] The main pump 14 is configured to supply hydraulic oil via a hydraulic oil line to the control valve 17. In this embodiment, the main pump 14 is a swash plate type variable displacement hydraulic pump.

[0038] The regulator 13 is configured to control the discharge amount (displacement volume) of the main pump 14. In this embodiment, the regulator 13 controls the discharge amount (displacement volume) of the main pump 14 by adjusting the swash plate tilt angle of the main pump 14 in response to a control command from the controller 30.

[0039] The pilot pump 15 is configured to supply hydraulic oil to hydraulic control devices including the operating device 26 via a pilot line. In this embodiment, the pilot pump 15 is a fixed displacement hydraulic pump. However, the pilot pump 15 may be omitted. In this case, the function of the pilot pump 15 may be realized by the main pump 14. That is, the main pump 14 may have a function of supplying hydraulic oil to the operating device 26 and the like after reducing the pressure of the hydraulic oil by a throttle or the like, in addition to the function of supplying hydraulic oil to the control valve 17.

[0040] The control valve 17 is configured to control the flow of hydraulic oil in the hydraulic system. In this embodiment, the control valve 17 includes control valves 171 to 176. The control valve 175 includes a control valve 175L and a control valve 175R, and the control valve 176 includes a control valve 176L and a control valve 176R. The control valve 17 can selectively supply hydraulic oil discharged by the main pump 14 to one or more hydraulic actuators through the control valves 171 to 176. The control valves 171 to 176 control the flow rate of hydraulic oil flowing from the main pump 14 to the hydraulic actuators and the flow rate of hydraulic oil flowing from the hydraulic actuators to a hydraulic oil tank. The hydraulic actuators include a boom cylinder 7, an arm cylinder 8, a bucket cylinder 9, a left traveling hydraulic motor 2ML, a right traveling hydraulic motor 2MR, and a swing hydraulic motor 2A.

[0041] The operating device 26 is a device used by an operator to operate the actuators. The actuators include at least one of a hydraulic actuator and an electric actuator. In this embodiment, the operating device 26 supplies hydraulic oil discharged by the pilot pump 15 to the pilot port of the corresponding control valve in the control valve 17 via a pilot line. The pressure of the hydraulic oil supplied to each pilot port (pilot pressure) is a pressure according to the operation direction and operation amount of the lever or pedal (not shown) of the operating device 26 corresponding to each hydraulic actuator. However, the operating device 26 may be an electrically controlled type instead of the pilot pressure type as described above. In this case, the control valve in the control valve 17 may be an electromagnetic solenoid type spool valve.

[0042] The discharge pressure sensor 28 is configured to detect the discharge pressure of the main pump 14. In this embodiment, the discharge pressure sensor 28 outputs the detected value to the controller 30.

[0043] The operation pressure sensor 29 is configured to detect the operation of the operation device 26 by the operator. In this embodiment, the operation pressure sensor 29 detects the operation direction and operation amount of the lever or pedal of the operation device 26 corresponding to each actuator in the form of pressure (operation pressure), and outputs the detected value as operation data to the controller 30. The operation of the operation device 26 may be detected using a sensor other than the operation pressure sensor.

[0044] The main pump 14 includes a left main pump 14L and a right main pump 14R. The left main pump 14L is configured to circulate the hydraulic oil to a hydraulic oil tank via a left center bypass line 40L or a left parallel line 42L. The right main pump 14R is configured to circulate the hydraulic oil to a hydraulic oil tank via a right center bypass line 40R or a right parallel line 42R.

[0045] The left center bypass line 40L is a hydraulic oil line that passes through control valves 171, 173, 175L, and 176L arranged within the control valve 17. The right center bypass line 40R is a hydraulic oil line that passes through control valves 172, 174, 175R, and 176R arranged within the control valve 17.

[0046] The control valve 171 is a spool valve that switches the flow of hydraulic oil to supply the hydraulic oil discharged by the left main pump 14L to the left traveling hydraulic motor 2ML, and to discharge the hydraulic oil discharged by the left traveling hydraulic motor 2ML to the hydraulic oil tank.

[0047] The control valve 172 is a spool valve that switches the flow of hydraulic oil to supply the hydraulic oil discharged by the right main pump 14R to the right traveling hydraulic motor 2MR and to discharge the hydraulic oil discharged by the right traveling hydraulic motor 2MR to a hydraulic oil tank.

[0048] The control valve 173 is a spool valve that switches the flow of hydraulic oil to supply the hydraulic oil discharged by the left main pump 14L to the swing hydraulic motor 2A and to discharge the hydraulic oil discharged by the swing hydraulic motor 2A to the hydraulic oil tank.

[0049] The control valve 174 is a spool valve that switches the flow of hydraulic oil to supply the hydraulic oil discharged by the right main pump 14R to the bucket cylinder 9 and to discharge the hydraulic oil in the bucket cylinder 9 to the hydraulic oil tank.

[0050] The control valve 175L is a spool valve that switches the flow of hydraulic oil to supply the hydraulic oil discharged by the left main pump 14L to the boom cylinder 7. The control valve 175R is a spool valve that switches the flow of hydraulic oil to supply the hydraulic oil discharged by the right main pump 14R to the boom cylinder 7 and to discharge the hydraulic oil in the boom cylinder 7 to the hydraulic oil tank.

[0051] The control valve 176L is a spool valve that switches the flow of hydraulic oil to supply the hydraulic oil discharged by the left main pump 14L to the arm cylinder 8 and to discharge the hydraulic oil in the arm cylinder 8 to the hydraulic oil tank.

[0052] The control valve 176R is a spool valve that switches the flow of hydraulic oil to supply the hydraulic oil discharged by the right main pump 14R to the arm cylinder 8 and to discharge the hydraulic oil in the arm cylinder 8 to the hydraulic oil tank.

[0053] The left parallel conduit 42L is a hydraulic oil line that runs parallel to the left center bypass conduit 40L. The left parallel conduit 42L can supply hydraulic oil to a more downstream control valve when the flow of hydraulic oil through the left center bypass conduit 40L is restricted or blocked by any of the control valves 171, 173, or 175L. The right parallel conduit 42R is a hydraulic oil line that runs parallel to the right center bypass conduit 40R. The right parallel conduit 42R can supply hydraulic oil to a more downstream control valve when the flow of hydraulic oil through the right center bypass conduit 40R is restricted or blocked by any of the control valves 172, 174, or 175R.

[0054] The regulator 13 includes a left regulator 13L and a right regulator 13R. The left regulator 13L controls the discharge volume of the left main pump 14L by adjusting the swash plate tilt angle of the left main pump 14L according to the discharge pressure of the left main pump 14L. Specifically, the left regulator 13L adjusts the swash plate tilt angle of the left main pump 14L in response to an increase in the discharge pressure of the left main pump 14L, for example, to reduce the discharge volume. The same is true for the right regulator 13R. This is to prevent the absorption horsepower of the main pump 14, which is expressed by the product of the discharge pressure and the discharge volume, from exceeding the output horsepower of the engine 11.

[0055] The operating device 26 includes a left operating lever 26L, a right operating lever 26R, and a travel lever 26D. The travel lever 26D includes a left traveling lever 26DL and a right traveling lever 26DR.

[0056] The left operating lever 26L is used for the rotation operation and the operation of the arm 5. When the left operating lever 26L is operated in the forward / backward direction, it uses the hydraulic oil discharged by the pilot pump 15 to apply a control pressure corresponding to the amount of lever operation to the pilot port of the control valve 176. When the left operating lever 26L is operated in the left / right direction, it uses the hydraulic oil discharged by the pilot pump 15 to apply a control pressure corresponding to the amount of lever operation to the pilot port of the control valve 173.

[0057] Specifically, when the left operating lever 26L is operated in the arm closing direction, it introduces hydraulic oil to the right pilot port of the control valve 176L and introduces hydraulic oil to the left pilot port of the control valve 176R. When the left operating lever 26L is operated in the arm opening direction, it introduces hydraulic oil to the left pilot port of the control valve 176L and introduces hydraulic oil to the right pilot port of the control valve 176R. When the left operating lever 26L is operated in the left turning direction, it introduces hydraulic oil to the left pilot port of the control valve 173, and when operated in the right turning direction, it introduces hydraulic oil to the right pilot port of the control valve 173.

[0058] The right operating lever 26R is used to operate the boom 4 and the bucket 6. When the right operating lever 26R is operated in the forward / backward direction, it uses the hydraulic oil discharged by the pilot pump 15 to apply a control pressure corresponding to the amount of lever operation to the pilot port of the control valve 175. When the right operating lever 26R is operated in the left / right direction, it uses the hydraulic oil discharged by the pilot pump 15 to apply a control pressure corresponding to the amount of lever operation to the pilot port of the control valve 174.

[0059] Specifically, the right operating lever 26R introduces hydraulic oil to the right pilot port of the control valve 175R when operated in the boom lowering direction. When the right operating lever 26R is operated in the boom raising direction, it introduces hydraulic oil to the right pilot port of the control valve 175L and also introduces hydraulic oil to the left pilot port of the control valve 175R. When the right operating lever 26R is operated in the bucket closing direction, it introduces hydraulic oil to the left pilot port of the control valve 174, and when operated in the bucket opening direction, it introduces hydraulic oil to the right pilot port of the control valve 174.

[0060] The travel lever 26D is used to operate the crawler 1C. Specifically, the left travel lever 26DL is used to operate the left crawler 1CL. The left travel lever 26DL may be configured to be interlocked with the left travel pedal. When the left travel lever 26DL is operated in the front-rear direction, it uses the hydraulic oil discharged by the pilot pump 15 to apply a control pressure corresponding to the lever operation amount to the pilot port of the control valve 171. The right travel lever 26DR is used to operate the right crawler 1CR. The right travel lever 26DR may be configured to be interlocked with the right travel pedal. When the right travel lever 26DR is operated in the front-rear direction, it uses the hydraulic oil discharged by the pilot pump 15 to apply a control pressure corresponding to the lever operation amount to the pilot port of the control valve 172.

[0061] The discharge pressure sensor 28 includes a discharge pressure sensor 28L and a discharge pressure sensor 28R. The discharge pressure sensor 28L detects the discharge pressure of the left main pump 14L and outputs the detected value to the controller 30. The discharge pressure sensor 28R detects the discharge pressure of the right main pump 14R and outputs the detected value to the controller 30.

[0062] The operation pressure sensor 29 includes operation pressure sensors 29LA, 29LB, 29RA, 29RB, 29DL, and 29DR. The operation pressure sensor 29LA detects the content of the operation of the left operation lever 26L in the forward / rearward direction by the operator in the form of pressure, and outputs the detected value to the controller 30. The content of the operation includes, for example, the lever operation direction and the lever operation amount (lever operation angle), etc.

[0063] Similarly, the operating pressure sensor 29LB detects the operation of the left operating lever 26L in the left-right direction by the operator in the form of pressure, and outputs the detected value to the controller 30. The operating pressure sensor 29RA detects the operation of the right operating lever 26R in the forward-backward direction by the operator in the form of pressure, and outputs the detected value to the controller 30. The operating pressure sensor 29RB detects the operation of the right operating lever 26R in the left-right direction by the operator in the form of pressure, and outputs the detected value to the controller 30. The operating pressure sensor 29DL detects the operation of the left traveling lever 26DL in the forward-backward direction by the operator in the form of pressure, and outputs the detected value to the controller 30. The operating pressure sensor 29DR detects the operation of the right traveling lever 26DR in the forward-backward direction by the operator in the form of pressure, and outputs the detected value to the controller 30.

[0064] The controller 30 receives the output of the operating pressure sensor 29, and outputs a control command to the regulator 13 as necessary, thereby changing the discharge volume of the main pump 14. The controller 30 also receives the output of the control pressure sensor 19 provided upstream of the orifice 18, and outputs a control command to the regulator 13 as necessary, thereby changing the discharge volume of the main pump 14. The orifice 18 includes a left orifice 18L and a right orifice 18R, and the control pressure sensor 19 includes a left control pressure sensor 19L and a right control pressure sensor 19R.

[0065] The left center bypass pipe 40L is provided with a left throttle 18L between the most downstream control valve 176L and the hydraulic oil tank. Therefore, the flow of hydraulic oil discharged by the left main pump 14L is restricted by the left throttle 18L. The left throttle 18L generates a control pressure for controlling the left regulator 13L. The left control pressure sensor 19L is a sensor for detecting this control pressure, and outputs the detected value to the controller 30. The controller 30 controls the discharge amount of the left main pump 14L by adjusting the swash plate tilt angle of the left main pump 14L according to this control pressure. The controller 30 reduces the discharge amount of the left main pump 14L as this control pressure increases, and increases the discharge amount of the left main pump 14L as this control pressure decreases. The discharge amount of the right main pump 14R is also controlled in a similar manner.

[0066] Specifically, in the case of a standby state in which none of the hydraulic actuators in the excavator 100 are operated as shown in Fig. 2, the hydraulic oil discharged by the left main pump 14L passes through the left center bypass pipe 40L and reaches the left throttle 18L. Then, the flow of the hydraulic oil discharged by the left main pump 14L increases the control pressure generated upstream of the left throttle 18L. As a result, the controller 30 reduces the discharge amount of the left main pump 14L to the allowable minimum discharge amount, thereby suppressing the pressure loss (pumping loss) that occurs when the hydraulic oil discharged by the left main pump 14L passes through the left center bypass pipe 40L.

[0067] On the other hand, when any of the hydraulic actuators is operated, the hydraulic oil discharged from the left main pump 14L flows into the hydraulic actuator to be operated via the control valve corresponding to the hydraulic actuator to be operated. The flow of hydraulic oil discharged from the left main pump 14L reduces or eliminates the amount of hydraulic oil reaching the left throttle 18L, lowering the control pressure generated upstream of the left throttle 18L. As a result, the controller 30 increases the discharge amount of the left main pump 14L, allowing sufficient hydraulic oil to flow into the hydraulic actuator to be operated, ensuring the drive of the hydraulic actuator to be operated. The controller 30 also controls the discharge amount of the right main pump 14R in the same manner.

[0068] The controller 30 receives detection values ​​from each of the pressure sensor 7A detecting the pressure in the rod side oil chamber of the boom cylinder 7, the pressure sensor 7B detecting the pressure in the bottom side oil chamber of the boom cylinder 7, the pressure sensor 8A detecting the pressure in the rod side oil chamber of the arm cylinder 8, the pressure sensor 8B detecting the pressure in the bottom side oil chamber of the arm cylinder 8, the pressure sensor 9A detecting the pressure in the rod side oil chamber of the bucket cylinder 9, and the pressure sensor 9B detecting the pressure in the bottom side oil chamber of the bucket cylinder 9. This allows the controller 30 to detect the pressure in the rod side oil chamber and the bottom side oil chamber of each of the boom cylinder 7, the arm cylinder 8, and the bucket cylinder 9.

[0069] The controller 30 also receives detection values ​​from the pressure sensor 2AA that detects the hydraulic pressure of the swing hydraulic motor 2A when turning left and the pressure sensor 2AB that detects the hydraulic pressure of the swing hydraulic motor 2A when turning right. This allows the controller 30 to detect the hydraulic pressure of the swing hydraulic motor 2A when turning left and when turning right.

[0070] With the above-described configuration, the hydraulic system of Fig. 2 can suppress unnecessary energy consumption related to the main pump 14 in a standby state. The unnecessary energy consumption includes pumping loss caused in the center bypass pipe 40 by the hydraulic oil discharged from the main pump 14. Furthermore, when operating a hydraulic actuator, the hydraulic system of Fig. 2 can reliably supply necessary and sufficient hydraulic oil from the main pump 14 to the hydraulic actuator to be operated.

[0071] Here, a description will be given of the functions of the controller 30. As shown in FIG.

[0072] The acquisition unit 31 acquires the detection values ​​of each of the multiple sensors equipped in the shovel 100 as state quantity information representing the state quantity of the shovel 100. Examples of the state quantity information acquired by the acquisition unit 31 include hydraulic oil temperature, engine water temperature, engine fuel injection amount, hydraulic pressure of the boom cylinder 7, hydraulic pressure of the arm cylinder 8, hydraulic pressure of the bucket cylinder 9, hydraulic pressure of the swing hydraulic motor 2A, discharge pressure of the main pump 14, operating pressure of each operating lever, and control pressure of the regulator 13. However, the state quantity information acquired by the acquisition unit 31 is not limited to these, and may be other information as long as it is information detected by a sensor equipped in the shovel 100. For example, the acquisition unit 31 is realized by a memory equipped in the controller 30.

[0073] Furthermore, the acquisition unit 31 acquires setting condition information indicating various setting conditions set in the shovel 100, information indicating a model number for identifying the shovel 100, and the like. In other words, the acquisition unit 31 acquires operation data of the shovel 100.

[0074] The reception control unit 32 receives a request signal (a request signal for requesting transmission of state quantity information) transmitted from the mobile terminal 200 via wireless communication between the receiving device S2 and the mobile terminal 200. For example, the reception control unit 32 is realized by the CPU in the controller 30 executing a program.

[0075] When the request signal is received by the reception control unit 32, the transmission control unit 33 transmits the operation data acquired by the acquisition unit 31 to the mobile terminal 200 via wireless communication with the mobile terminal 200 by the transmission device S1. For example, the transmission control unit 33 is realized by the CPU in the controller 30 executing a program.

[0076] Next, the electric operation system of the shovel 100 will be further described with reference to Fig. 3. Fig. 3 is a diagram that shows a schematic diagram of an example of the configuration of an electric operation system of a shovel. Note that Fig. 3 uses a boom operation system that raises and lowers the boom 4 as an example of the electric operation system.

[0077] In addition, the electric operation system can also be similarly applied to a traveling operation system for moving the lower traveling body 1 forward and backward, a rotation operation system for rotating the upper rotating body 3, an arm operation system for opening and closing the arm 5, and a bucket operation system for opening and closing the bucket 6, etc.

[0078] The electric operation system shown in FIG. 3 includes a boom operation lever 26A as an electric operation lever, a pilot pump 15, a pilot pressure operated control valve 17, a proportional valve 31AL for boom-raising operation, a proportional valve 31AR for boom-lowering operation, a controller 30, a gate lock lever 60, and a gate lock valve 62.

[0079] The boom operation lever 26A (operation signal generating unit), which is an example of an operation device, is provided with sensors such as an encoder and a potentiometer that can detect the operation amount (tilt amount) and tilt direction. The operation signal (electrical signal) corresponding to the operation of the boom operation lever 26A detected by the sensor of the boom operation lever 26A is input to the controller 30.

[0080] The proportional valve 31AL is provided in a pilot line that supplies hydraulic oil from the pilot pump 15 to a boom-raising pilot port of the control valve 17 (see control valves 175L and 175R shown in FIG. 2). The proportional valve 31AL is a solenoid valve whose opening is adjustable, and the opening of the proportional valve 31AL is controlled in response to a boom-raising operation signal (electrical signal), which is a control signal from the controller 30.

[0081] By controlling the aperture of proportional valve 31AL, the pilot pressure acting on the boom-up pilot port as a boom-up operation signal (pressure signal) is controlled. Similarly, proportional valve 31AR is provided in a pilot line that supplies hydraulic oil from pilot pump 15 to a boom-down pilot port of control valve 17 (see control valves 175L and 175R shown in FIG. 2). Proportional valve 31AR is a solenoid valve whose aperture can be adjusted, and the aperture of proportional valve 31AR is controlled in response to a boom-down operation signal (electrical signal) that is a control signal from controller 30. By controlling the aperture of proportional valve 31AR, the pilot pressure acting on the boom-down pilot port as a boom-down operation signal (pressure signal) is controlled.

[0082] The controller 30 outputs a boom-raising operation signal (electrical signal) and a boom-lowering operation signal (electrical signal) that control the opening degree of the proportional valves 31AL, 31AR. In this way, the controller 30 can control the flow rate and flow direction of the hydraulic oil supplied from the main pumps 14L, 14R to the boom cylinder 7 via the proportional valves 31AL, 31AR and the control valve 17 (control valves 175L, 175R), thereby controlling the operation of the boom 4.

[0083] For example, when the shovel 100 is manually operated, the controller 30 generates and outputs a boom-raising operation signal (electrical signal) or a boom-lowering operation signal (electrical signal) in response to an operation signal (electrical signal) of the boom operation lever 26A. Also, for example, when the shovel 100 is automatically controlled, the controller 30 generates and outputs a boom-raising operation signal (electrical signal) or a boom-lowering operation signal (electrical signal) based on a set program or the like.

[0084] The gate lock lever 60 is provided near the boarding / alighting door in the cabin 10. The gate lock lever 60 is provided so as to be able to swing between an unlocked state and a locked state. The operator sets the gate lock lever 60 to the unlocked state by pulling up the gate lock lever 60 to a substantially horizontal position, and sets the gate lock lever 60 to the locked state by pushing down the gate lock lever 60. In the unlocked state, the gate lock lever 60 blocks the boarding / alighting door of the cabin 10 to restrict the operator from exiting from the cabin 10. On the other hand, in the locked state, the gate lock lever 60 opens the boarding / alighting door of the cabin 10 to allow the operator to exit from the cabin 10.

[0085] The limit switch 61 is a switch that is ON (energized) when the gate lock lever 60 is in the unlocked state, and is OFF (disconnected) when the gate lock lever 60 is in the locked state.

[0086] The gate lock valve 62 is an on-off valve provided in a pilot line between the pilot pump 15 and the proportional valves 31 (31AL, 31AR). The gate lock valve 62 is, for example, a solenoid valve that opens when energized and closes when de-energized. A limit switch 61 is disposed in the power supply circuit of the gate lock valve 62. As a result, when the limit switch 61 is ON, the gate lock valve 62 opens. When the limit switch 61 is OFF, the gate lock valve 62 closes. That is, when the gate lock lever 60 is in the unlocked state, the gate lock valve 62 opens. On the other hand, when the gate lock lever 60 is in the locked state, the gate lock valve 62 closes.

[0087] The lock state detection sensor 63 detects whether the gate lock lever 60 is in an unlocked state or a locked state. For example, the lock state detection sensor 63 is a voltage sensor (or a current sensor) provided in an electric circuit connecting the gate lock valve 62 and the limit switch 61, and detects the unlocked state / locked state of the gate lock lever 60 by detecting the ON / OFF of the limit switch 61. The detection result is output to the controller 30. Note that the lock state detection sensor 63 may be configured to detect the unlocked state / locked state of the gate lock lever 60 by directly detecting the position of the lever.

[0088] Next, the mobile terminal 200 of this embodiment will be described with reference to Figures 4 and 5. Figure 4 is a diagram showing an example of the hardware configuration of the mobile terminal.

[0089] The mobile terminal 200 of this embodiment is a computer that includes an operation input device 201, a display device 202, an audio input / output device 203, an auxiliary storage device 204, a memory device 205, an arithmetic processing device 206, a communication device 207, and an imaging device 208, each of which is connected via a bus B or the like.

[0090] The operation input device 201 accepts operation input from a user. For example, the operation input device 201 accepts operation input such as recording, stopping recording, playing, stopping playing, saving, and sending of a moving image. In this embodiment, as an example of the operation input device 201, a display device 202 is Stacked touch panels may also be used.

[0091] The display device 202 displays various types of information. For example, a liquid crystal display, an organic EL display, etc. are used as the display device 202. For example, the display device 202 displays a moving image of the shovel 100 captured by the imaging device 208, state quantity information of the shovel 100 received by the communication device 207, etc.

[0092] The audio input / output device 203 is realized by, for example, a microphone and a speaker. The audio input / output device 203 outputs audio to the outside. For example, when a video of the shovel 100 is played, the audio input / output device 203 outputs audio (i.e., the operating sound of the shovel 100) synchronized with the video.

[0093] Furthermore, the audio input / output device 203 inputs audio from the outside. For example, while the imaging device 208 is capturing a video of the shovel 100, the audio input / output device 203 acquires audio (i.e., the operating sound of the shovel 100) synchronized with the video.

[0094] The auxiliary storage device 204 stores various programs (applications) installed in the mobile terminal 200, and also stores various files, data, and the like required by the mobile terminal 200.

[0095] M The memory device 205 reads out and stores a program for implementing the functions of the mobile terminal 200, which will be described later, from the auxiliary storage device 204 when a program installed in the mobile terminal 200 is started.

[0096] The processor 206 reads out and executes programs stored in the memory device 205 to realize various processes as described below.

[0097] The communication device 207 is an example of a "transmitter" and a "receiver", and transmits and receives information between the mobile terminal 200 and an external device using a predetermined wireless communication method (for example, Wi-Fi, Bluetooth (registered trademark), etc.).

[0098] The imaging device 208 is a camera that captures an image. The imaging device 208 is attached to, for example, the back surface of the mobile terminal 200, and can capture an image behind the mobile terminal 200. The imaging device 208 can capture both still images and moving images. For example, the imaging device 208 is used to capture moving images of the shovel 100.

[0099] Next, functions of the mobile terminal 200 of this embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram for explaining functions of the mobile terminal.

[0100] The mobile terminal 200 of this embodiment receives input Department The input unit 210, the communication control unit 220, the display control unit 230, the imaging control unit 240, the storage unit 250, the playback unit 260, and the memory unit 270. Department 210, the communication control unit 220, the display control unit 230, the imaging control unit 240, and the storage unit 250 are connected to the arithmetic processing unit 206, the auxiliary storage device 204, and the memory device 20 5 The functions of the storage unit 270 are realized by reading and executing a program stored in the storage unit 204, the memory device 205, or the like.

[0101] Input reception Department 210 accepts various inputs to the mobile terminal 200. Department 210 is shovel 100 To The control unit 204 accepts input of a request signal for requesting acquisition of operational data from the imaging device 208 and input of an operation instruction for the imaging device 208.

[0102] The communication control unit 220 controls the communication device 207 in response to the input received by the input reception 210, and communicates with an external device. Specifically, the communication control unit 220 determines whether communication between the shovel 100 and the mobile terminal 200 is possible, etc., in response to the status of communication by the communication device 207.

[0103] The display control unit 230 controls the display on the display device 202. Specifically, the display control unit 230 causes the display device 202 to display a screen corresponding to the operation instruction or the like accepted by the input acceptance 210.

[0104] The imaging control unit 240 controls the imaging device 208 in response to the operation instruction received by the input reception 210. Specifically, the imaging control unit 240 causes the imaging device 208 to capture a moving image of the shovel 100 and acquires the moving image data.

[0105] The storage unit 250 stores the information received by the communication control unit 220 from an external device in the memory unit 270. Specifically, the storage unit 250 associates the video data acquired by the imaging control unit 240 with the operation data received by the communication control unit 220 from the shovel 100, generates status record data 280, and stores it in the memory unit 270. In other words, the storage unit 250 stores data in which the status amount information received from the shovel 100 is associated with the video data in the memory unit 270.

[0106] The playback unit 260 plays back the state record data 280 stored in the storage unit 270, and displays it on the display device 202. The storage unit 270 stores data in response to an instruction from the storage unit 250.

[0107] Next, the processing of the mobile terminal 200 of this embodiment will be described with reference to Fig. 6. Fig. 6 is a first flowchart illustrating the processing of the mobile terminal.

[0108] When the mobile terminal 200 of this embodiment receives an operation instructing the start of a predetermined application through the input reception 210, the mobile terminal 200 starts the predetermined application (step S601). For example, the mobile terminal 200 starts the predetermined application in response to a user's selection of a predetermined icon on a home screen displayed on the display device 202. Note that the predetermined application is, for example, an application for realizing the functions of each unit shown in FIG. 5.

[0109] Following step S601, the mobile terminal 200 determines whether or not a connection with the shovel 100 has been confirmed by the communication control unit 220 (step S602). In other words, the communication control unit 220 determines whether or not there is an shovel 100 that can communicate with the communication device 207.

[0110] In step S602, if the connection with the shovel 100 is not confirmed, that is, if there is no shovel 100 around the mobile terminal 200 that is capable of communicating using the communication device 207, the mobile terminal 200 Ma Wait at.

[0111] In addition, the shovel 100 in which the connection with the mobile terminal 200 is not confirmed has the controller 30 in an off state. In addition, in this case, the mobile terminal 200 may end the application if the connection is not confirmed for a predetermined time or more.

[0112] In step S602, when a wireless communication connection with the shovel 100 is confirmed, the mobile terminal 200 causes the display control unit 230 to display on the display device 202 a list of the shovels 100 for which a wireless communication connection with the mobile terminal 200 has been confirmed, and accepts the selection of the shovel 100 with which to communicate (step S603). Details of the list screen of the shovels 100 will be described later.

[0113] Furthermore, in this embodiment, when the shovel 100 is selected, an item designation screen for designating an item of state quantity information to be displayed together with the video on the imaging screen when imaging the video of the selected shovel 100 may be displayed. Then, when the item of state quantity information is designated, the mobile terminal 200 may proceed to step S604. Details of the item designation screen will be described later.

[0114] In this embodiment, the items specified on the item specification screen may be stored in the storage unit 270 in association with the video data.

[0115] Next, the mobile terminal 200 determines whether an operator will be riding on the selected shovel 100 (step S604). Specifically, the mobile terminal 200 causes the display control unit 230 to display on the display device 202 a selection screen that allows the user to select whether to operate the shovel 100 by the operation of the operator, or to operate the shovel 100 in an unmanned state without an operator riding on it. The selection screen will be described in detail later.

[0116] In the following description, the operation of the shovel 100 operated by an operator may be referred to as a manned operation, and the operation of the shovel 100 without an operator on board may be referred to as an unmanned operation. Therefore, in step S604, it is determined whether the operation of the shovel 100 is a manned operation or an unmanned operation. Or It is being judged.

[0117] In step S604, if the operator is not on board, that is, if the operation of the shovel 100 is to be unmanned operation, the mobile terminal 200 proceeds to step S613, which will be described later.

[0118] In step S604, if an operator boards, i.e., if the operation of the shovel 100 is to be manned operation, the mobile terminal 200 transmits a request signal to the shovel 100 via the communication control unit 220, requesting the acquisition of operation data (state quantity information) (step S605).

[0119] Next, mobile terminal 200 causes communication control unit 220 to display an imaging screen for capturing moving images on display device 202, and determines whether an operation to instruct the start of recording has been accepted by input acceptance 210 (step S606). If the operation has not been accepted in step S606, mobile terminal 200 waits until the operation is accepted.

[0120] When the corresponding operation is accepted in step S606, the mobile terminal 200 causes the imaging control unit 240 to start recording a moving image of the shovel 100 and receiving operation data (step S607).

[0121] In the present embodiment, the mobile terminal 200 receives operation data including design condition information from the shovel 100, but is not limited to this. For example, the mobile terminal 200 may receive only state quantity information from the shovel 100 among the operation data acquired by the acquisition unit 31 of the shovel 100.

[0122] The excavator 100 has a plurality of sensors that continuously detect didThe value is transmitted as state quantity information to the mobile terminal 200. That is, the transmission control unit 33 of the shovel 100 transmits state quantity information including detection values ​​of a plurality of types of sensors to the mobile terminal 200 in real time.

[0123] The order of the processes in steps S605 and S606 may be reversed. In other words, the mobile terminal 200 may transmit a request signal to the shovel 100 after accepting an operation on the captured screen to instruct the start of recording.

[0124] The process from step S605 to step S607 will be specifically described below. When the manned operation of the shovel 100 is selected, the mobile terminal 200 of this embodiment causes the display device 202 to display a captured video screen via the communication control unit 220.

[0125] Then, when an operation to instruct recording of a video is accepted on the video capture screen, the mobile terminal 200 may transmit a request signal to the shovel 100 via the display control unit 230 and start capturing the video of the shovel 100.

[0126] In other words, with the mobile terminal 200 of this embodiment, by simply performing an operation to instruct recording of a video, it is possible to obtain video data showing the video of the shovel 100 and state quantity information for a period synchronized with the capture of the video of the shovel 100, thereby reducing the operational effort of the user of the mobile terminal 200.

[0127] The state quantity information may include an acquisition time zone of the state quantity information measured by a timing function of the shovel 100. The video data may include an image capture time zone of the video measured by a timing function of the mobile terminal 200. The mobile terminal 200 of this embodiment may associate the operation data (state quantity information) with the video data based on the acquisition time zone included in the state quantity information and the image capture time zone included in the video data.

[0128] Next, the mobile terminal 200 determines whether or not an operation to instruct the user to stop recording has been received on the captured screen through the input reception 210 (step S608). If the corresponding operation has not been received in step S608, the mobile terminal 200 returns to step S606.

[0129] In step S608, when the corresponding operation is accepted, the mobile terminal 200 causes the communication control unit 220 to stop receiving the operation data from the shovel 100 (step S609). Next, the mobile terminal 200 causes the imaging control unit 240 to stop capturing video by the imaging device 208 (step S610).

[0130] Next, the mobile terminal 200 cuts off the connection (communication) with the shovel 100 by the communication control unit 220 (step S611). Next, the mobile terminal 200 causes the storage unit 250 to store the operation data and the video data in association with each other as condition record data 280 in the memory unit 270 (step S612), and ends the process.

[0131] At this time, the storage unit 250 may store the display item of the state quantity information specified on the item specification screen in the memory unit 270 as a part of the state recording data 280. In addition, the mobile terminal 200 may transmit the state recording data 280 stored in the memory unit 270 to an external management device or the like.

[0132] In step S604, when unmanned operation is selected, the mobile terminal 200 causes the display control unit 230 to display on the display device 202 a confirmation screen that prompts the user to check whether or not there is an obstacle around the shovel 100 (step S613). Note that the confirmation screen may display a detection result by the object detection device S8 of the shovel 100, or the like.

[0133] Next, the mobile terminal 200 receives an input Department In step S614, if the corresponding operation has not been received, the mobile terminal 200 determines whether or not the corresponding operation has been received by the mobile terminal 210 (step S614). Ma Wait at.

[0134] In step S614, when the corresponding operation is accepted, the mobile terminal 200 causes the display control unit 230 to display on the display device 202 a list screen showing a list of operations of the shovel 100 (step S615). The details of the list screen of operations will be described later.

[0135] Next, when the mobile terminal 200 receives an operation to select an action through the input reception 210, the mobile terminal 200 transmits an instruction to start the selected action to the shovel 100 through the communication control unit 220 (step S616), and proceeds to step S605.

[0136] In the example of FIG. 6, when an operation to instruct to stop recording is received on the imaging screen, imaging of moving images by the imaging device 208 and reception of operational data are stopped, but the present invention is not limited to this.

[0137] In the present embodiment, the mobile terminal 200 may automatically stop recording and stop receiving operational data if no operation to stop recording is performed within a predetermined time after receiving an operation to start recording. In the present embodiment, by providing the mobile terminal 200 with this function, it is possible to prevent the state record data 280 from being acquired unintentionally by the user, such as when recording is started by mistake or when the user forgets to stop recording.

[0138] Furthermore, the mobile terminal 200 of this embodiment may stop recording and receiving operation data, for example, when an image captured by the imaging device 208 does not include an image of the shovel 100. When an image captured by the imaging device 208 does not include an image of the shovel 100, this means that the imaging device 208 is not pointed at the shovel 100, and there is a possibility that a video unintended by the user has been recorded. In this embodiment, it is possible to stop recording of a video unintended by the user and receiving operation data that does not correspond to a video.

[0139] Furthermore, the mobile terminal 200 of this embodiment may stop recording when the wireless communication connection with the shovel 100 is interrupted. In this embodiment, this function can prevent only the video from being recorded without acquiring operation data synchronized with the video.

[0140] Below, with reference to Figs. 7 to 13, examples of displays on the mobile terminal 200 will be described. hand 7 is a diagram showing an example of a list screen of excavators. A screen 71 shown in Fig. 7 is an example of a list screen of excavators 100 displayed on the display device 202 in step S603 of Fig. 6.

[0141] The screen 71 includes a display area 72 in which a list of excavators 100 whose connection with the mobile terminal 200 has been confirmed is displayed, and operation buttons 73.

[0142] In the display area 72, the model number of the shovel 100 for which connection with the mobile terminal 200 has been confirmed and a selection field associated with the model number of the shovel 100 are displayed in association with each other.

[0143] Mobile terminal 2 of this embodiment 00 When any of the selection fields displayed in the display area 72 is selected and the operation button 73 is operated, the shovel 100 identified by the model number associated with this selection field is selected as the shovel 100 with which to communicate. Then, the mobile terminal 200 transitions the display on the display device 202 from the screen 71 to an item designation screen for designating an item of state quantity information to be displayed on the video capture screen.

[0144] Fig. 8 is a diagram showing an example of an item designation screen for designating an item of state quantity information. A screen 81 shown in Fig. 8 is displayed on the display device 202 after the excavator 100 is selected on the screen 71, for example.

[0145] The screen 81 has display areas 82, 83, and operation buttons 84, 85. The display area 82 displays the model number of the shovel 100 that is performing wireless communication. The display area 83 displays a list of items of state quantity information that are displayed when capturing a video of the shovel 100 identified from the model number displayed in the display area 82. Note that the items displayed in the display area 83 are a list of items that are set as initial settings.

[0146] The operation button 84 is an operation button for setting the items to be displayed on the imaging screen from the items of the initial settings displayed in the display area 83. For example, when the operation button 84 is operated, the mobile terminal 200 of this embodiment saves the items of the state quantity information displayed in the display area 83 as part of the state recording data 280, and transitions the screen 81 to a selection screen for manned operation or unmanned operation.

[0147] The operation button 85 is an operation button for specifying an item other than the initial setting items displayed in the display area 83. In this embodiment, when the operation button 85 is operated, the screen 81 may be transitioned to a list screen of items included in the state quantity information.

[0148] 9 is a diagram showing an example of a selection screen for manned or unmanned operation. A screen 91 shown in FIG 9 is an example of the selection screen displayed in step S604 in FIG 6.

[0149] The screen 91 has a display area 92 and operation buttons 93 and 94. The display area 92 displays a message prompting the user to confirm whether or not an operator will board the shovel 100. In other words, the display area 92 displays a message prompting the user to select either manned operation or unmanned operation.

[0150] The operation button 93 is an operation button for selecting an attended operation, and the operation button 94 is an operation button for selecting an unattended operation. When the operation button 93 is operated, the mobile terminal 200 transitions the screen 91 to an imaging screen displayed in step S606. When the operation button 94 is operated, the terminal device 400 transitions the screen 91 to a confirmation screen displayed in step S613.

[0151] 10 is a diagram showing an example of a confirmation screen. A screen 101 shown in FIG.

[0152] A message is displayed in the display area 102 to prompt the user of the mobile terminal 200 to check whether or not there is an obstacle around the shovel 100. When an unmanned operation is selected, the mobile terminal 200 of this embodiment may transmit a request to the shovel 100 to obtain a detection result by the object detection device S8, and cause a message based on the detection result to be displayed in the display area 102.

[0153] Specifically, for example, when the detection result indicates that an obstacle has been detected around the shovel 100, the mobile terminal 200 may display a message to that effect in the display area 102.

[0154] screen 10 In step S615 of FIG. 6, when the operation button 103 is operated, the mobile terminal 200 transitions the screen 101 to a list screen of the operations of the shovel 100 that is displayed in step S615 of FIG.

[0155] Fig. 11 is a diagram showing an example of a list screen of the operations of the shovel. A screen 111 shown in Fig. 11 is an example of a list screen showing a list of operations of the shovel 100 in an unmanned operation.

[0156] The screen 111 has a display area 112 and an operation button 113. In the display area 112, prescribed action names and selection fields associated with each prescribed action name are displayed as a list of actions to be performed by the shovel 100.

[0157] The prescribed motion is a motion that transitions from a predetermined first prescribed posture to a predetermined second prescribed posture. Therefore, the prescribed motion is a motion that starts from the first prescribed posture and ends when the second prescribed posture is reached. The first prescribed posture and the second prescribed posture may be different postures, or may be the same posture. In other words, the prescribed motion may be a motion that changes posture from one prescribed posture to another prescribed posture, or a motion that performs a predetermined motion from one prescribed posture and then returns to the one prescribed posture.

[0158] The operation button 113 is an operation button for transmitting to the shovel 100 an instruction to start the selected prescribed operation.

[0159] When a selection field is selected in display area 112 and operation button 113 is operated, mobile terminal 200 transmits an instruction to start the specified operation corresponding to the selected selection field to shovel 100, and transitions screen 111 to a video capture screen that is displayed in step S606.

[0160] Fig. 12 is a first diagram showing an example of a moving image capture screen. A screen 121 shown in Fig. 12 is an example of a capture screen displayed on the display device 202 after a wireless communication connection with the shovel 100 is established.

[0161] Screen 121 has display areas 122, 123, 124, and operation button 125. Display area 122 displays an image captured by imaging device 208 of mobile terminal 200. Display area 122 also has display area 122a. When manned operation is selected as the operation of shovel 100, information identifying the operator of shovel 100 may be displayed in display area 122a. When unmanned operation is selected as the operation of shovel 100, information indicating that it is an unmanned operation may be displayed in display area 122a.

[0162] The display area 123 displays items specified on the item specification screen from among the state quantity information received from the excavator 100. In the example of Fig. 12, the display area 123 displays items that are initially set.

[0163] Specifically, the display area 123 displays the following items of state quantity information: hydraulic oil temperature, engine water temperature, engine fuel injection amount, pump pressure (discharge pressure of the main pump 14), and lever input (operating pressure of each operating lever).

[0164] In this embodiment, information indicating the items displayed in the display area 123 is treated as display item information, which is part of the state record data 280. The items displayed in the display area 123 are part of many items included in the state quantity information. Also, in the display area 123, instead of the item "engine fuel injection amount", the item "common rail pressure (engine fuel injection pressure)" included in the state quantity information may be displayed.

[0165] In the example of FIG. 12, since reception of state quantity information has not started, waveforms indicating values ​​of items of state quantity information are not displayed in the display area 123.

[0166] Information serving as bibliographic items for identifying video data is displayed in the display area 124. Specifically, the display area 124 displays the model number of the shovel 100 with which a wireless communication connection has been established, the date on which a request signal for operation data was transmitted, the time when recording of the captured video started, the name of the operation of the shovel 100, etc.

[0167] In the example of FIG. 12, since the video recording has not yet started, the date and start time are left blank, but the current date and start time may be displayed instead.

[0168] The name of the action of the shovel 100 displayed in the display area 124 may be input by the operator of the shovel 100. The name of the action of the shovel 100 may be selected from preset items such as digging, leveling, turning, and boom raising, for example, by operating an action input field. The action input field may be, for example, a list of actions of the shovel 100 displayed in the display area 112 shown in FIG. 11.

[0169] Furthermore, the action name of the shovel 100 may not be input by the operator, but may be an action name specified by the controller 30 of the shovel 100 based on detection values ​​of a posture sensor or the like as state quantity information. In this case, when the shovel 100 specifies the type of its own action, it may transmit the action name, which is the specified result, to the mobile terminal 200.

[0170] Furthermore, the name of the operation of the shovel 100 may be determined based on video data captured by the mobile terminal 200.

[0171] In addition, the items of information displayed in display area 124 are not limited to the example shown in Fig. 12. In addition, it may be possible to set the items to be displayed in display area 124. In addition, it may be possible to switch between displaying and hiding display area 124 on screen 121.

[0172] Furthermore, in this embodiment, some of the items of the design condition information of the excavator 100 included in the operation data may be displayed on the screen 121. In this case, the items of the design condition information displayed on the screen 121 may be items that are determined in advance as initial settings, or may be items that are specified by the user of the mobile terminal 200.

[0173] In the following description, the information displayed in the display area 124 may be referred to as bibliographic information of the video data. The bibliographic information of the video data is held as part of the state recording data 280 together with the video data and state amount information.

[0174] Operation button 125 is an operation button for instructing the start of video recording. When operation button 125 is operated on screen 121, mobile terminal 200 starts recording the video displayed in display area 122.

[0175] Fig. 13 is a second diagram showing an example of a moving image capture screen. A screen 121A shown in Fig. 13 is an example of a recording screen during recording of a moving image.

[0176] Screen 121A has display areas 122A, 123A, 124A, and operation button 126. Display area 122A has display area 122a and display area 122b. Display area 122b displays information indicating that the video currently displayed in display area 122A is being recorded.

[0177] In display area 123A, when video recording starts, operational data including state quantity information is received, and a waveform showing the value of each item of state quantity information is displayed. In display area 124A, the date and time when video recording started are displayed.

[0178] Moreover, operation button 126 is an operation button for instructing to stop recording of a moving image. When operation button 126 is operated on screen 121A, mobile terminal 200 of this embodiment stops recording of the moving image and stores state record data 280 in storage unit 270.

[0179] Furthermore, mobile terminal 200 of this embodiment may display an input screen for a memo regarding the state at the time of imaging on screen 121A after operation button 126 is operated. In this case, when a memo is input on the input screen, mobile terminal 200 stores memo information indicating the content of the input memo in storage unit 270 as a part of state record data 280.

[0180] In this manner, the status recording data 280 of this embodiment includes video data including audio data, operation data (including status amount information and setting condition information), bibliographic information of the video data, display item information indicating the items of status amount information displayed in the display area 123 during recording, and memo information. Note that the status recording data 280 does not need to include all of this information. It is sufficient that the status recording data 280 includes at least video data including audio data and status amount information.

[0181] The above is the process of acquiring the status record data 280 by the mobile terminal 200. Next, the process of reproducing the status record data 280 by the mobile terminal 200 will be described with reference to Fig. 14. Fig. 14 is a second flowchart illustrating the process of the mobile terminal.

[0182] In this embodiment, the predetermined application may be terminated once the process of acquiring the state recording data 280 is completed. In that case, when reproducing the state recording data 280, the mobile terminal 200 starts up the predetermined application again, and displays on the display device 202 a reproduction screen of the state recording data 280 stored in the storage unit 270.

[0183] Mobile terminal 200 determines whether or not an operation for instructing playback of state record data 280 has been accepted on the playback screen (step S1401). If the operation has not been accepted in step S1401, mobile terminal 200 waits until the operation is accepted.

[0184] When the corresponding operation is accepted in step S1401, the mobile terminal 200 accepts the selection of the state record data 280 to be played back (step S1402).

[0185] Next, the mobile terminal 200 determines whether or not a change in the display items of the state quantity information to be displayed during playback of the state record data 280 has been accepted (step S1403). Specifically, the mobile terminal 200 determines whether or not an operation to instruct a change in the display items of the state quantity information included in the selected state record data 280 has been accepted.

[0186] In step S1403, if the change in the display items is not accepted, the mobile terminal 200 proceeds to step S1405, which will be described later.

[0187] In step S1403, when a change to the display item is accepted, mobile terminal 200 acquires waveform data that is the value of the item selected as the display item to be displayed after the change, from the state quantity information included in state record data 280 (step S1404).

[0188] Next, mobile terminal 200 determines whether or not an operation to instruct the start of playback of state record data 280 has been accepted (step S1405). If the operation has not been accepted in step S1405, mobile terminal 200 waits until the operation is accepted.

[0189] If a corresponding operation is accepted in step S1405, mobile terminal 200 causes playback section 260 to read out state record data 280 stored in storage section 270, and starts playback (step S1406).

[0190] In other words, the mobile terminal 200 reads out the state record data 280 and displays the state record data 280 on the playback screen displayed on the display device 202.

[0191] Next, mobile terminal 200 determines whether or not an operation to instruct to stop playback has been received (step S1407). If the corresponding operation has not been received in step S1407, mobile terminal 200 waits until the corresponding operation is received.

[0192] When the corresponding operation is accepted in step S1407, mobile terminal 200 stops playing back state record data 280 (step S1408) and ends the process.

[0193] A display example of the mobile terminal 200 when the state record data 280 is reproduced will be described below with reference to FIG. 15 and FIG.

[0194] 15 is a first diagram showing an example of a playback screen. A screen 151 shown in Fig. 15 is an example of the playback screen displayed on the display device 202 in step S1401 of Fig. 14.

[0195] Screen 151 has display areas 152, 153, 154, and operation buttons 155. Display area 152 displays video data included in state record data 280. In the example of Fig. 15, state record data 280 has been selected, and shows the state before playback has started.

[0196] Therefore, the first frame (still image) of the video data included in the selected condition record data 280 is displayed in the display area 152. Moreover, since the condition record data 280 was acquired at the work site of the shovel 100, the state of the work site of the shovel 100 is also imaged together with the shovel 100. In the example of Fig. 15, it can be seen that the work site of the shovel 100 is a mountainous area.

[0197] Moreover, the display area 152 has a display area 152a. A part of the bibliographic information included in the condition recording data 280 is displayed in the display area 152a. In the example of Fig. 15, information indicating the operator of the shovel 100 when the video was captured is displayed as a part of the bibliographic information in the display area 152a.

[0198] Display area 153 displays items of state quantity information indicated by display item information included in state record data 280. Note that in the example of Fig. 15, since state record data 280 has not yet been played back, waveforms indicating the values ​​of each item displayed in display area 153 are not displayed. Also, since playback has not yet begun, timing display bar 159 indicating the playback time of the video data is displayed at the position that is the start point of the waveform.

[0199] Moreover, when the mobile terminal 200 of this embodiment receives an operation to select an item displayed in the display area 153, it is assumed that the mobile terminal 200 has received an instruction to change the item of the state quantity information. Specifically, it is assumed that the mobile terminal 200 has received an instruction to change the selected item to another item.

[0200] When the mobile terminal 200 receives an instruction to change the item, it displays a list of information items included in the state quantity information in a pull-down format or the like at the position where the selected item is displayed.

[0201] Then, when mobile terminal 200 receives a selection of an item from the list, it may display the item selected from the list in display area 153, instead of the item instructed to be changed. Mobile terminal 200 may also add the item selected from the list as a new item to be displayed in display area 153.

[0202] When the mobile terminal 200 accepts a change in an item, the mobile terminal 200 extracts waveform data corresponding to this item from the state quantity information. and others Extract.

[0203] The display area 154 displays the bibliographic information included in the status record data 280. In the example of FIG. 15, the machine number, the date, the start of recording, time In addition to the action name, the end time when the video data recording ended is displayed.

[0204] Operation button 155 is an operation button for instructing playback of status record data 280. When operation button 155 is operated on screen 151, mobile terminal 200 starts playing back status record data 280.

[0205] 16 is a second diagram showing an example of the playback screen. Screen 151A shown in Fig. 16 is an example of the playback screen displayed on display device 202 in step S1406 of Fig. 14.

[0206] The screen 151A has display areas 152A, 153A, and 156, and operation buttons 157 and 158.

[0207] Display area 152A displays the video data being played. Display area 152A also has display areas 152b and 152c. Display area 152b displays information indicating that video data included in state record data 280 is being played. Display area 152c displays bibliographic information of the video data being played. Note that display area 152c may display part of the bibliographic information of the video data.

[0208] Furthermore, the mobile terminal 200 of this embodiment causes the audio input / output device 203 to output audio data included in the video data.

[0209] Display area 153A displays a waveform indicating the value of the displayed item out of the state quantity information included in state record data 280. Also, in display area 153A, timing display bar 159 is displayed at a position indicating the playback time, and the waveform is displayed together with the movement of timing display bar 159. The waveform data indicating this waveform is data acquired in synchronization with the video data being played back.

[0210] Memo information and the like that was input when the video data was captured is displayed in the display area 156. In the example of Fig. 16, it can be seen that a large bucket was attached to the excavator 100 when the video being played was recorded.

[0211] The operation button 157 is an operation button for stopping the playback of the status record data 280. The operation button 158 is an operation button for transmitting the status record data 280 to an external management device or the like.

[0212] When operation button 157 is operated on screen 151A, mobile terminal 200 stops playing state record data 280. When operation button 158 is operated on screen 151A, mobile terminal 200 transmits state record data 280 that is being played or whose playback has been stopped to a management device, etc. After state record data 280 is transmitted to a management device, etc., mobile terminal 200 may erase state record data 280 held in storage unit 270.

[0213] Next, another example of the playback screen displayed on mobile terminal 200 will be described with reference to Fig. 17. Fig. 17 is a third diagram showing an example of the playback screen. Screen 151B shown in Fig. 17 is a modified example of screen 151A shown in Fig. 16.

[0214] The screen 151B has a display area 152B in which a moving image captured by the mobile terminal 200 and a moving image captured by the camera S6 of the shovel 100 among the state quantity information included in the state record data 280 are displayed. but , which is different from the screen 151A shown in FIG.

[0215] The display area 152B includes display areas 152b, 152c, 152d, and 152e. 。 In the display area 152b, information indicating that the video data is being played back is displayed. In the display area 152c, the bibliographic information included in the status record data 280 is displayed.

[0216] Display area 152d displays video data included in status record data 280. In other words, display area 152d displays video data captured by imaging device 208 of mobile terminal 200.

[0217] Display area 152e displays video data captured by camera S6 of shovel 100, which is among the state quantity information included in state recording data 280. More specifically, display area 152e displays a video captured by a camera that captures an image in front of shovel 100, among the cameras S6 that shovel 100 has.

[0218] In this way, the screen 151B simultaneously displays a video of the shovel 100 captured by the mobile terminal 200 and a video captured by the camera S6 of the shovel 100, allowing the user of the mobile terminal 200 to easily grasp the overall movement of the shovel 100.

[0219] In this manner, in this embodiment, a user of the mobile terminal 200 can simultaneously view a video of the shovel 100 in operation and state quantity information acquired in synchronization with the video data (including audio data) showing this video.

[0220] Furthermore, in this embodiment, since the condition record data 280 is recorded and stored, the viewer of the condition record data 280 can understand the operating condition of the shovel 100 even in a location other than the work site where the shovel 100 is working. Furthermore, according to this embodiment, since the work site of the shovel 100 is also captured as a video together with the shovel 100 in the video data, the user of the mobile terminal 200 can understand the work environment of the shovel 100.

[0221] Furthermore, in this embodiment, when the video data is played back, the audio data is also played back, so that the user of the mobile terminal 200 can hear the operating sounds of the shovel 100.

[0222] Therefore, the user of the mobile terminal 200 can check matters that cannot be determined only from the waveform of the state quantity information by viewing the state record data 280. Specifically, matters that cannot be determined only from the waveform of the state quantity information include whether or not the operation of the shovel 100 estimated from the waveform of the state quantity information matches the actual operation of the shovel 100, whether or not the operating speed of the shovel 100 is different from that in normal times, the color of the smoke emitted from the shovel 100, whether or not abnormal noises are generated during operation, whether or not the machine is suitable for the environment of the work site, and the like.

[0223] Therefore, according to this embodiment, even before an abnormality occurs in the shovel 100, the user of the mobile terminal 200 can check the condition record data 280 of the shovel 100 currently being used at the work site on the mobile terminal 200 and can grasp in detail how the shovel 100 is being moved and used. Therefore, the user of the mobile terminal 200 can make an evaluation in light of the work environment of the shovel 100.

[0224] The mobile terminal 200 may be carried by each of a plurality of users (for example, an operator, a serviceman, an engineer, etc.). In this case, each of the plurality of users can check the condition record data 280 of the shovel 100 on his / her own mobile terminal 200 at the work site.

[0225] In the above-described embodiment, the video captured by the mobile terminal 200 is a video capturing an image of the entire shovel 100 from the periphery of the shovel 100, but the present invention is not limited to this. The video captured by the mobile terminal 200 may be, for example, a video captured by the mobile terminal 200 installed inside the cabin 10 of the shovel 100. In this case, the captured video may be a video capturing an image of the interior of the cabin 10, or a video capturing an image of the exterior of the cabin 10.

[0226] Furthermore, the mobile terminal 200 of the present embodiment may be, for example, a wearable terminal. Specifically, the mobile terminal 200 may be a glasses-type mobile terminal or a wristwatch-type mobile terminal. The mobile terminal 200 may be of any type as long as it is portable and capable of capturing video and communicating with the shovel 100.

[0227] (Other embodiments) Other embodiments will be described below with reference to the drawings. Fig. 18 is a schematic diagram showing a configuration example of an excavator management system according to another embodiment. The excavator management system SYS1 shown in Fig. 18 is a system for managing one or more excavators 100.

[0228] In this embodiment, the management system SYS1 mainly includes a shovel 100, a mobile terminal 200, and a management device 300. In the management system SYS1, there may be one or more of each of the shovel 100, the mobile terminal 200, and the management device 300. In the example of Fig. 18, the management system SYS1 includes one shovel 100, one mobile terminal 200, and one management device 300.

[0229] The management device 300 is typically a fixed terminal device, for example, a server computer installed in a management center outside a work site, etc. The management device 300 may be, for example, a notebook PC, a tablet PC, or a mobile terminal device such as a smartphone.

[0230] The following describes the management device 300 of this embodiment. Fig. 19 is a diagram showing an example of the hardware configuration of the management device.

[0231] The management device 300 of this embodiment is a computer including an input device 301, an output device 302, a drive device 303, an auxiliary storage device 304, a memory device 305, an arithmetic processing device 306, and an interface device 307, all of which are interconnected via a bus B1.

[0232] The input device 301 is a device for inputting various information, and is realized by, for example, a touch panel. The output device 302 is a device for outputting various information. of The interface device 307 is used to connect to a network.

[0233] A management program that realizes each function described below is at least a part of various programs that control the management device 300. The management program is provided, for example, by distribution of a storage medium 308 or by downloading from a network. The storage medium 308 that records the management program can be of various types, such as a storage medium that optically, electrically, or magnetically records information, and a semiconductor memory that electrically records information, such as a ROM or a flash memory.

[0234] Furthermore, when storage medium 308 on which the management program is recorded is set in drive device 303, the management program is installed in auxiliary storage device 304 from storage medium 308 via drive device 303. The management program downloaded from the network is installed in auxiliary storage device 304 via interface device 307.

[0235] Auxiliary storage device 304, which realizes management information database 310 (see FIG. 20), described later, stores a management program installed in management device 300, and also stores various files, data, etc. required by management device 300. Memory device 305 reads out and stores the management program from auxiliary storage device 304 when management device 300 is started up. Then, arithmetic processing device 306 realizes various processes, described later, in accordance with the management program stored in memory device 305.

[0236] Next, the functional configuration of the management device 300 of this embodiment will be described with reference to Fig. 20. Fig. 20 is a diagram showing an example of the functional configuration of the management device.

[0237] The management device 300 of this embodiment includes a management information database 310 , a data acquisition section 320 , a data storage section 330 , a diagnosis section 340 , an operation evaluation section 350 , and a data output section 360 .

[0238] The management information database 310 is realized by storage devices such as the auxiliary storage device 304 and the memory device 305. The data acquisition unit 320, the data storage unit 330, the diagnosis unit 340, the operation evaluation unit 350, and the data output unit 360 are realized by the calculation processing unit 306 reading and executing programs stored in the auxiliary storage device 304, the memory device 305, etc.

[0239] The management information database 310 stores various types of information used for managing the shovel 100. The information stored in the management information database 310 includes, for example, the condition recording data 280, diagnosis result information indicating the results of diagnosis of the presence or absence of a malfunction of the shovel 100 based on the condition recording data 280, evaluation result information indicating the results of evaluation of the operation of the shovel 100, and the like.

[0240] The management information of this embodiment may be stored for each shovel 100. Furthermore, the management information may include a plurality of condition record data 280 acquired at different dates and times for each model number of the shovel 100.

[0241] The data acquisition section 320 acquires various pieces of information stored in the management information database 310. Specifically, the data acquisition section 320 acquires the status record data 280 transmitted from the mobile terminal 200.

[0242] The data storage section 330 stores the information acquired by the data acquisition section 320 and the information obtained as a result of processing by the diagnosis section 340 and the action evaluation section 350 in the management information database 310 as management information.

[0243] The diagnosis unit 340 receives from the mobile terminal 200 the shovel 100 of When a request for diagnosis regarding the operation is received, the diagnosing unit 340 may diagnose the presence or absence of a malfunction of the shovel 100, the degree of deterioration, and the like, and notify the mobile terminal 200 of the diagnosis result. The diagnosis result by the diagnosing unit 340 is stored in the management information database 310 as a part of the management information.

[0244] Specifically, the diagnosis unit 340 analyzes, for example, the state quantity information, To If the value of a specific item among the included items is equal to or greater than a predetermined threshold, it may be diagnosed (determined) as having a malfunction.

[0245] Furthermore, the diagnosis unit 340 may diagnose the degree of deterioration, etc., of the shovel 100 by using a plurality of condition record data 280 acquired at different dates and times for one shovel 100. At this time, the diagnosis unit 340 may convert an image of the shovel 100 in the video into a link model, and diagnose the operation based on the link model.

[0246] The link model is a model suitable for comparing the posture of the shovel 100. Specifically, the link model of the present embodiment is a three-dimensional image that depicts the posture of the shovel 100 in a simplified manner based on areas in an image of the shovel 100 that indicate the lower traveling body 1, the revolving mechanism 2, and the upper revolving body 3, points that indicate the link mechanism that connects the upper revolving body 3 and the boom 4, points that indicate the link mechanism that connects the boom 4 and the arm 5, points that indicate the link mechanism that connects the arm 5 and the bucket 6, and points that indicate the tip of the bucket.

[0247] The operation evaluation unit 350 evaluates the operation of the shovel 100 based on the state record data 280 acquired from the mobile terminal 200.

[0248] The operation evaluation unit 350 evaluates the operation of the shovel 100 based on, for example, a command value corresponding to the type of operation of the shovel 100, a detection value from a sensor, the posture of the shovel 100 in the video, and the like.

[0249] Specifically, for example, when the command value and the detection value from the sensor match and the posture of the shovel 100 in the video deviates from the posture indicated by the command value, the operation evaluation unit 350 outputs, as an evaluation result, information indicating that sensor calibration is necessary.

[0250] The evaluation result by the action evaluation section 350 is transmitted to the mobile terminal 200. The evaluation result by the action evaluation section 350 is also stored by the data storage section 330 in the management information database 310 as part of the management information.

[0251] The data output unit 360 outputs (transmits) various information from the management device 300 to an external device. The external device is, for example, the mobile terminal 200. Specifically, when the data output unit 360 receives a playback request for the status recording data 280 stored in the input reception 210 from the mobile terminal 200, the data output unit 360 transmits the status recording data 280 stored in the management information database 310 to the mobile terminal 200.

[0252] Next, the operation of the management system SYS1 of this embodiment will be described with reference to Fig. 21. Fig. 21 is a sequence diagram illustrating the operation of the management system.

[0253] In the management system SYS1, the mobile terminal 200 accepts an operation instructing transmission of the status record data 280, and transmits the status record data 280 to the management device 300 (step S211).

[0254] The management device 300 acquires the status record data 280 through the data acquisition section 320, and stores the status record data 280 in the management information database 310 through the data storage section 330 (step S212).

[0255] Furthermore, when the operation button 155 is operated on the playback screen displayed on the mobile terminal 200 (see FIG. 15), the management system SYS1 transmits a playback request for the selected state record data 280 to the management device 300 (step S213).

[0256] Before the playback screen is displayed, mobile terminal 200 may display a list screen of status recording data 280 for selecting status recording data 280 to be played back. In this case, management device 300 may transmit a list of status recording data 280 stored in management information database 310 to mobile terminal 200 and cause mobile terminal 200 to display the list screen.

[0257] When the management device 300 receives a request to play back the status record data 280 from the mobile terminal 200, the data output unit 360 reads out the status record data 280 stored in the management information database 310 (step S214). Then, the management device 300 transmits the read out status record data 280 to the mobile terminal 200 by the data output unit 360 (step S215).

[0258] The mobile terminal 200 receives the status record data 280, and plays back the received status record data 280 (step S216).

[0259] Furthermore, in the management system SYS1, when the mobile terminal 200 receives an operation requesting diagnosis of the excavator 100, the mobile terminal 200 makes a diagnosis request to the management device 300 (step S217).

[0260] When the management device 300 receives the diagnosis request through the data acquisition unit 320, the diagnosis unit 340 performs a diagnosis based on the status record data 280 (step S218). Then, the management device 300 transmits the diagnosis result to the mobile terminal 200 (step S219).

[0261] In this embodiment, as a diagnosis result, video data in which an image of the shovel 100 is converted into a link model may be transmitted to the mobile terminal 200. In the mobile terminal 200, the video data in which an image of the shovel 100 is converted into a link model may be played back.

[0262] The video data in which the image of the shovel is converted into a link model is video data in which the link model is superimposed on or replaced with the image of the shovel 100 in the video data captured by the imaging device 208. In the following description, the video data in which the link model is superimposed on or replaced with the image of the shovel 100 may be referred to as diagnostic video data.

[0263] Furthermore, in the management system SYS1, when the mobile terminal 200 receives a request to evaluate the operation of the shovel 100 (step S220), the operation evaluation unit 350 evaluates the operation of the shovel 100 based on the condition recording data 280 (step S221). Next, the management device 300 causes the data output unit 360 to transmit information indicating the evaluation result to the mobile terminal 200 (step S222). When the mobile terminal 200 receives the information indicating the evaluation result, it displays an evaluation result screen indicating the evaluation result.

[0264] Here, when the evaluation result includes information indicating that calibration of the sensor is necessary, the mobile terminal 200 of this embodiment transmits an instruction to calibrate the sensor to the shovel 100 (step S223). This instruction may include the sensor that needs to be calibrated and information necessary to perform the calibration. In response to this instruction, the shovel 100 calibrates the specified sensor (step S224).

[0265] In addition, in FIG. 21, the operations from step S211 to step S216, the operations from step S217 to step S219, and the operations from step S220 to step S224 may each be performed at an independent timing.

[0266] In this embodiment, for example, the playback request in step S213 in Fig. 21 may include a diagnosis request using the played back condition record data 280 and an evaluation request. In this case, in the mobile terminal 200, a series of processes from the playback of the condition record data 280 in step S216 to the acquisition of the evaluation result in step S222 is executed.

[0267] Next, the process of the diagnosis unit 340 of the management device 300 of this embodiment will be described with reference to FIGS.

[0268] 22 is a first diagram showing an example of a playback screen of diagnostic video data. A screen 221 shown in FIG. 22 may be displayed on the display device 202 of the mobile terminal 200 in step S219 in FIG.

[0269] The screen 221 has display areas 222 and 223, and an operation button 224. In the display area 222, an image 222a of the shovel 100 captured by the imaging device 208 and a link model 222b generated from the image 222a are displayed in a superimposed manner.

[0270] An elapsed time display bar 222c is displayed in the display area 222. The display area 223 displays the time that has elapsed since the start time of recording the video. On the screen 221, the elapsed time display bar 222c is synchronized with the time displayed in the display area 223. Furthermore, the image displayed in the display area 222 is an image, of multiple still images included in the video, that corresponds to the time indicated by the elapsed time display bar 222c and the display area 223.

[0271] In the example of FIG. 21, it can be seen that the image displayed in the display area 222 is an image 35 seconds after the start time of recording.

[0272] The operation button 224 is an operation button for converting the image displayed in the display area 222 into an image containing only the link model 222b.

[0273] When operation button 224 is operated on screen 221, mobile terminal 200 transitions screen 221 to a screen from which image 222a of shovel 100 is erased. When operation button 224 is operated, mobile terminal 200 may stop playing the diagnostic video data and erase image 222a of shovel 100 from the images displayed in display area 222 at the time when operation button 224 was operated.

[0274] Fig. 23 is a second diagram showing an example of a playback screen of diagnostic video data. Screen 221A shown in Fig. 23 is an example of a screen displayed on display device 202 of mobile terminal 200 after operation button 224 is operated on screen 221.

[0275] The screen 221A has display areas 222A and 223, and operation button groups 225 and 226. In the display area 222A, the image 222a of the shovel 100 is erased, and only the link model 222b is displayed.

[0276] Operation button group 225 is a group of operation buttons for switching the image displayed in display area 222A to a plurality of different images, and includes operation buttons 225a, 225b, and 225c.

[0277] The operation button 225a is an operation button for switching the image displayed in the display area 222A from the link model 222b to a captured image. The operation button 225b is an operation button for switching the image displayed in the display area 222A from the link model 222b to a waveform of state quantity information.

[0278] The operation button 225c is an operation button for switching the image displayed in the display area 222A from the link model 222b to a comparison image of the link models.

[0279] The operation button group 226 is a group of operation buttons for switching the link model 222b displayed in the display area 222A to link models as viewed from a plurality of different directions, and includes operation buttons 226a, 226b, 226c, and 226d.

[0280] The operation button 226a is an operation button for switching the link model 222b to a link model viewed from the front (front view). The operation button 226b is an operation button for switching the link model 222b to a link model viewed from the left side (left side view).

[0281] The operation button 226c is an operation button for switching the link model 222b to a link model viewed from the right side (right side view). The operation button 226d is an operation button for switching the link model 222b to a link model viewed from the back (rear view). 3 In the screen 221A shown in FIG.

[0282] Fig. 24 is a third diagram showing an example of a playback screen of diagnostic video data. Screen 221B shown in Fig. 24 is an example of a screen displayed on display device 202 of mobile terminal 200 after operation button 226c is operated on screen 221A.

[0283] The screen 221B shown in FIG. 24 has display areas 222B and 223, and operation button groups 225 and 226. 2 In B, the link model 222b is a right side view of the link model 222. c is displayed. Furthermore, on screen 221B, operation button 225c is selected.

[0284] Fig. 25 is a fourth diagram showing an example of a playback screen of diagnostic video data. Screen 221C shown in Fig. 25 is an example of a screen displayed on display device 202 of mobile terminal 200 after operation button 225c is operated on screen 221B.

[0285] The screen 221C includes a display area 222 C、 It has operation button groups 225 and 226. In the screen 221C, a display area 222C displays an image in which the link model 222d and the link model 222d' extracted from diagnostic moving image data generated from previously acquired condition record data 280' are superimposed.

[0286] Here, the relationship between the link model 222d and the link model 222d' will be described.

[0287] The past state record data 280' on which the link model 222d' is based is older than the past state record data 280 on which the link model 222d is based. To The operation of shovel 100 when status recording data 280 is acquired is the same as the operation of shovel 100 when status recording data 280' is acquired. The time that elapses from the start of recording of the moving image data included in status recording data 280 until the still image that is the basis of link model 222d appears is the same as the time that elapses from the start of recording of the moving image data included in status recording data 280' until the still image that is the basis of link model 222d' appears.

[0288] In other words, link model 222d and link model 222d' show the posture of shovel 100 at each time point when a predetermined time has elapsed since the start of the movement when shovel 100 is made to perform the same movement at different times.

[0289] Here, when the operation performed by the shovel 100 is a specified operation, the shovel 100 operates based on the same command value at each time, and therefore, link model 222d and link model 222d' match. Therefore, when link model 222d and link model 222d' do not match, it is presumed that some abnormality has occurred in the shovel 100 or deterioration of the machine body is progressing.

[0290] In the example of Figure 25, link model 222d and link model 222d' do not match, so the user of the mobile terminal 200 can understand that there is a suspected malfunction of the shovel 100 or the deterioration of the machine body, etc.

[0291] Note that the screen 221C may display a message indicating that a malfunction of the shovel 100, the progress of deterioration of the machine body, or the like is predicted as a diagnosis result by the diagnosing unit 340.

[0292] In addition, the diagnosis unit 340 of this embodiment determines, for example, the deviation width between the link model 222d and the link model 222d′. butIf the difference is less than a predetermined threshold, the aircraft may be diagnosed as degraded, and if the difference is equal to or greater than the predetermined threshold, the aircraft may be diagnosed as having an abnormality.

[0293] In addition, in this embodiment, a display section for displaying video data of a link model based on past state record data 280' and a display section for displaying video data of a link model based on state record data 280 may be provided within display area 222C, and the two video data may be played back simultaneously.

[0294] In this way, by playing video data of link models based on condition record data 280 acquired at different times side by side, the user of the mobile terminal 200 can understand the differences in the speed and vibration of the shovel 100's operation at each time.

[0295] Furthermore, in this embodiment, it is possible to compare diagnostic video data generated from condition record data 280 acquired at different times. For this reason, for example, by comparing condition record data 280 acquired in a state in which an abnormality has occurred in the shovel 100 with condition record data 280 acquired after the shovel 100 has been repaired, it is possible to allow the user of the mobile terminal 200 to confirm whether or not the repair has been completed.

[0296] In addition, in this embodiment, a method of using diagnostic video data generated from video data has been described as a method of comparing condition record data 280 acquired at different times, but the method of comparing condition record data 280 is not limited to this.

[0297] For example, in this embodiment, waveform data for the same item of state quantity information may be obtained from each of the state record data 280 obtained at different times, and the waveform data may be superimposed and compared.

[0298] Next, the processing of the action evaluation unit 350 of this embodiment will be described with reference to Fig. 26 to Fig. 28. Fig. 26 is a first diagram showing an example of a display of the evaluation result.

[0299] A screen 261 shown in FIG. 26 is an example of an evaluation result screen displayed on the display device 202 of the mobile terminal 200 in step S222 of FIG.

[0300] Screen 261 has display areas 262, 263, and 264. In display area 262, a part of the bibliographic information of shovel 100 that was the subject of operation evaluation and the diagnosis result by diagnosis unit 340 are displayed. Note that the information displayed in display area 262 is not limited to this. It is sufficient that display area 262 includes at least the model number of shovel 100 from the bibliographic information included in condition recording data 280.

[0301] The display area 263 shows a waveform for each item of state quantity information included in the state recording data 280. Note that the items of state quantity information displayed in the display area 263 may be items indicated by display item information included in the state recording data 280.

[0302] Furthermore, the waveform displayed in the display area 263 may be a waveform of an average value calculated each time a detection value of a sensor is obtained.

[0303] In this embodiment, the waveform of an item diagnosed as having an abnormality is displayed by comparing with state quantity information acquired in a past normal state. Display area In this case, a message may be displayed in the display area 263 indicating that the item has been diagnosed as abnormal.

[0304] In this embodiment, the data may be compared with state quantity information included in the past state record data 280' to identify items whose waveforms are different, and the waveforms of the identified items may be displayed in the display area 263. In this case, a message may be displayed in the display area 263 indicating that the items displayed in the display area 263 are items that should be checked with priority.

[0305] In this manner, in this embodiment, when the evaluation results of the operation evaluation unit 350 are displayed, items of state quantity information that have been diagnosed as abnormal or items of state quantity information that should be checked as a priority are displayed, thereby allowing the user of the mobile terminal 200 to understand the items that should be checked.

[0306] A radar chart with the items included in the state quantity information as axes is displayed in the display area 264. The items displayed in the display area 264 may be the same as the items whose waveforms are displayed in the display area 263. Also, the items displayed in the display area 264 may be items indicated by the display item information.

[0307] In this embodiment, the evaluation results are displayed as a radar chart, allowing the user of the mobile terminal 200 to easily grasp the balance of the operations of each part of the shovel 100.

[0308] Fig. 27 is a second diagram showing an example of the display of the evaluation result. Screen 271 shown in Fig. 27 is a display example of the evaluation result when comparing the toe position at the start of a "horizontal drawing motion" and after the start of the motion as one of the motion evaluations. The "horizontal drawing motion" is one of the specified motions.

[0309] The screen 271 has display areas 272 and 273. In the display area 272, an image 272a of the shovel 100, an image 272b of the bucket 6, and an elapsed time display bar 272c are displayed.

[0310] Image 272b of the shovel 100 is a still image of the shovel 100 at the time indicated by elapsed time display bar 272c, and image 272b is an image indicating the position of the bucket 6 in the still image of the shovel 100 at the start of playback of the video data.

[0311] Display area 273 displays graph 273a and information 273b indicating the type of values ​​shown in the graph. Graph 273a is a graph with the vertical axis representing command values, detected values ​​from the angle sensor, and image discrimination values, and the horizontal axis representing time. Information 273b indicates that the items whose values ​​are shown in the graph are command values, detected values ​​from the angle sensor, and image discrimination values, and that the dotted line in the graph corresponds to the image discrimination values, the solid line corresponds to the detection values, and the dashed-dotted line corresponds to the command values.

[0312] The image discrimination value in this embodiment is a value indicating the difference between the position of the toes in image 272a and image 272b displayed in display area 272. More specifically, the image discrimination value is a value indicating the difference between the height of the toes in image 272a and the height of the toes in image 272b.

[0313] In the example of Figure 27, the specified operation, "horizontal pulling operation," is being performed, so if the shovel 100 is in a normal state, the height of the toe of the shovel 100 before and after the start of the operation is constant, and the image discrimination value does not change.

[0314] In the graph 273a shown in the display area 273 of the screen 271, the command value for performing the "horizontal pulling operation" and the detection value of the angle sensor of the shovel 100 match, but the image discrimination value has changed. In this case, it is assumed that the reference value of the angle sensor has shifted.

[0315] In this embodiment, by comparing the video of the shovel 100 with the command values ​​and the sensor detection values ​​in this way, it is possible to allow the user of the mobile terminal 200 to understand the actual operation of the shovel 100 when control is being performed to perform a prescribed operation in the shovel 100. Also, in this embodiment, it is possible to allow the user of the mobile terminal 200 to understand a state in which the actual operation deviates from the prescribed operation even though control is being performed to cause the shovel 100 to perform a prescribed operation.

[0316] In the example of FIG. 27, a message or the like may be displayed in the display area 273 indicating that, although the shovel 100 is being controlled to perform a specified operation, the actual operation is different from the specified operation, and that calibration of the angle sensor is necessary.

[0317] Furthermore, in this embodiment, an operation button for instructing the shovel 100 to calibrate the angle sensor may be displayed on the screen 271. When this operation button is operated, the mobile terminal 200 may transmit to the shovel 100 an instruction to calibrate the reference value of the angle sensor together with information identifying the angle sensor that requires calibration. At this time, the mobile terminal 200 may calculate the deviation width of the reference value of the angle sensor based on the image discrimination value, and transmit this together with the calibration instruction to the shovel 100. The shovel 100 calibrates the angle sensor in response to this calibration instruction.

[0318] The deviation range of the reference value may be calculated by the action evaluation section 350 of the management device 300. In this case, the deviation range of the reference value is transmitted from the management device 300 to the mobile terminal 200 as part of the evaluation result of the action evaluation section 350.

[0319] In this way, according to this embodiment, even if the shovel 100 is being made to perform a prescribed operation, if the operation differs from the prescribed operation, the sensor of the shovel 100 can be easily calibrated.

[0320] Fig. 28 is a third diagram showing an example of a display of an evaluation result. Screen 281 shown in Fig. 28 is a display example of an evaluation result in which, as one of the operation evaluations, the position of a predetermined part of shovel 100 is identified from images of shovel 100 in several postures, and the position of the predetermined part for each posture is compared. Note that the process described with reference to Fig. 28 may be executed mainly by mobile terminal 200.

[0321] Screen 281 has display areas 282 and 283. In display area 282, an image 282a of shovel 100 in a certain posture and an image 282b of bucket 6 of shovel 100 in another posture are displayed. Note that the image of shovel 100 in a certain posture may be extracted from video data included in condition record data 280.

[0322] Display area 283 displays table 283a and operation buttons 283b and 283c. Table 283a is a table that displays coordinate values ​​indicating the position of a predetermined part of shovel 100 in an image of shovel 100 for each posture. Operation button 283b is an operation button for acquiring coordinate values ​​indicating the position of a predetermined part from an image of shovel 100 for each posture. Operation button 283c is an operation button for inputting the coordinate values ​​displayed in table 283a to shovel 100. To This is an operation button for sending.

[0323] In this embodiment, when an image of the shovel 100 in a certain posture is displayed in the display area 282 and the operation button 283b is operated, the coordinate values ​​of a specific part of the shovel 100 in the image are obtained and displayed in the table 283a.

[0324] A part of the table 283a may be displayed in the display area 282. The table 283a may also include coordinate values ​​indicating the positions of parts of the shovel 100 other than the parts displayed in the display area 282, and information on attitudes other than the attitude displayed in the display area 282. In this case, in this embodiment, by performing an operation such as swiping, pinching in, or pinching out on the display area 282, it is possible to confirm the coordinates of parts other than the parts displayed in the display area 282 of FIG. 28 and the coordinate values ​​of attitudes other than the attitude displayed in the display area 282 of FIG. 28.

[0325] In this embodiment, the predetermined parts of the shovel 100 are the boom foot, the boom top, the arm foot, the arm top, the bucket pin, and the tip of the bucket.

[0326] 28, image 282b is an image showing the position of the bucket 6 when the posture shown in the image of the shovel 100 displayed in display area 282 is "posture 1." In this embodiment, when operation button 283b is operated when the posture shown in the image of the shovel 100 displayed in display area 282 is "posture 1," coordinates showing the positions of the boom foot, boom top, arm foot, arm top, bucket pin, and bucket tip in the image at this time are obtained and displayed in table 284a.

[0327] Image 282a is an image of the shovel 100 when the posture of the shovel 100 is "posture 2". When the operation button 283b is operated in this state, coordinate values ​​indicating the positions of the boom foot, boom top, arm foot, arm top, bucket pin, and bucket tip in image 282a are acquired. Note that the postures of the shovel 100, such as "posture 1" and "posture 2", may be postures determined in advance. In this embodiment, the process of acquiring the coordinate values ​​may be performed by the mobile terminal 200.

[0328] The mobile terminal 200 of this embodiment acquires the coordinate values ​​of each part for each posture, and transmits information indicating the acquired coordinate values ​​for each posture to the shovel 100 when the operation button 283 is operated.

[0329] When the shovel 100 receives information indicating the coordinate values ​​of the predetermined parts for each posture, it calibrates various parameters based on this information. The various parameters are, for example, the length and angle between the predetermined parts in a certain posture. When the shovel 100 completes the calibration, it may transmit to the mobile terminal 200 a notification indicating that the calibration has been completed, and each parameter and its value after the calibration.

[0330] When the mobile terminal 200 acquires the calibrated parameters, the mobile terminal 200 may transmit the calibrated parameters to the management device 300 and store them in the management information database 310 .

[0331] In addition, when the mobile terminal 200 of this embodiment acquires the coordinate values ​​of each part for each posture, it may acquire the detection values ​​of the sensor when an image of each posture is captured from the state quantity information, and transmit a calibration instruction to the shovel 100 based on the coordinate values ​​of each part and the detection values ​​included in the state quantity information.

[0332] In addition, in this embodiment, an image of the shovel 100 in a predetermined posture is acquired from the video data included in the condition recording data 280, but this is not limiting. In this embodiment, for example, an image of the shovel 100 may be captured by the imaging device 208 when the shovel 100 assumes a certain posture.

[0333] Therefore, in this embodiment, for example, a signal indicating that an image is to be captured may be transmitted to the shovel 100. Upon receiving this signal, the shovel 100 may be configured to maintain a certain posture.

[0334] Furthermore, in this embodiment, when the shovel 100 assumes a predetermined posture, a signal notifying the mobile terminal 200 of the same may be transmitted to the mobile terminal 200. In this case, the user of the mobile terminal 200 may image the shovel 100 using the imaging device 208 after the mobile terminal 200 receives this notification.

[0335] In this embodiment, by doing so, it is possible to capture an image of the shovel 100 in a predetermined posture.

[0336] In this manner, in this embodiment, the operation of the shovel 100 is diagnosed and evaluated using status record data 280 that associates images (including moving images and still images) of the shovel 100 captured by the mobile terminal 200 with operation data received from the shovel 100 during the period when the images of the shovel 100 were being captured.

[0337] Therefore, in this embodiment, matters that cannot be determined from a comparison of the detection values ​​and command values ​​of the sensors of the shovel 100 can be determined from the image of the shovel 100, allowing the user of the mobile terminal 200 to understand the status of the shovel 100.

[0338] In this embodiment, the functions of the diagnosis unit 340 and the operation evaluation unit 350 of the management device 300 are provided in the mobile terminal 200. Even In this case, the mobile terminal 200 may transmit information indicating the diagnosis result and information indicating the evaluation result together with the condition record data 280 to the management device 300 via the communication control unit 220.

[0339] Although one embodiment of the present invention has been described in detail above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention described in the claims.

[0340] For example, in each of the above embodiments, the mobile terminal 200 has a function of transmitting video of the shovel 100, but this is not limited thereto, and the mobile terminal 200 does not necessarily have a function of transmitting video of the shovel 100.

[0341] Also, for example, in each of the above embodiments, the mobile terminal 200 has a function of displaying a video of the shovel 100 and the state quantity information of the shovel 100 in synchronization with each other, but this is not limited thereto, and the mobile terminal 200 does not have to have a function of displaying a video of the shovel 100 and the state quantity information of the shovel 100 in synchronization with each other.

[0342] Also, for example, in each of the above embodiments, the mobile terminal 200 is capable of displaying both a video of the shovel 100 and state quantity information of the shovel 100, but this is not limited thereto. The mobile terminal 200 may be capable of transmitting a request signal to the shovel 100, acquiring state quantity information from the shovel 100, and displaying only the state quantity information, without starting the video.

[0343] Also, for example, in each of the above embodiments, the shovel 100 transmits multiple types of state quantity information to the mobile terminal 200 in real time, but this is not limited to the above, and the shovel 100 may transmit multiple types of state quantity information collectively to the mobile terminal 200 at any timing (for example, at the timing when recording of the video of the shovel 100 is completed, at the timing when a predetermined recording time has elapsed, at the timing when a predetermined amount of state quantity information has been acquired, etc.).

[0344] This international application also claims priority based on Japanese Patent Application No. 2019-199300, filed on October 31, 2019, the entire contents of which are incorporated herein by reference. [Explanation of symbols]

[0345] 30 Controller 31 Acquisition Department 32 Reception control section 33 Transmission control section 100 Shovel 200 Mobile terminal (Mobile terminal for excavator) 210 Input reception 220 Communication Control Unit 230 Display control unit 240 Imaging control section 250 Storage Unit 260 Playback Department 270 Storage section 280 Status Record Data 300 Management device 310 Management Information Database 320 Data Acquisition Department 330 Data Storage Unit 340 Diagnostics Department 350 Motion Evaluation Department 360 Data Output Section SYS Excavator Management System

Claims

1. an excavator that acquires state quantity information representing state quantities of the excavator detected by a plurality of sensors; A mobile device; Equipped with The mobile terminal includes: a communication control unit that transmits a request signal to the shovel to request transmission of the state quantity information; a display control unit that displays, on a display device, the state quantity information received from the shovel and a video of the shovel synchronized with a period during which the state quantity information was received.

2. The mobile terminal includes: An imaging device is provided. The shovel management system according to claim 1 , wherein the video of the shovel is captured by the imaging device.

3. The display control unit receiving an instruction to record a video of the shovel and displaying a recording screen on the display device; The recording screen includes the following: The shovel management system according to claim 2 , further comprising: displaying a video of the shovel being recorded and waveforms of some of the information items included in the state quantity information.

4. The recording screen includes the following: The shovel management system according to claim 3 , further comprising: information for identifying the shovel; information indicating a date and time when recording of the video started; and information indicating an operation being performed by the shovel.

5. The display control unit is displaying a list screen of the prescribed operations of the shovel on the display device; The communication control unit Transmitting an operation instruction for a prescribed operation selected from the list screen to the shovel; The video of the shovel is, The shovel management system according to claim 2 , wherein the video is a video captured of the shovel performing a specified operation selected from the list screen.

6. The display control unit is displaying on the display device a selection screen for selecting whether the operation of the shovel is to be an operation by an operator or an unmanned operation; The shovel management system according to any one of claims 2 to 5, wherein when the unmanned operation is selected, a confirmation screen including information prompting the user to check for the presence or absence of obstacles around the shovel is displayed on the display device.

7. The mobile terminal includes: a storage unit that stores state record data in which the state quantity information is associated with a video of the shovel that is recorded while the state quantity information is being received; The excavator management system according to claim 2 , further comprising: a reproduction unit that reproduces the condition record data stored in the storage unit.

8. The display control unit is displaying a playback screen of the status record data on the display device; The reproducing unit is The excavator management system according to claim 7 , wherein an instruction to replay status record data is accepted on the replay screen, and the status record data stored in the storage unit is replayed.

9. The playback screen includes: The excavator management system according to claim 8 , further comprising: displaying a video represented by video data included in the condition record data and a waveform of a portion of an item of status quantity information included in the condition record data.

10. The playback screen includes: The shovel management system according to claim 9, wherein a video captured by a camera carried by the shovel is displayed together with the video and the waveform.

11. A management device that communicates with the mobile terminal, The management device includes: a data acquisition unit that acquires the condition record data from the mobile terminal; A diagnosis unit that diagnoses a condition of the shovel based on the condition record data; an operation evaluation unit that evaluates an operation of the shovel based on the condition record data; The shovel management system according to any one of claims 7 to 10, further comprising: a data output unit that outputs a diagnosis result by the diagnosing unit and an evaluation result by the operation evaluating unit to the mobile terminal.

12. a communication control unit that transmits a request signal to a shovel that acquires state quantity information representing state quantities of the shovel detected by a plurality of sensors, for requesting the shovel to transmit the state quantity information; a display control unit that displays, on a display device, the state quantity information received from the shovel and a video of the shovel synchronized with a period during which the state quantity information was received.

13. The computer of the portable terminal for the excavator, A program used in a portable terminal for an excavator to function as: a communication control unit that transmits a request signal to an excavator, which acquires state quantity information representing the state quantities of the excavator detected by a plurality of sensors, to request the transmission of the state quantity information; and a display control unit that displays, on a display device, the state quantity information received from the excavator and a video of the excavator synchronized with the period during which the state quantity information was received.

Citation Information

Patent Citations

  • Information communication system and communication terminal unit for operator

    JP2007023527A

  • Multifunctional mobile information terminal for shovel

    JP2017108429A

  • Shovel

    JP2017166232A

  • Communication device of work machine, mobile terminal, communication system of work machine, and communication processing method of work machine

    JP2019114861A

  • Shovel support device

    JP2019183646A