Information processing system, information processing device, and program

Abstract

To provide an information processing system improved in convenience of a user for detecting a prescribed operation or a prescribed work of a work machine.SOLUTION: A data collection system SYS related to one embodiment of the present disclosure has: an input information register part 2001 for acquiring information showing a prescribed operation or a prescribed work of a shovel 100; and a data acquiring condition forming part 2004 for forming conditions related to a prescribed specific amount showing the prescribed operation or the prescribed work of the shovel 100, on the basis of the information showing the prescribed operation or the prescribed work of the shovel 100.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device and the like. [Background technology]

[0002] BACKGROUND ART Techniques for detecting a predetermined movement or a predetermined task of a work machine are known (see, for example, Patent Document 1).

[0003] In Patent Document 1, a predetermined operation of the work machine corresponding to use of the work machine for an unintended purpose is detected based on various information acquired by the work machine. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2020 / 095945 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in order to detect a predetermined operation or a predetermined task of a work machine, it is necessary to set conditions in advance for determining whether a predetermined operation or a predetermined task of the work machine is being performed based on various types of information acquired by the work machine, which leaves room for improvement in terms of user convenience.

[0006] In view of the above-mentioned problems, an object of the present invention is to provide a technology that can improve user convenience when detecting a predetermined operation or a predetermined task of a work machine. [Means for solving the problem]

[0007] In order to achieve the above object, in one embodiment of the present disclosure, Work machinery but A specified action or task The condition of the work machine when an acquisition unit that acquires information representing the The work machineThe predetermined operation or the predetermined work The condition of the work machine when The predetermined action or the predetermined work is represented based on the information representing the predetermined action or the predetermined work. It is a condition , As a physical quantity that represents the state of the work machine a first generating unit that generates a condition related to a predetermined feature amount; Using a virtual model of the work machine, The work machine The predetermined operation or the predetermined work The condition of the work machine when a reproduction unit that reproduces the predetermined feature amount corresponding to the information represented by the image; an extraction unit that extracts data that meets the conditions from data that represents the state of the work machine and is acquired by the work machine; Equipped with the first generation unit generates the condition representing a range of the predetermined feature amount based on the predetermined feature amount reproduced by the reproduction unit. An information processing system is provided. In another embodiment of the present disclosure, Work machinery but A specified action or task The condition of the work machine when an acquisition unit that acquires information representing the The work machine The predetermined operation or the predetermined work The condition of the work machine when The predetermined action or the predetermined work is represented based on the information representing the predetermined action or the predetermined work. It is a condition , The words that express the status of the work machine are quantified a first generating unit that generates a condition related to a predetermined feature amount; an extraction unit that extracts data that meets the conditions from data that represents the state of the work machine and is acquired by the work machine; Equipped with The work machine The predetermined operation or the predetermined work The condition of the work machine when The information represented is the work machine but The predetermined operation or the predetermined work The condition of the work machine when Words to express of It is information, The first generation unit is a work machine but The predetermined operation or the predetermined work The condition of the work machine when and generating the condition representing a range of the predetermined feature quantity that has the same meaning as the word, using the predetermined feature quantity that is a numerical representation of the word as a reference. An information processing system is provided.

[0008] In still another embodiment of the present disclosure, Work machinery but A specified action or task The condition of the work machine when an acquisition unit that acquires information representing the The work machine The predetermined operation or the predetermined work The condition of the work machine when The predetermined action or the predetermined work is represented based on the information representing the predetermined action or the predetermined work. It is a condition , As a physical quantity that represents the state of the work machine a first generating unit that generates a condition related to a predetermined feature amount; a reproduction unit that reproduces the predetermined feature amount corresponding to information representing the predetermined motion or the predetermined work using a virtual model of the work machine; an extraction unit that extracts data that conforms to the conditions from data that is acquired by the work machine and that represents the state of the work machine, or a transmission unit that transmits the conditions to the work machine in order to extract data that conforms to the conditions from data that is acquired by the work machine and that represents the state of the work machine; Equipped with the first generation unit generates the condition representing a range of the predetermined feature amount based on the predetermined feature amount reproduced by the reproduction unit. An information processing device is provided. In still another embodiment of the present disclosure, Work machinery but A specified action or task The condition of the work machine when an acquisition unit that acquires information representing the The work machine The predetermined operation or the predetermined work The condition of the work machine when The predetermined action or the predetermined work is represented based on the information representing the predetermined action or the predetermined work. It is a condition , The words that express the status of the work machine are quantified a first generating unit that generates a condition related to a predetermined feature amount; an extraction unit that extracts data that conforms to the conditions from data that is acquired by the work machine and that represents the state of the work machine, or a transmission unit that transmits the conditions to the work machine in order to extract data that conforms to the conditions from data that is acquired by the work machine and that represents the state of the work machine; Equipped with The work machine The predetermined operation or the predetermined work The condition of the work machine when The information represented is the work machine but The predetermined operation or the predetermined work The condition of the work machine when Words to express of It is information, The first generation unit is a work machine but The predetermined operation or the predetermined work The condition of the work machine when and generating the condition representing a range of the predetermined feature quantity that has the same meaning as the word, using the predetermined feature quantity that is a numerical representation of the word as a reference. An information processing device is provided.

[0009] In still another embodiment of the present disclosure, In the information processing device, Work machinery but A specified action or task The condition of the work machine when an acquisition step of acquiring information representing the The work machine The predetermined operation or the predetermined work The condition of the work machine when The predetermined action or the predetermined work is represented based on the information representing the predetermined action or the predetermined work. It is a condition , As a physical quantity that represents the state of the work machine a first generation step of generating a condition related to a predetermined feature; a reproduction step of reproducing the predetermined feature amount corresponding to information representing the predetermined motion or the predetermined work using a virtual model of a work machine; an extraction step of extracting data that matches the condition from data that is acquired by the work machine and that represents the state of the work machine, or a transmission step of transmitting the condition to the work machine in order to extract data that matches the condition from data that is acquired by the work machine and that represents the state of the work machine; Execute In the first generation step, the condition representing a range of the predetermined feature amount is generated based on the predetermined feature amount reproduced in the reproduction step. Programs are offered. In still another embodiment of the present disclosure, In the information processing device, Work machinery but A specified action or task The condition of the work machine when an acquisition step of acquiring information representing the The work machine The predetermined operation or the predetermined work The condition of the work machine when The predetermined action or the predetermined work is represented based on the information representing the predetermined action or the predetermined work. It is a condition , The words that express the status of the work machine are quantified a first generation step of generating a condition related to a predetermined feature; an extraction step of extracting data that matches the condition from data that is acquired by the work machine and that represents the state of the work machine, or a transmission step of transmitting the condition to the work machine in order to extract data that matches the condition from data that is acquired by the work machine and that represents the state of the work machine; Execute The work machine The predetermined operation or the predetermined work The condition of the work machine when The information represented is the work machine but The predetermined operation or the predetermined work The condition of the work machine when Words to express of It is information, In the first generation step, a work machine but The predetermined operation or the predetermined work The condition of the work machine when and generating the condition representing a range of the predetermined feature quantity that has the same meaning as the word, using the predetermined feature quantity that is a numerical representation of the word as a reference. Programs are offered. [Effects of the Invention]

[0010] According to the above-described embodiment, it is possible to improve the convenience for the user when detecting a predetermined operation or a predetermined task of a work machine. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 illustrates an example of a data collection system. [Figure 2] FIG. 1 is a top view showing an example of a shovel. [Figure 3] FIG. 10 is a diagram illustrating another example of a work machine. [Figure 4] FIG. 2 is a block diagram showing an example of a hardware configuration of the shovel. [Figure 5] FIG. 2 is a block diagram showing an example of a hardware configuration of a data collection device. [Figure 6] 1 is a block diagram showing a first example of a functional configuration of a data collection system. [Figure 7] FIG. 10 is a block diagram showing a second example of the functional configuration of the data collection system. [Figure 8] FIG. 10 is a block diagram showing a third example of the functional configuration of the data collection system. [Figure 9] FIG. 10 is a block diagram showing a fourth example of the functional configuration of the data collection system. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, an embodiment will be described with reference to the drawings.

[0013] [Data collection system overview] First, an overview of the data collection system SYS according to this embodiment will be described with reference to FIGS.

[0014] Fig. 1 is a diagram showing an example of a data collection system SYS. In Fig. 1, a left side view of a shovel 100 is shown. Fig. 2 is a top view showing an example of the shovel 100. Fig. 3 is a diagram showing another example of a work machine.

[0015] As shown in FIG. 1, the data collection system SYS includes a shovel 100 and a data collection device 200.

[0016] 1, the data collection system SYS includes a plurality of (in this example, three or more) shovels 100. The data collection system SYS may also include only one, two, or three shovels 100.

[0017] The data collection system SYS uses the data collection device 200 to collect log data acquired by the shovel 100. Specifically, the data collection system SYS collects log data when the shovel 100 is performing a predetermined operation or a predetermined task.

[0018] For example, log data obtained during a predetermined operation or a predetermined task of the shovel 100 is used as training data for machine learning (supervised learning) of a control device related to the automatic driving function of the shovel 100. In this case, the user of the data collection system SYS is, for example, an engineer of a manufacturer that develops shovels with automatic driving functions. Also, the user of the data collection system SYS is, for example, an owner who actually uses multiple shovels 100, an engineer of the owner's company, etc.

[0019] Furthermore, for example, log data during a predetermined operation or a predetermined task of the shovel 100 may be used to monitor the work status of the shovel 100. In this case, monitoring the work status of the shovel 100 includes monitoring the work status of the shovel 100 performing work using an automatic driving function. In this case, the user of the data collection system SYS is, for example, an employee of a company that provides a service for externally monitoring a plurality of shovels 100. The company that provides a service for externally monitoring a plurality of shovels 100 is, for example, a manufacturer that manufactured at least some of the plurality of shovels 100.

[0020] The predetermined operation includes, for example, an excavation operation, a backfilling operation, a rolling operation, etc. The predetermined operation may also include an operation that corresponds to an unintended use of the shovel 100.

[0021] The predetermined work is composed of a series of operations. For example, the predetermined work includes excavation work, which is composed of a series of operations including an excavation operation, a boom raising and swinging operation, an earth removal operation, and a boom lowering and swinging operation. The predetermined work also includes backfilling work, which is composed of a series of operations including an earth removal operation, a boom raising and swinging operation, a backfilling operation, and a boom raising and swinging operation.

[0022] The log data may include log data relating to the state of the shovel 100, log data relating to the surrounding environment of the shovel 100, log data relating to the state of the operator of the shovel 100, and the like.

[0023] The log data relating to the state of the shovel 100 includes, for example, log data representing the operating state of the hydraulic actuator HA of the shovel 100 or the driven elements driven by the hydraulic actuator HA. The log data relating to the state of the shovel 100 includes, for example, sensing data acquired by various sensors SX mounted on the shovel 100. The data relating to the state of the shovel 100 may also include control data such as various command values ​​generated by the controller 30 that controls the shovel 100.

[0024] The log data relating to the environment surrounding the shovel 100 includes, for example, data showing the weather conditions around the shovel 100 and data showing the conditions of the work site around the shovel 100. The log data relating to the environment surrounding the shovel 100 includes, for example, sensing data acquired by the sensor SX, such as the outside air temperature around the shovel 100, the illuminance around the shovel 100, and the raindrop detection status on the shovel 100. The log data relating to the environment surrounding the shovel 100 also includes, for example, image data acquired by the sensor SX (imaging device 40) showing the state of the area around the shovel 100.

[0025] The log data relating to the state of the operator of the shovel 100 includes, for example, sensor data from the sensor SX that senses biological information.

[0026] The excavator 100 is a work machine from which log data is collected in the data collection system SYS.

[0027] The data collection system SYS may include other work machines instead of or in addition to the excavator 100. In this case, the predetermined operations and predetermined tasks may vary depending on the type of work machine. For example, as shown in FIG. 3, the data collection system SYS may include a crawler crane 300 (an example of a work machine or predetermined equipment).

[0028] As shown in FIGS. 1 and 2, the excavator 100 includes a lower traveling body 1, an upper rotating body 3, an attachment AT including a boom 4, an arm 5, and a bucket 6, and a cabin 10.

[0029] The lower traveling body 1 includes, for example, a left crawler 1CL and a right crawler 1CR, and the crawlers 1CL and 1CR are hydraulically driven by corresponding traveling hydraulic motors 1M, thereby self-propelling.

[0030] The upper rotating body 3 is rotatably mounted on the lower traveling body 1 via a rotating mechanism 2. For example, the upper rotating body 3 rotates relative to the lower traveling body 1 when the rotating mechanism 2 is hydraulically driven by a rotating hydraulic motor 2M.

[0031] Boom 4 is attached to the front center of upper rotating body 3 so as to be able to tilt up and down about a rotation axis in the left-right direction. Arm 5 is attached to the tip of boom 4 so as to be able to rotate about a rotation axis in the left-right direction. Bucket 6 is attached to the tip of arm 5 so as to be able to rotate about a rotation axis in the left-right direction.

[0032] The bucket 6 is an example of an end attachment, and is attached to the tip of the arm 5 in a manner that allows it to be appropriately replaced depending on the type of work being performed by the excavator 100. In other words, instead of the bucket 6, a bucket of a different type from the bucket 6, such as a relatively large bucket, a slope bucket, or a dredging bucket, may be attached to the tip of the arm 5. Also, a type of end attachment other than a bucket, such as a mixer, breaker, or crusher, may be attached to the tip of the arm 5. Also, a spare attachment such as a quick coupling or a tiltrotator may be provided between the arm 5 and the end attachment.

[0033] The boom 4, arm 5, and bucket 6 are hydraulically driven by a boom cylinder 7, an arm cylinder 8, and a bucket cylinder 9, respectively.

[0034] The cabin 10 is a control room where an operator sits and operates the excavator 100, and is mounted, for example, on the front left side of the upper rotating body 3.

[0035] The excavator 100 operates driven elements such as the lower traveling body 1 (i.e., the pair of left and right crawlers 1C), upper rotating body 3, boom 4, arm 5, and bucket 6 in response to operations by an operator inside the cabin 10.

[0036] Furthermore, instead of or in addition to being configured to be operable by an operator inside the cabin 10, the shovel 100 may be configured to be remotely operable from outside the shovel 100. When the shovel 100 is remotely operated, the inside of the cabin 10 may be unmanned. The following description will be given on the assumption that the operation of the operator includes at least one of operation of the operating device 26 by the operator inside the cabin 10 and remote operation by an external operator.

[0037] Remote operation includes, for example, a mode in which the shovel 100 is operated by operation input related to the actuator of the shovel 100 performed by a remote operation support device.

[0038] The remote operation support device is provided, for example, in a management center that externally manages the work of the shovel 100. The remote operation support device may also be a portable operation terminal, in which case the operator can remotely operate the shovel 100 while directly checking the work status of the shovel 100 from the vicinity of the shovel 100.

[0039] The functions of the remote operation support device are realized by any hardware or any combination of hardware and software. For example, the remote operation support device is mainly configured with a computer including a central processing unit (CPU), a memory device, an auxiliary storage device, an interface device, an input device, and a display device. The memory device is, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The auxiliary storage device is, for example, a hard disk drive (HDD), a solid state disk (SSD), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The interface device includes an external interface for connecting to an external recording medium and a communication interface for communicating with the outside, such as the shovel 100. The input device includes, for example, a lever-type operation input device. The display device is, for example, a liquid crystal display or an organic electroluminescence (EL) display. The operator uses the input device to input operations related to the actuators of the shovel 100, and the remote operation support device transmits signals corresponding to the operation input to the shovel 100 using the communication interface. This allows the operator to remotely control the excavator 100 using the remote operation support device.

[0040] Specifically, the shovel 100 may transmit, for example, via a communication device 60 described below, an image (hereinafter referred to as a "peripheral image") showing the surroundings including the area in front of the shovel 100, based on an image captured by an imaging device 40 described below. The remote operation support device may then display the image (peripheral image) received from the shovel 100 on a display device. Various information images (information screens) displayed on an output device 50 (display device) inside the cabin 10 of the shovel 100 may also be displayed on the display device of the remote operation support device. This allows an operator using the remote operation support device to remotely operate the shovel 100 while checking, for example, the display contents of images and information screens showing the surroundings of the shovel 100 displayed on the display device. The shovel 100 may then operate actuators to drive driven elements such as the lower traveling body 1, the upper rotating body 3, the boom 4, the arm 5, and the bucket 6 in accordance with a remote operation signal representing the content of the remote operation, received from the remote operation support device via the communication device 60.

[0041] Remote control may also include, for example, a mode in which the shovel 100 is operated by an external voice input or gesture input to the shovel 100 by a person (e.g., a worker) around the shovel 100. Specifically, the shovel 100 recognizes voices uttered by surrounding workers or gestures made by the workers through a voice input device (e.g., a microphone) or a gesture input device (e.g., an imaging device) mounted on the shovel 100. Then, the shovel 100 may operate actuators in accordance with the content of the recognized voices or gestures to drive driven elements such as the lower traveling body 1 (left and right crawlers 1C), upper rotating body 3, boom 4, arm 5, and bucket 6.

[0042] The excavator 100 may also automatically operate the actuators regardless of the operation by the operator. This allows the excavator 100 to realize a function ("automatic operation function" or "MC (Machine Control) function") that automatically operates at least some of the driven elements such as the lower traveling structure 1, the upper rotating structure 3, the boom 4, the arm 5, and the bucket 6.

[0043] The automatic driving function includes, for example, a function ("semi-automatic driving function" or "operation-assisted MC function") that automatically operates driven elements (actuators) other than the driven element (actuator) that is the target of operation, in response to an operator's operation of the operating device 26 or remote operation. The automatic driving function may also include a function ("fully automatic driving function" or "fully automatic MC function") that automatically operates at least some of the multiple driven elements (actuators) on the assumption that there is no operation of the operating device 26 or remote operation by the operator. When the fully automatic driving function is enabled in the shovel 100, the inside of the cabin 10 may be unmanned. The semi-automatic driving function, the fully automatic driving function, etc. may also include a mode in which the operation content of the driven element (actuator) that is the target of automatic driving is automatically determined according to predetermined rules. The semi-automatic driving function, the fully automatic driving function, etc. may also include a mode ("autonomous driving function") in which the shovel 100 autonomously makes various decisions and autonomously determines the operation content of the driven element (actuator) that is the target of automatic driving based on the decision results.

[0044] Furthermore, if the shovel 100 has an automatic operation function, the work of the shovel 100 may be remotely monitored. In this case, a remote monitoring support device having the same function as the remote operation support device may be provided. This allows a monitor who is a user of the remote monitoring support device to monitor the status of work performed by the automatic operation function of the shovel 100 while checking a peripheral image displayed on a display device of the remote monitoring support device. Furthermore, for example, if the monitor determines it is necessary from a safety perspective, the monitor can intervene in the automatic operation function of the shovel 100 and bring it to an emergency stop by making a predetermined input using an input device of the remote monitoring support device.

[0045] The data collection device 200 collects (acquires) log data when the excavator 100 is performing a predetermined operation or performing a predetermined task.

[0046] The data collection device 200 collects log data of the shovel 100 during a specified operation or specified work, for example, by having the shovel 100 acquire and upload log data during a specified operation or specified work (see Figures 6 to 8).

[0047] Furthermore, the data collection device 200 may extract log data of the shovel 100 during a predetermined operation or a predetermined task from the log data of the shovel 100 uploaded from the shovel 100 (see FIG. 9).

[0048] [Data acquisition system hardware configuration] Next, the hardware configuration of the data collection system will be described with reference to FIGS. 4 and 5 in addition to FIGS.

[0049] <Excavator hardware configuration> FIG. 4 is a block diagram showing an example of the hardware configuration of the shovel 100.

[0050] In Figure 4, the paths through which mechanical power is transmitted are indicated by double lines, the paths through which high-pressure hydraulic oil that drives the hydraulic actuator flows are indicated by solid lines, the paths through which pilot pressure is transmitted are indicated by dashed lines, and the paths through which electrical signals are transmitted are indicated by dotted lines.

[0051] The shovel 100 includes various components, such as a hydraulic drive system for hydraulically driving the driven elements, an operation system for operating the driven elements, a user interface system for exchanging information with the user, a communication system for communicating with the outside world, and a control system for various controls.

[0052] <Hydraulic drive system> 4, the hydraulic drive system of the excavator 100 includes the hydraulic actuator HA that hydraulically drives each of the driven elements such as the lower traveling body 1 (left and right crawlers 1C), the upper rotating body 3, and the attachment AT, as described above. The hydraulic drive system of the excavator 100 according to this embodiment also includes an engine 11, a regulator 13, a main pump 14, and a control valve 17.

[0053] The hydraulic actuator HA includes traveling hydraulic motors 1ML, 1MR, a swing hydraulic motor 2M, a boom cylinder 7, an arm cylinder 8, a bucket cylinder 9, and the like.

[0054] Note that the hydraulic actuators HA of the shovel 100 may be partially or entirely replaced with electric actuators. In other words, the shovel 100 may be a hybrid shovel or an electric shovel.

[0055] The engine 11 is the prime mover of the excavator 100 and the main power source in the hydraulic drive system. The engine 11 is, for example, a diesel engine that uses light oil as fuel. The engine 11 is mounted, for example, on the rear of the upper rotating body 3. The engine 11 rotates at a constant speed at a preset target speed under direct or indirect control by a controller 30 (described later), and drives the main pump 14 and the pilot pump 15.

[0056] It should be noted that instead of or in addition to the engine 11, the excavator 100 may be equipped with another prime mover (for example, an electric motor).

[0057] The regulator 13 controls (adjusts) the discharge amount of the main pump 14 under the control of the controller 30. For example, the regulator 13 adjusts the angle of the swash plate of the main pump 14 (hereinafter referred to as the "tilting angle") in response to a control command from the controller 30.

[0058] The main pump 14 supplies hydraulic oil to the control valve 17 through a high-pressure hydraulic line. The main pump 14 is mounted, for example, on the rear of the upper rotating body 3, similar to the engine 11. As described above, the main pump 14 is driven by the engine 11. The main pump 14 is, for example, a variable displacement hydraulic pump, and as described above, under the control of the controller 30, the tilt angle of the swash plate is adjusted by the regulator 13, thereby adjusting the stroke length of the piston and controlling the discharge flow rate and discharge pressure.

[0059] The control valve 17 is a hydraulic control device that controls the hydraulic actuators HA in response to an operator's operation of the operating device 26, the details of remote operation, or operation commands related to the automatic operation function output from the controller 30. The operation commands corresponding to the automatic operation function may be generated by the controller 30 or by another control device (computing device) that performs control related to the automatic operation function. The control valve 17 is mounted, for example, in the center of the upper rotating body 3. As described above, the control valve 17 is connected to the main pump 14 via a high-pressure hydraulic line, and selectively supplies hydraulic oil supplied from the main pump 14 to each hydraulic actuator in response to an operator's operation or an operation command corresponding to the automatic operation function. Specifically, the control valve 17 includes a plurality of control valves (also referred to as "directional control valves") that control the flow rate and flow direction of hydraulic oil supplied from the main pump 14 to each hydraulic actuator HA.

[0060] ≪Operation system≫ As shown in FIG. 4, the operating system of the excavator 100 includes a pilot pump 15, an operating device 26, a hydraulic control valve 31, a shuttle valve 32, and a hydraulic control valve 33.

[0061] The pilot pump 15 supplies pilot pressure to various hydraulic devices via a pilot line 25. The pilot pump 15 is mounted, for example, on the rear of the upper rotating body 3, similar to the engine 11. The pilot pump 15 is, for example, a fixed displacement hydraulic pump, and is driven by the engine 11 as described above.

[0062] The pilot pump 15 may be omitted. In this case, the relatively high-pressure hydraulic oil discharged from the main pump 14 may be reduced in pressure by a predetermined pressure reducing valve, and the resulting relatively low-pressure hydraulic oil may be supplied to various hydraulic devices as pilot pressure.

[0063] The operating device 26 is provided near the cockpit of the cabin 10 and is used by the operator to operate the various driven elements. Specifically, the operating device 26 is used by the operator to operate the hydraulic actuators HA that drive the respective driven elements, thereby enabling the operator to operate the driven elements that are the targets of the hydraulic actuators HA. The operating device 26 includes pedal devices and lever devices for operating the respective driven elements (hydraulic actuators HA).

[0064] For example, as shown in Fig. 4, the operating device 26 is of a hydraulic pilot type. Specifically, the operating device 26 uses hydraulic oil supplied from the pilot pump 15 through a pilot line 25 and a pilot line 25A branching from the pilot line 25, and outputs a pilot pressure corresponding to the operation to a secondary pilot line 27A. The pilot line 27A is connected to one inlet port of a shuttle valve 32, and is connected to the control valve 17 via a pilot line 27 connected to an outlet port of the shuttle valve 32. This allows pilot pressure corresponding to the operation of various driven elements (hydraulic actuators HA) in the operating device 26 to be input to the control valve 17 via the shuttle valve 32. Therefore, the control valve 17 can drive each hydraulic actuator HA according to the operation of the operating device 26 by an operator or the like.

[0065] The operating device 26 may be electric. In this case, the pilot line 27A, the shuttle valve 32, and the hydraulic control valve 33 are omitted. Specifically, the operating device 26 outputs an electric signal (hereinafter, "operation signal") corresponding to the operation content, and the operation signal is input to the controller 30. The controller 30 then outputs a control command corresponding to the operation signal, i.e., a control signal corresponding to the operation content of the operating device 26, to the hydraulic control valve 31. As a result, a pilot pressure corresponding to the operation content of the operating device 26 is input from the hydraulic control valve 31 to the control valve 17, and the control valve 17 can drive each hydraulic actuator HA according to the operation content of the operating device 26. Furthermore, the control valves (directional control valves) built into the control valve 17 and driving each hydraulic actuator HA may be electromagnetic solenoid-type. In this case, the operation signal output from the operating device 26 may be directly input to the control valve 17, i.e., the electromagnetic solenoid-type control valve. Furthermore, as described above, some or all of the hydraulic actuators HA may be replaced with electric actuators. In this case, the controller 30 may output a control command to the electric actuator or a driver that drives the electric actuator, etc., according to the operation content of the operating device 26, the remote operation content specified by the remote operation signal, the content of the operation command corresponding to the automatic driving function, etc. Furthermore, when the shovel 100 is remotely operated or operates using the automatic driving function, the operating device 26 may be omitted.

[0066] A hydraulic control valve 31 is provided for each driven element (hydraulic actuator HA) operated by the operating device 26 and for each drive direction of the driven element (hydraulic actuator HA) (e.g., the raising and lowering directions of the boom 4). In other words, two hydraulic control valves 31 are provided for each double-acting hydraulic actuator HA. The hydraulic control valve 31 may be provided, for example, in a pilot line 25B between the pilot pump 15 and the control valve 17 and configured to change its flow path area (i.e., the cross-sectional area through which hydraulic oil can flow). This allows the hydraulic control valve 31 to output a predetermined pilot pressure to a secondary pilot line 27B using hydraulic oil from the pilot pump 15 supplied through the pilot line 25B. Therefore, as shown in FIG. 4 , the hydraulic control valve 31 can indirectly apply a predetermined pilot pressure to the control valve 17 in response to a control signal from the controller 30 via a shuttle valve 32 between the pilot line 27B and the pilot line 27B. Therefore, the controller 30 can supply pilot pressure according to the operation of the operating device 26 from the hydraulic control valve 31 to the control valve 17, thereby realizing the operation of the excavator 100 based on the operation of the operator.

[0067] Furthermore, the controller 30 may, for example, control the hydraulic control valve 31 to realize an automatic driving function. Specifically, the controller 30 outputs a control signal corresponding to an operation command related to the automatic driving function to the hydraulic control valve 31, regardless of whether the operating device 26 is operated or not. As a result, the controller 30 causes the hydraulic control valve 31 to supply a pilot pressure corresponding to the operation command related to the automatic driving function to the control valve 17, thereby realizing the operation of the excavator 100 based on the automatic driving function.

[0068] Furthermore, the controller 30 may, for example, control the hydraulic control valve 31 to realize remote operation of the shovel 100. Specifically, the controller 30 outputs a control signal corresponding to the content of remote operation specified in a remote operation signal received from the remote operation support device to the hydraulic control valve 31 via the communication device 60. As a result, the controller 30 causes the hydraulic control valve 31 to supply a pilot pressure corresponding to the content of remote operation to the control valve 17, thereby realizing operation of the shovel 100 based on remote operation by the operator.

[0069] The shuttle valve 32 has two inlet ports and one outlet port, and outputs hydraulic oil having a higher pilot pressure of the two pilot pressures input to the two inlet ports to the outlet port. A shuttle valve 32 is provided for each driven element (hydraulic actuator HA) to be operated by the operating device 26 and for each drive direction of the driven element (hydraulic actuator HA). One of the two inlet ports of the shuttle valve 32 is connected to a pilot line 27A on the secondary side of the operating device 26 (specifically, the lever device or pedal device included in the operating device 26), and the other is connected to a pilot line 27B on the secondary side of the hydraulic control valve 31. The outlet port of the shuttle valve 32 is connected to the pilot port of a corresponding control valve of the control valve 17 via the pilot line 27. The corresponding control valve is a control valve that drives the hydraulic actuator that is to be operated by the lever device or pedal device connected to one inlet port of the shuttle valve 32. Therefore, each of these shuttle valves 32 can apply the higher of the pilot pressure in pilot line 27A on the secondary side of the operating device 26 and the pilot pressure in pilot line 27B on the secondary side of the hydraulic control valve 31 to the pilot port of the corresponding control valve. In other words, by outputting a pilot pressure higher than the pilot pressure on the secondary side of the operating device 26 from the hydraulic control valve 31, the controller 30 can control the corresponding control valve regardless of the operation of the operating device 26 by the operator. Therefore, the controller 30 can control the operation of the driven elements (undercarriage 1, upper revolving body 3, and attachment AT) regardless of the operating state of the operating device 26 by the operator, thereby achieving an automatic driving function.

[0070] The hydraulic control valve 33 is provided in a pilot line 27A connecting the operating device 26 and the shuttle valve 32. The hydraulic control valve 33 is configured, for example, to be able to change its flow path area. The hydraulic control valve 33 operates in response to a control signal input from the controller 30. As a result, the controller 30 can forcibly reduce the pilot pressure output from the operating device 26 when the operating device 26 is operated by an operator. Therefore, even when the operating device 26 is being operated, the controller 30 can forcibly suppress or stop the operation of the hydraulic actuator corresponding to the operation of the operating device 26. Furthermore, for example, even when the operating device 26 is being operated, the controller 30 can reduce the pilot pressure output from the operating device 26 to make it lower than the pilot pressure output from the hydraulic control valve 31. Therefore, by controlling the hydraulic control valves 31 and 33, the controller 30 can reliably apply a desired pilot pressure to the pilot port of the control valve in the control valve 17, for example, regardless of the operation of the operating device 26. Therefore, the controller 30 can more appropriately realize the automatic operation function and remote control function of the excavator 100 by controlling the hydraulic control valve 33 in addition to the hydraulic control valve 31, for example.

[0071] <User Interface> As shown in FIG. 4, the user interface system of the excavator 100 includes an operation device 26, an output device 50, and an input device 52.

[0072] The output device 50 outputs various information to a user of the shovel 100 (for example, an operator of the cabin 10 or an external remote control operator) or to people in the vicinity of the shovel 100 (for example, a worker or a driver of a work vehicle).

[0073] For example, the output device 50 includes lighting equipment, display devices, etc. that output various types of information visually. Examples of lighting equipment include warning lights, etc. Examples of sound output devices include liquid crystal displays, organic EL displays, etc. For example, as shown in FIG. 2, the lighting equipment and sound output devices may be provided inside the cabin 10 and output various types of information visually to an operator, etc. inside the cabin 10. Furthermore, the lighting equipment and sound output devices may be provided, for example, on the side of the upper rotating body 3, etc. and output various types of information visually to workers, etc. around the excavator 100.

[0074] Furthermore, for example, the output device 50 includes a sound output device (see FIG. 8) that outputs various types of information auditorily. Examples of sound output devices include a buzzer, a speaker, etc. The sound output device may be provided, for example, inside or outside the cabin 10, and may output various types of information auditorily to an operator inside the cabin 10 or to people (workers, etc.) around the excavator 100.

[0075] Furthermore, for example, the output device 50 may include a device that outputs various types of information in a tactile manner, such as by vibrating the cockpit.

[0076] The input device 52 receives various inputs from the user of the excavator 100, and signals corresponding to the received inputs are taken into the controller 30. The input device 52 is provided, for example, inside the cabin 10, and receives inputs from an operator or the like inside the cabin 10. The input device 52 may also be provided, for example, on the side of the upper rotating body 3, and receive inputs from workers or the like around the excavator 100.

[0077] For example, the input device 52 includes an operation input device that accepts operation inputs. The operation input device may include a touch panel mounted on the display device, a touch pad installed around the display device, a button switch, a lever, a toggle, a knob switch provided on the operation device 26 (lever device), and the like.

[0078] Furthermore, for example, the input device 52 may include an audio input device that accepts audio input from the user. The audio input device includes, for example, a microphone.

[0079] Furthermore, for example, the input device 52 may include a gesture input device that accepts gesture inputs from the user. The gesture input device includes, for example, an imaging device that captures an image of a gesture made by the user.

[0080] Furthermore, for example, the input device 52 may include a biometric input device that accepts biometric input from the user. The biometric input includes input of biometric information such as the user's fingerprint or iris.

[0081] <Communications> As shown in FIG. 4, the communication system of the shovel 100 according to this embodiment includes a communication device 60.

[0082] The communication device 60 connects to an external communication line and communicates with a device provided separately from the shovel 100. The device provided separately from the shovel 100 may include a device external to the shovel 100, as well as a portable terminal device (mobile terminal) brought into the cabin 10 by the user of the shovel 100. The communication device 60 may be, for example, a 4G (4 th Generation) and 5G (5 th The communication device 60 may include a mobile communication module conforming to standards such as the IEEE 802.11 Generation. The communication device 60 may also include, for example, a satellite communication module. The communication device 60 may also include, for example, a WiFi communication module or a Bluetooth (registered trademark) communication module. The communication device 60 may also include multiple communication devices in accordance with the communication lines to be connected.

[0083] For example, the communication device 60 communicates with an external device through a local communication line established at the work site. The local communication line is, for example, a local 5G (so-called local 5G) mobile communication line established at the work site or a local network (LAN: Local Area Network) based on WiFi6.

[0084] Furthermore, for example, the communication device 60 communicates with a remote operation support device located outside the work site through a wide area communication line that includes the work site, i.e., a wide area network (WAN). The wide area network includes, for example, a wide area mobile communication network, a satellite communication network, the Internet, etc.

[0085] <Control System> 4, the control system of the shovel 100 includes a controller 30. The control system of the shovel 100 according to this embodiment also includes an operating pressure sensor 29, an imaging device 40, and a sensor SX.

[0086] The controller 30 performs various controls related to the shovel 100 .

[0087] The functions of the controller 30 may be realized by any hardware or any combination of hardware and software, etc. For example, as shown in Fig. 4, the controller 30 includes an auxiliary storage device 30A, a memory device 30B, a CPU 30C, and an interface device 30D, which are connected by a bus B1.

[0088] The auxiliary storage device 30A is a non-volatile storage means, and stores the programs to be installed as well as necessary files, data, etc. The auxiliary storage device 30A is, for example, an EEPROM or flash memory.

[0089] For example, when an instruction to start a program is given, the memory device 30B loads the program from the auxiliary storage device 30A so that it can be read by the CPU 30C. The memory device 30B is, for example, an SRAM.

[0090] The CPU 30C executes, for example, a program loaded into the memory device 30B, and realizes various functions of the controller 30 according to instructions from the program.

[0091] The interface device 30D functions as, for example, a communication interface for connecting to a communication line inside the shovel 100. The interface device 30D may include a plurality of different types of communication interfaces in accordance with the types of communication lines to be connected.

[0092] The interface device 30D also functions as an external interface for reading data from a recording medium and writing data to a recording medium. The recording medium is, for example, a dedicated tool connected to a connector installed inside the cabin 10 via a detachable cable. The recording medium may also be a general-purpose recording medium, such as an SD memory card or a USB (Universal Serial Bus) memory. As a result, a program that realizes various functions of the controller 30 may be provided by, for example, a portable recording medium and installed in the auxiliary storage device 30A of the controller 30. The program may also be downloaded from another computer external to the excavator 100 via the communication device 60 and installed in the auxiliary storage device 30A.

[0093] Note that some of the functions of the controller 30 may be realized by another controller (control device). That is, the functions of the controller 30 may be realized in a distributed manner by a plurality of controllers.

[0094] The operating pressure sensor 29 detects the pilot pressure on the secondary side (pilot line 27A) of the hydraulic pilot type operating device 26, i.e., the pilot pressure corresponding to the operating state of each driven element (hydraulic actuator) in the operating device 26. A detection signal of the pilot pressure by the operating pressure sensor 29 corresponding to the operating state of each driven element (hydraulic actuator HA) in the operating device 26 is taken into the controller 30.

[0095] If the operating device 26 is an electrical type, the operating pressure sensor 29 is omitted because the controller 30 can grasp the operating state of each driven element through the operating device 26 based on the operating signal received from the operating device 26.

[0096] The imaging device 40 (an example of a periphery monitoring sensor) acquires an image of the periphery of the shovel 100. Furthermore, the imaging device 40 may acquire (generate) three-dimensional data (hereinafter simply referred to as "three-dimensional data of objects") representing the positions and outer shapes of objects around the shovel 100 within the imaging range (angle of view) based on the acquired image and data related to distance, which will be described later. The three-dimensional data of objects around the shovel 100 is, for example, data of coordinate information of a point cloud representing the surface of the object, range image data, etc.

[0097] 2, the imaging device 40 includes a camera 40F that images the area in front of the upper rotating body 3, a camera 40B that images the area behind the upper rotating body 3, a camera 40L that images the area to the left of the upper rotating body 3, and a camera 40R that images the area to the right of the upper rotating body 3. As a result, the imaging device 40 can capture images of the entire circumference of the shovel 100, i.e., a range covering an angular direction of 360 degrees, when viewed from above the shovel 100. Furthermore, the operator can visually recognize images captured by the cameras 40B, 40L, and 40R and peripheral images such as processing images generated based on the captured images through the output device 50 (display device) and the remote control display device, and can check the conditions to the left, right, and rear of the upper rotating body 3. Furthermore, by visually recognizing images captured by the camera 40F and peripheral images such as processing images generated based on the captured images through the remote control display device, the operator can remotely operate the shovel 100 while checking the operation of the attachment AT including the bucket 6. Hereinafter, the cameras 40F, 40B, 40L, and 40R may be collectively or individually referred to as "camera 40X."

[0098] Camera 40X is, for example, a monocular camera. Camera 40X may also be, for example, a stereo camera, a TOF (Time Of Flight) camera, or the like (hereinafter collectively referred to as a "3D camera") that can acquire data related to distance (depth) in addition to two-dimensional images.

[0099] The output data of the imaging device 40 (camera 40X) (for example, image data or three-dimensional data of objects around the shovel 100) is taken into the controller 30 via a one-to-one communication line or an in-vehicle network. This allows the controller 30 to monitor objects around the shovel 100 based on the output data of the camera 40X. Also, for example, the controller 30 can determine the surrounding environment of the shovel 100 based on the output data of the camera 40X. Also, for example, the controller 30 can determine the attitude state of the attachment AT shown in the captured image based on the output data of the camera 40X (camera 40F). Also, for example, the controller 30 can determine the attitude state of the body (upper rotating body 3) of the shovel 100 based on the output data of the camera 40X, using objects around the shovel 100 as a reference.

[0100] Note that some of the cameras 40F, 40B, 40L, and 40R may be omitted. For example, if the shovel 100 is not remotely operated, the cameras 40F and 40L may be omitted. This is because it is relatively easy for the operator in the cabin 10 to confirm the conditions in front of and to the left of the shovel 100. Also, instead of or in addition to the imaging device 40 (camera 40X), a distance sensor may be provided on the upper rotating body 3. The distance sensor is attached, for example, to the top of the upper rotating body 3, and acquires data regarding the distance and direction of surrounding objects relative to the shovel 100. Furthermore, the distance sensor may acquire (generate) three-dimensional data (for example, point cloud coordinate information data) of objects around the shovel 100 within its sensing range based on the acquired data. The distance sensor is, for example, a LIDAR (Light Detection and Ranging). Also, for example, the distance sensor may be, for example, a millimeter-wave radar, an ultrasonic sensor, an infrared sensor, or the like.

[0101] As described above, the sensor SX includes various sensors that acquire sensing data relating to the state of the shovel 100, the surrounding environment of the shovel 100, or the state of the operator of the shovel 100 (cabin 10).

[0102] The sensor SX includes, for example, a machine body attitude sensor that acquires sensing data related to the attitude state of the upper rotating body 3. The sensor SX also includes, for example, a boom attitude sensor that acquires sensing data related to the attitude state of the boom 4. The sensor SX also includes, for example, an arm attitude sensor that acquires sensing data related to the attitude state of the arm 5. The sensor SX also includes, for example, a bucket attitude sensor that acquires sensing data related to the attitude state of the bucket 6. The machine body attitude sensor is, for example, an acceleration sensor, an angular velocity sensor, a 6-axis sensor including an acceleration sensor and an angular velocity sensor, or an IMU (Inertial Measurement Unit). The same may be true for the boom attitude sensor, arm attitude sensor, and bucket attitude sensor. The boom attitude sensor may be, for example, a cylinder sensor that acquires sensing data related to the extension / retraction position of the boom cylinder 7 that drives the boom 4. Similarly, the arm attitude sensor may be, for example, a cylinder sensor that acquires sensing data related to the extension / retraction position of the arm cylinder that drives the arm 5. Similarly, the bucket attitude sensor may be, for example, a cylinder sensor that acquires sensing data related to the extension / retraction position of the bucket cylinder 9 that drives the bucket 6. The sensor SX also includes a position sensor that acquires data related to the position of the shovel 100. The position sensor is, for example, a Global Navigation Satellite System (GNSS) sensor that can acquire data related to the absolute position. The position sensor may also be, for example, a transponder that communicates with a predetermined device at the work site and can acquire data related to the local position at the work site.

[0103] The sensor SX includes, for example, an operating pressure sensor 29 and an imaging device 40.

[0104] The sensor SX also includes various sensors capable of acquiring sensing data relating to, for example, the outside air temperature of the shovel 100, the illuminance around the shovel 100, the raindrop detection status of the shovel 100, and the like.

[0105] The sensor SX also includes various sensors capable of acquiring sensing data relating to biological information of the operator of the shovel 100, for example.

[0106] <Hardware configuration of data collection device> FIG. 5 is a block diagram showing an example of the hardware configuration of the data collection device 200 according to this embodiment.

[0107] The functions of the data collection device 200 are realized by any hardware or any combination of hardware and software, etc. For example, as shown in Fig. 5, the data collection device 200 includes an external interface 201, an auxiliary storage device 202, a memory device 203, a CPU 204, a high-speed calculation device 205, a communication interface 206, an input device 207, and a display device 208, which are connected by a bus B2.

[0108] The external interface 201 functions as an interface for reading data from the recording medium 201A and writing data to the recording medium 201A. Examples of the recording medium 201A include a flexible disk, a CD (Compact Disc), a DVD (Digital Versatile Disc), a BD (Blu-ray (registered trademark) Disc), an SD memory card, a USB memory, etc. This allows the data collection device 200 to read various data used in processing through the recording medium 201A, store the data in the auxiliary storage device 202, and install programs that realize various functions.

[0109] The data collection device 200 may acquire various data and programs used in processing from an external device via the communication interface 206.

[0110] The auxiliary storage device 202 stores various installed programs, as well as files and data required for various processes. The auxiliary storage device 202 includes, for example, an HDD, an SSD, or a flash memory.

[0111] When an instruction to start a program is received, the memory device 203 reads and stores the program from the auxiliary storage device 202. The memory device 203 includes, for example, a DRAM or an SRAM.

[0112] The CPU 204 executes various programs loaded from the auxiliary storage device 202 to the memory device 203, and realizes various functions related to the data collection device 200 in accordance with the programs.

[0113] The high-speed arithmetic unit 205 performs arithmetic processing at a relatively high speed in cooperation with the CPU 204. The high-speed arithmetic unit 205 includes, for example, a graphics processing unit (GPU), an application specific integrated circuit (ASIC), or a field-programmable gate array (FPGA).

[0114] The high speed calculation device 205 may be omitted depending on the required calculation processing speed.

[0115] The communication interface 206 is used as an interface for communicatively connecting with an external device. This allows the data collection device 200 to communicate with an external device such as the excavator 100 through the communication interface 206. The communication interface 206 may have multiple types of communication interfaces depending on the communication method between the connected device and the like.

[0116] The input device 207 receives various inputs from a user. For example, the input device 207 includes an input device (remote control device) for an operator to perform remote control.

[0117] The input device 207 includes, for example, an operation input device that accepts mechanical operation input from a user. The operation input device includes, for example, a button, a toggle, a lever, etc. The operation input device also includes, for example, a touch panel mounted on the display device 208, a touch pad provided separately from the display device 208, etc.

[0118] The input device 207 also includes, for example, a voice input device capable of receiving voice input from the user. The voice input device includes, for example, a microphone capable of collecting the user's voice.

[0119] The input device 207 includes, for example, a gesture input device capable of receiving a gesture input from a user. The gesture input device includes, for example, a camera capable of capturing an image of a user's gesture.

[0120] The input device 207 includes, for example, a biometric input device capable of accepting biometric input from a user. The biometric input device includes, for example, a camera capable of acquiring image data containing information about a user's fingerprint or iris.

[0121] The display device 208 displays an information screen or an operation screen for the user. For example, the display device 208 includes the above-mentioned remote control display device. The display device 208 is, for example, a liquid crystal display or an organic EL (Electroluminescence) display.

[0122] [Data collection system functional configuration] Next, the functional configuration of the data collection system SYS will be described with reference to FIGS.

[0123] <Example 1> FIG. 6 is a block diagram showing a first example of the functional configuration of the data collection system SYS.

[0124] As shown in FIG. 6, the controller 30 of the shovel 100 includes a data acquisition condition information storage unit 301, an operation recognition unit 302, a condition determination unit 303, an operation log recording unit 304, an operation log storage unit 305, and an operation log transmission unit 306.

[0125] The data acquisition condition information storage unit 301 stores (registers) information (hereinafter referred to as "data acquisition condition information") that indicates the acquisition conditions for log data (hereinafter referred to as "data acquisition condition") distributed from the data collection device 200.

[0126] In this example, the data acquisition conditions define a range of feature quantities that represent predetermined movements or predetermined tasks of the shovel 100, with the feature quantities being physical quantities that represent the movements of the shovel 100. The feature quantities are, for example, physical quantities that represent the posture state of the machine body (upper rotating body 3) of the shovel 100 or the attachment AT (at least one of the boom 4, arm 5, and bucket 6).

[0127] The action recognition unit 302 recognizes the operational state of the shovel 100 based on output data from the sensor SX that acquires sensing data related to the state of the shovel 100, and outputs a feature amount representing the operational state. Specifically, the action recognition unit 302 may output a feature amount representing the action at that time for each predetermined processing cycle in the operating state from start to stop of the shovel 100.

[0128] For example, the operation recognition unit 302 outputs a feature quantity representing the operation state of the shovel 100 based on the output data of the sensor SX that acquires sensing data relating to the attitude state of the machine body and the attachment AT.

[0129] In addition, the operation recognition unit 302 may recognize the operation state of the shovel 100 based on the output data of the imaging device 40 (camera 40X), and output a feature representing the operation state of the shovel 100 by converting the recognized operation state into a corresponding feature.

[0130] The condition determination unit 303 determines whether the feature amount output by the action recognition unit 302 satisfies the data acquisition condition.

[0131] Specifically, the condition determination unit 303 may map the features output by the action recognition unit 302 into a feature space and determine whether the mapping result is included in the range of features defined as the data acquisition conditions.

[0132] When the condition determination unit 303 determines that the data acquisition conditions are met, the operation log recording unit 304 (an example of an extraction unit) records the log data of the shovel 100 at the same timing as the data of the sensor SX, the imaging device 40, etc. used by the operation recognition unit 302 in the operation log memory unit 305.

[0133] For example, the operation log recording unit 304 extracts log data at the same timing as the data used by the operation recognition unit 302 from the log data sequentially recorded in a ring buffer defined in the auxiliary storage device 30A, etc., and records it in the operation log memory unit 305.

[0134] The processing of the action recognition unit 302, the condition determination unit 303, and the action log recording unit 304 is performed as a series of processes. For example, the series of processes is performed every time the latest log data is acquired. Furthermore, the series of processes may be performed collectively at a timing when the processing load on the controller 30 is relatively low, such as the timing of termination processing when the shovel 100 is stopped.

[0135] The operation log storage unit 305 stores log data of the shovel 100 when the data acquisition condition is met, that is, log data of the shovel 100 when a predetermined operation or a predetermined task is performed.

[0136] The log data in the operation log storage unit 305 may be automatically deleted after a predetermined period of time has elapsed since it was recorded. Also, the log data in the operation log storage unit 305 may be deleted immediately after being transmitted to the data collection device 200, or after a certain period of time has elapsed.

[0137] The operation log transmission unit 306 transmits the log data stored in the operation log storage unit 305 when the excavator 100 performs a predetermined operation or when performing a predetermined task to the data collection device 200 .

[0138] For example, the operation log transmission unit 306 transmits, at a predetermined timing, log data that has not yet been transmitted to the data collection device 200 out of the log data during a predetermined operation or a predetermined task of the shovel 100 that is stored in the operation log storage unit 305. The predetermined timing is, for example, the timing of termination processing when the shovel 100 is stopped or the timing of initial processing when the shovel 100 is started.

[0139] In addition, the operation log transmission unit 306 may transmit to the data collection device 200, in response to a request signal received from the data collection device 200, log data from the shovel 100 during a specified operation or specified work that has not yet been transmitted to the data collection device 200.

[0140] The data collection device 200 includes an input information registration unit 2001, an input information storage unit 2002, a reproduction unit 2003, a data acquisition condition generation unit 2004, a data acquisition condition information storage unit 2005, and a distribution unit 2006. The data collection device 200 also includes an operation log acquisition unit 2007, an operation log storage unit 2008, and an operation log transmission unit 2009.

[0141] The input information registration unit 2001 (an example of an acquisition unit) registers, in the input information storage unit 2002, information (hereinafter referred to as “input information”) that is input from the outside and indicates a predetermined operation or a predetermined work of the shovel 100.

[0142] The input information is input directly by the user via the input device 207. Alternatively, the input information may be input via an external device (terminal device) used by the user, and input to the data collection device 200 via the communication interface 206.

[0143] In this example, the input information is information that represents the state of the shovel 100 when the shovel 100 is performing a predetermined operation or a predetermined task. For example, the input information is moving image information when the shovel 100 is performing a predetermined operation or a predetermined task.

[0144] The reproducing unit 2003 reproduces, based on the input information, the feature amount of the excavator 100 during a predetermined operation or a predetermined task corresponding to the input information.

[0145] For example, the reproduction unit 2003 uses the input information as input conditions and performs a virtual simulation using a virtual model in which various characteristics of the shovel 100 are reproduced, and reproduces feature values ​​of the shovel 100 during a predetermined operation or a predetermined task corresponding to the input information. Specifically, the reproduction unit 2003 may reproduce, for each frame of the moving image information, control values ​​(feature values) for the operation of the shovel 100 through virtual simulation so that the posture state of the virtual model under the same shooting conditions as the moving image information becomes the same as that of the shovel in the moving image information. Furthermore, the reproduction unit 2003 may apply a known skeletal detection technique to the moving image information to detect the posture state of the shovel for each frame in the moving image information, and reproduce, through virtual simulation, control values ​​for the operation of the shovel 100 to achieve that posture state.

[0146] The data acquisition condition generation unit 2004 (an example of a first generation unit) generates data acquisition conditions based on the characteristic quantities of the shovel 100 during a specified operation or specified work corresponding to the input information, reproduced by the reproduction unit 2003.

[0147] For example, the data acquisition condition generation unit 2004 generates data acquisition conditions by defining a predetermined range in the feature space based on the feature of the shovel 100 during a predetermined operation or a predetermined task corresponding to the input information, reproduced by the reproduction unit 2003. If the shovels 100 included in the data collection system SYS include models with different attachment AT specifications, etc., data acquisition conditions for each model may be generated by defining a predetermined range for each model.

[0148] The data acquisition condition information storage unit 2005 stores (registers) information on the data acquisition conditions (data acquisition condition information) generated by the data acquisition condition generation unit 2004.

[0149] When data acquisition condition information corresponding to the data acquisition conditions generated by the data acquisition condition generating unit 2004 is registered, the distribution unit 2006 (an example of a transmission unit) distributes the registered data acquisition condition information to the shovel 100. This allows the shovel 100 (controller 30) to use the data acquisition conditions distributed from the data collecting device 200 as described above to record log data when the shovel 100 is performing a predetermined operation or a predetermined task.

[0150] The operation log acquisition unit 2007 acquires log data transmitted (uploaded) from the shovel 100 when the shovel 100 performs a predetermined operation or when a predetermined task is performed.

[0151] The operation log storage unit 2008 stores log data acquired by the operation log acquisition unit 2007 when the excavator 100 performs a predetermined operation or a predetermined task.

[0152] The operation log transmission unit 2009 transmits log data of the shovel 100 during a predetermined operation or predetermined work, which is stored in the operation log storage unit 2008, to an external device (for example, a terminal device) used by the user, using the communication interface 206. This allows the user to use the log data of the shovel 100 during a predetermined operation or predetermined work on the terminal device or the like used by the user.

[0153] Thus, in this example, the data collection device 200 automatically generates conditions for acquiring log data during a specified operation or specified work of the shovel 100 based on information input by the user that represents a specified operation or specified work of the shovel 100.

[0154] This improves the convenience for the user when detecting a predetermined operation or a predetermined task of the shovel 100. 。

[0155] In this example, the shovel 100 (controller 30) determines whether the acquisition condition for the log data of the shovel 100 is met, and when the acquisition condition is met, extracts the corresponding log data of the shovel 100 and transmits it to the data collecting device 200.

[0156] This makes it possible to distribute the processing load of the data collection system SYS and reduce the processing load of the data collection device 200. Furthermore, it is possible to reduce the amount of log data sent from the excavator 100 to the data collection device 200, thereby reducing the communication load and communication costs.

[0157] <Example 2> FIG. 7 is a block diagram showing a second example of the functional configuration of the data collection system SYS.

[0158] The following description will focus on the differences from the first example described above, and descriptions of the same or corresponding contents as the first example described above may be omitted.

[0159] As shown in Figure 7, the controller 30 of the shovel 100 includes a data acquisition condition information storage unit 301, a caption generation unit 302A, a scene division unit 302B, a condition determination unit 303, an operation log recording unit 304, an operation log storage unit 305, and an operation log transmission unit 306.

[0160] In the data acquisition condition information storage unit 301, data acquisition condition information distributed from the data collection device is stored (registered), similarly to the first example described above.

[0161] In this example, the data acquisition conditions are based on a feature vector representing a permutation (or combination) of words, the smallest unit of a language (e.g., a sentence), and a range of the feature vector is specified that corresponds to the range of words that mean a specified operation or specified work of the shovel 100.

[0162] The caption generation unit 302A performs known video captioning processing on output data from the imaging device 40 (for example, images captured by the camera 40F) that shows the operation of the shovel 100, and generates a caption (explanatory text) that explains the captured image. Specifically, the caption generation unit 302A may perform video captioning processing on video data (hereinafter referred to as "video data unit") from the imaging device 40 for each predetermined number of frames (for example, one frame), and generate a caption for each video data unit.

[0163] The scene dividing unit 302B divides the video data of the imaging device 40 into scenes for each range of the same action or the same task, based on the caption for each video data unit generated by the caption generating unit 302A. Specifically, the scene dividing unit 302B may determine as one scene a group of consecutive video data units in which the captions generated for each video data unit represent the same action or the same task. Then, the scene dividing unit 302B may divide a scene between two adjacent frames in which the captions for each video data unit represent different actions or different tasks.

[0164] The condition determination unit 303 determines whether or not the feature vector corresponding to the caption (explanatory text) for each scene divided by the scene division unit 302B satisfies the data acquisition condition.

[0165] Specifically, the condition determination unit 303 may map feature vectors corresponding to captions (explanatory text) for each scene into a feature space and determine whether the mapping result is included in the range of features specified as the data acquisition conditions.

[0166] The operation log recording unit 304 records, in the operation log storage unit 305, log data of the excavator 100 corresponding to a scene for which the condition determination unit 303 has determined that the data acquisition condition is met.

[0167] The processes of the caption generation unit 302A, the scene division unit 302B, the condition determination unit 303, and the operation log recording unit 304 are performed as a series of processes. The series of processes is performed, for example, in real time. In this case, the scene division unit 302B determines whether or not a scene should be divided based on the caption for each piece of video data generated in real time by the caption generation unit 302A. Furthermore, each time a scene division point is generated by the scene division unit 302B, the condition determination unit 303 performs processing to determine whether or not the data acquisition condition is met for the scene immediately before the scene division point. Furthermore, the series of processes may be performed collectively at a timing when the processing load on the controller 30 is relatively low, such as the timing of termination processing when the excavator 100 is stopped.

[0168] The data collection device 200 includes an input information registration unit 2001, an input information storage unit 2002, a caption generation unit 2003A, a morphological analysis unit 2003B, a data acquisition condition generation unit 2004, a data acquisition condition information storage unit 2005, and a distribution unit 2006. The data collection device 200 also includes an operation log acquisition unit 2007, an operation log storage unit 2008, and an operation log transmission unit 2009.

[0169] As in the first example described above, the input information registration unit 2001 registers, in the input information storage unit 2002, information (input information) that is input from the outside and indicates a predetermined operation or a predetermined work of the shovel 100.

[0170] In this example, the input information is moving image information when the excavator 100 is performing a predetermined operation or a predetermined task.

[0171] The caption generation unit 2003A (an example of a second generation unit) performs known video captioning processing on the input information (video image information of the shovel 100 performing a predetermined operation or a predetermined task) to generate a caption (explanatory text) that explains the input information. In this way, the caption generation unit 2003A can generate a caption (explanatory text) that explains the predetermined operation or predetermined task of the shovel 100 that is shown in the video image information that serves as input information.

[0172] The morphological analysis unit 2003B performs a known morphological analysis process on the caption (explanatory text) generated by the caption generation unit 2003A, and divides the caption into permutations (or combinations) of the smallest units of words.The morphological analysis unit 2003B then outputs a feature vector representing the permutations (or combinations) of the smallest units of words in the caption (explanatory text).

[0173] The data acquisition condition generating unit 2004 generates data acquisition conditions by defining a predetermined range in the feature space based on the feature vector output by the morphological analysis unit 2003B.

[0174] Thus, in this example, the data collection device 200 automatically generates conditions for acquiring log data during a specified operation or specified work of the shovel 100 based on video information input by the user that represents a specified operation or specified work of the shovel 100.

[0175] This can improve the convenience for the user when detecting a predetermined operation or a predetermined task of the shovel 100.

[0176] Furthermore, in this example, similar to the first example described above, the shovel 100 (controller 30) determines whether the acquisition conditions for the log data of the shovel 100 are met, and when the acquisition conditions are met, extracts the corresponding log data of the shovel 100 and transmits it to the data collection device 200.

[0177] This makes it possible to distribute the processing load of the data collection system SYS and reduce the processing load of the data collection device 200. Furthermore, it is possible to reduce the amount of log data sent from the excavator 100 to the data collection device 200, thereby reducing the communication load and communication costs.

[0178] <Example 3> FIG. 8 is a block diagram showing a third example of the functional configuration of the data collection system SYS.

[0179] 8, the data collection system SYS according to this example differs from the second example described above in that the caption generation unit 2003A is omitted, but is otherwise the same as the second example described above. The following description will focus on the differences from the second example described above, and may omit descriptions of the same or corresponding content as the second example described above.

[0180] The data collection device 200 includes an input information registration unit 2001, an input information storage unit 2002, a morphological analysis unit 2003B, a data acquisition condition generation unit 2004, a data acquisition condition information storage unit 2005, and a distribution unit 2006. The data collection device 200 also includes an operation log acquisition unit 2007, an operation log storage unit 2008, and an operation log transmission unit 2009.

[0181] As in the second example described above, the input information registration unit 2001 registers in the input information storage unit 2002 information (input information) that is input from the outside and indicates a predetermined operation or a predetermined work of the shovel 100.

[0182] In this example, the input information is a word (for example, a sentence) that means a predetermined operation or a predetermined task of the excavator 100.

[0183] The morphological analysis unit 2003B performs known morphological analysis processing on the words that represent the predetermined motions or predetermined work of the shovel 100 as input information, and divides the words of the input information into permutations (or combinations) of the smallest units of words. Then, the morphological analysis unit 2003B outputs a feature vector that represents the permutations (or combinations) of the smallest units of words of the words of the input information.

[0184] Thus, in this example, the data collection device 200 automatically generates conditions for acquiring log data during a specified operation or specified work of the shovel 100 based on information about words that are input by the user and that represent a specified operation or specified work of the shovel 100.

[0185] This can improve the convenience for the user when detecting a predetermined operation or a predetermined task of the shovel 100.

[0186] In addition, in this example, the processing load when generating data acquisition conditions can be reduced.

[0187] Furthermore, in this example, the user only needs to input a word that represents a predetermined operation or a predetermined task of the shovel 100. This improves user convenience.

[0188] Furthermore, in this example, similar to the first example described above, the shovel 100 (controller 30) determines whether the acquisition conditions for the log data of the shovel 100 are met, and when the acquisition conditions are met, extracts the corresponding log data of the shovel 100 and transmits it to the data collection device 200.

[0189] This makes it possible to distribute the processing load of the data collection system SYS and reduce the processing load of the data collection device 200. Furthermore, it is possible to reduce the amount of log data sent from the excavator 100 to the data collection device 200, thereby reducing the communication load and communication costs.

[0190] <Example 4> FIG. 9 is a block diagram showing a fourth example of the functional configuration of the data collection system SYS.

[0191] As shown in FIG. 9, the controller 30 of the shovel 100 includes a total operation log recording unit 304A, a total operation log storage unit 305A, and a total operation log transmission unit 306A.

[0192] The total operation log recording unit 304A records the latest log data of the shovel 100 in the total operation log storage unit 305A at each predetermined processing cycle. In other words, unlike the first to third examples described above, the total operation log recording unit 304A records the log data of the shovel 100 at all times when log data can be acquired, regardless of the operation or work content of the shovel 100.

[0193] The latest log data of the excavator 100 is accumulated in the total operation log storage unit 305A at predetermined intervals.

[0194] Note that, when the log data in the total operation log storage unit 305A is transmitted to the data collection device 200, it may be deleted immediately or after a certain period of time has elapsed.

[0195] The total operation log transmission unit 306A transmits the log data of the excavator 100 stored in the total operation log storage unit 305A to the data collection device 200 for each predetermined period.

[0196] For example, the total operation log transmission unit 306A transmits, at a predetermined timing, log data of the shovel 100 stored in the total operation log storage unit 305A for each predetermined period that has not yet been transmitted to the data collection device 200 to the data collection device 200. The predetermined timing is, for example, the timing of termination processing when the shovel 100 is stopped or the timing of initial processing when the shovel 100 is started.

[0197] In addition, the total operation log transmission unit 306A may transmit to the data collection device 200, in response to a request signal received from the data collection device 200, the log data of the shovel 100 at a predetermined period that has not yet been transmitted to the data collection device 200.

[0198] 9, data collection device 200 differs from the first example described above in that distribution unit 2006 and operation log acquisition unit 2007 are omitted and total operation log storage unit 2006A, operation recognition unit 2006B, condition determination unit 2006C, and operation log recording unit 2007A are added, but is otherwise the same as the first example described above. The following description will focus on the differences from the first example described above, and may omit descriptions of the same or corresponding contents as the first example described above.

[0199] The data collection device 200 includes an input information registration unit 2001, an input information storage unit 2002, a reproduction unit 2003, a data acquisition condition generation unit 2004, and a data acquisition condition information storage unit 2005. The data collection device 200 also includes an entire operation log storage unit 2006A, an operation recognition unit 2006B, a condition determination unit 2006C, an operation log recording unit 2007A, an operation log acquisition unit 2007, an operation log storage unit 2008, and an operation log transmission unit 2009.

[0200] The total operation log storage unit 2006A stores log data of the excavator 100 uploaded (transmitted) from the excavator 100 at predetermined intervals.

[0201] The action recognition unit 2006B recognizes the action state of the shovel 100 based on the log data of the shovel 100 at the same timing (cycle), and outputs a feature amount representing the action state. Specifically, the action recognition unit 2006B may sequentially extract log data at the same timing (cycle) from the total action log storage unit 2006A, and output a feature amount representing the action state of the shovel 100 corresponding to the log data.

[0202] The action recognition unit 2006B may output a feature quantity representing the action state of the shovel 100 in the same manner as the action recognition unit 302 in the first example described above.

[0203] The condition determination unit 2006C determines whether or not the data acquisition conditions output by the action recognition unit 2006B are satisfied.

[0204] Specifically, the condition determination unit 2006C may map the features output by the action recognition unit 2006B into a feature space and determine whether the mapping result is included in the range of features defined as the data acquisition conditions.

[0205] When the condition determination unit determines that the data acquisition conditions are met, the operation log recording unit 2007A (an example of an extraction unit) records log data of the shovel 100 at the same timing as the data used by the operation recognition unit 2006B in the operation log memory unit 2008.

[0206] The processing of the action recognition unit 2006B, the condition determination unit 2006C, and the action log recording unit 2007A is performed as a series of processes.

[0207] Thus, in this example, in addition to generating data acquisition conditions, the data collection device 200 determines whether the data acquisition conditions are met and extracts log data from the log data of the shovel 100 at specified intervals, the log data representing the shovel 100 during specified operations or specified tasks.

[0208] This makes it possible to reduce the processing load on the shovel 100 when collecting log data during a predetermined operation or a predetermined task of the shovel 100.

[0209] <Other examples> The first to fourth examples described above may be modified or changed as appropriate.

[0210] For example, similar to the fourth example described above, the function of extracting log data during a specified operation or specified work of the shovel 100 may be transferred from the shovel 100 to the data collection device 200, based on the second or third example described above.

[0211] Specifically, in the second and third examples described above, the functions of the caption generation unit 302A, the scene division unit 302B, the condition determination unit 303, and the operation log recording unit 304 may be transferred to the data collection device 200. In this case, the shovel 100 is replaced with a functional configuration similar to that of the fourth example described above. Also, in this case, the data collection device 200 omits the distribution unit 2006 and the operation log acquisition unit 2007, similar to the fourth example described above.

[0212] [Effect] Next, the operation of the data collection system SYS (data collection device 200) according to this embodiment will be described.

[0213] In this embodiment, the data collection device 200 includes an acquisition unit (for example, an input information registration unit 2001) and a first generation unit (for example, a data acquisition condition generation unit 2004). Specifically, the acquisition unit acquires information representing a predetermined movement or a predetermined work of the shovel 100. Then, the first generation unit generates conditions (for example, data acquisition conditions) related to a predetermined feature amount representing the predetermined movement or the predetermined work of the shovel 100 based on the information representing the predetermined movement or the predetermined work of the shovel 100.

[0214] This allows the data collection system SYS to automatically generate conditions related to predetermined feature quantities during a predetermined movement or predetermined work of the shovel 100 from information input by the user that indicates a predetermined movement or predetermined work of the shovel 100. Therefore, the data collection system SYS can detect a predetermined movement or predetermined work of the shovel 100 depending on whether the conditions are met. Therefore, the data collection device 200 can improve the convenience for the user in detecting a predetermined movement or predetermined work of the shovel 100.

[0215] Furthermore, in this embodiment, the data collection system SYS may include an extraction unit (for example, the operation log recording unit 304 or the operation log recording unit 2007A). Specifically, the extraction unit may acquire data that meets the above conditions (data acquisition conditions) from data that indicates the state of the shovel 100 and is acquired by the shovel 100.

[0216] This allows the data collection system SYS to collect log data when the excavator 100 is performing a predetermined operation or performing a predetermined task.

[0217] In this embodiment, the data collection device 200 may also include the extraction unit described above.

[0218] This allows the data collection device 200 to perform all processes from generating the data acquisition condition to extracting the log data of the shovel 100 when the data acquisition condition is met. Therefore, the processing load on the shovel 100 can be reduced.

[0219] In this embodiment, the data collection device 200 may also include a transmission unit (for example, the distribution unit 2006). Specifically, the transmission unit may transmit the above conditions to the shovel 100.

[0220] This allows the data collection device 200 to collect log data during a predetermined operation or a predetermined task of the shovel 100. Furthermore, the data collection device 200 delegates to the shovel 100 the process of extracting log data of the shovel 100 when a data acquisition condition is met, thereby distributing the processing load across the entire data collection system SYS and reducing its own processing load.

[0221] Furthermore, in this embodiment, the information representing the predetermined operation or predetermined work of the shovel 100 may be information representing the state of the shovel 100 when the shovel 100 is performing the predetermined operation or predetermined work. The above-mentioned predetermined feature amount may be a feature amount representing the state of the shovel 100.

[0222] This enables the data collection device 200 to generate information representing the state of the shovel 100 when the shovel 100 is performing a specified operation or performing a specified task, and conditions relating to features representing the state of the shovel 100 that represent the specified operation or task of the shovel 100.

[0223] Furthermore, in this embodiment, the data collection system SYS may include a reproduction unit (for example, the reproduction unit 2003). Specifically, the reproduction unit may use a virtual model of the shovel 100 to reproduce a predetermined feature amount corresponding to information representing a predetermined motion or a predetermined work of the shovel 100. Then, the first generation unit may generate a condition representing a range of the predetermined feature amount, using the predetermined feature amount reproduced by the reproduction unit as a reference.

[0224] This enables the data collection device 200 to generate information representing the state of the shovel 100 when the shovel 100 is performing a specified operation or performing a specified task, and conditions relating to features representing the state of the shovel 100 that represent the specified operation or task of the shovel 100.

[0225] Furthermore, in this embodiment, the data collection system SYS may include a second generation unit (for example, a caption generation unit 2003A). Specifically, the information representing the predetermined movement or predetermined work may be video information including a situation in which the shovel 100 is performing the predetermined movement or predetermined work. Furthermore, the second generation unit may generate words that explain the predetermined movement or predetermined work of the shovel 100 shown in the video information. Then, the first generation unit may use a predetermined feature amount (feature amount vector) obtained by quantifying the word generated by the second generation unit as a reference and generate a condition that represents a range of a predetermined feature amount (feature amount vector) that has the same meaning as the word.

[0226] This allows the data collection device 200 to generate conditions related to features that are quantified words (sentences) that explain the specified movements or specified tasks of the shovel 100 from video image information of the shovel 100 performing a specified movement or performing a specified task.

[0227] Furthermore, in this embodiment, the information representing the predetermined movement or predetermined work of the shovel 100 may be information related to words representing the predetermined movement or predetermined work of the shovel 100. Then, the first generation unit may use a predetermined feature amount (feature amount vector) obtained by quantifying a word representing the predetermined movement or predetermined work of the shovel 100 as a reference, and generate a condition representing a range of the predetermined feature amount (feature amount vector) that has the same meaning as the word.

[0228] As a result, the data collection device 200 can generate conditions related to features that quantify the words (sentences) that describe the specified movements or specified work of the shovel 100 from information on the words (sentences) that represent the specified movements or specified work of the shovel 100.

[0229] Although the embodiments have been described in detail above, the present disclosure is not limited to such specific embodiments, and various modifications and variations are possible within the scope of the gist described in the claims. [Explanation of symbols]

[0230] 1 Undercarriage 1C Crawler 1M, 1ML, 1MR Travel Hydraulic Motor 2. Swivel mechanism 2M Swing Hydraulic Motor 3 Upper rotating body 4. Boom 5 Arm 6 buckets 7 Boom cylinder 8 Arm Cylinder 9 Bucket cylinder 10 Cabins 11 Engine 13 Regulator 14 Main pump 15 Pilot pump 17 Control valve 26 Operating device 29 Operating pressure sensor 30 Controllers 31 Hydraulic control valve 40 Imaging device 40B, 40F, 40L, 40R Camera 50 Output Device 52 Input Device 60 Communication equipment 100 Shovel 200 Data Collection Device 300 Crawler Crane 301 Data acquisition condition information storage unit 302 Motion recognition section 302A Caption Generation Unit 302B Scene division section 303 Condition judgment section 304 Operation log recording section 304A All operation log recording section 305 Operation log storage unit 305A All operation log storage unit 306 Operation log transmission unit 306A All operation log transmission unit 2001 Input Information Registration Department 2002 Input information storage unit 2003 Reenactment 2003A Caption Generation Unit 2003B Morphological Analysis Department 2004 Data Acquisition Condition Generation Unit 2005 Data acquisition condition information storage unit 2006 Distribution Department 2006A All operation log storage unit 2006B Motion recognition section 2006C Condition judgment section 2007 Operation log acquisition section 2007A Operation log recording section 2008 Operation log storage unit 2009 Operation log sending unit AT Attachment HA Hydraulic Actuator SX Sensor SYS Data Collection System

Claims

1. an acquisition unit that acquires information representing the state of the work machine when the work machine is performing a predetermined operation or a predetermined task; a first generation unit that generates a condition that represents the predetermined operation or the predetermined work, based on information that represents a state of the work machine when the work machine is performing the predetermined operation or the predetermined work, the condition relating to a predetermined feature quantity that is a physical quantity that represents the state of the work machine; a reproduction unit that reproduces the predetermined feature amount corresponding to information that represents the state of the work machine when the work machine is performing the predetermined operation or the predetermined task, using a virtual model of the work machine; an extraction unit that extracts data that meets the conditions from data that represents the state of the work machine and is acquired by the work machine; the first generation unit generates the condition representing a range of the predetermined feature amount based on the predetermined feature amount reproduced by the reproduction unit. Information processing system.

2. an acquisition unit that acquires information representing the state of the work machine when the work machine is performing a predetermined operation or a predetermined task; a first generation unit that generates conditions that represent the predetermined operation or the predetermined work, based on information that represents the state of the work machine when the work machine is performing the predetermined operation or the predetermined work, and that generate conditions related to predetermined feature quantities that are obtained by quantifying words that represent the state of the work machine; an extraction unit that extracts data that meets the conditions from data that represents the state of the work machine and is acquired by the work machine; the information representing the state of the work machine when the work machine is performing the predetermined operation or the predetermined work is information in words that represent the state of the work machine when the work machine is performing the predetermined operation or the predetermined work, the first generation unit uses the predetermined feature value, which is a numerical representation of a word that represents the state of the work machine when the work machine is performing the predetermined operation or the predetermined work, as a reference to generate the condition that represents a range of the predetermined feature value that has the same meaning as the word. Information processing system.

3. an acquisition unit that acquires information representing the state of the work machine when the work machine is performing a predetermined operation or a predetermined task; a first generation unit that generates a condition that represents the predetermined operation or the predetermined work, based on information that represents a state of the work machine when the work machine is performing the predetermined operation or the predetermined work, the condition relating to a predetermined feature quantity that is a physical quantity that represents the state of the work machine; a reproduction unit that reproduces the predetermined feature amount corresponding to information representing the predetermined motion or the predetermined work using a virtual model of the work machine; an extraction unit that extracts data that matches the conditions from data that is acquired by the work machine and that represents the state of the work machine, or a transmission unit that transmits the conditions to the work machine in order to extract data that matches the conditions from data that is acquired by the work machine and that represents the state of the work machine, the first generation unit generates the condition representing a range of the predetermined feature amount based on the predetermined feature amount reproduced by the reproduction unit. Information processing device.

4. an acquisition unit that acquires information representing the state of the work machine when the work machine is performing a predetermined operation or a predetermined task; a first generation unit that generates conditions that represent the predetermined operation or the predetermined work, based on information that represents the state of the work machine when the work machine is performing the predetermined operation or the predetermined work, and that generate conditions related to predetermined feature quantities that are obtained by quantifying words that represent the state of the work machine; an extraction unit that extracts data that matches the conditions from data that is acquired by the work machine and that represents the state of the work machine, or a transmission unit that transmits the conditions to the work machine in order to extract data that matches the conditions from data that is acquired by the work machine and that represents the state of the work machine, the information representing the state of the work machine when the work machine is performing the predetermined operation or the predetermined work is information in words that represent the state of the work machine when the work machine is performing the predetermined operation or the predetermined work, the first generation unit uses the predetermined feature value, which is a numerical representation of a word that represents the state of the work machine when the work machine is performing the predetermined operation or the predetermined work, as a reference to generate the condition that represents a range of the predetermined feature value that has the same meaning as the word. Information processing device.

5. In the information processing device, an acquisition step of acquiring information representing the state of the work machine when the work machine is performing a predetermined operation or a predetermined task; a first generation step of generating conditions that represent the predetermined operation or the predetermined work, based on information that represents the state of the work machine when the work machine is performing the predetermined operation or the predetermined work, the conditions relating to predetermined feature quantities that are physical quantities that represent the state of the work machine; a reproduction step of reproducing the predetermined feature amount corresponding to information representing the predetermined motion or the predetermined work using a virtual model of a work machine; an extraction step of extracting data that matches the condition from data that is acquired by the work machine and that represents the state of the work machine, or a transmission step of transmitting the condition to the work machine in order to extract data that matches the condition from data that is acquired by the work machine and that represents the state of the work machine, In the first generation step, the condition representing a range of the predetermined feature amount is generated based on the predetermined feature amount reproduced in the reproduction step. program.

6. In the information processing device, an acquisition step of acquiring information representing the state of the work machine when the work machine is performing a predetermined operation or a predetermined task; a first generation step of generating conditions that represent the predetermined operation or the predetermined work, based on information that represents the state of the work machine when the work machine is performing the predetermined operation or the predetermined work, the conditions being related to predetermined feature quantities that are quantified words that represent the state of the work machine; an extraction step of extracting data that matches the condition from data that indicates the state of the work machine acquired by the work machine, or a transmission step of transmitting the condition to the work machine in order to extract data that matches the condition from data that indicates the state of the work machine acquired by the work machine. the information representing the state of the work machine when the work machine is performing the predetermined operation or the predetermined work is information in words that represent the state of the work machine when the work machine is performing the predetermined operation or the predetermined work, In the first generation step, the predetermined feature value is a numerical representation of a word that represents the state of the work machine when the work machine is performing the predetermined operation or the predetermined work, and the condition that represents a range of the predetermined feature value that has the same meaning as the word is used as a reference. program.

Images