Information system and operation device

The information system optimizes data storage and transmission by determining the cooperation state between the operating device and target, addressing inefficiencies in remotely controlling multiple work machines by selectively saving and transmitting data.

JP2024168256APending Publication Date: 2024-12-05KOBELCO CONSTR MASCH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023084765
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing systems for remotely controlling work machines face inefficiencies in managing image data storage, leading to enlarged system configurations due to unnecessary data being saved when machines are not being controlled, especially when multiple machines are involved.

Method used

An information system that determines the cooperation state between the operating device and the operating target to decide whether to save acquired information, reducing unnecessary storage by not saving data when the machine is not being remotely controlled or is inoperable.

Benefits of technology

This approach reduces information storage capacity and system configuration expansion by selectively saving and transmitting data only when necessary, thereby optimizing resource utilization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168256000001_ABST
    Figure 2024168256000001_ABST
Patent Text Reader

Abstract

To provide an information system and an operation device, capable of suppressing an enlargement of a system configuration.SOLUTION: The present invention relates to an information system that determines whether it is necessary to store information acquired by at least one of an operation device and an operation target of the operation device according to a state of cooperation between the operation device and the operation target. The information system determines whether it is necessary to store "first actual machine information" acquired by a work machine 40 (operation target) and transmitted to a remote operation device 20 according to a state of cooperation between the remote operation device 20 and the operation target (e.g., a difference in an operation enabled state and an operation disabled state).SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information system that determines whether or not information acquired by at least one of an operation device and an operation target of the operation device needs to be saved depending on a cooperation state between the operation device and the operation target of the operation device. [Background technology]

[0002] In a system for remotely controlling a work machine, a video signal captured by a camera mounted on the work machine is transmitted via a line network and displayed on a monitor device of a remote control device (control room) installed in a remote location (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-168777 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is a demand for a system that can store image data displayed on the monitor device of a remote control device as operation history information of a work machine and can refer to the stored image data.

[0005] However, if image data is stored even when the work machine is not being remotely operated by the operator of the remote control device, it will require processing to store image data that is not necessary because it shows the situation when the work machine is not being remotely operated, which will result in the system configuration becoming bloated.

[0006] Furthermore, when there are multiple work machines that are to be operated by a remote control device, saving all image data corresponding to the multiple work machines would require processing to save not only image data corresponding to remotely operated work machines, but also image data corresponding to work machines that are not remotely operated, resulting in an expansion of the system configuration.

[0007] Therefore, an object of the present invention is to provide an information system and an operation device that can suppress the expansion of the system configuration. [Means for solving the problem]

[0008] The information system of the present invention comprises: Whether or not information acquired by at least one of the operation device as a designated device and the operation target needs to be stored is determined according to a cooperation state between the operation device and the operation target of the operation device.

[0009] According to the information system having this configuration, among the information acquired by the designated device, which is at least one of the operation device and the operation target of the operation device, information determined to be unnecessary according to the cooperation state between the operation device and the operation target is not stored in the designated device, etc. This reduces the information storage capacity in the designated device, etc., and thus can suppress the expansion of the system configuration.

[0010] The concept of "obtaining" information includes obtaining (detecting / measuring) the information using a sensor, etc., and receiving the information using a communication device. In addition to determining whether or not information that is primarily obtained by a first designated device and secondarily obtained (or received) by a second designated device from the first designated device needs to be stored in the second designated device and / or an external device, it may also be determined whether or not information that is primarily obtained by the first designated device needs to be stored in the first designated device and / or an external device.

[0011] In the information system having the above configuration, the operation target is a work machine, The operating device is a remote operating device for remotely operating the work machine. It is preferable.

[0012] According to the information system having this configuration, among the information acquired by the designated device, which is at least one of the work machine to be operated and the remote control device which is the operating device, information determined to be unnecessary according to the cooperation state between the remote control device and the work machine is not stored in the designated device, etc. This reduces the information storage capacity in the designated device, etc., and thus can suppress the expansion of the system configuration.

[0013] In the information system having the above configuration, the cooperation state includes an operable state in which the operation device is capable of operating the operation object, and an inoperable state in which the operation device is unable to operate the operation object, Whether or not the information needs to be stored is determined depending on whether the operation device and the operation target are in the operable state or the inoperable state. It is preferable.

[0014] According to the information system having this configuration, among the information acquired by the designated device, which is at least one of the operation device and the operation target of the operation device, information determined to be unnecessary depending on whether the operation target is in an "operable state" or an "inoperable state" by the operation device is not stored in the designated device, etc. This reduces the information storage capacity, and thus can suppress the expansion of the system configuration.

[0015] In the information system having the above configuration, According to a cooperation state between the operation device and one operation target candidate determined as the operation target among a plurality of operation target candidates that can be an operation target of the operation device, it is determined whether or not it is necessary to store information acquired by the one operation target candidate as the designated device. It is preferable.

[0016] According to the information system having this configuration, it is determined whether or not to store information acquired by one operation target candidate as a designated device that is determined as an operation target, among information acquired by multiple operation target candidates. Therefore, in addition to the information storage capacity of the designated device, etc., as described above, it is possible to reduce the information processing capacity required to determine whether or not each of the information acquired by the multiple operation target candidates needs to be stored, and thus it is possible to suppress the expansion of the system configuration.

[0017] In the information system having the above configuration, The information is stored in a storage device that stores the information. It is preferable.

[0018] According to the information system having the above configuration, among the information acquired by the designated device, which is at least one of the operation device and the operation target of the operation device, information determined not to need to be stored according to the cooperation state between the operation device and the operation target is not transmitted to the external server, and is not stored in the external server. Therefore, the information communication capacity between the designated device and the external server as well as the information storage capacity of the external server can be reduced, and the expansion of the system configuration can be suppressed.

[0019] In the information system having the above configuration, The information transmitted by the communication device to the external server is deleted from the designated device. It is preferable.

[0020] According to the information system having the above configuration, among the information acquired by the designated device, the information transmitted from the communication device to the external server is deleted from the designated device. This avoids wasteful storage of the same information in both the designated device and the external server indefinitely, thereby reducing the overall information storage capacity of the designated device and the external server, and thus preventing the system configuration from becoming bloated.

[0021] In the information system having the above configuration, The information that is determined not to need to be stored is deleted from the designated device. It is preferable.

[0022] According to the information system having this configuration, information acquired by the designated device that is determined not to need to be stored is deleted from the designated device. This avoids wasteful storage of unnecessary information in the designated device indefinitely, thereby reducing the information storage capacity of the designated device and thus preventing the system configuration from becoming bloated.

[0023] In the information system having the above configuration, The operation target is equipped with an imaging device that acquires a camera image as the information. It is preferable.

[0024] According to the information system having this configuration, when the operation target corresponds to the designated device, among the camera images acquired by the operation target through the imaging device, camera images determined to be unnecessary according to the cooperation state between the operation device and the operation target are not stored in the operation target. This reduces the information storage capacity of the designated device, and thus can suppress the expansion of the system configuration.

[0025] In the information system having the above configuration, The operation device receives the camera image as the information from the operation target. It is preferable.

[0026] According to the information system of this configuration, when the operation device corresponds to the designated device, among the camera images acquired by the operation target through the imaging device and received by the operation device from the operation target, the camera images determined to be unnecessary according to the cooperation state between the operation device and the operation target are not stored in the operation device. This reduces the information storage capacity of the designated device, and thus can suppress the expansion of the system configuration.

[0027] In the information system having the above configuration, The designated device is equipped with a display device for displaying the information. It is preferable.

[0028] According to the information system having this configuration, the information acquired by the designated device is displayed on the display device of the designated device. In this case, information determined to be unnecessary according to the cooperation state between the operation device and the operation target is not stored in the designated device, etc. This reduces the information storage capacity of the designated device, etc., and thus can suppress the expansion of the system configuration.

[0029] The operating device according to the first aspect of the present invention comprises: a display device that displays image data received from an operation target; and a processing device that determines, when the operation object is being operated, the image data displayed as an object to be saved.

[0030] According to the operation device having this configuration, when the operation target is not being operated, image data received from the operation target and displayed on the display device is not determined as a storage target. This reduces the information storage capacity of the operation device, and thus prevents the system configuration from becoming bloated.

[0031] The operating device according to the second aspect of the present invention is a display device that selects and displays image data received from a current operation target, which is one operation target candidate among a plurality of operation target candidates that can be operation targets of the operation device; and a processing device that determines, as an object to be saved, the image data displayed on the display device when the object to be operated is being operated by the operating device.

[0032] According to the operation device having this configuration, when one of the multiple operation target candidates, which is the current operation target, is not being operated, image data received from the operation target and displayed on the display device is not determined as a storage target. This reduces the information storage capacity of the operation device, and thus can prevent the system configuration from becoming bloated. [Brief description of the drawings]

[0033] [Figure 1] FIG. 1 is an explanatory diagram of a configuration of an information system. [Diagram 2] FIG. 2 is an explanatory diagram relating to the configuration of a remote control device. [Diagram 3] FIG. 2 is an explanatory diagram relating to the configuration of a work machine. [Figure 4] FIG. 1 is an explanatory diagram of the functions of an information system. [Diagram 5] FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0034] (Information System Configuration) The information system according to one embodiment of the present invention shown in FIG. 1 is made up of a remote control device 20 (control device) configured to be capable of communicating with an external server 10 and a work machine 40 (subject to operation) via a network.

[0035] (Configuration of remote control device) 1, the remote operation device 20 includes a remote control device 200 (processing device), a remote input interface 210, and a remote output interface 220. The remote control device 200 is configured with an arithmetic processing device (a single-core processor or a multi-core processor or a processor core constituting the same), reads necessary data and software from a storage device such as a memory, and executes arithmetic processing on the data according to the software.

[0036] The remote input interface 210 includes a remote control mechanism 211. The remote output interface 220 includes a remote image output device 221 (display device) and a remote wireless communication device 222.

[0037] The remote operation mechanism 211 includes a traveling operation device, a swing operation device, a boom operation device, an arm operation device, and a bucket operation device. Each operation device has an operation lever that receives a rotation operation. The operation lever (travel lever) of the traveling operation device is operated to move the lower traveling body 41 of the work machine 40. The travel lever may also serve as a travel pedal. For example, a travel pedal fixed to the base or lower end of the travel lever may be provided. The operation lever (swing lever) of the swing operation device is operated to move a hydraulic swing motor that constitutes the swing mechanism 43 of the work machine 40. The operation lever (boom lever) of the boom operation device is operated to move the boom cylinder 442 of the work machine 40. The operation lever (arm lever) of the arm operation device is operated to move the arm cylinder 444 of the work machine 40. The operation lever (bucket lever) of the bucket operation device is operated to move the bucket cylinder 446 of the work machine 40.

[0038] The operating levers constituting the remote control mechanism 211 are arranged around a seat St on which the operator sits, as shown in Fig. 2. The seat St is in the form of a high-back chair with armrests, but may be in the form of a low-back chair without a headrest, or in the form of a chair without a backrest, or in any other form on which the operator can sit.

[0039] Left and right travel levers 2110 corresponding to the left and right crawlers are arranged side by side in front of the seat St. One operation lever may serve as multiple operation levers. For example, the left operation lever 2111 provided in front of the left frame of the seat St shown in FIG. 2 may function as an arm lever when operated in the front-rear direction, and may function as a rotation lever when operated in the left-right direction. Similarly, the right operation lever 2112 provided in front of the right frame of the seat St shown in FIG. 2 may function as a boom lever when operated in the front-rear direction, and may function as a bucket lever when operated in the left-right direction. The lever pattern may be arbitrarily changed by an operation instruction from the operator.

[0040] The remote image output device 221 is composed of a single or multiple image output devices. The remote image output device 221 includes a capture board (output processing device) that outputs input video information to the screen of the image output device, and a hub (relay device) that inputs video information to the capture board according to the judgment result of the transmitted video information. In this embodiment, according to the judgment result of the first actual machine information transmitted from the work machine 40 as video information, a captured image as the first actual machine information is input to the capture board via the hub (details will be described later). As shown in FIG. 2, for example, the remote image output device 221 is composed of a central remote image output device 2210, a left remote image output device 2211, and a right remote image output device 2212, each having a substantially rectangular screen arranged in front of the seat St, diagonally forward to the left, and diagonally forward to the right. The shape and size of the screens (image display areas) of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be the same or different. The remote image output device 221 may be composed of a single curved or bendable image output device, or two or four or more image output devices arranged to surround the front of the seat St.

[0041] As shown in Fig. 2, the right edge of the left remote image output device 2211 is adjacent to the left edge of the central remote image output device 2210, such that the screens of the central remote image output device 2210 and the left remote image output device 2211 form an inclination angle θ1 (e.g., 120°≦θ1≦150°). As shown in Fig. 2, the left edge of the right remote image output device 2212 is adjacent to the right edge of the central remote image output device 2210, such that the screens of the central remote image output device 2210 and the right remote image output device 2212 form an inclination angle θ2 (e.g., 120°≦θ2≦150°). The inclination angles θ1 and θ2 may be the same or different.

[0042] The screens of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be parallel to the vertical direction or may be inclined to the vertical direction. At least one of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be composed of a plurality of divided image output devices. For example, the central remote image output device 2210 may be composed of vertically adjacent image output devices each having a substantially rectangular screen.

[0043] (Work machine configuration) 1, the work machine 40 includes an actual machine control device 400, an actual machine input interface 410, an actual machine output interface 420, and an actual machine wireless communication device 422. Each of the components of the actual machine control device 400 is configured by an arithmetic processing device (a single-core processor or a multi-core processor or a processor core constituting the same), reads necessary data and software from a storage device such as a memory, and executes arithmetic processing on the data in accordance with the software.

[0044] The work machine 40 is, for example, a crawler excavator (construction machine), and as shown in Fig. 3, includes a crawler-type lower traveling body 41 and an upper rotating body 42 that is rotatably mounted on the lower traveling body 41 via a rotating mechanism 43. A cab 42C (operator's cabin) is provided on the front left side of the upper rotating body 42. A work mechanism 44 is provided in the front center of the upper rotating body 42.

[0045] The real machine input interface 410 includes a real machine operation mechanism 411, a real machine imaging device 412, a real machine positioning device 414, and a real machine sensor group 416. The real machine operation mechanism 411 includes a plurality of operation levers arranged around a seat arranged inside the cab 42C in the same manner as the remote operation mechanism 211. A drive mechanism or robot that receives a signal according to the operation mode of the remote operation lever and moves the real machine operation lever based on the received signal is provided in the cab 42C. The real machine imaging device 412 is installed, for example, inside the cab 42C, and images the environment including at least a part of the working mechanism 44 through the front window and the left and right side windows. The front window and the side windows may be omitted in part or in whole. The real machine positioning device 414 is configured with a GPS or GNSS and, if necessary, a gyro sensor or the like, and measures the position (latitude and longitude) of the working machine 40.

[0046] The actual machine sensor group 416 is configured to output signals to the actual machine control device 400 according to parameter values ​​relating to the state of the work machine 40, such as the hoisting angle of the boom 441 relative to the upper rotating body 42, the rotation angle of the arm 443 relative to the boom 441, the rotation angle of the bucket 445 relative to the arm 443, hydraulic oil pressure, and remaining fuel.

[0047] 3, the working mechanism 44 includes a boom 441 that is movably attached to the upper rotating body 42, an arm 443 that is rotatably connected to the tip of the boom 441, and a bucket 445 (tip attachment) that is rotatably connected to the tip of the arm 443. The working mechanism 44 is equipped with a boom cylinder 442, an arm cylinder 444, and a bucket cylinder 446 that are configured as extendable and retractable hydraulic cylinders.

[0048] The boom cylinder 442 is interposed between the boom 441 and the upper rotating body 42 so as to extend and retract when supplied with hydraulic oil to rotate the boom 441 in the hoisting direction. The arm cylinder 444 is interposed between the arm 443 and the boom 441 so as to extend and retract when supplied with hydraulic oil to rotate the arm 443 about a horizontal axis relative to the boom 441. The bucket cylinder 446 is interposed between the bucket 445 and the arm 443 so as to extend and retract when supplied with hydraulic oil to rotate the bucket 445 about a horizontal axis relative to the arm 443.

[0049] (function) The functions of the construction support device and the imaging function control system having the above-mentioned configuration will be described with reference to the flowchart shown in Fig. 4. In the flowchart, a block "C●" is used for the sake of simplicity, and means transmission and / or reception of data, and means a conditional branch in which processing in a branching direction is executed on the condition that the data is transmitted and / or received.

[0050] In the remote operation device 20, the remote control device 200 transmits a designation signal to the work machine 40 via the remote wireless communication device 222 (FIG. 4 / STEP 210). When multiple work machines 40 are multiple operation target candidates, the designation signal may be transmitted to each of the multiple work machines 40. The presence or absence of a designation operation via the remote input interface 210 may be determined by the operator, and the designation signal may be transmitted when the determination result is affirmative. The "designation operation" is, for example, an operation such as tapping on the remote input interface 210 for the operator to designate the work machine 40 that he or she intends to remotely operate.

[0051] When the work machine 40 receives a designation signal through the actual machine wireless communication device 422 (FIG. 4 / C40), the actual machine control device 400 transmits a captured image (camera image, which may have been subjected to appropriate image processing) acquired through the actual machine imaging device 412 as "first actual machine information" to the remote control device 20 (FIG. 4 / STEP 410). The captured image (or captured image data) may be the captured image itself, or image data representing a simulated environmental image generated based on the captured image.

[0052] When the remote operation device 20 receives the first actual machine information through the remote wireless communication device 222 (FIG. 4 / C21), the remote control device 200 determines whether or not it is necessary to store the first actual machine information depending on the cooperation state between the remote operation device 20 and the work machine 40 (FIG. 4 / STEP 212). For example, the remote control device 200 executes the determination process depending on whether or not the captured image as the first actual machine information has been acquired by the current operation target (one operation target candidate) that is in a state where it can be remotely operated by the remote operation device 20.

[0053] Depending on whether or not the actual machine identifier received by the remote control device 200 together with the captured image matches with the actual machine identifier of the work machine 40, which is one operation target candidate currently designated by the user through the remote input interface 210 from among a plurality of operation target candidates, the one operation target candidate may be determined, and the determination process may be executed. In addition, the determination process may be executed depending on whether or not the first actual machine information has been acquired by the work machine 40 in a state capable of communicating with the remote operation device 20. When the work machine 40 is in a state capable of being remotely operated by the remote operation device 20 and is actually remotely operated through the remote operation mechanism 211, the determination process may be executed depending on whether or not the first actual machine information has been acquired by the work machine 40.

[0054] If the determination result is negative (FIG. 4 / STEP 212 . . . NO), the remote control device 200 controls the hub so that the captured image as the first actual machine information is not input to the capture board.

[0055] On the other hand, if the determination result is positive (FIG. 4 / STEP 212...YES), the remote control device 200 controls the hub so that the first actual machine information is input to the capture board, and the captured image as the first actual machine information is output to the remote image output device 221 (display device) via the capture board (FIG. 4 / STEP 214). As a result, for example, as shown in FIG. 5, a captured image reflecting the ground spreading in front of the cab 42C, as well as the boom 441 and arm 443 that are part of the working mechanism 44, and piles of rubble or earth and sand in the construction target area (the target of work by the bucket 445) is output to the remote image output device 221. The captured image input to the capture board may be a captured image transmitted from the work machine 40 that has been subjected to processing (such as processing for superimposing symbols, letters, or sign images serving as landmarks on the captured image). Furthermore, the captured image (first actual machine information) output by the remote control device 200 to the remote image output device 221 (FIG. 4 / STEP 214) is determined as a storage target. Specifically, the captured image (first actual machine information) output by the remote control device 200 to the remote image output device 221 via the capture board is at least temporarily stored or stored in the storage device (or a designated area of ​​the memory, etc.) of the remote control device 200, thereby determining the captured image as a storage target. The first actual machine information stored or stored in the storage device may be a recording of the video information output to the remote image output device 221. Then, the captured image (first actual machine information) as a storage target stored or stored in the storage device by the remote control device 200 through the remote wireless communication device 222 is transmitted or uploaded to the external server 10 by the remote control device 200 as the "designated device" (FIG. 4 / STEP 216). At this time, a real machine identifier for identifying the work machine 40 and a remote identifier for identifying the remote operation device 20 may be associated with the captured image and transmitted or uploaded to the external server 10. When the captured image (first actual machine information) is received by the external server 10 (FIG. 4 / C10), the captured image is saved or stored in an information storage resource or database in the cloud (FIG. 4 / STEP 110).

[0056] After that, when a certain period of time has elapsed, the captured image transmitted to the external server 10 is deleted from the storage device of the remote control device 20 (FIG. 4 / STEP 218).

[0057] In the remote operation device 20, the remote control device 200 recognizes the operation mode of the remote operation mechanism 211, and a remote operation command corresponding to the operation mode is transmitted to the work machine 40 via the remote wireless communication device 222 (FIG. 4 / STEP 220).

[0058] In the work machine 40, when the actual machine control device 400 receives a remote operation command via the actual machine wireless communication device 422 (FIG. 4 / C42), the operation of the work mechanism 44 and the like is controlled in accordance with the remote operation command (FIG. 4 / STEP 420). For example, the bucket 445 is used to dig up and scoop up soil in the target construction area in front of the work machine 40, and the upper rotating body 42 is rotated, after which the soil is dumped from the bucket 445 outside the target construction area.

[0059] Furthermore, the actual machine control device 400 acquires the state of the work machine 40 (which may include second actual machine information) based on the output signal of the actual machine sensor group 416, and transmits it to the remote operation device 20 (FIG. 4 / STEP 422). The "second actual machine information" may include at least one parameter value related to the state of the work machine 40, among the current position of the work machine 40, the tilt angle of the upper rotating body 42, the hoisting angle of the boom 441 relative to the upper rotating body 42, the rotation angle of the arm 443 relative to the boom 441, the rotation angle of the bucket 445 relative to the arm 443, the hydraulic oil pressure, and the remaining fuel amount. The "second actual machine information" may include the operation mode of the remote operation mechanism 211 (such as the operation amount or tilt angle of the operation lever constituting the remote operation mechanism 211), a remote operation command according to the operation mode, and / or the operation mode of the operation lever constituting the actual machine operation mechanism 411 controlled according to the remote operation command.

[0060] When the second actual machine information is received by the remote operation device 20 through the remote wireless communication device 222 (FIG. 4 / C22), the remote control device 200 at least temporarily stores or retains the second actual machine information in a storage device (or a designated area of ​​a memory, etc.). Furthermore, the remote control device 200 repeats the process of determining whether or not to store the first actual machine information and subsequent processes (see FIG. 4 / STEP 212 to STEP 220).

[0061] (Action and effect) According to the information system that exerts the above-mentioned function, among the "first actual machine information" acquired by the work machine 40 (operation target) and transmitted to the remote operation device 20, information determined to be unnecessary according to the cooperation state between the remote operation device 20 and the operation target (for example, whether the operation is possible or not) is not input to the capture board by controlling the hub, so that the information is not stored in the remote operation device 20 and is not transmitted to the external server 10, so that the information is not stored in the external server 10 (see FIG. 4 / STEP 212...NO). This reduces the overall information storage capacity of the remote operation device 20 and the external server 10 as the designated devices, and the information communication capacity between the remote operation device 20 and the external server 10, and thus the expansion of the system configuration can be suppressed.

[0062] Furthermore, of the first actual machine information acquired by the work machine 40 (operation target) and then transmitted to the remote operation device 20, the information transmitted from the remote operation device 20 to the external server 10 is deleted from the remote operation device 20 (see FIG. 4 / STEP 216 to STEP 218). This avoids wasteful storage of the same information in both the remote operation device 20 and the external server 10 indefinitely, thereby reducing the information storage capacity and, ultimately, preventing the system configuration from becoming bloated.

[0063] Furthermore, according to the information system that performs the above-mentioned function, when the judgment result of the coordination state between the remote control device 20 and the operation target (for example, whether the operation is possible or not) is negative (FIG. 4 / STEP 212...NO), the "second actual machine information" is not stored in the remote control device 20 and is not transmitted to the external server 10, and therefore is not stored in the external server 10. As a result, the information storage capacity can be reduced, and the expansion of the system configuration can be suppressed.

[0064] (Another embodiment of the present invention) In the above embodiment, the information system is constituted by the remote control device 20, but in other embodiments, it may be constituted by the work machine 40, or may be constituted by a computer (such as the external server 10) separate from the remote control device 20 and the work machine 40. The work machine 40 (operation target) may be operated by an operator aboard the work machine 40 via an actual machine operation mechanism 411.

[0065] In the above embodiment, the information transmitted from the remote control device 20 to the external server 10 among the "second actual machine information" may be deleted from the remote control device 20. This avoids wasteful storage of the same information in both the remote control device 20 and the external server 10 indefinitely, thereby reducing the information storage capacity and thus preventing the system configuration from becoming bloated.

[0066] In the above embodiment, a hub is provided for inputting the image information to the capture board according to the judgment result of the transmitted image information, but in another embodiment, a configuration without a hub may be used. For example, in this configuration, when the first actual machine information is received in the remote operation device 20 through the remote wireless communication device 222, the remote control device 200 saves or retains the first actual machine information at least temporarily in a storage device (or a designated area of ​​memory, etc.) regardless of the cooperation state between the remote operation device 20 and the work machine 40.

[0067] Next, whether or not the first actual machine information needs to be stored is determined according to the state of cooperation between the remote operation device 20 and the work machine 40. If the determination result is negative, the remote control device 200 deletes the captured image as the first actual machine information from the storage device of the remote operation device 20. On the other hand, if the determination result is positive, the remote control device 200 outputs the captured image as the first actual machine information to the remote image output device 221, and the captured image output to the remote image output device 221 (first actual machine information) is determined to be stored. Furthermore, the captured image (first actual machine information) determined as the storage target by the remote control device 200 as the "designated device" is transmitted or uploaded to the external server 10 as the storage target through the remote wireless communication device 222. After that, when a certain time has elapsed, the captured image transmitted to the external server 10 is deleted from the storage device of the remote operation device 20. This configuration also reduces the information storage capacity, and thus can suppress the expansion of the system configuration.

[0068] In the embodiment, the necessity of storing the first actual machine information is determined according to the cooperation state between the remote operation device 20 and the operation target, and the information determined to be unnecessary is not stored in the remote operation device 20 and is not transmitted to the external server 10, so it is not stored in the external server 10 (see FIG. 4 / STEP 212...NO). However, the information determined to be unnecessary may also be transmitted to the external server 10. For example, in this configuration, information including the first actual machine information and the second actual machine information is at least temporarily stored or stored in a storage device (or a designated area of ​​a memory, etc.) regardless of the cooperation state between the remote operation device 20 and the operation target. Also, the necessity of storing the information is determined according to the cooperation state between the remote operation device 20 and the work machine 40, and the captured image (first actual machine information) output to the remote image output device 221 is determined as the object to be stored. Next, the information and the determination result of the necessity of storing the information are transmitted or uploaded to the external server 10 by the remote control device 200 as the "designated device" through the remote wireless communication device 222. Then, when a certain time has passed, a process is executed to continue storing information that is to be stored and that is determined to be necessary among the information transmitted or uploaded by the external server 10, and to delete information that is not to be stored and that is determined to be unnecessary. Also, when a certain time has passed, the information transmitted to the external server 10 is deleted from the storage device of the remote operation device 20. This configuration also reduces the information storage capacity, and thus can prevent the system configuration from becoming bloated.

[0069] In the above embodiment, all of the first actual machine information and the second actual machine information are transmitted or uploaded from the remote control device 20 as the "designated device" to the external server 10, but in another embodiment, part or all of the first actual machine information and the second actual machine information may be directly uploaded to the external server 10 from the work machine 40 as the "designated device" (see Fig. 4 / STEP 410->...->C10). In this case, the information system may be configured by the actual machine control device 400 of the work machine 40, and the actual machine control device 400 may execute a process of determining whether or not the actual machine information needs to be stored (see Fig. 4 / STEP 212), a process of transmitting the actual machine information to the external server 10 (see Fig. 4 / STEP 216), and a process of deleting the actual machine information from the storage device (see Fig. 4 / STEP 218).

[0070] Furthermore, by configuring the external server 10 not to transmit information for which the determination result of whether or not it is necessary to store the first actual machine information according to the cooperation state between the remote operation device 20 and the operation target has become unnecessary, it is possible to prevent information that is not to be stored in the external server 10. Alternatively, information determined to be unnecessary can also be prevented from being stored in the external server 10 by transmitting or uploading information from the work machine 40 to the external server 10 regardless of the cooperation state between the remote operation device 20 and the operation target, transmitting a determination result of whether or not it is necessary to store the information from the information transmitted or uploaded by the external server 10 that has become unnecessary as a result of the determination, and executing a process of deleting information that has become unnecessary as a result of the determination, that is not to be stored.

[0071] In the above embodiment, the first actual machine information and the second actual machine information are transmitted or uploaded to the external server 10, and the captured image is saved or stored in an information storage resource or database in the cloud, but the destination for saving the information may be a large-capacity storage device (such as a hard disk) provided separately from the storage device of the remote control device 200. In this case, the transmission or uploading of the information to the external server 10 may be omitted.

[0072] In the above embodiment, the "operation target" was a work machine 40 (or construction machine), but in other embodiments, the "operation target" may be any equipment that can be remotely controlled and has the ability to acquire and transmit internal information and / or external information, such as an unmanned aerial vehicle, a vehicle, a crane, or other types of construction machine.

[0073] Instead of the remote control device 20 (or the work machine 40) as the designated device, the external server 10 may execute the process of determining whether or not the actual machine information needs to be saved (see FIG. 4 / STEP 212).

[0074] The work machine 40 may be configured to have an automatic driving function, and the remote control device 20 may transmit commands to start, pause and end automatic driving of the work machine 40, and in response to this, the work machine 40 may start, pause and end automatic driving. [Explanation of symbols]

[0075] 10. External Server 20. Remote control device 200 Remote control device (processing device) 210 Remote input interface 211. Remote control mechanism 220 Remote output interface 221 Remote image output device (display device) 222. Remote audio output device 224 Remote radio communication equipment 40. Work machinery 44‥Working mechanism 400... Actual machine control device 410... Actual machine input interface 420... Actual machine output interface

Claims

1. An information system that determines whether or not information acquired by at least one of an operation device as a designated device and an operation target of the operation device needs to be saved, depending on a cooperation state between the operation device and an operation target of the operation device.

2. 2. The information system according to claim 1, the operation target is a work machine, The operating device is a remote operating device for remotely operating the work machine. Information systems.

3. 2. The information system according to claim 1, the cooperation state includes an operable state in which the operation device is capable of operating the operation object, and an inoperable state in which the operation device is unable to operate the operation object, Whether or not the information needs to be stored is determined depending on whether the operation device and the operation target are in the operable state or the inoperable state. Information systems.

4. 2. The information system according to claim 1, According to a cooperation state between the operation device and one operation target candidate determined as the operation target among a plurality of operation target candidates that can be an operation target of the operation device, it is determined whether or not it is necessary to store information acquired by the one operation target candidate as the designated device. Information systems.

5. 2. The information system according to claim 1, The information is stored in a storage device that stores the information. Information systems.

6. 6. The information system according to claim 5, The information transmitted by the communication device to the external server is deleted from the designated device. Information systems.

7. 2. The information system according to claim 1, The information that is determined not to need to be stored is deleted from the designated device. Information systems.

8. 2. The information system according to claim 1, The operation target is equipped with an imaging device that acquires a camera image as the information. Information systems.

9. 9. The information system according to claim 8, The operation device receives the camera image as the information from the operation target. Information systems.

10. 2. The information system of claim 1, The designated device is equipped with a display device for displaying the information. Information systems.

11. a display device that displays image data received from an operation target; and a processing device that determines the image data displayed while the operation object is being operated as an object to be saved. Operating device.

12. a display device that selects and displays image data received from a current operation target, which is one operation target candidate among a plurality of operation target candidates that can be operation targets of the operation device; a processing device that determines, as a storage target, the image data displayed on the display device when the operation target is being operated by the operation device. Operating device.

Citation Information

Patent Citations

  • Vehicular video recorder

    JP2011090645A

  • Operation record analyzing system for construction machine

    JP2021050559A

  • Work machine remote control system and work machine remote control method

    JP2021114757A

  • Remote control support device and remote control support system

    JP2021197714A

  • Remote control system

    JP2013168777A