Information system and operation device

The information system addresses the challenge of managing image data storage in remote work machine control by determining the necessity of saving data based on the cooperation state, reducing unnecessary storage and enhancing system efficiency.

WO2024241712A1PCT designated stage expired Publication Date: 2024-11-28KOBELCO CONSTR MASCH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/013468
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-23
Filing Date
2024-04-01
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Existing information systems for remotely controlling work machines face challenges in managing image data storage, leading to an enlarged system configuration due to the need to save unnecessary data when machines are not being remotely controlled, resulting in increased processing and storage requirements.

Method used

The system determines whether to save image data based on the cooperation state between the operating device and the operating target, only saving data when the machine is being remotely controlled, and using a hub to control the input of captured images to the capture board, thereby reducing unnecessary data storage.

Benefits of technology

This approach reduces the overall information storage capacity and communication bandwidth, suppressing the expansion of the system configuration by avoiding the storage of unnecessary data and ensuring efficient data management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024013468_28112024_PF_FP_ABST
    Figure JP2024013468_28112024_PF_FP_ABST
Patent Text Reader

Abstract

This information system determines whether it is necessary to store information acquired by at least one of an operation device, which serves as a specification device, and an operation target of the operation device according to the state of cooperation between the operation device and the operation target.
Need to check novelty before this filing date? Find Prior Art

Description

Information Systems and Operating Devices

[0001] The present invention relates to an information system and an operation device.

[0002] In a system for remotely controlling a work machine, a video signal captured by a camera installed on the work machine is transmitted via a network and displayed on a monitor device in a remote control device (control room) installed in a remote location (see, for example, Patent Document 1).

[0003] JP 2013-168777 A

[0004] A system is desired that stores image data displayed on the monitor device of the remote control device as operation history information of the work machine and that allows the stored image data to be referenced.

[0005] However, if image data is saved even when the work machine is not being remotely operated by the operator of the remote control device, it will be necessary to save image data that is not necessary and that shows the situation when the work machine is not being remotely operated, which will result in the system configuration becoming larger.

[0006] Furthermore, if there are multiple work machines to be operated by a remote control device, saving all image data corresponding to the multiple work machines would require processing to save not only image data corresponding to remotely controlled work machines, but also image data corresponding to work machines that are not remotely controlled, which would result in an expansion of the system configuration.

[0007] An object of the present invention is to provide an information system and an operation device that can prevent the system configuration from becoming bloated.

[0008] The information system according to the present invention determines whether or not information acquired by at least one of the operation device as a designated device and the operation target needs to be saved, depending on the state of cooperation between the operation device and the operation target of the operation device.

[0009] The concept of "obtaining" information includes obtaining (detecting / measuring) the information using a sensor or the like, and receiving the information using a communication device. Whether or not information that is primarily obtained by a first designated device and secondarily obtained (or received) from the first designated device needs to be stored in the second designated device and / or an external device may be determined, and whether or not information that is primarily obtained by the first designated device needs to be stored in the first designated device and / or an external device may also be determined.

[0010] An operating device according to a first aspect of the present invention includes a display device that displays image data received from an operating object, and a processing device that determines the image data displayed while the operating object is being operated as an object to be saved.

[0011] An operation device according to a second aspect of the present invention includes a display device that selects and displays image data received from a current operation target, which is one of a plurality of operation target candidates that can be operated by the operation device, and a processing device that determines the image data displayed on the display device as an object to be saved when the operation target is being operated by the operation device.

[0012] Fig. 1 is an explanatory diagram relating to the configuration of the information system. Fig. 2 is an explanatory diagram relating to the configuration of the remote control device. Fig. 3 is an explanatory diagram relating to the configuration of the work machine. Fig. 4 is an explanatory diagram relating to the functions of the information system. Fig. 5 is an explanatory diagram relating to a work environment image.

[0013] (Configuration of information system) Fig. 1 is an explanatory diagram relating to the configuration of an information system. Fig. 2 is an explanatory diagram relating to the configuration of a remote control device. Fig. 3 is an explanatory diagram relating to the configuration of a work machine. The information system according to one embodiment of the present invention shown in Fig. 1 is made up of a remote control device 20 (operation device) configured to be able to communicate with both an external server 10 and a work machine 40 (operation target) via a network. Note that the information system may include at least one of the external server 10 and the work machine 40 (operation target).

[0014] 1, the remote control device 20 includes a remote control device 200 (processing device), a remote input interface 210, and a remote output interface 220. The remote control device 200 is configured with an arithmetic processing device (a single-core processor or a multi-core processor or processor cores constituting the same), reads necessary data and software from a storage device such as a memory, and executes arithmetic processing on the data in accordance with the software.

[0015] The remote input interface 210 includes a remote control mechanism 211. The remote output interface 220 includes a remote image output device 221 (display device) and a remote wireless communication device 222.

[0016] The remote operation mechanism 211 includes a travel operation device, a swing operation device, a boom operation device, an arm operation device, and a bucket operation device. Each operation device has an operation lever that is rotated. The operation lever (travel lever) of the travel operation device is operated to move the undercarriage 41 of the work machine 40. The travel lever may also serve as a travel pedal. For example, a travel pedal may be provided that is fixed to the base or lower end of the travel lever. The operation lever (swing lever) of the swing operation device is operated to operate the hydraulic swing motor that constitutes the swing mechanism 43 of the work machine 40. The operation lever (boom lever) of the boom operation device is operated to operate the boom cylinder 442 of the work machine 40. The operation lever (arm lever) of the arm operation device is operated to operate the arm cylinder 444 of the work machine 40. The operation lever (bucket lever) of the bucket operation device is operated to operate the bucket cylinder 446 of the work machine 40.

[0017] The operation levers constituting the remote control mechanism 211 are arranged around a seat St for the operator to sit on, as shown in Fig. 2. The seat St is in the form of a high-back chair with armrests, but may be in the form of a low-back chair without a headrest, a chair without a backrest, or any other seating configuration that allows the operator to sit on it.

[0018] Left and right travel levers 2110 corresponding to the left and right crawlers are arranged side by side in front of the seat St. One operating lever may serve as multiple operating levers. For example, the left operating lever 2111 provided in front of the left frame of the seat St shown in FIG. 2 may function as an arm lever when operated in the forward / backward direction and as a swing lever when operated in the left / right direction. Similarly, the right operating lever 2112 provided in front of the right frame of the seat St shown in FIG. 2 may function as a boom lever when operated in the forward / backward direction and as a bucket lever when operated in the left / right direction. The lever pattern may be changed as desired by an operator's operating command.

[0019] The remote image output device 221 is composed of a single or multiple image output devices. The remote image output device 221 includes a capture board (output processing device) that outputs input video information to the screen of the image output device, and a hub (relay device) that inputs video information to the capture board depending on the assessment result of the transmitted video information. In this embodiment, depending on the assessment result of the first actual machine information transmitted from the work machine 40 as video information, a captured image as the first actual machine information is input to the capture board via the hub (details will be described later). For example, as shown in FIG. 2 , the remote image output device 221 is composed of a central remote image output device 2210, a left remote image output device 2211, and a right remote image output device 2212, each having a substantially rectangular screen and arranged in front of, diagonally forward left of, and diagonally forward right of the seat St. The shapes and sizes of the screens (image display areas) of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be the same or different. The remote image output device 221 may be configured by a single curved or bendable image output device, or by two or four or more image output devices arranged to surround the front of the sheet St.

[0020] As shown in Fig. 2, the right edge of the left remote image output device 2211 is adjacent to the left edge of the central remote image output device 2210 so that the screens of the central remote image output device 2210 and the left remote image output device 2211 form an inclination angle θ1 (e.g., 120°≦θ1≦150°). As shown in Fig. 2, the left edge of the right remote image output device 2212 is adjacent to the right edge of the central remote image output device 2210 so that the screens of the central remote image output device 2210 and the right remote image output device 2212 form an inclination angle θ2 (e.g., 120°≦θ2≦150°). The inclination angles θ1 and θ2 may be the same or different.

[0021] The screens of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be parallel to the vertical direction or may be tilted relative to the vertical direction. At least one of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be composed of multiple divided image output devices. For example, the central remote image output device 2210 may be composed of adjacent image output devices above and below, each having a substantially rectangular screen.

[0022] 1, the work machine 40 is equipped with an actual machine control device 400, an actual machine input interface 410, an actual machine output interface 420, and an actual machine wireless communication device 422. Each of the components of the actual machine control device 400 is made up of an arithmetic processing device (a single-core processor or a multi-core processor or a processor core that makes up such a processor), which reads the necessary data and software from a storage device such as memory, and executes arithmetic processing on the data in accordance with the software.

[0023] The work machine 40 is, for example, a crawler excavator (construction machine), and as shown in Figure 3, includes a crawler-type lower traveling body 41 and an upper rotating body 42 that is rotatably mounted on the lower traveling body 41 via a rotating mechanism 43. A cab 42C (operator's compartment) is provided on the front left side of the upper rotating body 42. A work mechanism 44 is provided in the front center of the upper rotating body 42.

[0024] The actual machine input interface 410 includes an actual machine operation mechanism 411, an actual machine imaging device 412, an actual machine positioning device 414, and an actual machine sensor group 416. The actual machine operation mechanism 411 includes multiple control levers arranged around a seat inside the cab 42C in the same manner as the remote control mechanism 211. A drive mechanism or robot is provided in the cab 42C that receives signals corresponding to the operation mode of the remote control levers and moves the actual machine control levers based on the received signals. The actual machine imaging device 412 is installed, for example, inside the cab 42C and captures images of the environment including at least a portion of the work mechanism 44 through the front window and left and right side windows. Some or all of the front window and side windows may be omitted. The actual machine positioning device 414 is configured with a GPS or GNSS and, if necessary, a gyro sensor, etc., and measures the position (latitude and longitude) of the work machine 40.

[0025] The actual machine sensor group 416 is configured to output signals to the actual machine control device 400 according to the values ​​of parameters relating to the state of the work machine 40, such as the elevation angle of the boom 441 relative to the upper rotating body 42, the rotation angle of the arm 443 relative to the boom 441, the rotation angle of the bucket 445 relative to the arm 443, the hydraulic oil pressure, and the remaining fuel amount.

[0026] 3, the working mechanism 44 includes a boom 441 that is mounted on the upper rotating body 42 so that it can be raised and lowered, an arm 443 that is rotatably connected to the tip of the boom 441, and a bucket 445 (tip attachment) that is rotatably connected to the tip of the arm 443. The working mechanism 44 is equipped with a boom cylinder 442, an arm cylinder 444, and a bucket cylinder 446, each of which is made up of extendable and retractable hydraulic cylinders.

[0027] The boom cylinder 442 is interposed between the boom 441 and the upper rotating body 42 so as to extend and retract by receiving a supply of hydraulic oil to rotate the boom 441 in the hoisting direction. The arm cylinder 444 is interposed between the arm 443 and the boom 441 so as to extend and retract by receiving a supply of hydraulic oil to rotate the arm 443 about a horizontal axis relative to the boom 441. The bucket cylinder 446 is interposed between the bucket 445 and the arm 443 so as to extend and retract by receiving a supply of hydraulic oil to rotate the bucket 445 about a horizontal axis relative to the arm 443.

[0028] (Functions) Fig. 4 is an explanatory diagram relating to the functions of the information system. Fig. 5 is an explanatory diagram relating to work environment images. The functions of the construction support device and imaging function control system configured as described above will be explained using the flowchart shown in Fig. 4. In the flowchart, a block labeled "C (number)" is used for the sake of simplicity, and represents the transmission and / or reception of data, and represents a conditional branch in which processing in a branching direction is executed on the condition that the data is transmitted and / or received.

[0029] In the remote operation device 20, the remote control device 200 transmits a designation signal to the work machine 40 via the remote wireless communication device 222 (STEP 210 in FIG. 4 ). When multiple work machines 40 are multiple operation target candidates, a designation signal may be transmitted to each of the multiple work machines 40. A determination may be made as to whether or not the operator has performed a designation operation via the remote input interface 210, and if the determination result is positive, a designation signal may be transmitted. A "designation operation" is, for example, an operation such as tapping on the remote input interface 210 for the operator to designate the work machine 40 that he or she intends to remotely operate.

[0030] When a designation signal is received by the work machine 40 via the actual machine wireless communication device 422 (C40 in FIG. 4), the actual machine control device 400 transmits a captured image (camera image, which may have been subjected to appropriate image processing) acquired via the actual machine imaging device 412 as "first actual machine information" to the remote operation device 20 (STEP 410 in FIG. 4). The captured image (or captured image data) may be the captured image itself, or image data representing a simulated environmental image generated based on the captured image.

[0031] When the remote operation device 20 receives the first actual machine information via the remote wireless communication device 222 (C21 in FIG. 4), the remote control device 200 determines whether or not it is necessary to save the first actual machine information, depending on the cooperation status between the remote operation device 20 and the work machine 40 (STEP 212 in FIG. 4). For example, the remote control device 200 executes this determination process depending on whether or not the captured image as the first actual machine information has been acquired by the current operation target (one operation target candidate) that is in a state where it can be remotely operated by the remote operation device 20.

[0032] The one operation target candidate may be determined, and the determination process may be executed, depending on whether the actual machine identifier received by the remote control device 200 together with the captured image matches the actual machine identifier of the work machine 40 that is the one operation target candidate currently designated by the user from among a plurality of operation target candidates via the remote input interface 210. Alternatively, the determination process may be executed depending on whether first actual machine information has been acquired by a work machine 40 that is in a state capable of communicating with the remote operation device 20. When the work machine 40 is in a state capable of being remotely operated by the remote operation device 20 and is actually remotely operated via the remote operation mechanism 211, the determination process may be executed depending on whether first actual machine information has been acquired by the work machine 40.

[0033] If the determination result is negative (NO in STEP 212 in FIG. 4), the remote control device 200 controls the hub so that the captured image as the first actual machine information is not input to the capture board.

[0034] On the other hand, if the determination result is positive (YES in STEP 212 in FIG. 4 ), the remote control device 200 controls the hub so that the first actual machine information is input to the capture board, and the captured image as the first actual machine information is output to the remote image output device 221 (display device) via the capture board (STEP 214 in FIG. 4 ). As a result, for example, as shown in FIG. 5 , a captured image that reflects the ground spreading out in front of the cab 42C, as well as the boom 441 and arm 443 that are part of the work mechanism 44, and piles of rubble or earth and sand in the construction target area (the target of work by the bucket 445), is output to the remote image output device 221. The captured image input to the capture board may be a captured image transmitted from the work machine 40 that has been processed (such as a process of superimposing symbols, letters, or a sign image that serves as a landmark on the captured image).

[0035] Furthermore, the captured image (first actual machine information) output by the remote control device 200 to the remote image output device 221 (STEP 214 in FIG. 4 ) is determined as the image to be saved. Specifically, the captured image (first actual machine information) output by the remote control device 200 to the remote image output device 221 via the capture board is at least temporarily saved or stored in a storage device (or a designated area of ​​memory, etc.) of the remote control device 200, thereby determining the image as the image to be saved. The first actual machine information saved or stored in the storage device may be a recording of the video information output to the remote image output device 221. Then, the captured image (first actual machine information) to be saved, saved or stored in the storage device by the remote control device 200 via the remote wireless communication device 222, is transmitted or uploaded to the external server 10 by the remote control device 200 as the "designated device" (STEP 216 in FIG. 4 ). At this time, an actual machine identifier for identifying the work machine 40 and a remote identifier for identifying the remote operation device 20 may be associated with the captured image and transmitted or uploaded to the external server 10. When the captured image (first actual machine information) is received by the external server 10 (C10 in FIG. 4), the captured image is saved or stored in an information storage resource or database in the cloud (STEP 100 in FIG. 4).

[0036] After that, when a certain period of time has elapsed, the captured image transmitted to the external server 10 is deleted from the storage device of the remote control device 20 (STEP 218 in FIG. 4).

[0037] In the remote operation device 20, the remote control device 200 recognizes the operation mode of the remote operation mechanism 211, and transmits a remote operation command corresponding to the operation mode to the work machine 40 via the remote wireless communication device 222 (STEP 220 in FIG. 4).

[0038] When the actual machine control device 400 of the work machine 40 receives a remote operation command via the actual machine wireless communication device 422 (C42 in FIG. 4), the operation of the work mechanism 44 and the like is controlled in accordance with the remote operation command (STEP 420 in FIG. 4). For example, the bucket 445 is used to dig up and scoop up soil in the construction area in front of the work machine 40, and the upper rotating body 42 is then rotated, after which the soil is dropped from the bucket 445 outside the construction area.

[0039] Furthermore, the actual machine control device 400 acquires the state of the work machine 40 (which may include second actual machine information) based on the output signals of the actual machine sensor group 416, and transmits this to the remote operation device 20 (STEP 422 in FIG. 4 ). The "second actual machine information" may include the value of at least one parameter related to the state of the work machine 40, from among the current position of the work machine 40, the tilt angle of the upper rotating body 42, the hoisting angle of the boom 441 relative to the upper rotating body 42, the rotation angle of the arm 443 relative to the boom 441, the rotation angle of the bucket 445 relative to the arm 443, the hydraulic oil pressure, and the remaining fuel amount. The "second actual machine information" may include the operation mode of the remote operation mechanism 211 (such as the operation amount or tilt angle of the operation levers that constitute the remote operation mechanism 211), a remote operation command corresponding to the operation mode, and / or the operating mode of the operation levers and the like that constitute the actual machine operation mechanism 411 that are controlled in accordance with the remote operation command.

[0040] When the remote control device 20 receives the second actual machine information through the remote wireless communication device 222 (C22 in FIG. 4), the remote control device 200 at least temporarily saves or stores the second actual machine information in a storage device (or a designated area in memory, etc.). Furthermore, the remote control device 200 repeats the process from the process of determining whether or not to save the first actual machine information onward (see STEPs 212 to 220 in FIG. 4).

[0041] (Effects) According to the information system that performs the above functions, the hub is controlled so that information that is determined to be unnecessary depending on the cooperation state between the remote control device 20 and the operation target (for example, whether the state is operable or inoperable) out of the "first actual machine information" acquired by the work machine 40 (operation target) and then transmitted to the remote control device 20 is not input to the capture board, and therefore is not stored in the remote control device 20 and is not transmitted to the external server 10, and is therefore not stored in the external server 10 (NO in STEP 212 in FIG. 4 ). This reduces the overall information storage capacity of the remote control device 20 and the external server 10 as designated devices, and the information communication capacity between the remote control device 20 and the external server 10, and ultimately can prevent the system configuration from becoming bloated.

[0042] Furthermore, of the first actual machine information acquired by the work machine 40 (operation target) and then transmitted to the remote operation device 20, the information transmitted from the remote operation device 20 to the external server 10 is deleted from the remote operation device 20 (see STEP 216 to STEP 218 in FIG. 4 ). This avoids the waste of unlimitedly storing the same information in both the remote operation device 20 and the external server 10, thereby reducing the information storage capacity and, ultimately, preventing the system configuration from becoming bloated.

[0043] Furthermore, according to the information system that performs the above function, if the judgment result of the collaboration state between the remote control device 20 and the operation target (for example, whether the state is operable or inoperable) is negative (NO in STEP 212 of Figure 4), the "second actual machine information" is not stored in the remote control device 20 and is not transmitted to the external server 10, and therefore is not stored in the external server 10.As a result, the information storage capacity can be reduced, and ultimately the expansion of the system configuration can be suppressed.

[0044] (Other Embodiments of the Present Invention) In the above embodiment, the information system was configured by the remote control device 20, but in other embodiments it may be configured by the work machine 40, or may be configured by a computer (external server 10, etc.) separate from the remote control device 20 and the work machine 40. The work machine 40 (object to be operated) may be operated as a real machine by an operator on board the work machine 40 via a real machine operating mechanism 411.

[0045] In the above embodiment, the information transmitted from the remote control device 20 to the external server 10 among the "second actual machine information" may be configured to be deleted from the remote control device 20. This avoids wasteful storage of the same information in both the remote control device 20 and the external server 10, thereby reducing the information storage capacity and ultimately suppressing the expansion of the system configuration.

[0046] In the above embodiment, a hub was provided that inputs video information to a capture board in accordance with the judgment result of the transmitted video information, but in another embodiment, a configuration may be adopted in which a hub is not provided. For example, in this configuration, when the remote operation device 20 receives first actual machine information via the remote wireless communication device 222, the remote control device 200 saves or stores the first actual machine information at least temporarily in a storage device (or a designated area of ​​memory, etc.) regardless of the cooperation status between the remote operation device 20 and the work machine 40.

[0047] Next, a determination is made as to whether or not the first actual machine information needs to be saved, depending on the state of cooperation between the remote operation device 20 and the work machine 40. If the determination result is negative, the remote control device 200 deletes the captured image as the first actual machine information from the storage device of the remote operation device 20. On the other hand, if the determination result is positive, the remote control device 200 outputs the captured image as the first actual machine information to the remote image output device 221, and the captured image output to the remote image output device 221 (first actual machine information) is determined to be saved.

[0048] Furthermore, the remote control device 200 as the "designated device" transmits or uploads the captured image (first actual device information) determined to be stored to the external server 10 via the remote wireless communication device 222. After that, when a certain period of time has elapsed, the captured image transmitted to the external server 10 is deleted from the storage device of the remote control device 20. This configuration also reduces the information storage capacity, and ultimately prevents the system configuration from becoming bloated.

[0049] In the above embodiment, a determination is made as to whether or not the first actual machine information needs to be saved depending on the cooperation status between the remote operation device 20 and the operation target, and information determined to be unnecessary is not saved in the remote operation device 20 and is not transmitted to the external server 10, and is therefore not saved on the external server 10 (NO in STEP 212 in FIG. 4 ). However, a configuration may also be adopted in which information determined to be unnecessary is also sent to the external server 10. For example, in this configuration, information including the first actual machine information and the second actual machine information is at least temporarily saved or stored in a storage device (or a designated area of ​​memory, etc.) regardless of the cooperation status between the remote operation device 20 and the operation target. Furthermore, a determination is made as to whether or not the information needs to be saved depending on the cooperation status between the remote operation device 20 and the operation target, and the captured image (first actual machine information) output to the remote image output device 221 is determined to be saved. Next, the remote control device 200, as the "designated device," transmits or uploads the information and the determination result as to whether or not the information needs to be saved to the external server 10 via the remote wireless communication device 222. Then, after a certain period of time has elapsed, a process is executed to continue storing information that has been transmitted or uploaded by the external server 10 and that is to be stored because the determination result is necessary, and to delete information that has not been stored because the determination result is no longer necessary. Also, after a certain period of time has elapsed, the information transmitted to the external server 10 is deleted from the storage device of the remote operation device 20. This configuration also reduces the amount of information storage required, and ultimately prevents the system configuration from becoming bloated.

[0050] In the above embodiment, all of the first actual machine information and second actual machine information were transmitted or uploaded from the remote control device 20 as the "designated device" to the external server 10, but in another embodiment, some or all of the first actual machine information and second actual machine information may be uploaded directly to the external server 10 from the work machine 40 as the "designated device" (see STEPs 410 to C10 in Figure 4). In this case, the information system may be configured by the actual machine control device 400 of the work machine 40, and the actual machine control device 400 may execute a process for determining whether or not the actual machine information needs to be saved (see STEP 212 in Figure 4), a process for transmitting the actual machine information to the external server 10 (see STEP 216 in Figure 4), and a process for deleting the actual machine information from the storage device (see STEP 218 in Figure 4).

[0051] Furthermore, by configuring the system so that information that has been determined as unnecessary as a result of a determination as to whether or not it is necessary to store the first actual machine information in accordance with the cooperation status between the remote control device 20 and the operation target is not transmitted to the external server 10, it is possible to prevent information that is not to be stored from being stored on the external server 10. Alternatively, information that has been determined as unnecessary can also be prevented from being stored on the external server 10 by configuring the system so that information is transmitted or uploaded from the work machine 40 to the external server 10 regardless of the cooperation status between the remote control device 20 and the operation target, and the system so that the remote control device 20 or the work machine 40 transmits a determination as to whether or not the information needs to be stored to the external server 10, and processing is executed so that, after a certain period of time has elapsed, information that has been transmitted or uploaded by the external server 10 and that is to be stored as determined as needing to be stored as a result of the determination is continued to be stored, and information that has not been determined as unnecessary as a result of the determination is deleted.

[0052] In the above embodiment, the first actual machine information and the second actual machine information are transmitted or uploaded to the external server 10, and the captured images are saved or stored in an information storage resource or database in the cloud, but the destination for saving the information may be a large-capacity storage device (such as a hard disk) provided separately from the storage device of the remote control device 200. In this case, the transmission or uploading of the information to the external server 10 may be omitted.

[0053] In the above embodiment, the "operation target" was a work machine 40 (or construction machine), but in other embodiments, the "operation target" may be any equipment that can be remotely controlled and has the function of acquiring and transmitting internal information and / or external information, such as an unmanned aerial vehicle, a crane, or other types of construction machine.

[0054] The process of determining whether or not actual machine information needs to be saved (see STEP 212 in FIG. 4) may be executed by the external server 10 instead of the remote control device 20 (or the work machine 40) as the designated device.

[0055] The work machine 40 may have an automatic driving function, and the remote control device 20 may be configured to send commands to start, pause and end automatic driving of the work machine 40, and in response to these commands, the work machine 40 may start, pause and end automatic driving.

[0056] An information system according to a first aspect of the present invention determines whether or not information acquired by at least one of an operation device as a designated device and an operation target of the operation device needs to be saved, depending on the state of cooperation between the operation device and an operation target of the operation device.

[0057] According to the information system having such a configuration, among the information acquired by a designated device that is at least one of the operation device and the operation target of the operation device, information that is determined to be unnecessary depending on the cooperation state between the operation device and the operation target is not stored in the designated device, etc. This reduces the information storage capacity in the designated device, etc., and ultimately can prevent the system configuration from becoming bloated.

[0058] The concept of "obtaining" information includes obtaining (detecting / measuring) the information using a sensor or the like, and receiving the information using a communication device. Whether or not information that is primarily obtained by a first designated device and secondarily obtained (or received) from the first designated device needs to be stored in the second designated device and / or an external device may be determined, and whether or not information that is primarily obtained by the first designated device needs to be stored in the first designated device and / or an external device may also be determined.

[0059] An information system according to a second aspect of the present invention is the information system according to the first aspect, wherein the operation target is a work machine, and the operation device is a remote operation device for remotely operating the work machine.

[0060] According to an information system with this configuration, of the information acquired by the designated device, which is at least one of the work machine to be operated and the remote control device, which is the operating device, information that is determined to be unnecessary based on the state of cooperation between the remote control device and the work machine is not stored in the designated device, etc. This reduces the information storage capacity in the designated device, etc., and ultimately prevents the system configuration from becoming bloated.

[0061] An information system according to a third aspect of the present invention is an information system according to the first or second aspect, wherein the linked state includes an operable state in which the operating device is able to operate the operation target, and an inoperable state in which the operating device is unable to operate the operation target, and it is preferable that the need to save the information is determined depending on whether the operating device and the operation target are in the operable state or the inoperable state.

[0062] According to the information system having such a configuration, among the information acquired by the designated device, which is at least one of the operation device and the operation target of the operation device, information determined to be unnecessary depending on whether the operation target is in an "operable state" or an "inoperable state" by the operation device is not stored in the designated device, etc. This reduces the amount of information storage required, and ultimately prevents the system configuration from becoming bloated.

[0063] In the information system according to a fourth aspect of the present invention, in the information systems according to the first to third aspects, it is preferable that the information system determines whether or not it is necessary to store information acquired by one operation target candidate as the designated device, depending on the state of cooperation between the operation device and one operation target candidate determined as the operation target from among a plurality of operation target candidates that can be operated by the operation device.

[0064] According to the information system having this configuration, it is determined whether or not to store information acquired by one operation target candidate as a designated device that has been determined as an operation target, among information acquired by multiple operation target candidates. Therefore, in addition to the information storage capacity of the designated device, etc., as described above, it is possible to reduce the information processing capacity required to determine whether or not to store each piece of information acquired by multiple operation target candidates, and ultimately to suppress the expansion of the system configuration.

[0065] An information system according to a fifth aspect of the present invention is preferably the information system according to the first to fourth aspects, further comprising a communication device that transmits information determined to require storage to an external server.

[0066] According to the information system having this configuration, among the information acquired by the designated device, which is at least one of the operation device and the operation target of the operation device, information that is determined not to need to be saved based on the cooperation state between the operation device and the operation target is not transmitted to the external server, and is not saved in the external server. This reduces the information communication capacity between the designated device and the external server, as well as the information storage capacity of the external server, and thus can prevent the system configuration from becoming bloated.

[0067] An information system according to a sixth aspect of the present invention is the information system according to the fifth aspect, wherein the information transmitted by the communication device to the external server is preferably deleted from the designated device.

[0068] According to the information system having this configuration, among the information acquired by the designated device, information transmitted from the communication device to the external server is deleted from the designated device. This avoids the waste of unlimited storage of the same information in both the designated device and the external server, thereby reducing the overall information storage capacity of the designated device and the external server and ultimately suppressing the expansion of the system configuration.

[0069] An information system according to a seventh aspect of the present invention is any of the information systems according to the first to sixth aspects, and preferably deletes information determined not to need to be saved from the designated device.

[0070] According to the information system having this configuration, information acquired by a designated device that is determined not to need to be stored is deleted from the designated device. This avoids the waste of unlimited storage of unnecessary information in the designated device, thereby reducing the information storage capacity of the designated device and ultimately preventing the system configuration from becoming bloated.

[0071] An information system according to an eighth aspect of the present invention is any of the information systems according to the first to seventh aspects, wherein the operation target includes an imaging device that acquires a camera image as the information.

[0072] According to the information system having this configuration, when an operation target corresponds to a designated device, among the camera images acquired by the operation target through the imaging device, camera images determined to be unnecessary based on the cooperation status between the operation device and the operation target are not stored in the operation target, thereby reducing the information storage capacity of the designated device and thereby suppressing the expansion of the system configuration.

[0073] An information system according to a ninth aspect of the present invention is the information system according to the eighth aspect, wherein the operation device preferably receives a camera image as the information from the operation target.

[0074] According to the information system having this configuration, when the operation device corresponds to the designated device, among the camera images acquired by the operation target through the imaging device and received by the operation device from the operation target, camera images determined to be unnecessary based on the cooperation status between the operation device and the operation target are not stored in the operation device, thereby reducing the information storage capacity of the designated device and ultimately suppressing the expansion of the system configuration.

[0075] An information system according to a tenth aspect of the present invention is the information system according to any one of the first to ninth aspects, wherein the designated device preferably includes a display device that displays the information.

[0076] According to the information system having this configuration, information acquired by the designated device is displayed on the display device of the designated device. In this case, information determined to be unnecessary based on the state of cooperation between the operation device and the operation target is not stored in the designated device, etc. This reduces the information storage capacity of the designated device, etc., and ultimately prevents the system configuration from becoming bloated.

[0077] An operating device according to an eleventh aspect of the present invention includes a display device that displays image data received from an operating object, and a processing device that determines the image data displayed while the operating object is being operated as an object to be saved.

[0078] With the control device having this configuration, when the control target is not being operated, image data received from the control target and displayed on the display device is not determined as data to be saved, which reduces the information storage capacity of the control device and ultimately prevents the system configuration from becoming bloated.

[0079] An operation device according to a twelfth aspect of the present invention includes a display device that selects and displays image data received from a current operation target, which is one of a plurality of operation target candidates that can be operated by the operation device, and a processing device that determines the image data displayed on the display device as an object to be saved when the operation target is being operated by the operation device.

[0080] According to the operation device having this configuration, when one of the multiple operation target candidates, which is the current operation target, is not being operated, image data received from the operation target and displayed on the display device is not determined to be saved, which reduces the information storage capacity of the operation device and can ultimately prevent the system configuration from becoming bloated.

Claims

1. An information system that determines whether or not information acquired by at least one of an operating device and an operation target as a designated device needs to be saved, depending on the state of cooperation between the operating device and the operation target of the operating device.

2. An information system according to claim 1, wherein the operation target is a work machine, and the operation device is a remote operation device for remotely operating the work machine.

3. An information system as described in claim 1, wherein the linked state includes an operable state in which the operating device is capable of operating the operation target, and an inoperable state in which the operating device is unable to operate the operation target, and the information system determines whether or not the information needs to be saved depending on whether the operating device and the operation target are in the operable state or the inoperable state.

4. An information system as described in claim 1, which determines whether or not it is necessary to store information acquired by one operation target candidate as the designated device, depending on the state of cooperation between the operation device and one operation target candidate determined as the operation target from among a plurality of operation target candidates that can be operated by the operation device.

5. An information system according to claim 1, further comprising a communication device for transmitting information determined to require storage to an external server.

6. An information system according to claim 5, wherein the information transmitted by the communication device to the external server is deleted from the designated device.

7. An information system according to claim 1, wherein information determined not to need to be stored is deleted from the designated device.

8. An information system according to claim 1, wherein the operation target is provided with an imaging device that acquires camera images as the information.

9. An information system according to claim 8, wherein the operation device receives the camera image as the information from the object to be operated.

10. An information system according to claim 1, wherein the designated device is provided with a display device for displaying the information.

11. An operating device comprising: a display device that displays image data received from an operation object; and a processing device that determines the image data displayed while the operation object is being operated as an object to be saved.

12. An operating device comprising: a display device that selects and displays image data received from a current operating target, which is one of a plurality of operating target candidates that can be operated by the operating device; and a processing device that determines the image data displayed on the display device as an object to be saved when the operating target is being operated by the operating device.

Citation Information

Patent Citations

  • Remote control system

    JP2013168777A

  • Medical information system

    JP2005135344A

  • Operation record analyzing system for construction machine

    JP2021050559A

  • Remote control support device and remote control support system

    JP2021197714A

  • Medical image learning method and medical image processing device

    JP2023019756A