Information system and operation device

The system addresses communication quality issues in remote information systems by controlling image data transmission during concurrent operations, maintaining bandwidth and reducing latency through designated communication management.

JP2024168055APending Publication Date: 2024-12-05KOBELCO CONSTR MASCH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023084448
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing remote information systems face communication quality deterioration due to simultaneous image data transmission and other designated communication, leading to excessive bandwidth limitations.

Method used

Implementing a designated communication control process that suspends or reduces image data transmission when other communication is occurring, accumulating data until designated communication ends, and then resuming transmission at optimal speed.

Benefits of technology

Prevents excessive bandwidth restriction and maintains communication quality by managing image data transmission during concurrent operations, ensuring smooth data transfer and reduced latency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168055000001_ABST
    Figure 2024168055000001_ABST
Patent Text Reader

Abstract

To provide an information system and an operation device that suppress reduction in communication quality.SOLUTION: When there exists designation communication (communication other than transmission of imaged picture data from a remote operation device 20 to an external server 10) between the remote operation device 20 and the external server 10, the transmission of the imaged picture is suspended or speed of the transmission is reduced. Thereby, a situation in which channel capacity for the designation communication is excessively limited by the transmission of the imaged picture data is avoided. As a result, reduction in communication quality of the designation communication and the transmission of the imaged picture data can be suppressed.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information system including a display device that displays image data received from an operation target operated by an operation device, and a communication device that transmits the image data to an external server. [Background technology]

[0002] According to a remote information system for remotely operating a work machine, a video signal captured by a camera mounted on the work machine is transmitted via a line network and displayed on a monitor device of a remote operation device (control room) installed in a remote location (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-168777 A Summary of the Invention [Problem to be solved by the invention]

[0004] A system is desired that can store image data displayed on a monitor device of a remote control device as operation history information of a work machine and can refer to the stored image data. It is assumed that the image data will be stored in an external server of the remote control device that can be accessed online.

[0005] However, uploading image data to a server puts strain on the line, which can result in communication delays or slower response times, or other degradation in communication quality for other uses when the line is used for purposes other than uploading image data.

[0006] Therefore, an object of the present invention is to provide an information system and an operation device that suppress deterioration of communication quality. [Means for solving the problem]

[0007] The information system of the present invention comprises: When there is designated communication other than the transmission of image data acquired by a designated device between an external server and a designated device which is at least one of an operating device and an operating target operated by the operating device, a designated communication control process is executed to suspend the transmission of the image data by the designated device or to reduce the transmission speed of the image data.

[0008] According to the information system having the above configuration, when there is designated communication (communication other than image data transmission from the designated device to the external server) between the designated device, which is at least one of the operation device and the operation target operated by the operation device, and the external server, the transmission of the image data is suspended or the transmission speed is reduced. This makes it possible to avoid a situation in which the information communication capacity between the designated device and the external server is excessively restricted due to the simultaneous execution of the transmission of image data and the designated communication, and thus to suppress a decrease in the communication quality of the transmission of the image data and the designated communication.

[0009] The concept of "obtaining" image data includes obtaining the image data using an imaging device and receiving the image data using a communication device. In addition to controlling communication between a second designated device and an external server for image data that is primarily obtained by a first designated device and secondarily obtained (or received) by a second designated device from the first designated device, communication between the first designated device and an external server for information primarily obtained by the first designated device may also be controlled.

[0010] In the information system having the above configuration, the operation target is a work machine, The operation device is a remote operation device for remotely operating the work machine. It is preferable.

[0011] According to the information system having this configuration, when there is designated communication (communication from the remote control device for remotely controlling the work machine to the external server other than the transmission of image data acquired by the work machine) between the remote control device for remotely controlling the work machine and the external server, the transmission of the image data is put on hold or the transmission speed is reduced. This avoids a situation in which the communication capacity of both is excessively restricted due to the simultaneous execution of the transmission of image data and the designated communication, and thus can suppress a decrease in the communication quality of the transmission of the image data and the designated communication.

[0012] In the information system having the above configuration, The designated device acquires a camera image acquired by an imaging device of the operation target as the image data. It is preferred.

[0013] According to the information system of this configuration, when there is designated communication (communication from the designated device to the external server other than the transmission of image data acquired through the imaging device as the operation target) between the designated device and the external server, the transmission of the image data is suspended or the transmission speed is reduced. This avoids a situation in which the communication capacity for the designated communication is excessively restricted by the transmission of image data, and thus can suppress a decrease in the communication quality of the designated communication.

[0014] In the information system having the above configuration, The designated communication is communication for managing at least one of the start of operation of the operation target by the operation device, the interruption of the operation, and the end of the operation. It is preferred.

[0015] According to the information system of the above configuration, when there is designated communication (communication other than the transmission of image data acquired by the imaging device of the operation target from the operation device to the external server) between the operation device and the external server, the transmission of the image data is suspended or the transmission speed is reduced. This avoids a situation in which the communication capacity for the designated communication is excessively restricted by the transmission of image data, and thus can suppress a decrease in the communication quality of the designated communication (communication for managing at least one of the operation start, operation interruption, and operation end of the operation target by the operation device).

[0016] In the information system having the above configuration, When the designated communication ends during the execution of the designated communication control process, the designated device resumes transmission of the image data or returns the communication speed to the original speed. It is preferable.

[0017] According to the information system having this configuration, when the designated communication ends during the execution of the designated communication control process, the transmission of image data from the designated device to the external server, which had been on hold until then, is resumed, or the transmission speed, which had been reduced until then, is restored. This not only prevents a decrease in the communication quality of the designated communication, but also facilitates the smooth transmission of image data from the designated device to the external server, which in turn prevents a decrease in the communication quality.

[0018] In the information system having the above configuration, The designated device is caused to store the image data during the execution of the designated communication control process, and when the designated communication ends, the stored image data is transmitted. It is preferable.

[0019] According to the information system having the above configuration, when the designated communication is terminated, the image data stored in the designated device is transmitted from the designated device to the external server, which not only prevents a deterioration in the communication quality of the designated communication, but also facilitates smooth transmission of the image data from the designated device to the external server, thereby preventing a deterioration in the communication quality.

[0020] The operating device of the present invention comprises: a display device that displays image data received from an operation target; a communication device that transmits the image data to an external server; When there is designated communication with the external server other than the transmission of the image data, a designated communication control process is executed to suspend the transmission of the image data or to reduce the transmission speed of the image data.

[0021] According to the operation device having the above configuration, when there is designated communication (communication other than the transmission of image data from the operation device to the external server) between the operation device and the external server, the transmission of the image data is suspended or the transmission speed is reduced. This makes it possible to avoid a situation in which the communication capacity for the designated communication is excessively restricted by the transmission of image data, and thus to suppress a decrease in the communication quality of the designated communication. [Brief description of the drawings]

[0022] [Figure 1] FIG. 1 is an explanatory diagram of a configuration of an information system. [Diagram 2] FIG. 2 is an explanatory diagram relating to the configuration of a remote control device. [Diagram 3] FIG. 2 is an explanatory diagram relating to the configuration of a work machine. [Figure 4] FIG. 1 is an explanatory diagram of the functions of an information system. [Diagram 5] FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] (Information System Configuration) The information system according to one embodiment of the present invention shown in FIG. 1 is made up of a remote control device 20 (control device) configured to be capable of communicating with an external server 10 and a work machine 40 (subject to operation) via a network.

[0024] (Configuration of remote control device) 1, the remote operation device 20 includes a remote control device 200 (processing device), a remote input interface 210, and a remote output interface 220. The remote control device 200 is configured with an arithmetic processing device (a single-core processor or a multi-core processor or a processor core constituting the same), reads necessary data and software from a storage device such as a memory, and executes arithmetic processing on the data according to the software.

[0025] The remote input interface 210 includes a remote control mechanism 211. The remote output interface 220 includes a remote image output device 221 (display device) and a remote wireless communication device 222.

[0026] The remote operation mechanism 211 includes a traveling operation device, a swing operation device, a boom operation device, an arm operation device, and a bucket operation device. Each operation device has an operation lever that receives a rotation operation. The operation lever (travel lever) of the traveling operation device is operated to move the lower traveling body 41 of the work machine 40. The travel lever may also serve as a travel pedal. For example, a travel pedal fixed to the base or lower end of the travel lever may be provided. The operation lever (swing lever) of the swing operation device is operated to move a hydraulic swing motor that constitutes the swing mechanism 43 of the work machine 40. The operation lever (boom lever) of the boom operation device is operated to move the boom cylinder 442 of the work machine 40. The operation lever (arm lever) of the arm operation device is operated to move the arm cylinder 444 of the work machine 40. The operation lever (bucket lever) of the bucket operation device is operated to move the bucket cylinder 446 of the work machine 40.

[0027] The operating levers constituting the remote control mechanism 211 are arranged around a seat St on which the operator sits, as shown in Fig. 2. The seat St is in the form of a high-back chair with armrests, but may be in the form of a low-back chair without a headrest, or in the form of a chair without a backrest, or in any other form on which the operator can sit.

[0028] Left and right travel levers 2110 corresponding to the left and right crawlers are arranged side by side in front of the seat St. One operation lever may serve as multiple operation levers. For example, the left operation lever 2111 provided in front of the left frame of the seat St shown in FIG. 2 may function as an arm lever when operated in the front-rear direction, and may function as a rotation lever when operated in the left-right direction. Similarly, the right operation lever 2112 provided in front of the right frame of the seat St shown in FIG. 2 may function as a boom lever when operated in the front-rear direction, and may function as a bucket lever when operated in the left-right direction. The lever pattern may be arbitrarily changed by an operation instruction from the operator.

[0029] The remote image output device 221 is composed of one or more image output devices. The remote image output device 221 includes a capture board (output processing device) that outputs input video information to the screen of the image output device, and a hub (relay device) that inputs the video information to the capture board according to the judgment result of the transmitted video information.

[0030] 2, the remote image output device 221 is composed of a central remote image output device 2210, a left remote image output device 2211, and a right remote image output device 2212, each having a substantially rectangular screen, and disposed respectively in front of, diagonally forward left, and diagonally forward right of, the seat St. The shapes and sizes of the screens (image display areas) of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be the same or different. The remote image output device 221 may be composed of a single curved or bendable image output device, or two or four or more image output devices disposed to surround the front of the seat St.

[0031] As shown in Fig. 2, the right edge of the left remote image output device 2211 is adjacent to the left edge of the central remote image output device 2210, such that the screens of the central remote image output device 2210 and the left remote image output device 2211 form an inclination angle θ1 (e.g., 120°≦θ1≦150°). As shown in Fig. 2, the left edge of the right remote image output device 2212 is adjacent to the right edge of the central remote image output device 2210, such that the screens of the central remote image output device 2210 and the right remote image output device 2212 form an inclination angle θ2 (e.g., 120°≦θ2≦150°). The inclination angles θ1 and θ2 may be the same or different.

[0032] The screens of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be parallel to the vertical direction or may be inclined to the vertical direction. At least one of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be composed of a plurality of divided image output devices. For example, the central remote image output device 2210 may be composed of vertically adjacent image output devices each having a substantially rectangular screen.

[0033] (Work machine configuration) 1, the work machine 40 includes an actual machine control device 400, an actual machine input interface 410, an actual machine output interface 420, and an actual machine wireless communication device 422. Each of the components of the actual machine control device 400 is configured by an arithmetic processing device (a single-core processor or a multi-core processor or a processor core constituting the same), reads necessary data and software from a storage device such as a memory, and executes arithmetic processing on the data in accordance with the software.

[0034] The work machine 40 is, for example, a crawler excavator (construction machine), and as shown in Fig. 3, includes a crawler-type lower traveling body 41 and an upper rotating body 42 that is rotatably mounted on the lower traveling body 41 via a rotating mechanism 43. A cab 42C (operator's cabin) is provided on the front left side of the upper rotating body 42. A work mechanism 44 is provided in the front center of the upper rotating body 42.

[0035] The real machine input interface 410 includes a real machine operation mechanism 411, a real machine imaging device 412, a real machine positioning device 414, and a real machine sensor group 416. The real machine operation mechanism 411 includes a plurality of operation levers arranged around a seat arranged inside the cab 42C in the same manner as the remote operation mechanism 211. A drive mechanism or robot that receives a signal according to the operation mode of the remote operation lever and moves the real machine operation lever based on the received signal is provided in the cab 42C. The real machine imaging device 412 is installed, for example, inside the cab 42C, and images the environment including at least a part of the working mechanism 44 through the front window and the left and right side windows. The front window and the side windows may be omitted in part or in whole. The real machine positioning device 414 is configured with a GPS or GNSS and, if necessary, a gyro sensor or the like, and measures the position (latitude and longitude) of the working machine 40.

[0036] The actual machine sensor group 416 is configured to output signals to the actual machine control device 400 according to parameter values ​​relating to the state of the work machine 40, such as the hoisting angle of the boom 441 relative to the upper rotating body 42, the rotation angle of the arm 443 relative to the boom 441, the rotation angle of the bucket 445 relative to the arm 443, hydraulic oil pressure, and remaining fuel.

[0037] 3, the working mechanism 44 includes a boom 441 that is movably attached to the upper rotating body 42, an arm 443 that is rotatably connected to the tip of the boom 441, and a bucket 445 (tip attachment) that is rotatably connected to the tip of the arm 443. The working mechanism 44 is equipped with a boom cylinder 442, an arm cylinder 444, and a bucket cylinder 446 that are configured as extendable and retractable hydraulic cylinders.

[0038] The boom cylinder 442 is interposed between the boom 441 and the upper rotating body 42 so as to extend and retract when supplied with hydraulic oil to rotate the boom 441 in the hoisting direction. The arm cylinder 444 is interposed between the arm 443 and the boom 441 so as to extend and retract when supplied with hydraulic oil to rotate the arm 443 about a horizontal axis relative to the boom 441. The bucket cylinder 446 is interposed between the bucket 445 and the arm 443 so as to extend and retract when supplied with hydraulic oil to rotate the bucket 445 about a horizontal axis relative to the arm 443.

[0039] (function) The functions of the construction support device and the imaging function control system having the above-mentioned configuration will be described with reference to the flowchart shown in Fig. 4. In the flowchart, a block "C●" is used for the sake of simplicity, and means transmission and / or reception of data, and means a conditional branch in which processing in a branching direction is executed on the condition that the data is transmitted and / or received.

[0040] In the remote operation device 20, the remote control device 200 transmits a designation signal to the work machine 40 via the remote wireless communication device 222 (FIG. 4 / STEP 210). When multiple work machines 40 are multiple operation target candidates, the designation signal may be transmitted to each of the multiple work machines 40. The presence or absence of a designation operation via the remote input interface 210 may be determined by the operator, and the designation signal may be transmitted when the determination result is affirmative. The "designation operation" is, for example, an operation such as tapping on the remote input interface 210 for the operator to designate the work machine 40 that he or she intends to remotely operate.

[0041] When the work machine 40 receives a designation signal through the actual machine wireless communication device 422 (FIG. 4 / C40), the actual machine control device 400 transmits a captured image (camera image, which may have been subjected to appropriate image processing) acquired through the actual machine imaging device 412 as "first actual machine information" to the remote control device 20 (FIG. 4 / STEP 410). The captured image (or captured image data) may be the captured image itself, or image data representing a simulated environmental image generated based on the captured image.

[0042] When the remote operation device 20 receives the first actual machine information through the remote wireless communication device 222 (FIG. 4 / C21), the remote control device 200 outputs a captured image as the first actual machine information to the remote image output device 221 (display device) (FIG. 4 / STEP 211). As a result, for example, as shown in FIG. 5, a captured image that reflects the ground spreading out in front of the cab 42C, as well as the boom 441 and arm 443 that are part of the working mechanism 44, and piles of rubble or earth and sand in the construction target area (the target of work by the bucket 445) is output to the remote image output device 221.

[0043] The remote control device 200 judges whether the second communication condition is satisfied (FIG. 4 / STEP 212). The "second communication condition" includes, for example, that the designated information that needs to be transmitted to the external server 10 is stored in the storage device (designated area of ​​the memory) of the remote operation device 20, that the information amount of the designated information is equal to or greater than a second designated value, that a response in a designated manner has been received from the external server 10, and / or that an operation in a second designated manner has been performed by the operator of the remote operation device 20 through the remote input interface 210. The "designated information" may include, in addition to "second actual machine information" described later, information indicating that an operation has been performed through the remote input interface 210 for at least one of "start remote operation", "interrupt remote operation", and "end remote operation" of the work machine 40.

[0044] When it is determined that the second communication condition is satisfied (FIG. 4 / STEP 212...YES), the remote control device 200 as the "designated device" transmits or uploads the designated information to the external server 10 through the remote wireless communication device 222 (FIG. 4 / STEP 214). At this time, an actual machine identifier for identifying the work machine 40 and a remote identifier for identifying the remote operation device 20 may be associated with the captured image and transmitted or uploaded to the external server 10. The external server 10 to which the "designated information" is sent and the external server 10 to which the "captured image" is sent may be the same or different. The "designated information" and the "captured image" may each be transmitted to the external server 10 not only from one remote operation device 20 but also from each of multiple remote operation devices 20.

[0045] When the external server 10 receives the designated information (FIG. 4 / C11), the designated information is saved or stored in an information storage resource or database in the cloud (FIG. 4 / STEP 110).

[0046] Furthermore, the remote control device 200 executes a "designated communication control process" (FIG. 4 / STEP 215). Specifically, the upload of the captured image to the external server 10 by the remote control device 200 as the "designated device" is put on hold, or the priority of the captured image as a transmission target to the external server 10 is relatively lowered compared to the designated information, and for example, the occupancy of the communication band of the captured image is reduced. While the remote control device 200 determines that the second communication condition is satisfied, untransmitted captured images are accumulated or cumulatively stored in the storage device of the remote control device 200. When the designated communication ends during the execution of the designated communication control process, the transmission of the captured image data is resumed, or the communication speed is restored.

[0047] If it is determined that the second communication condition is not satisfied (FIG. 4 / STEP 212...NO), the remote control device 200 determines whether the first communication condition is satisfied (FIG. 4 / STEP 216). The "first communication condition" includes, for example, that a specified period has elapsed since the start or end time of the previous upload of the captured image to the external server 10 in the storage device (designated area of ​​the memory) of the remote operation device 20, and / or that upload of the designated information to the external server 10 has been completed during execution of the designated communication process control. The "first communication condition" may include, for example, that a captured image that needs to be transmitted to the external server 10 is saved or accumulated, that the amount of information of the captured image is equal to or greater than a first designated value, and / or that an operator of the remote operation device 20 has operated in a first designated manner through the remote input interface 210.

[0048] When it is determined that the first communication condition is satisfied (FIG. 4 / STEP 216...YES), the remote control device 200 as the "designated device" transmits or uploads designation information to the external server 10 via the remote wireless communication device 222 (FIG. 4 / STEP 218). At this time, an actual machine identifier for identifying the work machine 40 and a remote identifier for identifying the remote operation device 20 may be associated with the captured image and transmitted or uploaded to the external server 10. When the captured image (first actual machine information) is received by the external server 10 (FIG. 4 / C12), the captured image is saved or stored in an information storage resource or database in the cloud (FIG. 4 / STEP 120).

[0049] In the remote operation device 20, the remote control device 200 recognizes the operation mode of the remote operation mechanism 211, and a remote operation command corresponding to the operation mode is transmitted to the work machine 40 via the remote wireless communication device 222 (FIG. 4 / STEP 220).

[0050] In the work machine 40, when the actual machine control device 400 receives a remote operation command via the actual machine wireless communication device 422 (FIG. 4 / C42), the operation of the work mechanism 44 and the like is controlled in accordance with the remote operation command (FIG. 4 / STEP 420). For example, the bucket 445 is used to dig up and scoop up soil in the target construction area in front of the work machine 40, and the upper rotating body 42 is rotated, after which the soil is dumped from the bucket 445 outside the target construction area.

[0051] Furthermore, the actual machine control device 400 acquires the state of the work machine 40 (which may include second actual machine information) based on the output signal of the actual machine sensor group 416, and transmits it to the remote operation device 20 (FIG. 4 / STEP 422). The "second actual machine information" may include at least one parameter value related to the state of the work machine 40, among the current position of the work machine 40, the tilt angle of the upper rotating body 42, the hoisting angle of the boom 441 relative to the upper rotating body 42, the rotation angle of the arm 443 relative to the boom 441, the rotation angle of the bucket 445 relative to the arm 443, the hydraulic oil pressure, and the remaining fuel amount. The "second actual machine information" may include the operation mode of the remote operation mechanism 211 (such as the operation amount or tilt angle of the operation lever constituting the remote operation mechanism 211), a remote operation command according to the operation mode, and / or the operation mode of the operation lever constituting the actual machine operation mechanism 411 controlled according to the remote operation command.

[0052] When the second actual machine information is received by the remote operation device 20 through the remote wireless communication device 222 (FIG. 4 / C22), the remote control device 200 at least temporarily stores or retains the second actual machine information in a storage device (or a designated area of ​​a memory, etc.). Furthermore, the remote control device 200 repeats the processes subsequent to the process of determining whether the second communication condition is satisfied (see FIG. 4 / STEP 212 to STEP 218).

[0053] (Action and effect) According to the information system that realizes the above-mentioned function, when there is designated communication (communication other than the transmission of captured image data from the remote operation device 20 to the external server 10) between the remote operation device 20 and the external server 10, the transmission of the captured image is suspended or the transmission speed is reduced (see FIG. 4 / STEP 212...YES->STEP 214->STEP 215). This avoids a situation in which the transmission of captured image data and the designated communication are simultaneously performed, resulting in excessive restriction of communication capacity, and thus can suppress deterioration of the communication quality of the transmission of the captured image data and the designated communication.

[0054] When the designated communication ends during the execution of the designated communication control process, the transmission of the image data that was put on hold is resumed, or the transmission speed that was reduced is restored (see FIG. 4 / STEP 218). This not only prevents the communication quality of the designated communication from deteriorating, but also facilitates the transmission of the captured image data from the remote control device 20 to the external server 10, thereby preventing the communication quality from deteriorating.

[0055] When the designated communication is completed, the captured image data that has been stored in the storage device of the remote control device 20 is transmitted to the external server 10 (see FIG. 4 / STEP 218). This not only prevents a deterioration in the communication quality of the designated communication, but also facilitates smooth transmission of the captured image data from the remote control device 20 to the external server 10, thereby preventing a deterioration in the communication quality.

[0056] (Another embodiment of the present invention) In the above embodiment, the information system is constituted by the remote control device 20, but in other embodiments, it may be constituted by the work machine 40, or may be constituted by a computer (such as the external server 10) separate from the remote control device 20 and the work machine 40. The work machine 40 (operation target) may be operated by an operator aboard the work machine 40 via an actual machine operation mechanism 411.

[0057] In the above embodiment, the "operation target" was a work machine 40 (or construction machine), but in other embodiments, the "operation target" may be any equipment that can be remotely controlled and has the ability to acquire and transmit internal information and / or external information, such as an unmanned aerial vehicle, a vehicle, a crane, or other types of construction machine.

[0058] In the above embodiment, the actual machine information is uploaded to the external server 10 from the remote operation device 20 as the "designated device", but in another embodiment, the actual machine information may be uploaded directly to the external server 10 from the work machine 40 as the "designated device" (see FIG. 4 / STEP 410->C11 and STEP 422->C12). In this case, the information system may be configured by the actual machine control device 400 of the work machine 40, and the actual machine control device 400 may execute a process of determining whether the second communication condition is satisfied (see FIG. 4 / STEP 212), a process of transmitting designated information to the external server 10 (see FIG. 4 / STEP 214), a designated communication control process (see FIG. 4 / STEP 215), a process of determining whether the first communication condition is satisfied (see FIG. 4 / STEP 216), and a process of transmitting a captured image to the external server 10 (see FIG. 4 / STEP 218).

[0059] The work machine 40 may be configured to have an automatic driving function, and the remote control device 20 may transmit commands to start, pause and end automatic driving of the work machine 40, and in response to this, the work machine 40 may start, pause and end automatic driving. [Explanation of symbols]

[0060] 10. External Server 20. Remote control device 200 Remote control device (processing device) 210 Remote input interface 211. Remote control mechanism 220 Remote output interface 221 Remote image output device (display device) 222. Remote audio output device 224 Remote radio communication equipment 40. Work machinery 44‥Working mechanism 400... Actual machine control device 410... Actual machine input interface 420... Actual machine output interface

Claims

1. When there is designated communication other than the transmission of image data acquired by a designated device between an external server and a designated device which is at least one of an operation device and an operation target operated by the operation device, a designated communication control process is executed to suspend the transmission of the image data by the designated device or to reduce the transmission speed of the image data. Information systems.

2. 2. The information system according to claim 1, the operation target is a work machine, The operation device is a remote operation device for remotely operating the work machine. Information systems.

3. 2. The information system according to claim 1, The designated device acquires a camera image acquired by an imaging device of the operation target as the image data. Information systems.

4. 2. The information system according to claim 1, The designated communication is communication for managing at least one of the start of operation of the operation target by the operation device, the interruption of the operation, and the end of the operation. Information systems.

5. 2. The information system according to claim 1, When the designated communication ends during the execution of the designated communication control process, the designated device resumes transmission of the image data or returns the communication speed to the original speed. Information systems.

6. 2. The information system according to claim 1, The designated device is caused to store the image data during the execution of the designated communication control process, and when the designated communication ends, the stored image data is transmitted. Information systems.

7. a display device that displays image data received from an operation target; a communication device that transmits the image data to an external server; When there is a designated communication other than the transmission of the image data with the external server, a designated communication control process is executed to suspend the transmission of the image data or to reduce the transmission speed of the image data. Operating device.

Citation Information

Patent Citations

  • Image-photographing device, operation device and image- photographing system therefor

    JP2002354324A

  • Remote control system for construction machinery

    JP2017043924A

  • Vehicle event recorder systems and networks having integrated cellular wireless communications systems

    US20160068105A1

  • Work assisting server, work assisting method, and work assisting system

    US20220406211A1

  • Remote operation system and remote operation server

    WO2020194884A1