Information system and operation device
By implementing a communication control process that suspends or reduces image data transmission during other communication tasks, the system addresses the issue of communication quality deterioration in remote information systems, ensuring efficient data transfer and maintaining communication quality.
Patent Information
- Application Number
- PCT/JP2024/016261
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-23
- Filing Date
- 2024-04-25
- Publication Date
- 2024-11-28
AI Technical Summary
The existing remote information systems for controlling work machines experience deterioration in communication quality due to the pressure of uploading image data to external servers, leading to communication delays and decreased response when used for purposes other than image data transmission.
Implementing a designated communication control process that suspends or reduces the transmission of image data when other communication is occurring, allowing the system to manage communication bandwidth and prioritize designated communication tasks.
This approach prevents excessive limitation of communication capacity and maintains smooth transmission of captured image data, thereby suppressing deterioration in communication quality and ensuring efficient data transfer.
Smart Images

Figure JP2024016261_28112024_PF_FP_ABST
Abstract
Description
Information Systems and Operating Devices
[0001] The present invention relates to an information system and an operation device.
[0002] In a remote information system for remotely operating a work machine, a video signal captured by a camera installed on the work machine is transmitted via a line network and displayed on a monitor device in a remote operation device (control room) installed in a remote location (see, for example, Patent Document 1).
[0003] JP 2013-168777 A
[0004] A system is desired that can store image data displayed on the monitor of a remote control device as operation history information of a work machine and reference the stored image data. It is assumed that the image data will be stored in an external server of the remote control device that can be accessed online.
[0005] However, uploading image data to a server puts strain on the line, which can lead to a decrease in communication quality for other uses, such as communication delays or slower response, when the line is used for purposes other than uploading the image data.
[0006] An object of the present invention is to provide an information system and an operation device that suppress deterioration of communication quality.
[0007] The information system of the present invention executes a designated communication control process that suspends the transmission of image data by a designated device or reduces the transmission speed of the image data when there is designated communication other than the transmission of image data acquired by a designated device between an external server and a designated device that is at least one of an operating device and an operation target operated by the operating device.
[0008] The concept of "obtaining" image data includes obtaining the image data using an imaging device and receiving the image data using a communication device. In addition to controlling communication between a second designated device and an external server for image data that a first designated device primarily obtains and a second designated device secondarily obtains (or receives) from the first designated device, communication between the first designated device and an external server for information that the first designated device primarily obtains may also be controlled.
[0009] The operating device of the present invention comprises a display device that displays image data received from an operation target, and a communication device that transmits the image data to an external server, and executes a designated communication control process that suspends the transmission of the image data or reduces the transmission speed of the image data when there is designated communication other than the transmission of the image data between the external server and the operating device.
[0010] Fig. 1 is an explanatory diagram relating to the configuration of the information system. Fig. 2 is an explanatory diagram relating to the configuration of the remote control device. Fig. 3 is an explanatory diagram relating to the configuration of the work machine. Fig. 4 is an explanatory diagram relating to the functions of the information system. Fig. 5 is an explanatory diagram relating to a work environment image.
[0011] (Configuration of information system) Fig. 1 is an explanatory diagram relating to the configuration of an information system. Fig. 2 is an explanatory diagram relating to the configuration of a remote control device. Fig. 3 is an explanatory diagram relating to the configuration of a work machine. The information system according to one embodiment of the present invention shown in Fig. 1 is made up of a remote control device 20 (operation device) configured to be able to communicate with both an external server 10 and a work machine 40 (operation target) via a network. Note that the information system may include at least one of the external server 10 and the work machine 40 (operation target).
[0012] 1, the remote control device 20 includes a remote control device 200 (processing device), a remote input interface 210, and a remote output interface 220. The remote control device 200 is configured with an arithmetic processing device (a single-core processor or a multi-core processor or processor cores constituting the same), reads necessary data and software from a storage device such as a memory, and executes arithmetic processing on the data in accordance with the software.
[0013] The remote input interface 210 includes a remote control mechanism 211. The remote output interface 220 includes a remote image output device 221 (display device) and a remote wireless communication device 222.
[0014] The remote operation mechanism 211 includes a travel operation device, a swing operation device, a boom operation device, an arm operation device, and a bucket operation device. Each operation device has an operation lever that is rotated. The operation lever (travel lever) of the travel operation device is operated to move the undercarriage 41 of the work machine 40. The travel lever may also serve as a travel pedal. For example, a travel pedal may be provided that is fixed to the base or lower end of the travel lever. The operation lever (swing lever) of the swing operation device is operated to operate the hydraulic swing motor that constitutes the swing mechanism 43 of the work machine 40. The operation lever (boom lever) of the boom operation device is operated to operate the boom cylinder 442 of the work machine 40. The operation lever (arm lever) of the arm operation device is operated to operate the arm cylinder 444 of the work machine 40. The operation lever (bucket lever) of the bucket operation device is operated to operate the bucket cylinder 446 of the work machine 40.
[0015] The operation levers constituting the remote control mechanism 211 are arranged around a seat St for the operator to sit on, as shown in Fig. 2. The seat St is in the form of a high-back chair with armrests, but may be in the form of a low-back chair without a headrest, a chair without a backrest, or any other seating configuration that allows the operator to sit on it.
[0016] Left and right travel levers 2110 corresponding to the left and right crawlers are arranged side by side in front of the seat St. One operating lever may serve as multiple operating levers. For example, the left operating lever 2111 provided in front of the left frame of the seat St shown in FIG. 2 may function as an arm lever when operated in the forward / backward direction and as a swing lever when operated in the left / right direction. Similarly, the right operating lever 2112 provided in front of the right frame of the seat St shown in FIG. 2 may function as a boom lever when operated in the forward / backward direction and as a bucket lever when operated in the left / right direction. The lever pattern may be changed as desired by an operator's operating command.
[0017] The remote image output device 221 is composed of one or more image output devices. The remote image output device 221 includes a capture board (output processing device) that outputs input video information to the screen of the image output device, and a hub (relay device) that inputs the video information to the capture board depending on the evaluation result of the transmitted video information.
[0018] 2, the remote image output device 221 is composed of a central remote image output device 2210, a left remote image output device 2211, and a right remote image output device 2212, each having a substantially rectangular screen, and arranged in front of, the front left, and the front right of, the seat St. The shapes and sizes of the screens (image display areas) of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be the same or different. The remote image output device 221 may be composed of a single curved or bendable image output device, or two or four or more image output devices arranged to surround the front of the seat St.
[0019] As shown in Fig. 2, the right edge of the left remote image output device 2211 is adjacent to the left edge of the central remote image output device 2210 so that the screens of the central remote image output device 2210 and the left remote image output device 2211 form an inclination angle θ1 (e.g., 120°≦θ1≦150°). As shown in Fig. 2, the left edge of the right remote image output device 2212 is adjacent to the right edge of the central remote image output device 2210 so that the screens of the central remote image output device 2210 and the right remote image output device 2212 form an inclination angle θ2 (e.g., 120°≦θ2≦150°). The inclination angles θ1 and θ2 may be the same or different.
[0020] The screens of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be parallel to the vertical direction or may be tilted relative to the vertical direction. At least one of the central remote image output device 2210, the left remote image output device 2211, and the right remote image output device 2212 may be composed of multiple divided image output devices. For example, the central remote image output device 2210 may be composed of adjacent image output devices above and below, each having a substantially rectangular screen.
[0021] 1, the work machine 40 is equipped with an actual machine control device 400, an actual machine input interface 410, an actual machine output interface 420, and an actual machine wireless communication device 422. Each of the components of the actual machine control device 400 is made up of an arithmetic processing device (a single-core processor or a multi-core processor or a processor core that makes up such a processor), which reads the necessary data and software from a storage device such as memory, and executes arithmetic processing on the data in accordance with the software.
[0022] The work machine 40 is, for example, a crawler excavator (construction machine), and as shown in Figure 3, includes a crawler-type lower traveling body 41 and an upper rotating body 42 that is rotatably mounted on the lower traveling body 41 via a rotating mechanism 43. A cab 42C (operator's compartment) is provided on the front left side of the upper rotating body 42. A work mechanism 44 is provided in the front center of the upper rotating body 42.
[0023] The actual machine input interface 410 includes an actual machine operation mechanism 411, an actual machine imaging device 412, an actual machine positioning device 414, and an actual machine sensor group 416. The actual machine operation mechanism 411 includes multiple control levers arranged around a seat inside the cab 42C in the same manner as the remote control mechanism 211. A drive mechanism or robot is provided in the cab 42C that receives signals corresponding to the operation mode of the remote control levers and moves the actual machine control levers based on the received signals. The actual machine imaging device 412 is installed, for example, inside the cab 42C and captures images of the environment including at least a portion of the work mechanism 44 through the front window and left and right side windows. Some or all of the front window and side windows may be omitted. The actual machine positioning device 414 is configured with a GPS or GNSS and, if necessary, a gyro sensor, etc., and measures the position (latitude and longitude) of the work machine 40.
[0024] The actual machine sensor group 416 is configured to output signals to the actual machine control device 400 according to the values of parameters relating to the state of the work machine 40, such as the elevation angle of the boom 441 relative to the upper rotating body 42, the rotation angle of the arm 443 relative to the boom 441, the rotation angle of the bucket 445 relative to the arm 443, the hydraulic oil pressure, and the remaining fuel amount.
[0025] 3, the working mechanism 44 includes a boom 441 that is mounted on the upper rotating body 42 so that it can be raised and lowered, an arm 443 that is rotatably connected to the tip of the boom 441, and a bucket 445 (tip attachment) that is rotatably connected to the tip of the arm 443. The working mechanism 44 is equipped with a boom cylinder 442, an arm cylinder 444, and a bucket cylinder 446, each of which is made up of extendable and retractable hydraulic cylinders.
[0026] The boom cylinder 442 is interposed between the boom 441 and the upper rotating body 42 so as to extend and retract by receiving a supply of hydraulic oil to rotate the boom 441 in the hoisting direction. The arm cylinder 444 is interposed between the arm 443 and the boom 441 so as to extend and retract by receiving a supply of hydraulic oil to rotate the arm 443 about a horizontal axis relative to the boom 441. The bucket cylinder 446 is interposed between the bucket 445 and the arm 443 so as to extend and retract by receiving a supply of hydraulic oil to rotate the bucket 445 about a horizontal axis relative to the arm 443.
[0027] (Functions) Fig. 4 is an explanatory diagram relating to the functions of the information system. Fig. 5 is an explanatory diagram relating to work environment images. The functions of the construction support device and imaging function control system configured as described above will be explained using the flowchart shown in Fig. 4. In the flowchart, a block labeled "C (number)" is used for the sake of simplicity, and represents the transmission and / or reception of data, and represents a conditional branch in which processing in a branching direction is executed on the condition that the data is transmitted and / or received.
[0028] In the remote operation device 20, the remote control device 200 transmits a designation signal to the work machine 40 via the remote wireless communication device 222 (STEP 210 in FIG. 4 ). When multiple work machines 40 are multiple operation target candidates, a designation signal may be transmitted to each of the multiple work machines 40. A determination may be made as to whether or not the operator has performed a designation operation via the remote input interface 210, and if the determination result is positive, a designation signal may be transmitted. A "designation operation" is, for example, an operation such as tapping on the remote input interface 210 for the operator to designate the work machine 40 that he or she intends to remotely operate.
[0029] When the work machine 40 receives a designation signal via the actual machine wireless communication device 422 (C40 in FIG. 4), the actual machine control device 400 transmits the captured image (camera image, which may have been subjected to appropriate image processing) acquired via the actual machine imaging device 412 as "first actual machine information" to the remote operation device 20 (STEP 410 in FIG. 4). The captured image (or captured image data) may be the captured image itself, or image data representing a simulated environmental image generated based on the captured image.
[0030] When the remote operation device 20 receives the first actual machine information through the remote wireless communication device 222 (C21 in FIG. 4), the remote control device 200 outputs a captured image as the first actual machine information to the remote image output device 221 (display device) (STEP 211 in FIG. 4). As a result, for example, as shown in FIG. 5, a captured image that reflects not only the ground spreading out in front of the cab 42C but also the boom 441 and arm 443 that are part of the work mechanism 44, and piles of rubble or earth and sand in the construction area (the target of work by the bucket 445) is output to the remote image output device 221.
[0031] The remote control device 200 determines whether the second communication condition is satisfied (STEP 212 in FIG. 4 ). The "second communication condition" includes, for example, that designation information that needs to be transmitted to the external server 10 is stored in the storage device (designated area of memory) of the remote operation device 20, that the amount of information in the designation information is equal to or greater than a second designated value, that a response in a designated manner has been received from the external server 10, and / or that an operation in a second designated manner has been performed by the operator of the remote operation device 20 via the remote input interface 210. The "designation information" may include, in addition to "second actual machine information" described below, information indicating that an operation has been performed via the remote input interface 210 for at least one of "start remote operation," "interrupt remote operation," and "end remote operation" of the work machine 40.
[0032] If it is determined that the second communication condition is satisfied (YES in STEP 212 in FIG. 4 ), the remote control device 200, which serves as the "designated device," transmits or uploads designation information to the external server 10 via the remote wireless communication device 222 (STEP 214 in FIG. 4 ). At this time, an actual machine identifier for identifying the work machine 40 and a remote identifier for identifying the remote operation device 20 may be associated with the captured image and transmitted or uploaded to the external server 10. The external server 10 to which the "designated information" is sent and the external server 10 to which the "captured image" is sent may be the same or different. The "designated information" and the "captured image" may each be transmitted to the external server 10 not only from one remote operation device 20 but also from each of a plurality of remote operation devices 20.
[0033] When the external server 10 receives the designation information (C11 in FIG. 4), the designation information is saved or stored in an information storage resource or database in the cloud (STEP 110 in FIG. 4).
[0034] Furthermore, the remote control device 200 executes a "designated communication control process" (STEP 215 in FIG. 4). Specifically, uploading of captured images to the external server 10 by the remote control device 200 as the "designated device" is suspended, or the priority of the captured images as targets for transmission to the external server 10 is relatively lowered compared to the designated information, thereby reducing the occupancy of the communication bandwidth of the captured images, for example. While the remote control device 200 determines that the second communication condition is satisfied, unsent captured images are accumulated or cumulatively saved in the storage device of the remote control device 200. If the designated communication ends during execution of the designated communication control process, transmission of the captured image data is resumed, or the communication speed is restored.
[0035] If it is determined that the second communication condition is not satisfied (NO in STEP 212 of FIG. 4 ), the remote control device 200 determines whether the first communication condition is satisfied (STEP 216 of FIG. 4 ). The "first communication condition" includes, for example, that a specified period has elapsed since the start or end time of the previous upload of captured images to the external server 10 in the storage device (designated memory area) of the remote operation device 20, and / or that uploading of designated information to the external server 10 has been completed during execution of the designated communication process control. The "first communication condition" may include, for example, that captured images that need to be transmitted to the external server 10 are saved or accumulated, that the amount of information in the captured images is equal to or greater than a first designated value, and / or that the operator of the remote operation device 20 has operated the remote input interface 210 in a first designated manner.
[0036] If it is determined that the first communication condition is satisfied (YES in STEP 216 in FIG. 4 ), the remote control device 200 as the "designated device" transmits or uploads designation information to the external server 10 via the remote wireless communication device 222 (STEP 218 in FIG. 4 ). At this time, an actual machine identifier for identifying the work machine 40 and a remote identifier for identifying the remote operation device 20 may be associated with the captured image and transmitted or uploaded to the external server 10. If the captured image (first actual machine information) is received by the external server 10 (C12 in FIG. 4 ), the captured image is saved or stored in an information storage resource or database in the cloud (STEP 120 in FIG. 4 ).
[0037] In the remote operation device 20, the remote control device 200 recognizes the operation mode of the remote operation mechanism 211, and transmits a remote operation command corresponding to the operation mode to the work machine 40 via the remote wireless communication device 222 (STEP 220 in FIG. 4).
[0038] When the actual machine control device 400 of the work machine 40 receives a remote operation command via the actual machine wireless communication device 422 (C42 in FIG. 4), the operation of the work mechanism 44 and the like is controlled in accordance with the remote operation command (STEP 420 in FIG. 4). For example, the bucket 445 is used to dig up and scoop up soil in the construction area in front of the work machine 40, and the upper rotating body 42 is then rotated, after which the soil is dropped from the bucket 445 outside the construction area.
[0039] Furthermore, the actual machine control device 400 acquires the state of the work machine 40 (which may include second actual machine information) based on the output signals of the actual machine sensor group 416, and transmits this to the remote operation device 20 (STEP 422 in FIG. 4 ). The "second actual machine information" may include the value of at least one parameter related to the state of the work machine 40, from among the current position of the work machine 40, the tilt angle of the upper rotating body 42, the hoisting angle of the boom 441 relative to the upper rotating body 42, the rotation angle of the arm 443 relative to the boom 441, the rotation angle of the bucket 445 relative to the arm 443, the hydraulic oil pressure, and the remaining fuel amount. The "second actual machine information" may include the operation mode of the remote operation mechanism 211 (such as the operation amount or tilt angle of the operation levers that constitute the remote operation mechanism 211), a remote operation command corresponding to the operation mode, and / or the operating mode of the operation levers and the like that constitute the actual machine operation mechanism 411 that are controlled in accordance with the remote operation command.
[0040] When the remote control device 20 receives the second actual machine information through the remote wireless communication device 222 (C22 in FIG. 4), the remote control device 200 at least temporarily saves or stores the second actual machine information in a storage device (or a designated area in memory, etc.). Furthermore, the remote control device 200 repeats the process from the process of determining whether the second communication condition is satisfied (see STEPs 212 to 218 in FIG. 4).
[0041] (Effects) According to the information system that performs the above functions, when designated communication (communication other than transmission of captured image data from the remote control device 20 to the external server 10) occurs between the remote control device 20 and the external server 10, the transmission of the captured image is put on hold or the transmission speed is reduced (see YES in STEP 212 → STEP 214 → STEP 215 in FIG. 4 ). This avoids a situation in which the transmission of captured image data and the designated communication are performed simultaneously, resulting in excessive restriction of communication capacity, and ultimately suppresses a decrease in the communication quality of the transmission of the captured image data and the designated communication.
[0042] If the designated communication ends during the execution of the designated communication control process, the transmission of the image data that had been put on hold is resumed, or the transmission rate that had been reduced is restored (see STEP 218 in FIG. 4 ). This not only prevents a decrease in the communication quality of the designated communication, but also facilitates smooth transmission of the captured image data from the remote control device 20 to the external server 10, thereby preventing a decrease in the communication quality.
[0043] When the designated communication is completed, the captured image data stored in the storage device of the remote control device 20 is transmitted to the external server 10 (see STEP 218 in FIG. 4 ). This not only prevents a deterioration in the communication quality of the designated communication, but also facilitates smooth transmission of the captured image data from the remote control device 20 to the external server 10, thereby preventing a deterioration in the communication quality.
[0044] (Other Embodiments of the Present Invention) In the above embodiment, the information system was configured by the remote control device 20, but in other embodiments it may be configured by the work machine 40, or may be configured by a computer (external server 10, etc.) separate from the remote control device 20 and the work machine 40. The work machine 40 (object to be operated) may be operated as a real machine by an operator on board the work machine 40 via a real machine operating mechanism 411.
[0045] In the above embodiment, the "operation target" was a work machine 40 (or construction machine), but in other embodiments, the "operation target" may be any equipment that can be remotely controlled and has the function of acquiring and transmitting internal information and / or external information, such as an unmanned aerial vehicle, a crane, or other types of construction machine.
[0046] In the above embodiment, the actual machine information is uploaded to the external server 10 from the remote operation device 20 as the "designated device", but in another embodiment, the actual machine information may be uploaded directly to the external server 10 from the work machine 40 as the "designated device" (see STEPs 410 to C11 and STEPs 422 to C12 in FIG. 4). In this case, the information system may be configured by the actual machine control device 400 of the work machine 40, and the actual machine control device 400 may execute the process of determining whether the second communication condition is satisfied (see STEP 212 in FIG. 4), the process of transmitting designated information to the external server 10 (see STEP 214 in FIG. 4), the designated communication control process (see STEP 215 in FIG. 4), the process of determining whether the first communication condition is satisfied (see STEP 216 in FIG. 4), and the process of transmitting a captured image to the external server 10 (see STEP 218 in FIG. 4).
[0047] The work machine 40 may have an automatic driving function, and the remote control device 20 may be configured to send commands to start, pause and end automatic driving of the work machine 40, and in response to these commands, the work machine 40 may start, pause and end automatic driving.
[0048] An information system according to a first aspect of the present invention executes a designated communication control process that suspends the transmission of image data by a designated device or reduces the transmission speed of the image data when there is designated communication other than the transmission of image data acquired by a designated device between an external server and a designated device that is at least one of an operating device and an operation target operated by the operating device.
[0049] According to the information system having this configuration, when designated communication (communication other than the transmission of image data from the designated device to the external server) occurs between the designated device, which is at least one of the operation device and the operation target operated by the operation device, and the external server, the transmission of the image data is put on hold or the transmission speed is reduced. This prevents the simultaneous execution of the transmission of image data and the designated communication, thereby preventing excessive restriction of the information communication capacity between the designated device and the external server, and ultimately suppresses deterioration in the communication quality of the transmission of the image data and the designated communication.
[0050] The concept of "obtaining" image data includes obtaining the image data using an imaging device and receiving the image data using a communication device. In addition to controlling communication between a second designated device and an external server for image data that a first designated device primarily obtains and a second designated device secondarily obtains (or receives) from the first designated device, communication between the first designated device and an external server for information that the first designated device primarily obtains may also be controlled.
[0051] An information system according to a second aspect of the present invention is the information system according to the first aspect, wherein the operation target is a work machine, and the operation device is a remote operation device for remotely operating the work machine.
[0052] According to the information system having this configuration, when designated communication (communication other than the transmission of image data acquired by the work machine from the control device to the external server) occurs between the remote control device for remotely operating the work machine and the external server, the transmission of the image data is put on hold or the transmission speed is reduced. This avoids a situation in which the communication capacity of both is excessively limited due to the simultaneous execution of the transmission of image data and the designated communication, and can thereby suppress a decrease in the communication quality of the transmission of the image data and the designated communication.
[0053] In an information system according to a third aspect of the present invention, in the information system according to the first or second aspect, it is preferable that the designated device acquires as the image data a camera image acquired by an imaging device provided in the target to be operated.
[0054] According to the information system having this configuration, when designated communication (communication other than transmission of image data acquired by an imaging device from the designated device to the external server) occurs between the designated device and the external server, the transmission of the image data is put on hold or the transmission speed is reduced. This prevents the transmission of image data from excessively limiting the communication capacity for the designated communication, and ultimately reduces the deterioration of the communication quality of the designated communication.
[0055] In an information system according to a fourth aspect of the present invention, in the information systems according to the first to third aspects, it is preferable that the designated communication is communication for managing at least one of starting operation of the operation target by the operation device, interrupting operation, and ending operation.
[0056] According to the information system having this configuration, when designated communication (communication other than transmission of image data acquired by the imaging device of the operation target from the operation device to the external server) occurs between the operation device and the external server, the transmission of the image data is put on hold or the transmission speed is reduced. This prevents a situation in which the communication capacity for the designated communication is excessively limited due to the transmission of image data, and ultimately can suppress a decrease in the communication quality of the designated communication (communication for managing at least one of the start, interruption, and end of operation of the operation target by the operation device).
[0057] In the information system according to the fifth aspect of the present invention, in the information systems according to the first to fourth aspects, it is preferable that when the designated communication is terminated while the designated communication control process is being executed, the designated device resumes transmitting the image data or the communication speed is restored to its original speed.
[0058] According to the information system having this configuration, when the designated communication ends during the execution of the designated communication control process, the transmission of image data from the designated device to the external server, which had been on hold until then, is resumed, or the transmission speed, which had been reduced until then, is restored. This not only prevents a deterioration in the communication quality of the designated communication, but also facilitates the smooth transmission of image data from the designated device to the external server, which can ultimately prevent a deterioration in the communication quality.
[0059] An information system according to a sixth aspect of the present invention is preferably the information system according to the first to fifth aspects, in which the designated device is caused to store the image data while the designated communication control process is being executed, and when the designated communication is completed, the stored image data is transmitted.
[0060] According to the information system having this configuration, when the designated communication ends, the image data stored in the designated device up to that point is transmitted from the designated device to the external server, which not only prevents a deterioration in the communication quality of the designated communication but also facilitates smooth transmission of the image data from the designated device to the external server, thereby preventing a deterioration in the communication quality.
[0061] An operating device according to a seventh aspect of the present invention includes a display device that displays image data received from an operating object, and a communication device that transmits the image data to an external server, and executes a designated communication control process that suspends the transmission of the image data or reduces the transmission speed of the image data when there is designated communication other than the transmission of the image data between the external server and the operating device.
[0062] According to the operation device having the above configuration, when designated communication (communication other than transmission of image data from the operation device to the external server) occurs between the operation device and the external server, the transmission of the image data is put on hold or the transmission speed is reduced. This prevents a situation in which the communication capacity for the designated communication is excessively limited due to the transmission of image data, and thus can suppress a deterioration in the communication quality of the designated communication.
Claims
1. An information system which, when there is designated communication other than the transmission of image data acquired by a designated device between an external server and a designated device which is at least one of an operating device and an operation target operated by the operating device, executes a designated communication control process which suspends the transmission of the image data by the designated device or reduces the transmission speed of the image data.
2. An information system according to claim 1, wherein the operation target is a work machine, and the operation device is a remote operation device for remotely operating the work machine.
3. An information system according to claim 1, wherein the designated device acquires, as the image data, a camera image captured by an imaging device provided in the target to be operated.
4. An information system according to claim 1, wherein the designated communication is a communication for managing at least one of the start of operation of the operation target by the operation device, interruption of the operation, and end of the operation.
5. An information system according to claim 1, wherein when the designated communication ends during execution of the designated communication control process, the designated device resumes transmission of the image data or the communication speed is restored.
6. An information system according to claim 1, wherein the designated device is caused to store the image data while the designated communication control process is being executed, and when the designated communication is terminated, the stored image data is transmitted.
7. An operating device comprising: a display device that displays image data received from an operation target; and a communication device that transmits the image data to an external server, and which executes a designated communication control process that suspends the transmission of the image data or reduces the transmission speed of the image data when there is designated communication between the external server and the operating device other than the transmission of the image data.
Citation Information
Patent Citations
Remote control system
JP2013168777A
Image-photographing device, operation device and image- photographing system therefor
JP2002354324A
Remote control system for construction machinery
JP2017043924A
Remote operation system and remote operation server
WO2020194884A1
Cited By
Method for operating a device for carrying out a work operation of a self-propelled construction machine from a control station located at a distance from the construction machine, as well as a device for carrying out a work operation of at least one self-propelled construction machine from a control station located at a distance from the construction machine
EP4800188A1
