Remote control system

Through the matching and auxiliary mechanism of the remote control system, the problem of insufficient skills for novice operators when remotely manipulating construction machinery is solved, skill matching and learning between operators is achieved, and the remote control skills level is improved.

CN118901077APending Publication Date: 2024-11-05HITACHI CONSTRUCTION MACHINERY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380026401.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-03-23
Filing Date
2023-03-22
Publication Date
2024-11-05

AI Technical Summary

Technical Problem

Novice operators are unable to bear the work that requires advanced skills when remotely manipulating construction machinery, and the lack of learning opportunities for skilled people leads to increased difficulty in learning skills.

Method used

A remote control system is designed to match multiple remote control devices with construction machinery through matching servers, search and prompt the operators for candidate jobs that can be undertaken based on the database, and assist in selecting jobs when needed to achieve skill matching between operators. and assist in cooperation.

Benefits of technology

It effectively improves the operator's remote control skills, and allows novices to learn the skills of skilled people through matching and assistance mechanisms, reducing the difficulty of operators in the event of insufficient number of people.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118901077A_ABST
    Figure CN118901077A_ABST
Patent Text Reader

Abstract

Provided is a remote control system including a matching server that matches a construction machine and a remote control device, in which candidate work is retrieved, and a prompt is given to a first remote control device operated by a first operator who has been subjected to login authentication, and the first remote control device is operated by a second operator who has been subjected to login authentication. When a notification of an assistance request is received from the first remote control device for a selected job selected from among the candidate jobs, a second operator capable of assisting the selected job is detected from among the registered operators. The assistance request and the work related to the assistance request are notified to a second remote control device operated by the second operator, and when a notification of acceptance of the assistance request is received from the second remote control device, the assistance request and the work related to the assistance request are received on the basis of the database. Both the first remote control device and the second remote control device are communicatively connected to the construction machine to be controlled used in the selection work.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a remote control system for remotely controlling construction machinery such as a hydraulic excavator. Background Art

[0002] As operators of construction machinery are aging, a remote control system for remotely controlling unmanned construction machinery has been developed as a measure to address the problem of operator shortage. According to the remote control system, there is no need for the operator to actually go to the work site, which has the advantage of being easy to secure operators in accordance with the situation where there are fewer geographical restrictions. As one of such remote control systems, the following system is known, which presents the operator with the candidate of the operation to be performed by remote control, and the operator can select the operation (Patent Document 1).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2020-77294 Summary of the invention

[0006] In remote control of construction machinery, there are individual differences in the skills of operators from beginners to experienced operators. Generally, beginners cannot take on tasks that require advanced skills. In addition, in the case of beginners, if there are no people who can serve as learning samples, such as experienced operators with advanced skills, learning skills will become a personal struggle, making it difficult to effectively learn remote control skills.

[0007] An object of the present invention is to provide a remote control system that can effectively improve an operator's skills in remote control of a construction machine.

[0008] In order to achieve the above-mentioned purpose, the present invention provides a remote control system, comprising: construction machinery; multiple remote control devices for wirelessly controlling the construction machinery; and a matching server for matching one of the multiple remote control devices with the construction machinery, wherein the matching server is configured to store a database including authentication data of multiple operators, skill data related to the skills possessed by each of the multiple operators, construction machinery data related to the construction machinery configured at a work site, and required skill data related to the skills required for operations using the construction machinery at the work site, and based on the database, retrieve candidate operations that can be undertaken by a first operator who has undergone login authentication, and then The first remote control device operated by the first operator is prompted that, when a notification of an assistance request is received from the first remote control device for a selected operation selected from the candidate operations, a second operator who can assist the selected operation is detected from among the logged-in operators based on the database, the assistance request and the operation related to the assistance request are notified to the second remote control device operated by the second operator, and when a notification of acceptance of the assistance request is received from the second remote control device, both the first remote control device and the second remote control device are communicatively connected relative to the engineering machinery that is the operation object used in the selected operation based on the database.

[0009] Effects of the Invention

[0010] According to the present invention, it is possible to effectively improve the operator's skills regarding remote control of a construction machine. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 This is a schematic diagram of a remote control system according to one embodiment of the present invention.

[0012] Figure 2 This is a schematic diagram of a remote control system according to one embodiment of the present invention.

[0013] Figure 3 This is a block diagram of a remote control system according to one embodiment of the present invention.

[0014] Figure 4 This is a flowchart showing the procedure of a preparation operation (login operation) for an operation using the remote control system according to one embodiment of the present invention.

[0015] Figure 5 This is a flowchart showing the procedure of a remote control operation of a construction machine using the remote control system according to one embodiment of the present invention. DETAILED DESCRIPTION

[0016] Hereinafter, embodiments of the present invention will be described using the drawings.

[0017] - Remote control system -

[0018] Figure 1 as well as Figure 2 is a schematic diagram of a remote control system according to one embodiment of the present invention. Figure 3 This is a block diagram of a remote control system according to one embodiment of the present invention. Figure 1 - Figure 3 The remote control system exemplified in the embodiment includes: construction machines 2A and 2B capable of wireless control; a plurality of remote control devices 4A and 4B for wirelessly controlling the construction machines 2A and 2B; and a matching server 6 for matching one of the plurality of remote control devices 4A and 4B with the construction machines 2A and 2B. The construction machines 2A and 2B are arranged at a work site 1. The remote control devices 4A and 4B are arranged in an operation room 3 located at a place far from the work site 1.

[0019] - Construction machinery -

[0020] The construction machines 2A and 2B are typically hydraulic excavators, but are not limited to hydraulic excavators and may be other construction machines such as dump trucks, bulldozers, dump loaders, and scrapers. Figure 1 The example in the figure is that both construction machines 2A and 2B are hydraulic excavators. Figure 2 The example in FIG. 2A shows that the construction machine 2A is a hydraulic excavator and the construction machine 2B is a dump truck. In addition, the construction machines 2A and 2B are typically self-propelled construction machines that can travel by themselves, but sometimes they can also be stationary construction machines. The construction machines 2A and 2B can be the same type of construction machines or different types of construction machines. Figure 1 In the figure, two construction machines 2A and 2B are shown at the work site 1, but sometimes the number of construction machines at the work site 1 may be one, or three or more. Figure 1 Only one work site 1 is shown in the figure. Although there may be only one work site 1 registered in the system, typically a plurality of work sites 1 are registered in the system.

[0021] The construction machine 2A includes a communicator 21A for data communication, a camera 22A, an encoder (image transmission unit) 23A, a converter (operation signal receiving unit) 24A, and a communicator 25A for remote control. Similarly, the construction machine 2B also includes a communicator 21B for data communication, a camera 22B, an encoder (image transmission unit) 23B, a converter (operation signal receiving unit) 24B, and a communicator 25B for remote control.

[0022] The communicators 21A and 21B play a role of transmitting and receiving data related to matching to and from the matching server 6 via the matching information network NT2.

[0023] The cameras 22A and 22B are vehicle-mounted cameras that capture images viewed from the driver's seat.

[0024] The encoders 23A and 23B convert the images captured by the cameras 22A and 22B into digital signals and output them.

[0025] The converters 24A and 24B play a role of converting a communication signal related to operation input from a connected remote control device into a control signal for the in-vehicle device.

[0026] The communicators 25A and 25B play a role of transmitting and receiving data related to remote control (network operation signals and network image signals) with the remote control device connected via the remote control network NT1.

[0027] The communicators 21A and 21B of the construction machines 2A and 2B are connected to the matching server 6 via the matching information network NT2. After the construction machines 2A and 2B themselves become remotely controllable in accordance with the start operation, they transmit a standby notification indicating that they are in an operable state to the matching server 6 via the communicators 21A and 21B and the matching information network NT2. The operable state refers to a state in which remote control is possible, for example, a state in which the prime mover is shifted to an operating state and the cameras 22A and 22B and the communicators 25A and 25B are already started.

[0028] In addition, the operable construction machines 2A and 2B are appropriately connected to the remote control devices 4A and 4B in the operation room 3 by the communication control processing 621 of the matching server 6 via the communicators 25A and 25B and the remote control network NT1. Figure 1 As shown, the remote control devices 4A, 4B are respectively connected to the construction machines 2A, 2B for communication. Figure 2 As shown, sometimes the remote control devices 4A and 4B are communicatively connected to the same construction machine 2A.

[0029] The images captured by the cameras 22A and 22B are converted into network image signals by encoders 23A and 23B, respectively, and sent from communicators 25A and 25B, and transmitted to the remote control devices connected to the communication via the remote control network NT1. In addition, the network operation signals sent from the remote control devices connected to the communication are received by the communicators 25A and 25B, respectively converted into analog or digital operation signals by converters 24A and 24B, and output to the corresponding devices mounted on the construction machines 2A and 2B.

[0030] For example, in Figure 1 When the remote control devices 4A and 4B are respectively connected to the construction machines 2A and 2B for communication, the construction machine 2A is operated according to the operation of the remote control device 4A, and the construction machine 2B is operated according to the operation of the remote control device 4B. Figure 2 As shown, when the remote control devices 4A and 4B are communicatively connected to the same construction machine 2A, the construction machine 2A operates according to the operation of the remote control device 4A or 4B in consideration of the priority control right described later.

[0031] - Remote control device -

[0032] The remote control devices 4A and 4B are devices that simulate the cab of the engineering machine to be controlled, and the types of the operating devices 44A and 44B (described later) differ depending on the controlled object. Figure 1 as well as Figure 2 In the figure, two remote control devices 4A and 4B are arranged in the operation room 3, but the remote control devices arranged on the system are not limited to two, and more than three remote control devices can be arranged on the system. In addition, the remote control devices 4A and 4B do not need to be arranged in the same operation room 3. In this embodiment, the operator who operates the remote control device 4A is recorded as operator A, and the operator who operates the remote control device 4B is recorded as operator B. For the sake of convenience, it is assumed that operator A is a novice and operator B is an experienced person in remote operation of construction machinery, and the proficiency of operator A (described later) is lower than that of operator B.

[0033] The remote control device 4A includes a communicator 41A, an input device 42A, a display 43A for data display, an operating device 44A for remote control, a display 45A for image display, a communicator 46A, a talker 47A, and an operating device 48A for setting a priority control right. Similarly, the remote control device 4B includes a communicator 41B, an input device 42B, a display 43B for data display, an operating device 44B for remote control, a display 45B for image display, a communicator 46B for remote control, a talker 47B, and an operating device 48B for setting a priority control right.

[0034] The communicators 41A and 41B are devices for data communication related to matching. The communicators 41A and 41B play the role of transmitting and receiving data related to matching to and from the matching server 6 via the matching information network NT2.

[0035] The input devices 42A and 42B are devices for inputting data, and for example, devices such as a keyboard and a touch panel can be used.

[0036] The displays 43A and 43B are display devices that display input data, received data, etc. When a touch panel is used for the displays 43A and 43B, the displays 43A and 43B can also be used as the input devices 42A and 42B.

[0037] The operating devices 44A and 44B are devices that simulate the operating devices of remotely controlled construction machinery. These operating devices 44A and 44B are of different types depending on the type of construction machinery. For example, when the controlled object is a hydraulic excavator, an operating lever device is used, and when the controlled object is a dump truck, an operating lever and operating pedal are used.

[0038] The displays 45A and 45B are display devices that display images captured by the cameras 22A and 22B of the construction machines 2A and 2B in real time. The displays 45A and 45B function as simulated windows that display images of the work site 1, which are equivalent to the field of view seen from the driver's seat of the construction machines 2A and 2B or a position equivalent thereto.

[0039] The communicators 46A and 46B are devices for data communication related to remote control. The communicators 46A and 46B play the role of transmitting and receiving data related to remote control (network operation signals and network image signals) between the construction machines connected via the remote control network NT1.

[0040] The intercom 47A, 47B is a device for conducting voice communication with an operator operating another remote control device, and is composed of a microphone and a speaker. For example, the intercom 47A, 47B can be configured to communicate with each other via the matching information network NT2. These intercoms 47A, 47B can be in the form of being provided on a control panel and a display, etc., but are not limited to this form, and can also be in the form of earphones and receivers. For example, two operators A and B operating the remote control devices 4A, 4B can communicate directly via the intercoms 47A, 47B.

[0041] In addition, as a means for directly communicating between operators, it is not limited to a device that performs voice communication, and a device that performs text communication such as a chat program can also be used.

[0042] The operating devices 48A and 48B are operating devices for setting priority control rights. For example, when the remote control devices 4A and 4B are connected to the same construction machinery through communication, the operating devices 48A and 48B can be used to set which of the remote control devices 4A and 4B has a network operation signal that takes priority. As the operating devices 48A and 48B, a dedicated mechanical operating device can be set as the remote control device 4A and 4B, but for example, when a touch panel is used for the display 43A and 43B, the display 43A and 43B can also serve as the operating device 48A and 48B. In addition, the following form can also be adopted, that is, a setting screen for priority control rights is displayed on the display 43A and 43B, and the setting operation of priority control rights is performed by using the setting input of the input device 42A and 42B. That is, it can also be configured so that the input device 42A and 42B also serve as the operating device 48A and 48B.

[0043] In the present embodiment, when the remote control devices 4A and 4B are connected to the same construction machinery 2A through communication, priority control rights are set for one remote control device (described later). For example, when priority control rights are set for the remote control device 4B, by operating the operating device 48B of the remote control device 4B, a setting signal that invalidates the network operation signal based on the remote control device 4A can be sent from the remote control device 4B to the matching server 6. In this case, the matching server 6 controls the remote control network NT1 according to the above-mentioned setting signal, and the operation of the construction machinery 2A based on the remote control device 4A becomes invalid. In addition, sometimes it is possible that an inappropriate situation may occur because the operator of one side always holds the priority control rights. In such a case, the operators of the remote control devices 4A and 4B communicate with each other, and the operating devices 48A and 48B perform prescribed operations on each other, thereby transferring the priority control rights between the remote control devices 4A and 4B. For example, when a predetermined setting signal is input from remote control device 4A or 4B in response to a predetermined operation of operating device 48A or 48B, matching server 6 selectively sets priority control rights for construction machine 2A for one of remote control devices 4A or 4B based on the setting signal.

[0044] The communicators 46A and 46B for remote control are connected to the selected construction machinery via the remote control network NT1. The network image signals transmitted from the construction machinery connected to the communication via the remote control network NT1 are received by the communicators 46A and 46B, converted into image signals and input into the displays 45A and 45B. The camera images of the construction machinery connected to the communication are displayed in real time on the displays 45A and 45B. Operators A and B operate the operating devices 44A and 44B while watching the images displayed on the displays 45A and 45B. The operation signals output from the operating devices 44A and 44B accompanying the operations of operators A and B are converted into network operation signals and sent from the communicators 46A and 46B, and transmitted to the construction machinery connected to the communication via the remote control network NT1.

[0045] On the other hand, the communicators 41A and 41B for data communication are connected to the matching server 6 via the matching information network NT2. The operators A and B log in to the matching server 6 by appropriately operating the input devices 42A and 42B according to the display of the displays 43A and 43B. After logging in, the operators A and B confirm the data received from the matching server 6, such as the candidates of the construction machinery and the work site, other operators in each work, etc., through the displays 43A and 43B, and operate the input devices 42A and 42B to select the desired work site and construction machinery. The data input by the input devices 42A and 42B are transmitted from the communicators 41A and 41B to the matching server 6 via the matching information network NT2.

[0046] - Management Terminal -

[0047] Here, the matching server 6 is connected to a management terminal 5 (computer) managed by a manager who manages the matching server 6 via the matching information network NT2. The management terminal 5 is connected to a communicator 51, a display 55, and an input device 56 (keyboard, mouse, etc.). The communicator 51 is, for example, the same device as the communicator 41A of the remote control device 4A, and plays a role in connecting the management terminal 5 to the matching information network NT2. The manager operates the input device 56 while watching the display 55 to register the work 52 performed using the construction machinery equipped at the work site 1, the skills 53 required for the work 52, and the data of the operator 54 registered in the system. These registered data are sent from the communicator 51 to the matching server 6 via the matching information network NT2.

[0048] Specific examples of the registered contents of the work 52 include the name of the work site, the types and numbers of construction machines arranged at the work site, and the skills (skills 53) required for the work using each construction machine.

[0049] Specific examples of the contents of the operator 54 registration include personal data (name, age, connection area, ID, password, etc.) of the operator (operator A, B, etc.), work history, skills, desired work, etc. The skills possessed by the operator can be registered based on the operator's self-declaration record in addition to the actual performance data recorded by the remote control system.

[0050] - Matchmaking Servers -

[0051] The matching server 6 is a computer having a CPU and other storage devices such as a memory, and has a matching function 61 and a manipulation network control function 62. The matching function 61 performs communication processing with the construction machines 2A, 2B, the remote manipulation devices 4A, 4B, and the management terminal 5 via a communicator 611 provided in the matching server 6 (or connected thereto). In addition, the matching function 61 performs an operator authentication process 612, a DB login process 613, a matching process 614, an operator reference process 615, and a work reference process 616. The manipulation network control function 62 controls a switch 622 through a communication control process 621 to perform switching control of the construction machines that are the communication connection objects of the remote manipulation devices 4A, 4B.

[0052] The communicator 611 plays a role of communicating with the construction machines 2A, 2B, the remote control devices 4A, 4B, and the management terminal 5 via the matching information network NT2. For example, the matching server 6 receives the standby notification (described above) from the construction machines 2A, 2B via the communicator 611. In addition, the communicator 611 receives various data logged in through the management terminal 5, such as the work site, the construction machine, the required skills required for the remote control of the construction machine and the work using the construction machine, the operator, and the skills possessed by each operator. The authentication data of the operator A, B, etc., which is input by the input device 42A, 42B of the remote control device 4A, 4B, is received from the remote control device 4A, 4B via the communicator 611, and the authentication data is input to the matching server 6.

[0053] In the operator authentication process 612, the authentication data of operators A and B received from the remote control devices 4A and 4B are queried to the operator DB 617 to confirm whether operators A and B are operators registered in the operator DB 617. The authentication result is transmitted to the remote control devices 4A and 4B via the matching information network NT2.

[0054] In the DB login process 613, when the standby notification from the construction machines 2A and 2B is input, the fact that the construction machines 2A and 2B are in an operable state is reflected in the operation DB 618. In addition, the work site data, construction machine data, and required skill data input from the management terminal 5 are stored in the operation DB 618 through the DB login process 613. The authentication data and possessed skill data of the operators A and B input from the remote control devices 4A and 4B and the management terminal 5 are stored in the operator DB 617 through the DB login process 613.

[0055] In the operator reference process 615 , personal data such as the skills possessed by the operators A and B are referenced from the operator DB 617 .

[0056] In the work reference process 616 , data related to the work, such as work data, required skill data, and construction machine data, are referenced from the work DB 618 .

[0057] In the matching process 614, the skill data of operators A and B referenced by the operator reference process 615 and the required skill data referenced by the operation reference process 616 are compared to create a list of candidate operations and construction machinery that operators A and B can undertake. The created list of candidate operations and the like is sent to the remote control devices 4A and 4B via the matching information network NT2. The remote control devices 4A and 4B display the list of candidate operations and the like on the displays 43A and 43B to present them to operators A and B. When operators A and B select the desired operation and construction machinery from the list and input them through the input devices 42A and 42B, the data of the operation and construction machinery selected by operators A and B are input to the matching server 6 via the matching information network NT2. In the matching process 614, the remote control device and the selected construction machinery are matched based on the selection of operators A and B.

[0058] In the communication control process 621, the switch 622 is controlled based on the combination of the remote control device and the construction machine set by the matching function 61, and the matched remote control device and the construction machine are connected to each other through the remote control network NT1. As a result, for example, operators A and B can operate the remote control devices 4A and 4B to remotely control the construction machine connected to the communication and perform work. The setting of the above-mentioned priority right of operation is also performed by the communication control process 621.

[0059] Then, when the operators A and B complete the operation of ending the remote control in the remote control devices 4A and 4B, a notification of the end of the operation is sent from the remote control devices 4A and 4B via the communicators 41A and 41B and the matching information network NT2 to the matching server 6. In the matching server 6, when the notification of the end of the operation is received via the communicator 611, the communication control process 621 is executed and the switch 622 is controlled to cut off the communication connection between the remote control devices 4A and 4B and the construction machines 2A and 2B, and the matching process 614 is ended.

[0060] In addition, the DB registration process 613 is executed together with the above-mentioned end process, and the actual performance values ​​such as the content of the work related to the remote control after the end process, the type of the construction machine after the control, and the work time are reflected in the data of the operators A and B stored in the operator DB 617. The work time can be evaluated by, for example, the communication connection time between the remote control device 4A, 4B and the construction machine 2A, 2B, the operation time of the operation device 44A, 44B, or the driving time of the actuator of the construction machine 2A, 2B.

[0061] - Preparation -

[0062] Figure 4 This is a flowchart showing the procedure of the preparation work (login work) for the work using the remote control system of this embodiment. Figure 4 The flowchart is used to explain the sequence of preparation work for the operation using the remote control system.

[0063] (Step S1)

[0064] First, in step S1, for example, the operator's data is logged in in the management terminal 5 using the display 55 and the input device 56 by the management operator. The operator's data logged in here includes the operator's identification number, the password issued to the operator, the experience time and proficiency of remote operation of construction machinery. Proficiency refers to data that quantifies the operator's skills in remote operation of each type of construction machinery. As an example, the operation time of each type of operation of each type of construction machinery and the operator's proficiency in the operation (for example, the operator's report) can be cited. The operator's data input to the management terminal 5 is sent to the matching server 6 via the communicator 51 and the matching information network NT2, and is stored in the operator DB 617 after the DB login process 613.

[0065] (Step S2)

[0066] In step S2, for example, the management operator registers the data of the requested operation in the management terminal 5 using the display 55 and the input device 56. The operation data registered here include the construction machinery used in each operation, the operator's proficiency required for remotely operating the construction machinery for each operation, and the estimated time required for each operation. The operation data input to the management terminal 5 is transmitted to the matching server 6 via the communicator 51 and the matching information network NT2, and is stored in the operation DB 618 after the DB registration process 613.

[0067] Typically, the preparation work is performed in the order of steps S1 and S2, but steps S1 and S2 can also be performed in a different order. In addition, the preparation work is performed whenever necessary, and sometimes both steps S1 and S2 need to be performed, and sometimes only one of steps S1 and S2 is sufficient.

[0068] - Remote control -

[0069] Figure 5 1 is a flowchart showing the procedure of remote control work of a construction machine using the remote control system of the present embodiment. Figure 5 , describes the process of operators A and B using the remote control system of this embodiment to perform remote control work on a construction machine. In addition, Figure 5 The flowchart assumes that the data of operators A and B and the data of the operation have been logged. Figure 4 Preparation work.

[0070] (Step S11)

[0071] Step S11 is the step of login authentication of operator A. First, in the operation room 3, operator A operates the input device 42A to input his ID (identification number) and password while viewing the display 43A of the remote control device 4A. The input ID and password are sent to the matching server 6 via the communicator 41A and the matching information network NT2. In the matching server 6, the operator authentication process 612 is executed to inquire the operator DB 617 about the received ID and password of operator A. In the case where the data of operator A exists in the operator DB 617, a notification of authentication OK is sent from the matching server 6 to the remote control device 4A via the matching information network NT2, and the authentication result (authentication OK) is displayed on the display 43A of the remote control device 4A. In the case where the data of operator A does not exist in the operator DB 617, a notification of authentication NG is sent from the matching server 6 to the remote control device 4A via the matching information network NT2, and the authentication result (authentication NG) is displayed on the display 43A of the remote control device 4A. In the case of authentication NG, Figure 5 The process ends here.

[0072] (Step S12)

[0073] Step S12 is a step of login authentication of operator B. The steps performed in conjunction with the login authentication of operator B and the processing contents of the matching server 6 are the same as those in the case of the login authentication of operator A. Figure 5 The order of the login authentication of operators A and B shown is an example, and the order of the login authentication of operators A and B may be reversed. At this point in time, it is assumed that operators A and B do not know that the other party is logging in or about to log in to the system.

[0074] (Step S13)

[0075] Step S13 is a step in which the matching server 6 searches for candidate jobs that the operator A who has logged in and authenticated can undertake based on the operator DB 617 and the job DB 618, and presents the search result to the first remote control device 4A operated by the operator A. The matching server 6 executes the operator reference processing 615 to read data such as the experience time and proficiency of remote control of construction machinery related to the operator A from the operator DB 617. In addition, the matching server 6 executes the job reference processing 616 to search for candidate jobs suitable for the operator A from the job DB 618 using the experience time and proficiency of remote control of construction machinery of the operator A and the jobs that can be undertaken as search conditions. The searched candidate job data is transmitted from the matching server 6 to the remote control device 4A via the matching information network NT2 together with the candidate data of the construction machinery used in the job, and is displayed on the display 43A of the remote control device 4A.

[0076] In addition, in step S13, depending on the search conditions (i.e., the skills possessed by operator A, etc.), there may be a situation where no candidate operations matching the search conditions are extracted, or there may be a situation where only one or more candidate operations are extracted. Figure 5 The process ends here.

[0077] (Step S14)

[0078] Step S14 is a step in which operator A issues a request for assistance based on the work of others. When operator A selects the work to be undertaken by himself and the construction machinery to be operated from the candidate work displayed on the display 43A, he confirms the data of the content of the selected work (operation items performed in the work, such as loading and unloading of earth and sand, movement of construction machinery, etc.). In this example, it is assumed that the selected work selected from the candidate work includes operation items that operator A is not good at. Therefore, operator A performs an operation requesting assistance (such as the selection of the operation item requesting assistance and the display of the meaning of the request for assistance) for the operation item that he is not good at. As a result, a notification of the assistance request is sent from the remote control device 4A to the matching server 6 via the matching information network NT2.

[0079] (Step S15)

[0080] The subsequent step S15 is a step in which the matching server 6 executes the matching process 614 to search for a second operator who assists the operator A, and issues a notification of an assistance request to the second operator extracted by the search.

[0081] Specifically, in step S15, when the matching server 6 receives a notification of an assistance request for the selected operation from the remote control device 4A, it searches for the second operator from the logged-in operators based on the operator DB 617 and the operation DB 618. The second operator is extracted using, as a search condition, the operation item as the object of the assistance request specified by the operator A, for example, the experience time and proficiency of the remote operation of the construction machinery (machine model) to be operated by the operator A. Here, it is assumed that the operator B is extracted as the second operator. In this case, the matching server 6 notifies the remote control device 4B operated by the operator B of the assistance request and the operation (operation item, etc.) related to the assistance request via the matching information network NT2. The content of the notification is displayed on the display 43B of the remote control device 4B.

[0082] Furthermore, when the only operator suitable as the second operator is operator B, or when operator B has the best suitability as the second operator, the configuration may be such that the assistance request is notified only to the remote control device 4B. In addition, when there are multiple operators suitable as the second operator registered, the configuration may be such that the assistance request is notified to multiple remote control devices operated by these operators.

[0083] In step S14, the operator A may perform an operation to accept the selected operation without performing the operation to request assistance, and the matching server 6 may receive a notification of the selection of the operation and its acceptance from the remote operating device 4A. In this case, the matching server 6 skips the order of steps S15 and S16, transfers the process from step S14 to step S17, and matches the remote operating device 4A alone with the construction machine.

[0084] (Step S16)

[0085] Step S16 is a step in which the operator B accepts the assistance request of the operator A. The operator B checks the display of the display 43B, operates the input device 42B, and inputs whether to accept the assistance request. In the case where the assistance request cannot be accepted, the operator B operates the input device 42B and inputs that the assistance request cannot be accepted. In this case, a notification of non-acceptance of the assistance request is sent from the remote control device 4B to the matching server 6 via the matching information network NT2.

[0086] In the case where the remote control device that notified the assistance request cannot obtain a notification of acceptance, if there are other candidates besides the second operator, the matching server 6 transmits a notification of the assistance request to the remote control device operated by the other person. As a result, if there is no operator who accepts the assistance request, the matching server 6 transmits a notification to the remote control device 4A that there is no operator who intends to accept the assistance request, and notifies the operator A. If the assistance of other persons cannot be obtained, the operator A can give up the assistance request and take on the work alone, can select other candidate work, or can cancel the work.

[0087] On the other hand, when the operator B accepts the assistance request, the operator B operates the input device 42B and inputs the intention of accepting the assistance request. In this case, a notification of acceptance of the assistance request is sent from the remote operating device 4B to the matching server 6 via the matching information network NT2. When receiving the notification of acceptance of the assistance request in this way, the matching server 6 executes the matching process 614, sends the data of the operator B to the remote operating device 4A, and displays it on the display 43A.

[0088] The operator A refers to the data of the operator B displayed on the display 43A, determines the operation items etc. to be requested for assistance to the operator B while considering the skills etc. of the operator B, and operates the input device 42A to input specific assistance request contents. The data of the assistance request contents are transmitted from the remote control device 4A to the matching server 6 via the matching information network NT2.

[0089] As part of the matching process 614, the matching server 6 transmits the assistance request content input by the operator A to the remote control device 4B, displays it on the display 43B, and informs the operator B. The operator B sees the assistance request content from the operator A displayed on the display 43B to determine whether to accept the final request, and operates the input device 42B to transmit the acceptance to the matching server 6. In the case where the operator B does not accept the final request (decides to accept), the matching server 6 transmits a notification of the assistance request to the remote control device operated by other persons, etc., in the same manner as described above, if there are other candidates in addition to the second operator. In this example, the case where the operator B decides to accept the request is further described.

[0090] (Step S17)

[0091] Step S17 is a step in which the matching server 6 determines the work to be jointly undertaken by the operators A and B as part of the matching process 614. The matching server 6 receives a notification of acceptance from the remote control device 4B, and transmits a notification to the remote control devices 4A and 4B via the matching information network NT2 that the matching of the operators A and B and the work has been established, and notifies the operators A and B. In this way, the work to be jointly undertaken by the operators A and B is determined.

[0092] (Step S18)

[0093] Step S18 is a step in which the matching server 6 executes the communication control processing 621 upon receiving the acceptance notification from the remote control device 4B, and connects the remote control devices 4A and 4B to the construction machine to be controlled in the selected operation based on the operation DB 618. Figure 2 Assume that the controlled object is the construction machine 2A. The matching server 6 establishes a communication connection between the remote control devices 4A, 4B and the construction machine 2A via the remote control network NT1 and starts measuring the operation time (eg, the connection time between the remote control devices 4A, 4B and the construction machine 2A).

[0094] Here, when the communication connection between the remote control devices 4A, 4B and the construction machine 2A is established, the matching server 6 controls the remote control network NT1 to set the priority control right of the construction machine 2A to the remote control device 4B, which is the auxiliary one of the remote control devices 4A and 4B. In this case, although the construction machine 2A can be controlled by both the remote control devices 4A and 4B, the network operation signal from the remote control device 4B is given priority over the network operation signal from the remote control device 4A. For example, even in the process of being controlled by the remote control device 4A, if the network operation signal from the remote control device 4B is input, the construction machine 2A will be operated according to the network operation signal from the remote control device 4B.

[0095] (Step S19)

[0096] Step S19 is a step of remotely controlling the construction machine 2A. When the communication connection between the remote control device 4A, 4B and the construction machine 2A is established, the image captured by the camera 22A is sent from the construction machine 2A to the remote control device 4A, 4B, and is displayed in real time on the display 45A, 45B of the remote control device 4A, 4B. Basically, the following situation is envisioned: the first operator, i.e., operator A, who has selected the work to be undertaken, operates the operating device 44A while viewing the image displayed on the display 45A. In this case, a network operation signal is sent from the remote control device 4A to the construction machine 2A in conjunction with the operation of the operating device 44A, and the construction machine 2A moves according to the operation of the operator A to perform the work.

[0097] However, during this period, when operator B determines that there is a point that should be corrected in operator A's operation, for example, through the image displayed on the display 45B, operator B appropriately operates the operating device 44B. If the remote operating device 4B set with priority operation rights is operated, the construction machine 2A will move according to the operation of the remote operating device 4B even in the process of operation based on the remote operating device 4A. In this case, for example, the content that the operation based on the remote operating device 4B is prioritized is displayed on the display 45A of the remote operating device 4A, and operator A is notified that operator B's operation has intervened. Of course, when the operation is entrusted from operator A to operator B, operator B operates the construction machine 2A instead of operator A based on the agreement of operators A and B.

[0098] Furthermore, for example, when operator B wants to invalidate an operation item (such as loading of earth and sand) that operator A cannot perform properly due to insufficient skills, operator B operates operating device 48B to send a setting signal of priority operating right to matching server 6. As a result, communication control processing 621 is executed to invalidate the network operation signal from remote operating device 4A, making it impossible to operate construction machine 2A by remote operating device 4A.

[0099] In addition, in the case where it is not appropriate to give the priority right of operation uniformly to the operator B (assistant), for example, the operators A and B communicate with each other using the intercoms 47A and 47B, and the priority right of operation can be transferred between the remote control devices 4A and 4B. Specifically, through the operation of the operating devices 48A and 48B, a predetermined setting signal is sent from the remote control devices 4A and 4B to the matching server 6. The matching server 6 that receives the setting signal selectively sets the priority right of operation of the construction machine 2A for one of the remote control devices 4A and 4B based on the setting signal. In this way, for example, the remote control right set for the remote control device 4B can be transferred to the remote control device 4A.

[0100] Furthermore, the communication between operators A and B is not limited to voice calls, and may be replaced by other communication methods such as sending and receiving text messages using a chat program or the like.

[0101] Then, after completing the predetermined work, the operator A or B (for example, the operator with the priority control right) operates the input device 42A or 42B of the remote control device 4A or 4B that the operator is operating, and sends an end signal to the matching server 6 via the matching information network NT2. The matching server 6 that receives the end signal executes the communication control process 621 to cut off the communication connection between the remote control device 4A, 4B and the construction machine 2A.

[0102] (Step S20)

[0103] Step S20 is a step of updating the operator DB 617 by taking into account the actual performance related to the remote control of operators A and B after the operation is completed. The matching server 6 terminates the measurement of the operation time by disconnecting the communication connection between the remote control devices 4A and 4B and the construction machine 2A. In addition, the matching server 6 executes the DB login process 613, and updates the operator DB 617 and the operation DB 618 based on the operation time performed by operators A and B and the proportion of the auxiliary time in the operation time for this operation. Here, for example, data such as the type of construction machine operated, the operation time, the type of operation, the operation item, and the proportion of the auxiliary time are updated. Along with the update of these data, data such as the operations that operators A and B can undertake and the operations that can be assisted are also updated by satisfying the predetermined conditions set in advance. The updated data of the operator DB 617 and the operation DB 618 (or the difference data before and after the update) are sent from the matching server 6 to the management terminal 5.

[0104] -Effect-

[0105] (1) According to the present embodiment, in response to the assistance request of the operator A who is responsible for the remote operation of the construction machine, the operator B who can respond to the assistance request is matched, and the remote control devices 4A and 4B operated by the operators A and B are communicatively connected to the same construction machine 2A. Thus, even a task that is difficult to be completed by the operator A alone can be performed with the help of the operator B, and the degree of freedom of matching the operator with the task is increased, making it easier to secure operators who are prone to insufficient manpower.

[0106] On this basis, according to this embodiment, operator A can delegate the operation that he is not good at to operator B during the operation, and learn the operation performed by operator B through display 45A. In this way, the operator can learn the skills possessed by others through actual drills through the remote control system for the operation that he is not good at, and effectively learn the skills of remote control without relying on personal thinking. In this way, according to this embodiment, the operator's skills in remote control of construction machinery can be effectively improved.

[0107] (2) In addition, in the present embodiment, when multiple remote control devices are connected to the same construction machine for communication, priority control rights are set for the remote control device operated by the operator entrusted with assistance. Thus, for example, when there is a danger point in the operation of operator A, operator B can intervene in the operation of operator A to operate the construction machine, which is effective in avoiding operation failure and helping operator A learn skills.

[0108] (3) In addition, for example, operator B who has received the assistance request can invalidate the network operation signal of the remote control device 4A operated by operator A by operating and setting the operation device 48B. In this way, during the assistance operation performed by operator B, the erroneous operation of operator A is invalidated, and the operation of operator B can be prevented from being unpredictably hindered.

[0109] On this basis, the operation of the remote control device 4A by the assisted operator A becomes invalid, so that the operator A can freely operate the operating device 44A while watching the display 45A. Thus, for example, the operator A can operate the operating device 44A in accordance with the movement of the construction machine 2A by the operation of the operator B shown on the display 45A, imitate the operation of the operator B, and experience it personally, thereby effectively learning the remote control skills.

[0110] (4) In addition, the priority right of operation can be transferred between the remote control devices 4A and 4B through appropriate communication between operators A and B. Thus, for example, in a case where the intervention of the operation by operator B who has made the assistance request is not preferred, the priority right of operation can be held by operator A who has made the assistance request, and the priority right of operation can be flexibly set according to the situation.

[0111] - Modifications -

[0112] In the above-described embodiment, a case is described in which a communication connection between the remote control device 4A, 4B and the construction machine 2A is established after the operator B decides to accept the assistance request of the operator A. However, the timing of establishing a communication connection between the remote control device 4A operated by the operator A and the construction machine 2A is not limited to the above-described example. For example, it may also be configured so that before the operator A makes an assistance request, the communication connection between the remote control device 4A and the construction machine 2A is established at the time when the operator A selects the operation and the construction machine 2A from the candidate operations. That is, the configuration is not limited to the step of executing the assistance request at the time before the operation of the operator A starts, and it may also be configured so that the assistance request is executed at the time when the need actually arises after the operation starts.

[0113] in addition, Figure 3 In the example, the operator DB 617 and the job DB 618 are stored in the matching server 6. However, at least one of the operator DB 617 and the job DB 618 may be configured to be stored in another computer (for example, the management terminal 5) instead of the storage device of the matching server 6. In this case, not only a single computer (matching server 6) but a plurality of computers (for example, the matching server 6 and the management terminal 5) constitute the matching server of the invention.

[0114] Description of Reference Numerals

[0115] 2A, 2B...construction machinery, 4A, 4B...remote control device, 5...management terminal (matching server), 6...matching server, 617...operator DB (database), 618...job DB (database).

Claims

1. A remote control system comprising: Construction machinery; A plurality of remote control devices for wirelessly controlling the engineering machinery; and a matching server for matching one of the plurality of remote control devices with the construction machine, The remote control system is characterized in that: The matching server is composed of: storing a database including authentication data of a plurality of operators, possessed skill data related to skills possessed by each of the plurality of operators, construction machine data related to the construction machine arranged at a work site, and required skill data related to skills required for work using the construction machine at the work site, Based on the database, candidate jobs that can be undertaken by a first operator who has completed login authentication are searched and presented to a first remote control device operated by the first operator. When a notification of a request for assistance is received from the first remote control device for a selected operation selected from the candidate operations, a second operator who can assist the selected operation is detected from among the logged-in operators based on the database; notifying a second remote control device operated by the second operator of the assistance request and an operation related to the assistance request, When the notification of acceptance of the assistance request is received from the second remote operating device, both the first remote operating device and the second remote operating device are communicatively connected to the construction machine to be operated in the selected work based on the database.

2. The remote control system according to claim 1, characterized in that: The matching server sets a priority control right of the construction machine to be the control target for the second remote control device among the first remote control device and the second remote control device.

3. The remote control system according to claim 2, characterized in that: The matching server invalidates the operation of the construction machine serving as the control target performed by the first remote control device based on the setting signal from the second remote control device.

4. The remote control system according to claim 1, characterized in that: The matching server sets a priority control right of the construction machine that is the control target to either the first remote control device or the second remote control device based on setting signals from the first remote control device and the second remote control device.