Remote operation system, remote operation management method, and management program

Abstract

The invention relates to a remote operation system, a remote operation management method, and a management program. A remote operation system for remote operation of a plurality of moving bodies includes one or more processors configured to acquire operator license information indicating licenses possessed by each of a plurality of remote operators with respect to operation of the plurality of moving bodies; a request capability information acquisition unit that acquires request capability information indicating at least a request license requested for the remote operation of the target moving body; on the basis of the operator license information and the request license, a first remote operator among the plurality of remote operators having the request license is allocated to perform the remote operation of the target moving body.

Description

Technical Field

[0001] The present disclosure relates to remote operation of a mobility (mobility, travel, mobile tool). Background Art

[0002] U.S. Patent Application Publication No. 2020 / 0062267 discloses a system related to remote operation of a vehicle. The system assigns an appropriate remote operator for remote operation of the vehicle based on the skills and experience values of the remote operator(s). Summary of the Invention

[0003] Consider the case where a remote operator performs remote operation of a mobility. As the object of remote operation, there may be various mobilities. However, a remote operator may not hold a license related to all types of mobilities. When a remote operator who does not have a license for the mobility to be operated is wrongly assigned to perform remote operation of the target mobility, it is necessary to start the assignment process from the beginning, which is inefficient.

[0004] The present disclosure provides a technique capable of efficiently performing an assignment process for assigning a remote operator for remote operation of a mobility.

[0005] A remote operation system for remote operation of multiple mobilities according to a first aspect of the present disclosure includes one or more processors configured to obtain operator license information indicating licenses that each of a plurality of remote operators has regarding operations of the multiple mobilities; obtain required ability information indicating at least a required license for the remote operation of a target mobility; and based on the operator license information and the required license, assign a first remote operator among the plurality of remote operators who has the required license to perform the remote operation of the target mobility.

[0006] A remote operation management method for a computer to manage remote operation of multiple mobilities according to a second aspect of the present disclosure includes: obtaining operator license information indicating licenses that each of a plurality of remote operators has regarding operations of the multiple mobilities; obtaining required ability information indicating at least a required license for the remote operation of a target mobility; and based on the operator license information and the required license, assigning a first remote operator among the plurality of remote operators who has the required license to perform the remote operation of the target mobility.

[0007] The management program executed by a computer for managing remote operations of multiple moving bodies according to the third aspect of the present disclosure includes: acquiring operator license information, which represents licenses that each of multiple remote operators has regarding operations of the multiple moving bodies; acquiring required ability information, which represents at least a required license for the remote operation of an object moving body; and based on the operator license information and the required license, allocating a first remote operator among the multiple remote operators who has the required license to perform the remote operation of the object moving body.

[0008] According to the present disclosure, the licenses that each remote operator has and the required license for the remote operation of the object moving body are considered. Moreover, a first remote operator who has the required license is allocated to perform the remote operation of the object moving body. Thereby, a situation where a remote operator who does not have the required license is erroneously allocated to the object moving body is prevented in advance. Therefore, there is no need to start the allocation process from the beginning, and an efficient allocation process can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Hereinafter, features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described with reference to the drawings, in which like reference numerals denote like elements, and wherein:

[0010] Figure 1 is a conceptual diagram for explaining the outline of a remote operation system.

[0011] Figure 2 is a diagram showing an example of the content of various remote operations requested for various moving bodies.

[0012] Figure 3 is a conceptual diagram showing an example of the configuration (structure) of a remote operation system.

[0013] Figure 4 is a block diagram showing an example of the configuration of a moving body.

[0014] Figure 5 is a block diagram showing an example of the configuration of a remote operator terminal.

[0015] Figure 6 is a block diagram showing an example of the configuration of a management system.

[0016] Figure 7 is a conceptual diagram for explaining the outline of the allocation process performed by the management system.

[0017] Figure 8 is a block diagram showing an example of a functional structure associated with score calculation.

[0018] Figure 9 It is a conceptual diagram showing an example of an operator's status and an operator's score.

[0019] Figure 10 It is a conceptual diagram showing an example of a terminal status and a terminal score.

[0020] Figure 11 It is a block diagram showing another example of a functional structure associated with score calculation.

[0021] Figure 12 It is a block diagram showing an example of a functional structure associated with the allocation process under the first viewpoint.

[0022] Figure 13 It is a conceptual diagram showing an example of operator license information.

[0023] Figure 14 It is a block diagram showing an example of a functional structure associated with the allocation process under the second viewpoint.

[0024] Figure 15 It is a conceptual diagram showing an example of terminal specifications information.

[0025] Figure 16 It is a block diagram showing an example of a functional structure associated with the allocation process under the third viewpoint.

[0026] Figure 17 It is a conceptual diagram showing an example of terminal specifications information related to an operating system and required terminal specifications.

[0027] Figure 18 It is a conceptual diagram showing an example of terminal specifications information related to a display system and required terminal specifications. Detailed implementation manners

[0028] With reference to the accompanying drawings, the implementation manners of the present disclosure will be described.

[0029] 1. Outline of the remote operation system

[0030] Figure 1 It is a conceptual diagram for explaining the outline of the remote operation system 1 according to this implementation manner. The remote operation system 1 is a system for remotely operating the mobile body 100. Remote operation includes the concept of remote driving. The remote operation system 1 includes the mobile body 100, the remote operator terminal 200, and the management system 300.

[0031] The mobile body 100 is a movable object (mobile object) capable of moving. The mobile body 100 can also be manually operated by an operator riding on the mobile body 100. The mobile body 100 can also have an autonomous movement function. In any case, the mobile body 100 is configured to be remotely operable as needed. That is, the mobile body 100 is an object of remote operation of the remote operation system 1.

[0032] The type of the mobile body 100 that becomes the object of remote operation is not limited to one type, and can be multiple types. For example, the mobile body 100 is a vehicle traveling on a road (e.g., sedan, truck, bus, MaaS (Mobility as a Service) vehicle, autonomous driving vehicle, etc.). As another example, the mobile body 100 can also be a vehicle used in a factory (e.g., forklift, factory truck, etc.). As yet another example, the mobile body 100 can also be a special small vehicle (e.g., golf course cart, personal mobility means, electric wheelchair, etc.). As yet another example, the mobile body 100 can also be construction machinery (e.g., power shovel, bulldozer, etc.). As yet another example, the mobile body 100 can also be a robot (e.g., logistics robot, work robot, etc.). As yet another example, the mobile body 100 can also be a flying object (e.g., drone, etc.). As yet another example, the mobile body 100 can also be a ship (e.g., small ship, large cruiser, etc.). As yet another example, the mobile body 100 can also be a ride in an amusement park (e.g., trolley, amusement facility, etc.).

[0033] Figure 2 Examples of the content of various remote operations requested for various mobile bodies 100 are shown. As Figure 2 Illustrated, the mobile bodies 100 are diverse, and in addition, the content of the requested remote operations is also diverse. In addition, the remote operation can be requested either by the mobile body 100 itself or by a service provider cooperating with the remote operation system 1. In the latter case, the content of the remote operation can also be said to be the content of the service provided by the service provider.

[0034] The remote operator terminal 200 is a terminal device used by the remote operator O to remotely operate the mobile body 100. That is, the remote operator terminal 200 is configured to be used by the remote operator O to perform remote operation of the mobile body 100. Examples of the remote operator terminal 200 include a cockpit-type terminal, a PC, a tablet computer, a smart phone, etc. A single remote operator terminal 200 may also be configured to be capable of handling remote operations of various mobile bodies 100. Alternatively, a single remote operator terminal 200 may be a dedicated terminal for remote operation of a specific mobile body 100. In addition, the combination of the remote operator O and the remote operator terminal 200 may be determined in advance or may be freely changeable. That is, a single remote operator terminal 200 may be used only by a specific remote operator O, or may be used by various remote operators O in turn.

[0035] The management system (manager) 300 manages the remote operation system 1. The management system 300 may also be composed of multiple servers performing distributed processing. For example, the management system 300 manages multiple remote operators O and multiple remote operator terminals 200. In addition, the management system 300 responds to a remote operation request and allocates a remote operator O and a remote operator terminal 200 to perform remote operation of the mobile body 100. In addition, the management system 300 may also manage the state of the mobile body 100 during remote operation. Details of the management system 300 will be described later.

[0036] The mobile body 100, the remote operator terminal 200, and the management system 300 can communicate with each other via a communication network. For example, the mobile body 100 can perform wireless communication with the remote operator terminal 200 and / or the management system 300 via a wireless communication network. The remote operator terminal 200 and the management system 300 can communicate with each other via a wired communication network or a wireless communication network. The mobile body 100 and the remote operator terminal 200 may communicate via the management system 300 or may communicate directly without passing through the management system 300.

[0037] The general information flow during the remote operation of the mobile body 100 is as follows.

[0038] The mobile body 100 is equipped with various sensors including a camera. The camera captures an image of the situation around the mobile body 100. Through the camera, an image representing the situation around the mobile body 100 is obtained. The mobile body information MOV is information obtained by various sensors and at least includes the image captured by the camera. The mobile body information MOV may also include the position and state (e.g., speed, steering angle, etc.) of the mobile body 100. The mobile body 100 sends the mobile body information MOV to the remote operator terminal 200.

[0039] The remote operator terminal 200 receives the moving body information MOV sent from the moving body 100. The remote operator terminal 200 presents the moving body information MOV to the remote operator O. Specifically, the remote operator terminal 200 includes a display device, and displays images and the like on the display device. The remote operator O views the displayed information, identifies the situation around the moving body 100, and performs remote operation of the moving body 100. The remote operation information OPE is information related to the remote operations (steering operation, acceleration operation, deceleration operation, forward and backward movement operation, lateral movement operation, etc.) performed by the remote operator O. For example, the remote operation information OPE includes the operation amount input by the remote operator O. The remote operation information OPE can be said to be information reflecting the degree of remote operation performed by the remote operator O. The remote operator terminal 200 sends the remote operation information OPE to the moving body 100.

[0040] The moving body 100 receives the remote operation information OPE sent from the remote operator terminal 200. The moving body 100 performs moving body control according to the received remote operation information OPE. In this way, the remote operation of the moving body 100 is realized.

[0041] Figure 3 It is a conceptual diagram showing a configuration example of the remote operation system 1. In Figure 3 the example shown, the remote operation management center is set in a predetermined site or a predetermined building. Moreover, the management system 300 and a plurality of remote operator terminals 200 (200-1 to 200-N, where N is an integer of 2 or more) are set in the remote operation management center. In addition, a plurality of remote operators O work in the remote operation management center. The management system 300 monitors and manages the states of the plurality of remote operator terminals 200 in the remote operation management center. In addition, the management system 300 monitors and manages the states of the plurality of remote operators O in the remote operation management center.

[0042] 2. Configuration example

[0043] 2-1. Configuration example of the moving body

[0044] Figure 4 It is a block diagram showing a configuration example of the moving body 100. The moving body 100 includes a communication device 110, a sensor group 120, one or more actuators 130, and a control device 150.

[0045] The communication device 110 performs wireless communication with the outside of the moving body 100. For example, the communication device 110 performs wireless communication with the remote operator terminal 200 and / or the management system 300.

[0046] The sensor group 120 includes an identification sensor, a moving body state sensor, a position sensor, etc. The identification sensor identifies (detects) the conditions around the moving body 100. As the identification sensor, a camera C, LIDAR (Laser Imaging Detection and Ranging), a radar, etc. can be exemplified. The moving body state sensor detects the state of the moving body 100. The moving body state sensor includes a speed sensor, an acceleration sensor, a yaw rate sensor, a steering angle sensor, etc. The position sensor detects the position and orientation of the moving body 100. For example, the position sensor includes GNSS (Global Navigation Satellite System).

[0047] The actuator 130 moves the moving body 100. For example, the actuator 130 includes a forward and backward moving actuator for moving the moving body 100 forward and backward (accelerating, decelerating). As another example, the actuator 130 may also include a lateral moving actuator for moving the moving body 100 laterally. As still another example, when the moving body 100 is equipped with an arm, the actuator 130 may also include an arm actuator for moving the arm (operating).

[0048] For example, when the moving body 100 is an ordinary vehicle, the actuator 130 includes a steering device, a driving device, and a braking device. The steering device steers the wheels. For example, the steering device includes an electric power steering (EPS) device. The driving device is a power source that generates a driving force. As the driving device, an engine, an electric motor, a wheel hub motor, etc. can be exemplified. The braking device generates a braking force.

[0049] The control device 150 is a computer that controls the moving body 100. The control device 150 includes one or more processors 160 (hereinafter simply referred to as the processor 160) and one or more storage devices 170 (hereinafter simply referred to as the storage device 170). The processor 160 performs various processes. Examples of the processor 160 include a general-purpose processor, a special-purpose processor, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), an integrated circuit, a conventional circuit, and / or a combination thereof. The processor 160 may also be referred to as circuitry or processing circuitry. Circuitry is hardware programmed to implement the described functions or hardware that executes the functions. The storage device 170 stores various information. Examples of the storage device 170 include a volatile memory, a non-volatile memory, an HDD (Hard Disk Drive), and an SSD (Solid State Drive).

[0050] The control program PROG1 is a computer program executed by the processor 160. The functions of the control device 150 can also be realized through the cooperation of the processor 160 that executes the control program PROG1 and the storage device 170. The control program PROG1 is stored in the storage device 170. Alternatively, the control program PROG1 may also be recorded on a computer-readable recording medium.

[0051] The control device 150 acquires driving environment information ENV indicating the driving (operation) environment of the moving body 100. The driving environment information ENV is stored in the storage device 170.

[0052] The driving environment information ENV includes surrounding condition information representing the recognition results of recognition sensors. For example, the surrounding condition information includes images captured by the camera C. Additionally, the surrounding condition information may also include object information related to the objects around the moving body 100. Examples of the objects around the moving body 100 include pedestrians, other vehicles (front vehicles, parked vehicles, etc.), white lines, stop lines, signal lights (traffic lights), signs, roadside structures (buildings), etc. The object information represents the relative position and relative speed of the object with respect to the moving body 100. For example, by analyzing the images obtained by the camera, objects can be recognized and the relative position of the object can be calculated. Additionally, based on the point cloud information obtained by LIDAR, objects can also be recognized and the relative position and relative speed of the object can be obtained.

[0053] In addition, the driving environment information ENV may also include moving body state information representing the detection results of moving body state sensors. The moving body state information represents the speed, acceleration (longitudinal acceleration, lateral acceleration), yaw rate, and steering angle of the moving body 100, etc.

[0054] Furthermore, the driving environment information ENV may also include position information representing the position and moving direction (azimuth) of the moving body 100. The position information is obtained by a position sensor. High-precision position information can also be obtained by performing self-position estimation processing (localization) using map information and surrounding condition information (object information).

[0055] The control device 150 performs movement control for controlling the movement of the moving body 100. The movement control includes longitudinal movement control and lateral movement control. The control device 150 performs movement control by controlling the actuator 130.

[0056] The control device 150 may also perform autonomous movement control based on the driving environment information ENV. More specifically, the control device 150 generates a movement plan for the moving body 100 based on the driving environment information ENV. Furthermore, the control device 150 generates a target trajectory required for the moving body 100 to travel according to the movement plan based on the driving environment information ENV. The target trajectory includes a target position and a target speed. Moreover, the control device 150 performs movement control to make the moving body 100 follow the target trajectory.

[0057] In the case of remotely operating the moving body 100, the control device 150 communicates with the remote operator terminal 200 via the communication device 110.

[0058] The control device 150 sends the moving body information MOV to the remote operator terminal 200. The moving body information MOV is the information required for the remote operator O to remotely operate the moving body 100, and includes at least a part of the above-described driving environment information ENV. In particular, the moving body information MOV includes the image captured by the camera C. The moving body information MOV may also include other surrounding condition information. The moving body information MOV may also include the moving body state information. The moving body information MOV may also include the position information.

[0059] In addition, the control device 150 receives the remote operation information OPE from the remote operator terminal 200. The remote operation information OPE is information related to the remote operation (steering operation, acceleration operation, deceleration operation, forward and backward movement operation, lateral movement operation, etc.) of the remote operator O. For example, the remote operation information OPE includes the operation amount input by the remote operator O. The control device 150 performs movement control according to the received remote operation information OPE.

[0060] 2-2. Configuration Example of Remote Operator Terminal

[0061] Figure 5 It is a block diagram showing a configuration example of the remote operator terminal 200. The remote operator terminal 200 includes a communication device 210, a display device 220, an input device 230, an operator sensor 240, and a control device 250.

[0062] The communication device 210 communicates with the moving body 100 and the management system 300.

[0063] The display device 220 displays various information to the remote operator O who performs the remote operation. In other words, the display device 220 presents various information to the remote operator O by displaying various information. Typically, the display device 220 is a display (monitor) such as a liquid crystal display or an organic EL display. The display device 220 may also be a touch panel.

[0064] The input device 230 accepts the input of the remote operator O. For example, the input device 230 includes the remote operation components that the remote operator O operates when remotely operating the moving body 100. Examples of the remote operation components include a steering wheel (rudder wheel), an accelerator pedal, a brake pedal, a direction indicator, a joystick, a cross key, and a switch. The remote operation component may also be a touch panel. The input device 230 may also include a keyboard, a mouse, a touch panel, etc. other than the remote operation components.

[0065] The operator sensor 240 is a sensor for monitoring the status of the remote operator O. For example, the operator sensor 240 includes a biological sensor that detects biological information of the remote operator O. As biological information, body temperature, heart rate, blood pressure, sweating amount, etc. can be exemplified.

[0066] The control device 250 controls the remote operator terminal 200. The control device 250 includes one or more processors 260 (hereinafter, simply referred to as the processor 260) and one or more storage devices 270 (hereinafter, simply referred to as the storage device 270). The processor 260 executes various processes. As the processor 260, a CPU, a GPU, an ASIC, an FPGA, etc. can be exemplified. Examples of the processor 260 include a general-purpose processor, a special-purpose processor, a CPU, a GPU, an ASIC, an FPGA, an integrated circuit, a conventional circuit, and / or a combination thereof. The processor 260 can also be referred to as circuitry or processing circuitry. Circuitry is hardware programmed to implement the described functions or hardware that executes the functions. The storage device 270 stores various information. As the storage device 270, a volatile memory, a non-volatile memory, an HDD, an SSD, etc. can be exemplified.

[0067] The control program PROG2 is a computer program executed by the processor 260. The functions of the control device 250 can also be realized by the cooperation of the processor 260 that executes the control program PROG2 and the storage device 270. The control program PROG2 is stored in the storage device 270. Alternatively, the control program PROG2 can also be recorded on a computer-readable recording medium. The control program PROG2 can also be provided via a network.

[0068] The control device 250 communicates with the mobile body 100 via the communication device 210. The control device 250 receives the mobile body information MOV sent from the mobile body 100. The control device 250 presents the mobile body information MOV to the remote operator O by displaying the mobile body information MOV including an image on the display device 220. The remote operator O can recognize the status of the mobile body 100 and / or the surrounding conditions based on the mobile body information MOV displayed on the display device 220.

[0069] The remote operator O operates the remote operation part of the input device 230. The operation amount of the remote operation part is detected by a sensor provided in the remote operation part. The control device 250 generates remote operation information OPE that reflects the operation amount of the remote operation part by the remote operator O. The remote operation information OPE can be said to be information that reflects the degree of remote operation by the remote operator O. Further, the control device 250 transmits the remote operation information OPE to the mobile body 100 via the communication device 210.

[0070] 2-3. Configuration example of management system

[0071] Figure 6 FIG. is a block diagram showing a configuration example of the management system 300. The management system 300 includes a communication device 310 and a control device 350.

[0072] The communication device 310 communicates with the mobile body 100 and the remote operator terminal 200.

[0073] The control device 350 controls the management system 300. The control device 350 includes one or more processors 360 (hereinafter simply referred to as the processor 360) and one or more storage devices 370 (hereinafter simply referred to as the storage device 370). The processor 360 performs various processes. Examples of the processor 360 include a general-purpose processor, a special-purpose processor, a CPU, a GPU, an ASIC, an FPGA, an integrated circuit, a conventional circuit, and / or a combination thereof. The processor 360 may also be referred to as circuitry or processing circuitry. Circuitry is hardware programmed to implement the described functions or hardware that performs the functions. The storage device 370 stores various information. Examples of the storage device 370 include a volatile memory, a non-volatile memory, an HDD, an SSD, etc.

[0074] The management program PROG3 is a computer program executed by the processor 360. The functions of the control device 350 can also be realized by the cooperation of the processor 360 that executes the management program PROG3 and the storage device 370. The management program PROG3 is stored in the storage device 370. Alternatively, the management program PROG3 may be recorded on a computer-readable recording medium. The management program PROG3 may also be provided via a network.

[0075] The storage device 370 also stores operator management information MGT-O and terminal management information MGT-T. The operator management information MGT-O is information for managing multiple remote operators O. For example, the operator management information MGT-O represents, for each remote operator O, an operator ID, a license, an availability, an assignment status, and a labor (work) history, etc. The terminal management information MGT-T is information for managing multiple remote operator terminals 200. For example, the terminal management information MGT-T represents, for each remote operator terminal 200, a terminal ID, a specification, an availability, an assignment status, and an operation (work) history, etc.

[0076] The control device 350 communicates with the mobile body 100 and the remote operator terminal 200 via the communication device 310. The control device 350 can also relay the communication between the mobile body 100 and the remote operator terminal 200. That is, the control device 350 can also relay the mobile body information MOV and the remote operation information OPE between the mobile body 100 and the remote operator terminal 200.

[0077] Before starting the remote operation of the mobile body 100, the control device 350 executes an "assignment process" of assigning an appropriate remote operator O and an appropriate remote operator terminal 200 to the remote operation of the mobile body 100. Hereinafter, the assignment process performed by the management system 300 (control device 350) will be described in further detail.

[0078] 3. Assignment Process

[0079] Figure 7 is a conceptual diagram for explaining the outline of the assignment process performed by the management system 300. Hereinafter, the mobile body 100 that is the object of the remote operation will be referred to as "object mobile body 100-X", the remote operator O assigned to the remote operation of the object mobile body 100-X will be referred to as "first remote operator O-X", and the remote operator terminal 200 assigned to the remote operation of the object mobile body 100-X will be referred to as "first remote operator terminal 200-X".

[0080] The management system 300 (control device 350) includes an assignment processing unit 400 that executes the assignment process. First, the assignment processing unit 400 receives a remote operation request REQ related to the object mobile body 100-X. For example, the remote operation request REQ is issued from the object mobile body 100-X itself. In this case, the object mobile body 100-X wirelessly communicates the remote operation request REQ to the management system 300. As another example, the remote operation request REQ can also be sent from a service provider that cooperates with the remote operation system 1 to the management system 300.

[0081] The remote operation request REQ indicates the type of the object moving body 100-X and the content of the desired remote operation. In response to the received remote operation request REQ, the allocation processing unit 400 allocates the first remote operator O-X and the first remote operator terminal 200-X to perform the remote operation of the object moving body 100-X. More specifically, the allocation processing unit 400 allocates an appropriate first remote operator O-X among the multiple remote operators O to perform the remote operation of the object moving body 100-X based on the remote operation request REQ and the operator management information MGT-O. In addition, the allocation processing unit 400 allocates an appropriate first remote operator terminal 200-X among the multiple remote operator terminals 200 to perform the remote operation of the object moving body 100-X based on the remote operation request REQ and the terminal management information MGT-T.

[0082] In order to implement appropriate allocation processing, the following three viewpoints are studied.

[0083] [Viewpoint 1] The status of each remote operator O and the status of each remote operator terminal 200.

[0084] [Viewpoint 2] The licenses held by each remote operator O and the required licenses for the remote operation of the object moving body 100-X.

[0085] [Viewpoint 3] The terminal specifications of each remote operator terminal 200 and the required terminal specifications for the remote operation of the object moving body 100-X.

[0086] The allocation processing unit 400 performs the allocation processing considering at least one of Viewpoint 1 to Viewpoint 3. The allocation processing unit 400 may also perform the allocation processing considering two or more of Viewpoint 1 to Viewpoint 3. Hereinafter, Viewpoint 1, Viewpoint 2, and Viewpoint 3 will be described in detail in Sections 4, 5, and 6, respectively.

[0087] 4. [Viewpoint 1] Allocation Processing Considering Operator Status and Terminal Status

[0088] Regarding the remote operator O, there may be a state suitable for remote operation and a state that is not. Assuming that the first remote operator O-X in a state not suitable for remote operation is selected, the accuracy of the remote operation will decrease. Similarly, regarding the remote operator terminal 200, there may be a state suitable for remote operation and a state that is not. Assuming that the first remote operator terminal 200-X in a state not suitable for remote operation is used, the accuracy of the remote operation will decrease.

[0089] Thus, in the first aspect, the allocation process is performed in consideration of the states of the respective remote operators O and the states of the respective remote operator terminals 200. For this purpose, the states of the respective remote operators O and the states of the respective remote operator terminals 200 are quantified in the form of "scores". A score is a quantitative parameter indicating the suitability (adaptability) for remote operation. For example, the score is calculated within the range of 0 to 100. The higher the score, the higher the suitability for remote operation. Then, based on this score, an appropriate first remote operator O-X and an appropriate first remote operator terminal 200-X are selected and assigned to the remote operation of the target moving body 100-X. Hereinafter, the first aspect will be described in more detail.

[0090] 4-1. Example of score

[0091] Figure 8 It is a block diagram showing an example of a functional structure related to score calculation.

[0092] 4-1-1. Example of operator score

[0093] The operator state acquisition unit 510 acquires operator state information STA-O indicating the state of the remote operator O. The operator score calculation unit 520 calculates an operator score SCR-O based on the operator state information STA-O. The operator score SCR-O indicates the suitability of the remote operator O for remote operation.

[0094] Figure 9 An example of the operator state and the operator score SCR-O is shown.

[0095] In the first example, the operator state acquisition unit 510 acquires the health state of the remote operator O. That is, the state of the remote operator O includes the health state of the remote operator O. For example, the remote operator O uses the remote operator terminal 200 or his own terminal (e.g., smartphone) to declare his own health state. As another example, in order to detect the health state of the remote operator O, the operator sensor 240 can also be used. The operator sensor 240 can be included in the remote operator terminal 200 (refer to Figure 5) may also be included in the terminal (e.g., a smart phone) owned by the remote operator O. The operator sensor 240 includes a biological sensor that detects biological information of the remote operator O. Examples of the biological information include body temperature, heart rate, blood pressure, sweating amount, etc. The operator state acquisition unit 510 acquires the biological information detected by the operator sensor 240. Moreover, the operator state acquisition unit 510 acquires the health state of the remote operator O based on the biological information of the remote operator O. For example, the health state is obtained from the biological information by using a machine learning model. The operator score calculation unit 520 calculates a first operator score based on the health state of the remote operator O. As Figure 9 shown, the better the health state of the remote operator O, the higher the first operator score.

[0096] In the second example, the operator state acquisition unit 510 acquires the working hours of the remote operator O engaged in remote operation during a certain period in the past. That is, the state of the remote operator O includes the working hours of the remote operator O engaged in remote operation during a certain period in the past. This working hours can be obtained, for example, from the operation log recorded by the remote operator terminal 200 that the remote operator O has operated in the past. Alternatively, the working hours can be obtained from the labor history records of each remote operator O included in the operator management information MGT-O. The operator score calculation unit 520 calculates a second operator score based on the working hours of the remote operator O. As Figure 9 shown, the longer the working hours of the remote operator O, the lower the second operator score.

[0097] In the third example, the operator state acquisition unit 510 acquires the hourly wage of the remote operator O. That is, the state of the remote operator O includes the hourly wage of the remote operator O. For example, the remote operator O uses the remote operator terminal 200 or his own terminal (e.g., a smart phone) to register his hourly wage. The hourly wage of each remote operator O can also be pre-registered in the operator management information MGT-O and can be obtained from the operator management information MGT-O. The operator score calculation unit 520 calculates a third operator score based on the hourly wage of the remote operator O. As Figure 9 shown, the lower the hourly wage of the remote operator O, the higher the third operator score.

[0098] Two or more of the above first to third examples can also be combined. In this case, the respective scores are added together.

[0099] Typically, the operator state acquisition unit 510 acquires the operator state information STA-O indicating the state of the remote operator O in real time. Moreover, the operator score calculation unit 520 calculates the operator score SCR-O based on the operator state information STA-O in real time.

[0100] The operator status acquisition unit 510 and the operator score calculation unit 520 may be included in the remote operator terminal 200, may be included in the management system 300, or may be distributed between the remote operator terminal 200 and the management system 300. When the operator status acquisition unit 510 is included in the management system 300, the remote operator terminal 200 sends the biological information of the remote operator O, the information on the working hours, etc. to the management system 300. When the operator status acquisition unit 510 and the operator score calculation unit 520 are included in the remote operator terminal 200, the remote operator terminal 200 only needs to send the information on the operator score SCR-O to the management system 300. In this case, since there is no need to send the biological information of the remote operator O, the information on the working hours, etc. to the management system 300, the communication volume between the remote operator terminal 200 and the management system 300 can be reduced. This helps to reduce the communication resources used.

[0101] 4-1-2. Examples of Terminal Scores

[0102] The terminal status acquisition unit 530 acquires the terminal status information STA-T indicating the status of the remote operator terminal 200. The terminal score calculation unit 540 calculates the terminal score SCR-T based on the terminal status information STA-T. The terminal score SCR-T indicates the suitability of the remote operator terminal 200 for remote operation.

[0103] Figure 10 Examples of the terminal status and the terminal score SCR-T are shown.

[0104] In the first example, the terminal status acquisition unit 530 acquires the communication status of the remote operator terminal 200. That is, the status of the remote operator terminal 200 includes the communication status of the remote operator terminal 200. As the communication status, examples include the communication speed (throughput), communication delay, etc. The remote operator terminal 200 can measure the communication speed, communication delay, etc. based on the reception status of the data received from the communication partner. As another example, the remote operator terminal 200 measures the communication speed, communication delay, etc. based on the data sent to the communication partner and the feedback from the communication partner. The terminal status acquisition unit 530 acquires the communication status measured by the remote operator terminal 200. The terminal score calculation unit 540 calculates the first terminal score based on the communication status of the remote operator terminal 200. As Figure 10 shown, the better the communication status of the remote operator terminal 200, the higher the first terminal score.

[0105] In the second example, the terminal status acquisition unit 530 acquires the control device 250 of the remote operator terminal 200 (refer to Figure 5) The degree of abnormality. That is, the state of the remote operator terminal 200 includes the degree of abnormality of the control device 250 of the remote operator terminal 200. For example, the control device 250 has a self-diagnosis function. The terminal state acquisition unit 530 acquires the self-diagnosis result (normal, warning, abnormal) obtained by the control device 250 using the self-diagnosis function. The terminal score calculation unit 540 calculates the second terminal score based on the degree of abnormality of the control device 250 of the remote operator terminal 200. As Figure 10 shown, the higher the degree of abnormality of the control device 250 of the remote operator terminal 200, the lower the second terminal score.

[0106] It is also possible to combine the above first example and the second example. In this case, the respective scores are added together.

[0107] Typically, the terminal state acquisition unit 530 acquires the terminal state information STA-T indicating the state of the remote operator terminal 200 in real time. Moreover, the terminal score calculation unit 540 calculates the terminal score SCR-T based on the terminal state information STA-T in real time.

[0108] The terminal state acquisition unit 530 and the terminal score calculation unit 540 may be included in the remote operator terminal 200, may be included in the management system 300, or may be distributed between the remote operator terminal 200 and the management system 300. When the terminal state acquisition unit 530 is included in the management system 300, the remote operator terminal 200 sends information on the communication state and / or the degree of abnormality of the control device 250 to the management system 300. When the terminal state acquisition unit 530 and the terminal score calculation unit 540 are included in the remote operator terminal 200, the remote operator terminal 200 only needs to send the information on the terminal score SCR-T to the management system 300. In this case, since there is no need to send the information on the communication state and / or the degree of abnormality of the control device 250 of the remote operator terminal 200 to the management system 300, the communication volume between the remote operator terminal 200 and the management system 300 can be reduced. This helps to reduce the communication resources used.

[0109] 4-1-3. Composite Score

[0110] Figure 11 is a block diagram showing another example of the functional structure related to score calculation. The score integration unit 550 calculates the composite score SCR by integrating the operator score SCR-O and the terminal score SCR-T. That is, the composite score SCR reflects the operator score SCR-O and the terminal score SCR-T. This composite score SCR indicates the suitability of the combination of the remote operator O and the remote operator terminal 200 for remote operation. The higher the composite score SCR, the higher the suitability.

[0111] For example, the score integration unit 550 calculates the average value of the operator score SCR-O and the terminal score SCR-T. When the average value is less than 100, this average value is used as the integrated score SCR. On the other hand, when the average value is 100 or more, the integrated score SCR is uniformly set to 100.

[0112] The score integration unit 550 may be included in the remote operator terminal 200 or in the management system 300. It is also possible to include all of the operator status acquisition unit 510, the operator score calculation unit 520, the terminal status acquisition unit 530, the terminal score calculation unit 540, and the score integration unit 550 in the remote operator terminal 200. In this case, the remote operator terminal 200 only needs to send the information of the integrated score SCR to the management system 300. Therefore, the communication volume between the remote operator terminal 200 and the management system 300 can be reduced. This helps to reduce the communication resources used.

[0113] 4-2. Assignment Processing

[0114] Figure 12 It is a block diagram showing an example of a functional structure related to the assignment processing under the first aspect. The assignment processing unit 400 of the management system 300 includes a score acquisition unit 410 and a selection unit 450.

[0115] The score acquisition unit 410 acquires the operator score SCR-O from the operator score calculation unit 520. More specifically, the score acquisition unit 410 acquires the operator score SCR-O of each of the multiple remote operators O represented by the operator management information MGT-O. The score acquisition unit 410 may also register the operator score SCR-O of each of the multiple remote operators O in the operator management information MGT-O. Typically, the score acquisition unit 410 acquires the operator score SCR-O of each of the multiple remote operators O in real time.

[0116] The selection unit 450 selects an appropriate first remote operator O-X from multiple remote operators O based on the operator score SCR-O and the operator management information MGT-O. More specifically, the selection unit 450 extracts available (idle) remote operators O from the multiple remote operators O based on the operator management information MGT-O. Further, the selection unit 450 selects the first remote operator O-X from the available remote operators O based on the operator score SCR-O. For example, the selection unit 450 preferentially selects a remote operator O with a high operator score SCR-O as the first remote operator O-X. That is, the operator score SCR-O is used as the operator priority. In the case where there are multiple candidates with the same operator score SCR-O, the selection unit 450 may also preferentially select a remote operator O with a longer waiting time as the first remote operator O-X. Moreover, the selected first remote operator O-X is assigned to remotely operate the target moving body 100-X.

[0117] The score acquisition unit 410 acquires the terminal score SCR-T from the terminal score calculation unit 540. More specifically, the score acquisition unit 410 acquires the terminal score SCR-T of each of the multiple remote operator terminals 200 represented by the terminal management information MGT-T. The score acquisition unit 410 may also register the terminal score SCR-T of each of the multiple remote operator terminals 200 in the terminal management information MGT-T. Typically, the score acquisition unit 410 acquires the terminal score SCR-T of each of the multiple remote operator terminals 200 in real time.

[0118] The selection unit 450 selects an appropriate first remote operator terminal 200-X from multiple remote operator terminals 200 based on the terminal score SCR-T and the terminal management information MGT-T. More specifically, the selection unit 450 extracts available (idle) remote operator terminals 200 from the multiple remote operator terminals 200 based on the terminal management information MGT-T. Further, the selection unit 450 selects the first remote operator terminal 200-X from the available remote operator terminals 200 based on the terminal score SCR-T. For example, the selection unit 450 preferentially selects a remote operator terminal 200 with a high terminal score SCR-T as the first remote operator terminal 200-X. That is, the terminal score SCR-T is used as the terminal priority. In the case where there are multiple candidates with the same terminal score SCR-T, the selection unit 450 may also preferentially select a remote operator terminal 200 with a longer waiting time as the first remote operator terminal 200-X. Moreover, the selected first remote operator terminal 200-X is assigned to remotely operate the target moving body 100-X.

[0119] Or, in Figure 11In the case of the example shown, the score acquisition unit 410 acquires the comprehensive score SCR from the score integration unit 550. More specifically, the score acquisition unit 410 acquires the comprehensive score SCR for each of the multiple combinations of the remote operator O and the remote operator terminal 200. Typically, the score acquisition unit 410 acquires the comprehensive score SCR for each of the multiple combinations of the remote operator O and the remote operator terminal 200 in real time.

[0120] The selection unit 450 selects an appropriate combination of the first remote operator O-X and the first remote operator terminal 200-X based on the comprehensive score SCR, the operator management information MGT-O, and the terminal management information MGT-T. More specifically, the selection unit 450 extracts the available (idle) remote operators O from the multiple remote operators O based on the operator management information MGT-O. In addition, the selection unit 450 extracts the available (idle) remote operator terminals 200 from the multiple remote operator terminals 200 based on the terminal management information MGT-T. Furthermore, the selection unit 450 selects the first remote operator O-X from the available remote operators O and selects the first remote operator terminal 200-X from the available remote operator terminals 200 based on the comprehensive score SCR. For example, the selection unit 450 preferentially selects a combination of a remote operator O and a remote operator terminal 200 with a high comprehensive score SCR as the combination of the first remote operator O-X and the first remote operator terminal 200-X. That is, the comprehensive score SCR is used as the priority. In the case where there are multiple candidates with the same comprehensive score SCR, the selection unit 450 may also preferentially select a combination including a remote operator O with a longer waiting time. Moreover, the selected combination of the first remote operator O-X and the first remote operator terminal 200-X is assigned to perform the remote operation of the target moving body 100-X.

[0121] 4-3. Effects

[0122] As described above, according to the first aspect, based on the state of the remote operator O, the operator score SCR-O indicating the suitability of the remote operator O for the remote operation is calculated. Moreover, based on this operator score SCR-O, the first remote operator O-X assigned to the remote operation of the target moving body 100-X is selected. That is, considering the suitability, an appropriate first remote operator O-X is assigned to perform the remote operation of the target moving body 100-X. Thereby, the accuracy of the remote operation of the target moving body 100-X is ensured.

[0123] In addition, based on the state of the remote operator terminal 200, a terminal score SCR-T representing the suitability of the remote operator terminal 200 for remote operation is calculated. Further, based on this terminal score SCR-T, the first remote operator terminal 200-X assigned to the remote operation of the target mobile body 100-X is selected. That is, considering the suitability, an appropriate first remote operator terminal 200-X is assigned for the remote operation of the target mobile body 100-X. Thereby, the accuracy of the remote operation of the target mobile body 100-X is ensured.

[0124] The score calculation can also be performed by the remote operator terminal 200. In this case, the remote operator terminal 200 only needs to send the score information to the management system 300. Therefore, the communication volume between the remote operator terminal 200 and the management system 300 can be reduced. This helps to reduce the communication resources used.

[0125] 5. [Second perspective] Considering the assignment process of operator licenses

[0126] Consider a case where there are multiple mobile bodies 100 as objects of remote operation (refer to Figure 2 ). The remote operator O does not necessarily hold licenses (qualifications, licenses) related to all types of mobile bodies 100. When a remote operator O who does not have a license to operate the target mobile body 100-X is wrongly assigned to perform the remote operation of the target mobile body 100-X, the assignment process needs to be restarted from the beginning, which is inefficient.

[0127] Therefore, in the second perspective, the assignment process is performed considering the licenses held by each of the multiple remote operators O. More specifically, the first remote operator O-X who has the required license for the remote operation of the target mobile body 100-X is assigned to perform the remote operation of the target mobile body 100-X. Hereinafter, the second perspective will be described in more detail.

[0128] 5-1. Operator license information

[0129] Figure 13 An example of the operator license information LIC is shown. The operator license information LIC represents the licenses (qualifications, licenses) that each of the multiple remote operators O has regarding the operation (driving) of various mobile bodies 100. In other words, the operator license information LIC represents the licenses held by each remote operator O. The license for a certain mobile body 100 is a certificate officially permitting the operation of that mobile body 100. Each remote operator O holds licenses for one or more mobile bodies 100. It is also possible for a remote operator O to hold licenses for two or more mobile bodies 100. The licenses held may be different for each remote operator O.

[0130] The operator license information LIC is included in the operator management information MGT-O. For example, each remote operator O uses a remote operator terminal 200 or their own terminal to declare the licenses they possess. The management system 300 pre-generates the operator license information LIC by collecting the license information held by each remote operator O, and updates it as needed.

[0131] 5-2. Assignment Processing

[0132] Figure 14 It is a block diagram showing an example of the functional structure related to the assignment processing under the second viewpoint. The assignment processing unit 400 of the management system 300 includes a required license acquisition unit 420 and a selection unit 450.

[0133] The required license acquisition unit 420 receives a remote operation request REQ. The remote operation request REQ indicates the type of the target moving body 100-X. The required license acquisition unit 420 can identify the "required license REQ-LIC" required for the remote operation of the target moving body 100-X based on the type of the target moving body 100-X.

[0134] The required ability information REQ-ABL represents the abilities required for the remote operation of the target moving body 100-X. The required ability information REQ-ABL includes at least the information of the required license REQ-LIC.

[0135] The selection unit 450 includes an operator selection unit 450-O. The operator selection unit 450-O selects an appropriate first remote operator O-X from multiple remote operators O based on the operator management information MGT-O and the required ability information REQ-ABL. More specifically, the operator selection unit 450-O extracts the available (idle) remote operators O from the multiple remote operators O based on the operator management information MGT-O. Furthermore, the operator selection unit 450-O obtains the operator license information LIC included in the operator management information MGT-O and the information of the required license REQ-LIC included in the required ability information REQ-ABL. Moreover, the operator selection unit 450-O selects the first remote operator O-X with the required license REQ-LIC from the available remote operators O. The selected first remote operator O-X is assigned to perform the remote operation of the target moving body 100-X.

[0136] In the case where there are multiple remote operators O with a license requirement REQ-LIC, the operator selection unit 450-O may also consider the operator score SCR-O described in the above subsection 4 to select the first remote operator O-X. More specifically, the operator selection unit 450-O may also preferentially select a remote operator O with a high operator score SCR-O as the first remote operator O-X. In the case where there are multiple candidates with the same operator score SCR-O, the operator selection unit 450-O may also preferentially select a remote operator O with a longer waiting time as the first remote operator O-X.

[0137] As another example, in the case where there are multiple remote operators O with a license requirement REQ-LIC, the operator selection unit 450-O may also select a remote operator O with the fewest types of licenses held as the first remote operator O-X for this time. In this case, remote operators O with licenses for a larger number of types of moving bodies 100 will be retained. As a result, the probability of being able to appropriately assign a remote operator O to the target moving body 100-X that requests remote operation is increased next.

[0138] 5-3. Effects

[0139] As described above, according to the second view, the license possessed by each remote operator O and the license requirement REQ-LIC required for the remote operation of the target moving body 100-X are considered. Moreover, the first remote operator O-X having the license requirement REQ-LIC is assigned to perform the remote operation of the target moving body 100-X. Thereby, the accuracy of the remote operation of the target moving body 100-X is ensured. In addition, the situation where a remote operator O without the license requirement REQ-LIC is erroneously assigned to the target moving body 100-X is prevented in advance. Therefore, there is no need to start the assignment process from scratch, and an efficient assignment process can be achieved.

[0140] 6. [Third view] Assignment process considering terminal specifications

[0141] The specifications required by the remote operator terminal 200 may vary depending on the type of the target moving body 100-X. In addition, the specifications required by the remote operator terminal 200 may also vary depending on the content of the requested remote operation. If a remote operator terminal 200 that does not meet the specifications required for the remote operation of the target moving body 100-X is assigned to perform the remote operation of the target moving body 100-X, the accuracy of the remote operation will be reduced. In addition, it is inefficient to start the assignment process from scratch.

[0142] Therefore, in the third aspect, allocation processing is performed in consideration of the specifications of each of the plurality of remote operator terminals 200. More specifically, the first remote operator terminal 200-X that meets the required terminal specifications for the remote operation of the target moving body 100-X is allocated to perform the remote operation of the target moving body 100-X. Hereinafter, the third aspect will be described in more detail.

[0143] 6-1. First Example

[0144] Figure 15 An example of the terminal specification information SPC is shown. The terminal specification information SPC represents the specifications of each of the plurality of remote operator terminals 200. In Figure 15 the example shown, the terminal specification information SPC represents, for each remote operator terminal 200, the type of the remote operator terminal 200, the type of the moving body 100 that can be handled (capable of being handled), and the content of the remote operation (service) that can be handled.

[0145] Examples of the type of the remote operator terminal 200 include a cockpit-type terminal, a PC, a tablet computer, a smart phone, etc. If the type of the remote operator terminal 200 changes, the type of the moving body 100 that can be handled and the content of the remote operation that can be handled also change accordingly. For example, a cockpit-type terminal is suitable for the remote operation of various types of vehicles and is also suitable for road driving and long-distance driving. On the other hand, a tablet computer is not necessarily suitable for road driving and long-distance driving. A tablet computer can be used for short-distance driving of a vehicle in a limited area such as a parking lot, autopilot assistance such as pulling over to the roadside in an emergency, remote operation of a small vehicle in a factory, etc.

[0146] The terminal specification information SPC is included in the terminal management information MGT-T. For example, the management system 300 collects information on its type from each of the plurality of remote operator terminals 200. Moreover, the management system 300 pre-generates Figure 15 the terminal specification information SPC as exemplified, and updates it as needed.

[0147] Figure 16 is a block diagram showing an example of a functional structure related to the allocation processing in the third aspect. The allocation processing unit 400 of the management system 300 includes a required terminal specification acquisition unit 430 and a selection unit 450.

[0148] The required terminal specification acquisition unit 430 receives a remote operation request REQ. The remote operation request REQ represents at least one of "the type of the object mobile body 100-X" and "the content of the desired remote operation of the object mobile body 100-X". The required terminal specification acquisition unit 430 can identify the "required terminal specification REQ-SPC" required for the remote operation of the object mobile body 100-X based on the remote operation request REQ. In this example, the remote operation request REQ is directly used as the required terminal specification REQ-SPC.

[0149] The required ability information REQ-ABL represents the ability required for the remote operation of the object mobile body 100-X. The required ability information REQ-ABL includes at least the information of the required terminal specification REQ-SPC.

[0150] The selection unit 450 includes a terminal selection unit 450-T. The terminal selection unit 450-T selects an appropriate first remote operator terminal 200-X from multiple remote operator terminals 200 based on the terminal management information MGT-T and the required ability information REQ-ABL. More specifically, the terminal selection unit 450-T extracts the available (idle) remote operator terminals 200 from the multiple remote operator terminals 200 based on the terminal management information MGT-T. Furthermore, the terminal selection unit 450-T obtains the terminal specification information SPC included in the terminal management information MGT-T and the information of the required terminal specification REQ-SPC included in the required ability information REQ-ABL. Moreover, the terminal selection unit 450-T selects the first remote operator terminal 200-X that meets the required terminal specification REQ-SPC from the available remote operator terminals 200. The selected first remote operator terminal 200-X is assigned to perform the remote operation of the object mobile body 100-X.

[0151] In the case where there are multiple remote operator terminals 200 that meet the required terminal specification REQ-SPC, the terminal selection unit 450-T may also consider the terminal score SCR-T described in the above subsection 4 to select the first remote operator terminal 200-X. More specifically, the terminal selection unit 450-T may preferentially select the remote operator terminal 200 with a higher terminal score SCR-T as the first remote operator terminal 200-X. In the case where there are multiple candidates with the same terminal score SCR-T, the terminal selection unit 450-T may also preferably select the remote operator terminal 200 with a longer waiting time as the first remote operator terminal 200-X.

[0152] 6-2. Second example

[0153] It is also possible to consider preparing dedicated remote operator terminals 200 (remote cockpits) for each type of moving body 100. On the other hand, if various types of moving bodies 100 can be remotely operated using a single remote operator terminal 200, it is preferable from the viewpoints of cost reduction, reduction of installation area, efficiency, convenience, etc. Thus, in the second example, a study is made on remotely operating various types of moving bodies 100 using a single remote operator terminal 200. For this purpose, the specifications (equipment) of the remote operator terminal 200 are re-captured more abstractly. More specifically, as described below, the specifications (equipment) of the remote operator terminal 200 are defined by "operating system capabilities" and "display system capabilities". In addition, descriptions that overlap with the above-mentioned first example are appropriately omitted.

[0154] 6-2-1. Operating System Capabilities

[0155] The input device 230 of the remote operator terminal 200 (refer to Figure 5 ) includes remote operation components that are operated by the remote operator O when remotely operating the moving body 100. As remote operation components, a steering wheel (rudder wheel), an accelerator pedal, a brake pedal, a joystick, a cross key, a touch panel, etc. can be exemplified. Even if the physical structures of the remote operation components are different, the uses of the remote operation components are common. That is, the remote operation components are used for the forward and backward operations and the lateral operation of the target moving body 100-X. Therefore, a certain remote operation component can be replaced with another remote operation component.

[0156] For example, the forward operation, backward operation, and lateral operation of the joystick respectively correspond to the operation of the accelerator pedal, the operation of the brake pedal, and the operation of the steering wheel. As another example, the operating systems of various types of moving bodies 100 can also be reproduced through a user interface (UI) displayed on the touch panel. In any case, the operation amount of a certain remote operation component can be converted into the operation amount of another remote operation component. Therefore, a certain remote operation component can be replaced with another remote operation component.

[0157] Based on the above viewpoints, the operating system capabilities of the remote operator terminal 200 are defined. Specifically, the operating system capabilities of the remote operator terminal 200 include "the number of inputs for the forward and backward operations of the moving body 100" and "the number of inputs for the lateral operation of the moving body 100". The operating system capabilities of the remote operator terminal 200 may also include "the presence or absence of operation feedback". "The presence or absence of operation feedback" means whether the remote operator terminal 200 is equipped with an operation reaction force mechanism that can generate an operation reaction force on the remote operator O.

[0158] Figure 17 It is a diagram showing an example of terminal specification information SPC related to the operating system and required terminal specification REQ-SPC. AsFigure 17 As shown, the terminal specification information SPC includes operating system information representing the operating system capabilities of each of the multiple remote operator terminals 200. For example, the number of front and rear operation inputs of the remote operator terminal 200 equipped with an accelerator pedal and a brake pedal is "2". As another example, the number of front and rear operation inputs of the remote operator terminal 200 equipped with a joystick is "2". In the case of a tablet computer capable of displaying an arbitrary user interface on a touch panel, the operating system capabilities can be freely set.

[0159] The required terminal specification REQ - SPC includes the operating system capabilities required for the remote operation of the object moving body 100 - X. As Figure 17 shown, if the type of the object moving body 100 - X (e.g., vehicle, ship, construction machinery) is different, the required operating system capabilities also change. In addition, even if the type of the object moving body 100 - X is the same, depending on the content of the desired remote operation (e.g., long - distance driving, shoulder retreat), the required operating system capabilities may also be different.

[0160] The required terminal specification acquisition unit 430 receives a remote operation request REQ. The remote operation request REQ represents at least one of "the type of the object moving body 100 - X" and "the content of the desired remote operation of the object moving body 100 - X". The required terminal specification acquisition unit 430 can identify the required terminal specification REQ - SPC including the operating system capabilities required for the remote operation of the object moving body 100 - X based on the remote operation request REQ.

[0161] For example, a conversion table 435 representing the correspondence between the remote operation request REQ and the required terminal specification REQ - SPC is prepared in advance (refer to Figure 16 ). The conversion table 435 is pre - stored in the storage device 370 of the management system 300. The required terminal specification acquisition unit 430 can identify the required terminal specification REQ - SPC corresponding to the remote operation request REQ by referring to the conversion table 435.

[0162] The terminal selection unit 450 - T acquires the information of the terminal specification information SPC and the required terminal specification REQ - SPC. Moreover, the terminal selection unit 450 - T selects the first remote operator terminal 200 - X that meets the required terminal specification REQ - SPC from the available remote operator terminals 200 based on the terminal specification information SPC and the required terminal specification REQ - SPC. More specifically, the terminal selection unit 450 - T selects the first remote operator terminal 200 - X that at least has the required operating system capabilities based on the terminal specification information SPC (operating system information) and the required terminal specification REQ - SPC. The selected first remote operator terminal 200 - X is assigned to perform the remote operation of the object moving body 100 - X.

[0163] In the case where there are multiple remote operator terminals 200 having the required operating system capabilities, the terminal selection unit 450-T may also consider the terminal score SCR-T described in the above subsection 4 to select the first remote operator terminal 200-X. More specifically, the terminal selection unit 450-T may also preferentially select the remote operator terminal 200 with a high terminal score SCR-T as the first remote operator terminal 200-X. In the case where there are multiple candidates with the same terminal score SCR-T, the terminal selection unit 450-T may also preferentially select the remote operator terminal 200 with a longer waiting time as the first remote operator terminal 200-X.

[0164] As another example, in the case where there are multiple remote operator terminals 200 having the required operating system capabilities, the terminal selection unit 450-T may also select the remote operator terminal 200 having the minimum operating system capabilities as the first remote operator terminal 200-X for this time. In this case, the remote operator terminals 200 having higher operating system capabilities will be reserved. As a result, the probability of being able to allocate an appropriate remote operator terminal 200 is increased even when a higher operating system capability is required for the remote operation of the next target moving body 100-X.

[0165] As a modification example, in a specific situation, the terminal selection unit 450-T may also select the remote operator terminal 200 that slightly fails to meet the required operating system capabilities as the first remote operator terminal 200-X. As a specific situation, the case where there are no other options in an emergency can be considered. For example, although operation feedback is preferably desired, in an emergency, the remote operator terminal 200 without operation feedback may also be selected as the first remote operator terminal 200-X. However, in this case, the terminal selection unit 450-T instructs function restrictions on the target moving body 100-X and the first remote operator terminal 200-X. As function restrictions, restrictions such as reducing the upper limit speed to a limit value lower than the default value and narrowing the steering range to a narrower range than the default range can be considered. The instructions for the target moving body 100-X and the first remote operator terminal 200-X are performed through communication.

[0166] 6-2-2. Display system capabilities

[0167] The display device 220 of the remote operator terminal 200 (refer to Figure 5) There are also various types. For example, the number of monitors included in the display device 220 may vary for each remote operator terminal 200. Additionally, the resolution (size) of each monitor also varies. If the resolution (size) of the monitor is large, it is also possible to simultaneously display multiple types of images within one monitor. Additionally, when the control device 250 of the remote operator terminal 200 has a Picture-in-Picture function, it is also possible to embed other images within one image. From the above viewpoints, the display system capabilities of the remote operator terminal 200 are defined. Specifically, the display system capabilities of the remote operator terminal 200 include the "number of monitors" and the "number of images that can be simultaneously displayed".

[0168] Figure 18 It is a diagram showing an example of the terminal specification information SPC related to the display system and the required terminal specification REQ-SPC. As Figure 18 shown, the terminal specification information SPC includes display system information indicating the display system capabilities of each of the multiple remote operator terminals 200.

[0169] The required terminal specification REQ-SPC includes the display system capabilities required for the remote operation of the target moving body 100-X. As Figure 18 shown, if the type of the target moving body 100-X (e.g., vehicle, construction machinery) is different, the required display system capabilities also change. Additionally, even if the type of the target moving body 100-X is the same, depending on the content of the desired remote operation (e.g., chauffeur service, valet parking), the required display system capabilities may also be different.

[0170] The required terminal specification acquisition unit 430 receives the remote operation request REQ. The remote operation request REQ indicates at least one of the "type of the target moving body 100-X" and the "content of the desired remote operation of the target moving body 100-X". The required terminal specification acquisition unit 430 can identify the required terminal specification REQ-SPC including the display system capabilities required for the remote operation of the target moving body 100-X based on the remote operation request REQ.

[0171] For example, a conversion table 435 indicating the correspondence between the remote operation request REQ and the required terminal specification REQ-SPC is prepared in advance (refer to Figure 16 ). The conversion table 435 is pre-stored in the storage device 370 of the management system 300. The required terminal specification acquisition unit 430 can identify the required terminal specification REQ-SPC corresponding to the remote operation request REQ by referring to the conversion table 435.

[0172] The terminal selection unit 450-T acquires the terminal specification information SPC and the information of the required terminal specification REQ-SPC. Moreover, based on the terminal specification information SPC and the required terminal specification REQ-SPC, the terminal selection unit 450-T selects the first remote operator terminal 200-X that meets the required terminal specification REQ-SPC from the available remote operator terminals 200. More specifically, the terminal selection unit 450-T selects the first remote operator terminal 200-X that has at least the required display system capabilities based on the terminal specification information SPC (display system information) and the required terminal specification REQ-SPC. The selected first remote operator terminal 200-X is assigned to remotely operate the target moving body 100-X.

[0173] In the case where there are multiple remote operator terminals 200 that have the required display system capabilities, the terminal selection unit 450-T may also consider the terminal score SCR-T described in the above subsection 4 to select the first remote operator terminal 200-X. More specifically, the terminal selection unit 450-T may preferentially select the remote operator terminal 200 with a higher terminal score SCR-T as the first remote operator terminal 200-X. In the case where there are multiple candidates with the same terminal score SCR-T, the terminal selection unit 450-T may also preferentially select the remote operator terminal 200 with a longer waiting time as the first remote operator terminal 200-X.

[0174] As another example, in the case where there are multiple remote operator terminals 200 that meet the required display system capabilities, the terminal selection unit 450-T may also select the remote operator terminal 200 with the minimum display system capabilities as the first remote operator terminal 200-X for this time. In this case, the remote operator terminals 200 with higher display system capabilities will be reserved. As a result, the probability of being able to assign an appropriate remote operator terminal 200 is increased even when a higher display system capability is required for the remote operation of the next target moving body 100-X.

[0175] As a modification example, under specific circumstances, the terminal selection unit 450-T may also select a remote operator terminal 200 that somewhat fails to meet the required display system capabilities as the first remote operator terminal 200-X. As specific circumstances, the situation where there are no other options in an emergency can be considered. For example, although it is preferable to display two types of auxiliary images in addition to the three types of necessary images, in an emergency, a remote operator terminal 200 that can only display three types of images may be selected as the first remote operator terminal 200-X. However, in this case, the terminal selection unit 450-T instructs the object moving body 100-X and the first remote operator terminal 200-X of function restrictions. As function restrictions, a restriction value that reduces the upper limit speed to a value lower than the default value, and a restricted range that narrows the steering range to a range narrower than the default range, etc. can be considered. The instructions to the object moving body 100-X and the first remote operator terminal 200-X are carried out through communication.

[0176] In addition, the remote operator O can freely customize the display method of the image according to the content of the remote operation request REQ. The display method of the image includes layout, image display position, image size, and presence or absence of image display, etc. The remote operator O can also freely set the presence or absence of display of the auxiliary image. As the auxiliary image, it includes vehicle width lines, trajectory lines, maximum turning lines, and safe parking positions, etc.

[0177] 6-3. Effects

[0178] As described above, according to the third aspect, the specifications of each remote operator terminal 200 and the required terminal specifications REQ-SPC required for the remote operation of the object moving body 100-X are considered. Moreover, the first remote operator terminal 200-X that meets the required terminal specifications REQ-SPC is allocated to perform the remote operation of the object moving body 100-X. Thereby, the accuracy of the remote operation of the object moving body 100-X is ensured. In addition, the situation where a remote operator terminal 200 that does not have the required terminal specifications REQ-SPC is erroneously allocated to the object moving body 100-X is prevented in advance. Therefore, there is no need to re-perform the allocation process from the beginning, and an efficient allocation process can be achieved.

Claims

1. A remote operation system is a system for remote operation of multiple mobile bodies, characterized in that: comprising one or more processors, wherein the one or more processors are configured to: acquiring operator license information indicating licenses that each of a plurality of remote operators has for operations of the plurality of mobile objects; acquiring required capability information, the required capability information indicating at least a required license required for the remote operation of the target moving object; Based on the operator license information and the requested license, a first remote operator having the requested license among the plurality of remote operators is assigned to perform the remote operation of the target moving object.

2. The remote operation system according to claim 1, characterized in that: The one or more processors are configured to: receiving a remote operation request indicating the type of the target moving object, The required license required for the remote operation of the target moving object is identified based on the type of the target moving object.

3. The remote operation system according to claim 1, characterized in that: The one or more processors are further configured to: obtaining operator status information indicating the status of a remote operator, calculating an operator score representing suitability of the remote operator for the remote operation based on the operator status information, The first remote operator is selected based on the operator score.

4. The remote operation system according to any one of claims 1 to 3, characterized in that: The required capability information further indicates a required terminal specification, wherein the required terminal specification is a specification required for the remote operation of the target moving object. The one or more processors are further configured to: acquiring terminal specification information indicating specifications of each of the plurality of remote operator terminals, Based on the terminal specification information and the requested terminal specification, a first remote operator terminal satisfying the requested terminal specification among the plurality of remote operator terminals is assigned to perform the remote operation of the target moving object.

5. The remote operation system according to claim 4, characterized in that: The one or more processors are further configured to: receiving a remote operation request indicating at least one of a type of the target moving object and a content of the remote operation of the target moving object, Based on the remote operation request, the required terminal specification required for the remote operation of the target moving object is identified.

6. The remote operation system according to claim 4, characterized in that: The one or more processors are further configured to: obtaining terminal status information indicating the status of the remote operator terminal, calculating a terminal score representing suitability of the remote operator terminal for the remote operation based on the terminal status information, The first remote operator terminal is selected based on the terminal score.

7. A remote operation management method is a method for managing remote operations of multiple mobile objects by a computer, characterized in that: include: acquiring operator license information indicating licenses that each of a plurality of remote operators has for operations of the plurality of mobile objects; acquiring required capability information, the required capability information indicating at least a required license required for the remote operation of the target moving object; Based on the operator license information and the requested license, a first remote operator having the requested license among the plurality of remote operators is assigned to perform the remote operation of the target moving object.

8. A management program is a program executed by a computer to manage remote operations of multiple mobile objects, characterized in that: include: acquiring operator license information indicating licenses that each of a plurality of remote operators has for operations of the plurality of mobile objects; acquiring required capability information, the required capability information indicating at least a required license required for the remote operation of the target moving object; Based on the operator license information and the requested license, a first remote operator having the requested license among the plurality of remote operators is assigned to perform the remote operation of the target moving object.

Images