Remote operation system
The remote operation system improves the accuracy of mobility operations by assessing the compatibility of external operators and terminals and assigning only suitable ones, thus enhancing operational efficiency.
Patent Information
- Application Number
- JP2023210779
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-14
- Publication Date
- 2025-06-26
AI Technical Summary
The accuracy of remote operation of mobility is compromised when an external operator or external operator terminal in an inappropriate state is selected, leading to decreased operational efficiency.
A remote operation system that acquires state information of external operators and terminals, calculates a compatibility score based on this information, and selects appropriate operators and terminals for remote operation assignments.
Ensures the accuracy and efficiency of remote operation by ensuring that only compatible external operators and terminals are assigned to mobility operations, thereby maintaining high operational standards.
Smart Images

Figure 2025095028000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to remote operation of mobility.
Background Art
[0002] Patent Document 1 discloses a vehicle remote operation support system. When there is a shortage of operators, the vehicle remote operation support system requests remote operation support from an external operator in an external center away from the control center.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] Consider an external operator outside the remote operation management center performing remote operation of mobility. For an external operator, there can be a state appropriate for remote operation and a state that is not. Similarly, for the external operator terminal used by the external operator for remote operation, there can be a state appropriate for remote operation and a state that is not. If an external operator or external operator terminal in an inappropriate state for remote operation is selected, the accuracy of remote operation will decrease.
Means for Solving the Problems
[0005] One aspect of the present disclosure relates to a remote operation system for remote operation of mobility. An external operator is a remote operator outside the remote operation management center that manages remote operation of mobility. An external operator terminal is a remote operator terminal configured to be used by an external operator for remote operation. The remote operation system includes one or more processors. The one or more processors acquire state information indicating at least one of the state of an external operator and the state of an external operator terminal. The one or more processors calculate a score indicating the compatibility of at least one of the external operator and the external operator terminal with respect to the remote operation based on the state information. The one or more processors select at least one of a first external operator and a first external operator terminal to be assigned to the remote operation of the target mobility based on the score.
Effect of the Invention
[0006] According to the present disclosure, the accuracy of remote operation of mobility is ensured.
Brief Description of the Drawings
[0007]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Embodiments for Carrying Out the Invention
[0008] 1. Remote Support System FIG. 1 is a conceptual diagram for explaining the outline of the remote operation system 1 according to the present embodiment. The remote operation system 1 is a system for remotely operating the mobility 100. Remote operation is a concept including remote driving. The remote operation system 1 includes a mobility 100, a remote operator terminal 200, and a management system 300. The mobility 100, the remote operator terminal 200, and the management system 300 can communicate with each other via a communication network. For example, the mobility 100 can wirelessly communicate with the remote operator terminal 200 and the management system 300 via a wireless communication network. The remote operator terminal 200 and the management system 300 can communicate with each other via a wired / wireless communication network.
[0009] 1-1. Mobility The mobility 100 is a movable object. The mobility 100 may be manually operated by an operator on board the mobility 100. The mobility 100 may have an autonomous driving function. In any case, the mobility 100 is configured to be remotely operable as needed. That is, the mobility 100 is an object of remote operation by the remote operation system 1.
[0010] The type of the mobility 100 that is the object of remote operation is not limited to one, and may be plural. For example, the mobility 100 is a vehicle traveling on a public road. As another example, the mobility 100 may be a vehicle used in a factory. As still another example, the mobility 100 may be a special small vehicle. As still another example, the mobility 100 may be a construction machine. As still another example, the mobility 100 may be a robot. As still another example, the mobility 100 may be an aircraft. As still another example, the mobility 100 may be a ship. As still another example, the mobility 100 may be a ride in an amusement park.
[0011] 1-2. Remote Operator Terminal The remote operator terminal 200 is a terminal device used when the remote operator O remotely operates the mobility 100. That is, the remote operator terminal 200 is configured to be used by the remote operator O for remotely operating the mobility 100. Examples of the remote operator terminal 200 include a cockpit-type terminal, a PC, a tablet, a smartphone, and the like. A single remote operator terminal 200 may be configured to support remote operations of various types of mobility 100.
[0012] The remote operator terminal 200 includes a communication device 210, a display device 220, an input device 230, an operator sensor 240, and a control device 250.
[0013] The communication device 210 communicates with the mobility 100 and the management system 300.
[0014] The display device 220 displays various information to the remote operator O who performs the remote operation. In other words, the display device 220 presents various information to the remote operator O by displaying the various information. Examples of the display device 220 include a display and a touch panel.
[0015] The input device 230 receives an input from the remote operator O. For example, the input device 230 includes a remote operation member that the remote operator O operates when remotely operating the mobility 100. Examples of the remote operation member include a steering wheel, an accelerator pedal, a brake pedal, a joystick, a cross key, a switch, and the like. The remote operation member may be a touch panel. The input device 230 may include an information input unit other than the remote operation member.
[0016] The operator sensor 240 is a sensor for monitoring the state of the remote operator O. For example, the operator sensor 240 includes a biological sensor that detects biological information of the remote operator O. Examples of the biological information include body temperature, heart rate, blood pressure, sweating amount, and the like.
[0017] The control device 250 controls the remote operator terminal 200. The control device includes one or more processors and one or more storage devices. The processor executes various processes. Examples of the processor include a CPU, a GPU, an ASIC, an FPGA, etc. The processor can also be referred to as circuitry or processing circuitry. The storage device stores various information. Examples of the storage device include a volatile memory, a non-volatile memory, an HDD, an SSD, etc. The functions of the control device 250 may be realized by the cooperation of the processor that executes the control program and the storage device. The control program is stored in the storage device. Alternatively, the control program may be recorded on a computer-readable recording medium.
[0018] 1-3. Management System (Manager) The management system 300 is a computer that manages the remote operation system 1. The management system 300 may be composed of a plurality of servers that perform distributed processing. The management system 300 manages a plurality of remote operators O and a plurality of remote operator terminals 200.
[0019] The management system 300 includes a communication device 310, one or more processors 320 (hereinafter simply referred to as the processor 320), and one or more storage devices 330 (hereinafter simply referred to as the storage device 330). The communication device 310 communicates with the mobility 100 and the remote operator terminal 200.
[0020] Processor 320 executes various processes. Examples of processor 320 include a general-purpose processor, an application-specific processor, a CPU, a GPU, an ASIC, an FPGA, an integrated circuit, a conventional circuit, and / or combinations thereof. Processor 320 may also be referred to as circuitry or processing circuitry. Circuitry is hardware programmed to implement the described functions or hardware that performs the functions. Storage device 330 stores various information. Examples of storage device 330 include volatile memory, non-volatile memory, HDD, SSD, etc. The functions of management system 300 may be realized by the cooperation of processor 320 that executes the management program and storage device 330. The management program is stored in storage device 330. Alternatively, the management program may be recorded on a computer-readable recording medium. The management program may be provided via a network.
[0021] Before starting the remote operation of mobility 100, processor 320 executes an "assignment process" that assigns an appropriate remote operator O and an appropriate remote operator terminal 200 for the remote operation of mobility 100.
[0022] FIG. 2 is a conceptual diagram for explaining the outline of the assignment process by management system 300. Operator management information MGT-O and terminal management information MGT-T are stored in storage device 330. Operator management information MGT-O is information for managing a plurality of remote operators O. For example, operator management information MGT-O indicates, for each remote operator O, an operator ID, a held license, availability, an assignment status, a work history, etc. Terminal management information MGT-T is information for managing a plurality of remote operator terminals 200. For example, terminal management information MGT-T indicates, for each remote operator terminal 200, a terminal ID, specifications, availability, an assignment status, a movement history, etc.
[0023] The mobility 100 that is the target of remote operation is hereinafter referred to as "target mobility 100-X". The remote operator O assigned to the remote operation of the target mobility 100-X is hereinafter referred to as "first remote operator O-X". The remote operator terminal 200 assigned to the remote operation of the target mobility 100-X is hereinafter referred to as "first remote operator terminal 200-X".
[0024] The management system 300 (processor 320) includes an allocation processing unit 400 that executes allocation processing. First, the allocation processing unit 400 receives a remote operation request REQ regarding the target mobility 100-X. For example, the remote operation request REQ is issued from the target mobility 100-X itself. In this case, the target mobility 100-X transmits the remote operation request REQ to the management system 300 via wireless communication. As another example, the remote operation request REQ may be transmitted from a service provider that is in partnership with the remote operation system 1 to the management system 300.
[0025] The remote operation request REQ indicates the type of the target mobility 100-X and the content of the desired remote operation. In response to the received remote operation request REQ, the allocation processing unit 400 allocates the first remote operator O-X and the first remote operator terminal 200-X to the remote operation of the target mobility 100-X. More specifically, the allocation processing unit 400 selects an appropriate first remote operator O-X from among a plurality of remote operators O based on the remote operation request REQ and the operator management information MGT-O. Also, the allocation processing unit 400 selects an appropriate first remote operator terminal 200-X from among a plurality of remote operator terminals 200 based on the remote operation request REQ and the terminal management information MGT-T.
[0026] 1-4. Information flow during remote operation The mobility device 100 is equipped with various sensors including a camera. The camera captures the surrounding situation of the mobility device 100. An image showing the surrounding situation of the mobility device 100 is obtained by the camera. The mobility information MOV is information obtained by various sensors and includes at least the image captured by the camera. The mobility information MOV may include the position and state (e.g., speed, steering angle, etc.) of the mobility device 100. The mobility device 100 transmits the mobility information MOV to the remote operator terminal 200.
[0027] The remote operator terminal 200 receives the mobility information MOV transmitted from the mobility device 100. The remote operator terminal 200 presents the mobility information MOV to the remote operator O. Specifically, the remote operator terminal 200 displays an image or the like on the display device 220. The remote operator O recognizes the surrounding situation of the mobility device 100 by looking at the displayed information and performs remote operation of the mobility device 100. Specifically, the remote operator O operates the remote operation member of the input device 230. The operation amount of the remote operation member is detected by a sensor installed on the remote operation member. The control device 250 generates remote operation information OPE reflecting the operation amount of the remote operation member by the remote operator O. Then, the control device 250 transmits the remote operation information OPE to the mobility device 100 via the communication device 210.
[0028] The mobility device 100 receives the remote operation information OPE transmitted from the remote operator terminal 200. The mobility device 100 performs mobility control according to the received remote operation information OPE. In this way, the remote operation of the mobility device 100 is realized.
[0029] 2. Utilization of External Operator FIG. 3 is a conceptual diagram showing a configuration example of the remote operation system 1. The remote operation management center is a facility for managing the remote operation of the mobility 100. The remote operation management center is provided within a predetermined site or a predetermined building. The above-described management system 300 is installed in the remote operation management center. According to the present embodiment, from the viewpoints inside and outside the remote operation management center, the remote operator O and the remote operator terminal 200 are classified into two types.
[0030] The "internal operator OI" is the remote operator O within the remote operation management center. That is, the internal operator OI is engaged in the remote operation service within the remote operation management center. The internal operator OI may be a full-time remote operator O. The "internal operator terminal 200I" is the remote operator terminal 200 used by the internal operator OI for remote operation and is installed within the remote operation management center. The management system 300 constantly monitors and manages the states of a plurality of internal operators OI. In addition, the management system 300 constantly monitors and manages the states of a plurality of internal operator terminals 200I.
[0031] On one hand, the "external operator OE" is a remote operator O outside the remote operation management center. That is, the external operator OE is engaged in remote operation services outside the remote operation management center. For example, the external operator OE is engaged in remote operation services at home. The external operator OE may be a part-time remote operator O. The reliability of the external operator OE may be lower than that of the internal operator OI. The "external operator terminal 200E" is the remote operator terminal 200 used by the external operator OE for remote operation and exists outside the remote operation management center. The management system 300 does not necessarily always monitor the states of multiple external operators OE. The management system 300 may obtain the states of multiple external operators OE at a predetermined timing (e.g., during assignment processing). Also, the management system 300 does not necessarily always monitor the states of multiple external operator terminals 200E. The management system 300 may obtain the states of multiple external operator terminals 200E at a predetermined timing (e.g., during assignment processing).
[0032] According to this embodiment, not only the internal operator OI and the internal operator terminal 200I, but also the external operator OE and the external operator terminal 200E are utilized as needed. Basically, the internal operator OI and the internal operator terminal 200I are preferentially used. However, when a predetermined condition is satisfied, the external operator OE and the external operator terminal 200E are used. For example, the predetermined condition includes that the number or ratio of available (idle) internal operators OI is below a threshold. As another example, the predetermined condition includes that the number or ratio of available (idle) internal operator terminals 200I is below a threshold. The threshold may be zero.
[0033] Figure 4 is a flowchart showing the allocation process. In step S310, the allocation processing unit 400 receives a remote operation request REQ regarding the target mobility 100-X. In step S320, the allocation processing unit 400 determines whether a predetermined condition is satisfied. If the predetermined condition is not satisfied (step S320; No), the process proceeds to step S330. In step S330, the allocation processing unit 400 executes an internal operator allocation process. Specifically, the allocation processing unit 400 selects an appropriate internal operator OI and an appropriate internal operator terminal 200I, and allocates them to the remote operation of the target mobility 100-X.
[0034] On the other hand, if the predetermined condition is satisfied (step S320: Yes), the process proceeds to step S340. In step S340, the allocation processing unit 400 executes an external operator allocation process. Specifically, the allocation processing unit 400 selects an appropriate external operator OE (hereinafter referred to as "the first external operator OE-X") and an appropriate external operator terminal 200E (hereinafter referred to as "the first external operator terminal 200E-X"), and allocates them to the remote operation of the target mobility 100-X. Hereinafter, the external operator allocation process will be described in more detail.
[0035] 3. External operator allocation process In order to realize an appropriate external operator allocation process, the following first to third viewpoints are considered. The allocation processing unit 400 executes the external operator allocation process in consideration of at least one of the first to third viewpoints. The allocation processing unit 400 may execute the external operator allocation process in consideration of two or more of the first to third viewpoints.
[0036] 3-1. [First viewpoint] Allocation process considering operator state and terminal state Regarding the external operator OE, there can be a state appropriate for remote operation and a state that is not. If the first external operator OE-X in an inappropriate state for remote operation is selected, the accuracy of remote operation will decrease. Similarly, regarding the external operator terminal 200E, there can be a state appropriate for remote operation and a state that is not. If the first external operator terminal 200E-X in an inappropriate state for remote operation is used, the accuracy of remote operation will decrease.
[0037] Therefore, from the first perspective, allocation processing is performed in consideration of the state of each external operator OE and the state of each external operator terminal 200E. For this purpose, the state of each external operator OE and the state of each external operator terminal 200E are quantified in the form of a "score". The score is a quantitative parameter indicating the suitability for remote operation. For example, the score is calculated in the range of 0 to 100. The higher the score, the higher the suitability for remote operation. Then, based on the score, the first external operator OE and the first external operator terminal 200E-X are selected and assigned to the remote operation of the target mobility 100-X.
[0038] Figure 5 is a conceptual diagram for explaining an example of the state and score.
[0039] The first example of the state of the external operator OE is the health state of the external operator OE. For example, the external operator OE reports his / her health state using the external operator terminal 200E or his / her own terminal (e.g., smartphone). As another example, the operator sensor 240 (see FIG. 1) may be used to detect the health state of the external operator OE. The operator sensor 240 includes a biological sensor that detects the biological information of the external operator OE. Examples of biological information include body temperature, heart rate, blood pressure, sweating amount, etc. For example, the health state can be obtained from the biological information by using a machine learning model. Based on the health state of the external operator OE, the first operator score is calculated. The first operator score increases as the health state of the external operator OE improves.
[0040] A second example of the state of the external operator OE is the working hours that the external operator OE has engaged in remote operations over a certain period in the past. This working hours can be obtained, for example, from the operation log recorded on the external operator terminal 200E that the external operator OE has operated in the past. Alternatively, the working hours can be obtained from the work history of each external operator OE included in the operator management information MGT-O. Based on the working hours of the external operator OE, a second operator score is calculated. The second operator score decreases as the working hours of the external operator OE increase.
[0041] A third example of the state of the external operator OE is the hourly wage of the external operator OE. For example, the external operator OE registers his / her hourly wage using the external operator terminal 200E or his / her own terminal (e.g., smartphone). The hourly wage of each external operator OE may be pre-registered in the operator management information MGT-O and obtained from the operator management information MGT-O. Based on the hourly wage of the external operator OE, a third operator score is calculated. The third operator score increases as the hourly wage of the external operator OE decreases.
[0042] A first example of the state of the external operator terminal 200E is the communication state of the external operator terminal 200E. Examples of the communication state include communication speed (throughput), communication delay, etc. The external operator terminal 200E can measure the communication speed, communication delay, etc. based on the reception state of the data received from the communication partner. As another example, the external operator terminal 200E measures the communication speed, communication delay, etc. based on the data transmitted to the communication partner and the feedback from the communication partner. Based on the communication state of the external operator terminal 200E, a first terminal score is calculated. The first terminal score increases as the communication state of the external operator terminal 200E improves.
[0043] A second example of the state of the external operator terminal 200E is the degree of abnormality of the control device 250 (see FIG. 1) of the external operator terminal 200E. For example, the control device 250 has a self-diagnostic function. The degree of abnormality is obtained from the self-diagnosis result (normal, warning, abnormal) by the self-diagnostic function. Based on the degree of abnormality of the control device 250, a second terminal score is calculated. The second terminal score decreases as the degree of abnormality of the control device 250 of the external operator terminal 200E increases.
[0044] The external operator terminal 200E acquires "status information" indicating at least one of the state of the external operator OE and the state of the external operator terminal 200E. The state of the external operator OE includes at least one of the first to third examples above. The state of the external operator terminal 200E includes at least one of the first and second examples above. Alternatively, the management system 300 may acquire the status information from the external operator terminal 200E. Then, the external operator terminal 200E or the management system 300 calculates a score based on the status information. Note that the status information used for calculating the score may be the latest or may be from the past (for example, at the time of the previous assignment).
[0045] The score includes at least one of an operator score and a terminal score. The operator score indicates the suitability of the external operator OE for remote operation. The operator score includes at least one of the first to third operator scores above. The operator score may be the sum of two or more of the first to third operator scores. The terminal score indicates the suitability of the external operator terminal 200E for remote operation. The terminal score includes at least one of the first and second terminal scores above. The terminal score may be the sum of the first and second terminal scores. Alternatively, the score may be an integrated score in which the operator score and the terminal score are integrated. The integrated score indicates the suitability of the combination of the external operator OE and the external operator terminal 200E for remote operation. In any case, the higher the score, the higher the suitability for remote operation.
[0046] The allocation processing unit 400 of the management system 300 acquires score information. The allocation processing unit 400 may register the operator score of each of the plurality of external operators OE in the operator management information MGT-O. Further, the allocation processing unit 400 may register the terminal score of each of the plurality of external operator terminals 200E in the terminal management information MGT-T.
[0047] Based on the operator score and the operator management information MGT-O, the allocation processing unit 400 selects an appropriate first external operator OE-X from among the plurality of external operators OE. More specifically, the allocation processing unit 400 extracts available (idle) external operators OE from among the plurality of external operators OE based on the operator management information MGT-O. Further, the allocation processing unit 400 selects the first external operator OE-X from among the available external operators OE based on the operator score. For example, the allocation processing unit 400 preferentially selects an external operator OE with a high operator score as the first external operator OE-X. When there are a plurality of candidates having the same operator score, an external operator OE with a longer waiting time may be preferentially selected as the first external operator OE-X. Then, the allocation processing unit 400 assigns the selected first external operator OE-X to the remote operation of the target mobility 100-X.
[0048] The allocation processing unit 400 selects an appropriate first external operator terminal 200E-X from among a plurality of external operator terminals 200E based on the terminal score and the terminal management information MGT-T. More specifically, the allocation processing unit 400 extracts available (idle) external operator terminals 200E from among the plurality of external operator terminals 200E based on the terminal management information MGT-T. Further, the allocation processing unit 400 selects the first external operator terminal 200E-X from among the available external operator terminals 200E based on the terminal score. For example, the allocation processing unit 400 preferentially selects an external operator terminal 200E with a high terminal score as the first external operator terminal 200E-X. Then, the allocation processing unit 400 assigns the selected first external operator terminal 200E-X to the remote operation of the target mobility 100-X.
[0049] Alternatively, the allocation processing unit 400 may obtain the integrated score of each of a plurality of combinations of the external operator OE and the external operator terminal 200E. In this case, the allocation processing unit 400 selects an appropriate combination of the first external operator OE-X and the first external operator terminal 200E-X based on the integrated score, the operator management information MGT-O, and the terminal management information MGT-T. For example, the allocation processing unit 400 preferentially selects a combination of the external operator OE and the external operator terminal 200E with a high integrated score as the combination of the first external operator OE-X and the first external operator terminal 200E-X. Then, the allocation processing unit 400 assigns the selected combination of the first external operator OE-X and the first external operator terminal 200E-X to the remote operation of the target mobility 100-X.
[0050] As described above, according to the first perspective, based on at least one of the state of the external operator OE and the state of the external operator terminal 200E, a score indicating the compatibility of at least one of the external operator OE and the external operator terminal 200E with respect to the remote operation is calculated. Then, based on that score, at least one of the first external operator OE-X and the first external operator terminal 200E-X assigned to the remote operation of the target mobility 100-X is selected. That is, the assignment process is carried out taking compatibility into account. Thereby, the accuracy of the remote operation of the target mobility 100-X is ensured.
[0051] The score calculation may be performed by the external operator terminal 200E. In this case, the external operator terminal 200E only needs to send the score information to the management system 300. Therefore, the communication volume between the external operator terminal 200E and the management system 300 is reduced. This contributes to the reduction of the communication resources used.
[0052] 3-2. [Second Perspective] Assignment Process Considering Operator License In the second perspective, the assignment process is carried out taking into account the licenses held by each of the plurality of external operators OE. More specifically, the first external operator OE-X having the required license required for the remote operation of the target mobility 100-X is assigned to the remote operation of the target mobility 100-X.
[0053] (A) in FIG. 6 shows an example of operator license information. The operator license information indicates the licenses (qualifications, permits) held by each of the plurality of external operators OE regarding the operation of a plurality of types of mobility 100. In other words, the operator license information indicates the licenses held by each external operator OE. The license for a certain mobility 100 officially permits the operation of that mobility 100. Each external operator OE holds the licenses for one or more types of mobility 100. One external operator OE may hold the licenses for two or more types of mobility 100.
[0054] The operator license information is included in the operator management information MGT-O. For example, each external operator OE reports the license it holds using the external operator terminal 200E or its own terminal. The management system 300 generates the operator license information in advance by collecting the license information of each external operator OE and updates it as needed.
[0055] The allocation processing unit 400 receives a remote operation request REQ. The remote operation request REQ indicates the type of the target mobility 100-X. The allocation processing unit 400 can recognize the "required license" required for the remote operation of the target mobility 100-X based on the type of the target mobility 100-X. The required capability information includes the information of the required license.
[0056] The allocation processing unit 400 selects an appropriate first external operator OE-X from among a plurality of external operators OE based on the operator management information MGT-O and the required capability information. More specifically, the allocation processing unit 400 extracts available external operators OE from among the plurality of external operators OE based on the operator management information MGT-O. Further, the allocation processing unit 400 acquires the operator license information and the information of the required license. Then, the allocation processing unit 400 selects a first external operator OE-X having the required license from among the available external operators OE based on the operator license information and the required license. The selected first external operator OE-X is assigned to the remote operation of the target mobility 100-X.
[0057] As described above, according to the second perspective, the license held by each external operator OE and the required license for the remote operation of the target mobility 100-X are considered. Then, the first external operator OE-X having the required license is assigned to the remote operation of the target mobility 100-X. Thereby, the accuracy of the remote operation of the target mobility 100-X is ensured. In addition, a situation where an external operator OE without the required license is erroneously assigned to the target mobility 100-X is avoided. Therefore, it is not necessary to redo the assignment process from the beginning, and an efficient assignment process is realized.
[0058] 3-3. [Third Perspective] Assignment Process Considering Terminal Specifications From the third perspective, the assignment process is performed in consideration of the specifications of each of the plurality of external operator terminals 200E. More specifically, the first external operator terminal 200E-X that satisfies the required terminal specifications required for the remote operation of the target mobility 100-X is assigned to the remote operation of the target mobility 100-X.
[0059] (B) in FIG. 6 shows an example of terminal specification information. The terminal specification information indicates the specifications of each of the plurality of external operator terminals 200E. In the example shown in FIG. 6, the terminal specification information shows, for each external operator terminal 200E, the type of the external operator terminal 200E, the types of mobility 100 that can be supported, and the content of the remote operation that can be supported.
[0060] Examples of the type of the external operator terminal 200E include a cockpit-type terminal, a PC, a tablet, a smartphone, etc. If the type of the external operator terminal 200E changes, the types of mobility 100 that can be supported and the content of the remote operation that can be supported also change. For example, a vehicle cockpit is suitable for the remote operation of various types of vehicles and is also suitable for driving on public roads and long-distance driving. On the other hand, a tablet is not necessarily suitable for driving on public roads and long-distance driving. A tablet can be used for short-distance driving of vehicles in a limited area such as a parking lot, automatic driving support such as shoulder evacuation in an emergency, remote operation of small vehicles in a factory, etc.
[0061] The terminal specification information is included in the terminal management information MGT-T. For example, the management system 300 collects information of this type from each of a plurality of external operator terminals 200E. Then, the management system 300 pre-generates the terminal specification information illustrated in FIG. 6 based on the type of each external operator terminal 200E, and updates it as necessary.
[0062] The allocation processing unit 400 receives a remote operation request REQ. The remote operation request REQ indicates at least one of "the type of the target mobility 100-X" and "the content of the desired remote operation of the target mobility 100-X". The allocation processing unit 400 can recognize the "required terminal specification" required for the remote operation of the target mobility 100-X based on the remote operation request REQ. The required capability information includes information on the required terminal specification.
[0063] The allocation processing unit 400 selects an appropriate first external operator terminal 200E-X from among a plurality of external operator terminals 200E based on the terminal management information MGT-T and the required capability information. More specifically, the allocation processing unit 400 extracts available external operator terminals 200E from among the plurality of external operator terminals 200E based on the terminal management information MGT-T. Further, the allocation processing unit 400 acquires the terminal specification information and the information on the required terminal specification. Then, the allocation processing unit 400 selects a first external operator terminal 200E-X that satisfies the required terminal specification from among the available external operator terminals 200E based on the terminal specification information and the required terminal specification. The selected first external operator terminal 200E-X is assigned to the remote operation of the target mobility 100-X.
[0064] As described above, according to the third aspect, the specifications of each external operator terminal 200E and the required terminal specifications required for the remote operation of the target mobility 100-X are considered. Then, the first external operator terminal 200E-X that meets the required terminal specifications is assigned to the remote operation of the target mobility 100-X. Thereby, the accuracy of the remote operation of the target mobility 100-X is ensured. In addition, a situation in which an external operator terminal 200E that does not have the required terminal specifications is erroneously assigned to the target mobility 100-X is avoided. Therefore, it is not necessary to redo the assignment process from the beginning, and an efficient assignment process is realized.
Explanation of Signs
[0065] 1…Remote operation system, 100…Mobility, 200E…External operator terminal, 300…Management system, OE…External operator
Claims
1. A remote operation system for remotely operating mobility, wherein an external operator is a remote operator outside a remote operation management center that manages the remote operation of the mobility, an external operator terminal is a remote operator terminal configured to be used by the external operator for the remote operation, the remote operation system includes one or more processors, the one or more processors, acquire status information indicating at least one of the status of the external operator and the status of the external operator terminal, calculate a score indicating the compatibility of at least one of the external operator and the external operator terminal with respect to the remote operation based on the status information, select at least one of a first external operator and a first external operator terminal to be assigned to the remote operation of the target mobility based on the score configured as a remote operation system.
2. The remote operation system according to claim 1, wherein the status of the external operator includes at least one of the health status of the external operator, the working hours the external operator has been engaged in the remote operation within a certain period in the past, and the hourly wage of the external operator a remote operation system.
3. The remote operation system according to claim 1, wherein the status of the external operator terminal includes at least one of the communication status of the external operator terminal and the degree of abnormality of the control device of the external operator terminal a remote operation system.
4. The remote operation system according to any one of claims 1 to 3, wherein there are a plurality of types of mobility, the one or more processors further, acquire operator license information indicating the licenses each of a plurality of external operators has regarding the operations of the plurality of types of mobility, acquire required ability information indicating the required license for the remote operation of the target mobility, select the first external operator having the required license based on the operator license information and the required license configured as a remote operation system.
5. The remote operation system according to any one of claims 1 to 3, wherein an internal operator is a remote operator within the remote operation management center The internal operator terminal is a remote operator terminal configured to be used by the internal operator for the remote operation. The predetermined condition includes that the number or ratio of available internal operators or available internal operator terminals is equal to or less than a threshold value. When the predetermined condition is satisfied, the one or more processors assign the first external operator and the first external operator terminal to the remote operation of the target mobility. Remote operation system.
Citation Information
Patent Citations
Vehicle control authority setting method, vehicle control authority setting device, vehicle control authority setting program, and vehicle control method
JP2019040587A
Remote function selector
JP2022143691A
Remote substitute driving system, control method, and program
JP2022152550A
Remote assistance device and remote assistance method
JP2022160237A
Remote support management system, remote support management method, and remote support management program
JP2022172948A