MOBILE BODY CONTROL METHOD, CONTROL SYSTEM, AND CONTROL PROGRAM

The method addresses vehicle control systems by dynamically selecting control modes based on remote support necessity and readiness, ensuring smooth transitions and reduced anxiety during automatic driving.

JP7586151B2Active Publication Date: 2024-11-19TOYOTA JIDOSHA KK
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2022132630
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-08-23
Publication Date
2024-11-19
Estimated Expiration
2042-08-23

AI Technical Summary

Technical Problem

Conventional vehicle control systems face issues when automatic driving mode is selected outside remote driving zones, leading to potential vehicle stops and anxiety for occupants or traffic disruptions due to delayed remote support requests.

Method used

A method for controlling vehicles with automatic and remote support functions, involving multiple control modes with varying safety constraints, dynamically selecting modes based on the necessity of remote support and the readiness of the support system.

Benefits of technology

Enables seamless and secure automatic driving transitions by appropriately responding to remote support needs, reducing occupant anxiety and minimizing traffic disruptions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007586151000001
    Figure 0007586151000001
  • Figure 0007586151000002
    Figure 0007586151000002
  • Figure 0007586151000003
    Figure 0007586151000003
Patent Text Reader

Abstract

To appropriately respond to a sudden request for remote support that occurs during automatic drive of a mobile body having an automatic drive function and a remotely supported function.SOLUTION: A method for controlling a mobile body includes the steps of: selecting a control mode for automatic drive of the mobile body; and transmitting information of the selected control mode to the mobile body. The control mode includes a first mode, a second mode in which restriction related to traveling safety is stricter than the first mode, and a third mode in which the restriction is stricter than the first mode and is looser than the second mode. The step of selecting the control mode includes the step of selecting the control mode corresponding to a combination of determination results as to whether or not remote support for the mobile body is necessary and specification results of a state of a remote support side corresponding to the remote support for the mobile body from options including the first, second, and third modes.SELECTED DRAWING: Figure 11
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a method, system, and program for controlling a moving object having an autonomous driving function and a remotely assisted function. [Background technology]

[0002] JP 2021-022319 A discloses a vehicle control device that selectively executes two driving modes of a vehicle's traveling device. The two driving modes include an automatic driving mode and a remote driving mode. When the automatic driving mode is selected, the conventional control device controls the traveling device based on operation information generated autonomously by the control device. On the other hand, when the remote driving mode is selected, the conventional control device controls the traveling device based on remote driving information from an operator.

[0003] The conventional control device also predicts sections where the automatic driving mode is selected (automatic driving sections) and sections where the remote driving mode is selected (remote driving sections) based on route information related to the automatic driving of the vehicle. Then, when the vehicle approaches a remote driving section, the conventional control device requests remote driving information from the operator. When the remote driving information is provided in response to this request, the conventional control device switches the driving mode of the vehicle from the automatic driving mode to the remote driving mode.

[0004] In addition to JP 2021-022319 A, examples of documents showing the technical state of the technical field related to the present disclosure include International Publication No. 2021 / 177052, JP 2019-191893 A, and JP 2017-174282 A. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-022319 [Patent Document 2] International Publication No. 2021 / 177052 [Patent Document 3] JP 2019-191893 A [Patent Document 4] JP 2017-174282 A Summary of the Invention [Problem to be solved by the invention]

[0006] In the above conventional control device, when the current location of the vehicle is in an automatic driving section and away from a remote driving section, the automatic driving mode is selected. However, even in such a case, it is assumed that remote assistance by an operator, such as remote driving, may be required. In this case, the issue is how to continue the automatic driving of the vehicle from the time it is determined that remote assistance is required until the vehicle receives information related to the remote assistance provided in response to the determination.

[0007] In particular, if a response to a request for remote assistance is not made immediately, it is considered that the vehicle will be automatically driven to temporarily stop before the location where the cause of the remote assistance is present. In other words, in this case, the vehicle will wait to receive information about the remote assistance before the location where the cause of the remote assistance is present. However, the occurrence of a waiting time may cause anxiety to the vehicle occupants or may affect the traffic flow around the vehicle. Therefore, it can be said that there is room for technological development to prevent the occurrence of such problems.

[0008] One objective of the present disclosure is to provide technology that can appropriately respond to a sudden request for remote assistance that occurs during autonomous driving of a mobile body that has an autonomous driving function and a remotely assisted function. [Means for solving the problem]

[0009] A first aspect of the present disclosure is a method for controlling a moving object having an autonomous driving function and a remotely assisted function, and has the following features. The method comprises: selecting a control mode for automatic driving of the moving object; transmitting information of the selected control mode to the moving body; Includes. The control modes include a first mode and a second mode in which restrictions on driving safety are stricter than those in the first mode. The step of selecting a control mode includes: determining whether remote assistance is required for the moving object; selecting the first mode as the control mode when it is determined that the remote assistance is not necessary, and selecting the second mode as the control mode when it is determined that the remote assistance is necessary; Includes.

[0010] A second aspect of the present disclosure is a method for controlling a moving object having an autonomous driving function and a remotely assisted function, and has the following features. The method comprises: selecting a control mode for automatic driving of the moving object; transmitting information of the selected control mode to the moving body; Includes. The control modes include a first mode and a second mode in which restrictions on driving safety are stricter than those in the first mode. The step of selecting a control mode includes: Identifying a state of a remote support side corresponding to remote support for the mobile object; selecting the first mode as the control mode when the state of the remote support side is identified as a ready state in which the remote support side is ready to respond to the remote support, and selecting the second mode as the control mode when the state of the remote support side is identified as an unready state in which the remote support side is not ready to respond to the remote support; Includes.

[0011] A third aspect of the present disclosure is a method for controlling a moving object having an autonomous driving function and a remotely assisted function, and has the following features. The method comprises: selecting a control mode for automatic driving of the moving object; transmitting information of the selected control mode to the moving body; Includes. The control modes include a first mode, a second mode in which constraints regarding driving safety are stricter than those in the first mode, and a third mode in which the constraints are stricter than those in the first mode and less stringent than those in the second mode. The step of selecting a control mode includes: determining whether remote assistance is required for the moving object; Identifying a state of a remote support side corresponding to remote support for the mobile object; selecting a control mode corresponding to a combination of the determination result of whether the remote support is necessary or not and the identification result of the state of the remote support side from among options including the first, second, and third modes; Includes.

[0012] A fourth aspect of the present disclosure is an apparatus for controlling a moving object having an autonomous driving function and a remotely assisted function, and has the following features. The apparatus includes a processor. The processor, A process of selecting a control mode for automatic driving of the moving body; A process of transmitting information of the selected control mode to the moving body; The present invention is configured to: The control modes include a first mode, a second mode in which constraints regarding driving safety are stricter than those in the first mode, and a third mode in which the constraints are stricter than those in the first mode and less stringent than those in the second mode. In the process of selecting the control mode, the processor A process of determining whether remote support for the moving object is required; A process of identifying a state of a remote support side corresponding to remote support for the mobile object; A process of selecting a control mode corresponding to a combination of a determination result of whether the remote support is necessary or not and a result of identifying a state of the remote support side from among options including the first, second, and third modes; The present invention is configured to:

[0013] A fifth aspect of the present disclosure is a program for controlling a moving object having an autonomous driving function and a remotely assisted function, and has the following features. The program is A process of selecting a control mode for automatic driving of the moving body; A process of transmitting information of the selected control mode to the moving body; to be executed by the computer. The control modes include a first mode, a second mode in which constraints regarding driving safety are stricter than those in the first mode, and a third mode in which the constraints are stricter than those in the first mode and less stringent than those in the second mode. In the process of selecting the control mode, the program A process of determining whether remote support for the moving object is required; A process of identifying a state of a remote support side corresponding to remote support for the mobile object; A process of selecting a control mode corresponding to a combination of a determination result of whether the remote support is necessary or not and a result of identifying a state of the remote support side from among options including the first, second, and third modes; to be executed by the computer. Effect of the Invention

[0014] According to the present disclosure, a control mode for automatic driving of a moving body is selected based on at least one of a determination result of whether remote support for the moving body is necessary and a result of identifying a state of the remote support side corresponding to the remote support. Then, information on the selected control mode is transmitted to the moving body.

[0015] In the first aspect, the control modes for the automatic driving of the moving body include a first mode and a second mode that has stricter constraints on driving safety than the first mode. In addition, in the first aspect, the first or second mode is selected depending on a determination result of whether or not remote support for the moving body is necessary. Therefore, according to the first aspect, it is possible to appropriately perform the automatic driving of the moving body depending on the determination result.

[0016] Like the first aspect, in the second aspect, the control mode for the automatic driving of the moving body includes a first mode and a second mode. Also, in the second aspect, the first or second mode is selected according to a result of identifying a state of the remote support side corresponding to the remote support for the moving body. Therefore, according to the second aspect, it is possible to appropriately perform the automatic driving of the moving body according to the identification result.

[0017] In the third to fifth aspects, the control modes include the first, second, and third modes. The third mode is a control mode in which the constraints on driving safety are stricter than those in the first mode, and are looser than those in the second mode. In the third aspect, a control mode corresponding to a combination of a determination result of whether or not remote support for the moving body is necessary and a specified result of a state of the remote support side corresponding to the remote support is selected from among options including the first, second, and third modes. Therefore, according to the third to fifth aspects, it is possible to appropriately perform automatic driving of the moving body according to a combination of the determination result and the specified result. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a diagram illustrating remote support for a moving object. [Diagram 2] FIG. 2 is a diagram illustrating an automatic driving function of a moving object. [Diagram 3] 3A to 3C are diagrams illustrating examples of vehicle control modes that are set in the embodiment. [Figure 4] 11A and 11B are diagrams illustrating an example of selection of a vehicle control mode based on a determination result of whether or not remote support for a moving object is necessary. [Diagram 5]11A and 11B are diagrams illustrating an example of selection of a vehicle control mode based on a result of identifying a state on the remote support side corresponding to remote support for a moving object. [Figure 6] 11A and 11B are diagrams illustrating an example of selection of a vehicle control mode based on a result of identifying a state on the remote support side corresponding to remote support for a moving object. [Figure 7] 11 is a diagram illustrating an example of selection of a vehicle control mode based on a combination of a determination result of the necessity of remote support for a moving object and a result of identifying the state of the remote support side corresponding to this remote support. FIG. [Figure 8] 2 is a block diagram showing a configuration example of a management server; [Figure 9] FIG. 2 is a block diagram showing a configuration example of a moving body. [Figure 10] FIG. 2 is a block diagram showing a configuration example of an operator's terminal. [Figure 11] 10 is a flowchart showing the flow of processing executed in a management server (processor) that is particularly related to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, a control method, a control device, and a control program for a moving object according to an embodiment of the present disclosure will be described with reference to the drawings. The control method according to the embodiment is realized by computer processing performed in the control device according to the embodiment. In addition, in each drawing, the same or corresponding parts are given the same reference numerals, and the description thereof will be simplified or omitted.

[0020] 1. Remote support Fig. 1 is a diagram for explaining remote support for a moving object, which illustrates a management server 1, a vehicle 2, and a terminal of an operator OP (hereinafter also referred to as an "operator terminal") 3.

[0021] The management server 1 is an example of a control device according to an embodiment. The management server 1 manages a remote support service. The management server 1 is typically managed by a provider of the remote support service. The management server 1 communicates with a vehicle 2 and an operator terminal 3.

[0022] Vehicle 2 is an example of a moving body controlled by a control device according to an embodiment. Vehicle 2 has a function of receiving remote support (remotely supported function). Vehicle 2 may be a vehicle owned by a remote support service provider, or may be a vehicle owned by a corporation or individual that has entered into a contract to provide remote support services with this provider. Vehicle 2 has a function of performing autonomous driving (autonomous driving function) in addition to the remotely supported function. This autonomous driving function will be described later.

[0023] The operator OP performs remote support for the vehicle 2. The operator OP may be an employee of a business providing the remote support service, or may be an employee of a corporation or an individual that has concluded a contract for outsourcing with the business. The total number of operators OP engaged in the remote support service is at least two. The total number of operators OP that respond to the remote support for the vehicle 2 is at least one, and the selection of this at least one responder (person in charge) is performed by the management server 1.

[0024] Here, "at least one responder" means that there is one or more operators OP (i.e., responder candidates) who are scheduled to respond to remote support for the vehicle 2. When remote support for the vehicle 2 is performed, at least one operator OP (i.e., a practical responder) is selected from the at least one responder candidate. The selection of this at least one practical responder is also performed by the management server 1.

[0025] Examples of remote assistance include recognition assistance and decision support. For example, consider a case where the vehicle 2 is driving autonomously. When sunlight hits a traffic light in front of the vehicle 2, the accuracy of recognition of the light status of the traffic light decreases. When the light status cannot be recognized, it becomes difficult to determine what action should be taken and when. In such a case, recognition support of the light status by the operator OP and / or decision support of the vehicle 2's action based on the result of recognition of the light status by the operator OP are performed.

[0026] Remote assistance also includes remote driving. In remote driving, for example, an operator OP performs at least one of steering, acceleration, and deceleration of the vehicle 2 by referring to a camera image showing the surroundings of the vehicle 2 and a camera image showing the interior of the vehicle 2.

[0027] FIG. 1 illustrates data COM12 and COM21 exchanged between a management server 1 and a vehicle 2 (more precisely, a terminal mounted on the vehicle 2), and data COM13 and COM31 exchanged between the management server 1 and an operator terminal 3. Data COM12 is transmitted from the management server 1 to the vehicle 2. Data COM21 is transmitted from the vehicle 2 to the management server 1. Data COM13 is transmitted from the management server 1 to the operator terminal 3. Data COM31 is transmitted from the operator terminal 3 to the management server 1.

[0028] Examples of the data COM21 include data for identifying the vehicle 2, data of a camera image showing the surroundings of the vehicle 2, and data of a camera image showing the interior of the vehicle 2. Examples of the data COM21 include various data when the vehicle 2 requests remote support (e.g., data for identifying the vehicle 2, data of a camera image, data indicating the content of remote support, etc.). Examples of the data COM13 include data corresponding to the selection result of an operator OP corresponding to remote support for the vehicle 2. Examples of the data COM31 and the data COM12 include data of recognition support and judgment support by the operator OP. When the vehicle 2 is remotely driven, the data COM31 and the data COM12 include driving operation data.

[0029] 2.Autonomous driving function FIG. 2 is a diagram illustrating the autonomous driving function of the vehicle 2. FIG. 2 illustrates a data processing device 21 of the vehicle 2. The data processing device 21 is a computer that controls the behavior of the vehicle 2. Typically, the data processing device 21 is mounted on the vehicle 2. At least a part of the functions of the data processing device 21 may be realized as a function of an external device provided outside the vehicle 2. In other words, at least a part of the functions of the data processing device 21 may be realized in a distributed manner between the vehicle 2 and the external device.

[0030] The data processing device 21 performs, for example, vehicle control for automatic driving of the vehicle 2. In this vehicle control, for example, the steering, acceleration, and deceleration of the vehicle 2 are controlled so that the vehicle 2 follows a target trajectory TR. The target trajectory TR is a trajectory along which the vehicle 2 should travel. The target trajectory TR is generated, for example, based on a travel route from the departure point of the vehicle 2 to the destination. The travel route is calculated, for example, by a navigation system (not shown). The target trajectory TR may be generated based on peripheral information of the vehicle 2, or may be generated based on a combination of the travel route and peripheral information.

[0031] The target trajectory TR includes, for example, a set of target control values ​​TCi in vehicle control for automatic driving. The target control values ​​TCi are exemplified by target positions [Xi, Yi] through which the vehicle 2 should pass. In the example shown in FIG. 2, the X direction is the forward direction of the vehicle 2, and the Y direction is a planar direction perpendicular to the X direction. However, the coordinate system (X, Y) is not limited to the example shown in FIG. 2. The target positions [Xi, Yi] are set at predetermined intervals (for example, 1 to 2 m) on the target trajectory TR. The target positions [Xi, Yi] are set, for example, from several seconds to several tens of seconds ahead from the current time.

[0032] The target control value TCi may be a combination of the target position [Xi, Yi] and the target speed [VXi, VYi] of the vehicle 2 at the target position [Xi, Yi]. Instead of the target speed [VXi, VYi], a target time at the target position [Xi, Yi] may be used. When the target time is used, the target control value TCi may further include the orientation of the vehicle 2 at the target time. In addition to the target position [Xi, Yi] and the target speed [VXi, VYi], the target control value TCi may include at least one of a target yaw angle of the vehicle 2 at the target position [Xi, Yi] and a target acceleration of the vehicle 2 at the target position [Xi, Yi].

[0033] In order to make the vehicle 2 follow the target trajectory TR, vehicle control for automatic driving calculates the deviation (e.g., position deviation, speed deviation, time deviation, yaw angle deviation, speed deviation, etc.) between the target vehicle state corresponding to the target control value TCi and the current vehicle state of the vehicle 2. In this vehicle control, a control command value of the traveling device (actuator) of the vehicle 2 is also calculated so as to reduce this deviation. In other words, the control command value is a command value for controlling the current vehicle state to the target vehicle state. The traveling device includes a steering device, a drive device, and a braking device. Then, the traveling device is controlled based on the control command value.

[0034] 3. Vehicle control mode MD In the embodiment, a vehicle control mode MD for autonomous driving is set. The vehicle control mode MD is set in the management server 1. Information on the vehicle control mode MD is transmitted from the management server 1 to the vehicle 2 every time the vehicle control mode MD is set. The vehicle 2 performs vehicle control for autonomous driving by referring to the information on the vehicle control mode MD. Hereinafter, the information on the vehicle control mode MD transmitted from the management server 1 to the vehicle 2 is also referred to as "mode information MDE". The mode information MDE is included in the data COM12 shown in FIG. 1.

[0035] Fig. 3 is a diagram for explaining examples of vehicle control modes MD set in the embodiment. In the example shown in Fig. 3, five types of vehicle control modes MD including an efficiency-oriented mode (aggressive mode or AGG mode), a standard mode (moderate mode or MDR mode), a semi-safety-oriented mode (semi-conservative mode or SCN mode), a safety-oriented mode (conservative mode or CNS mode), and a safe stop mode (safe stop mode) are set as the vehicle control modes MD.

[0036] The four vehicle control modes MD, excluding the safe stop mode, differ in the strictness of constraints on driving safety. These constraints are the strictest in the safety-oriented mode, followed by the semi-safety-oriented mode, the standard mode, and the efficiency-oriented mode, in that order. The safe stop mode is a vehicle control mode MD that is not bound by constraints on driving safety. When the safe stop mode is set, vehicle control is performed to stop the vehicle 2 on the shoulder or shoulder strip.

[0037] The "strictness of constraints regarding driving safety" can be evaluated, for example, by examining multiple candidate driving routes calculated by a navigation system and focusing on at least one of the items exemplified below.

[0038] For example, consider a case where multiple candidate driving routes are routes that pass through both general roads and expressways. In this case, it is expected that the amount of information that a vehicle must recognize for safe driving increases as the proportion of the distance that passes through general roads increases. In addition, it is expected that the total number of lane changes and the total number of changes in direction of travel, such as right and left turns, that are required when passing through the driving route will be fewer as the proportion of the distance that passes through expressways increases. Therefore, a candidate driving route that has a high proportion of distance that passes through general roads can be evaluated as a candidate with "strict constraints on driving safety," and a candidate driving route that has a low proportion of distance that passes through general roads can be evaluated as a candidate with "relaxed constraints on driving safety."

[0039] In another example, consider a case where multiple candidate driving routes are routes that pass through both urban areas and suburban areas. In this case, it is expected that the amount of information that the vehicle must recognize for driving safety increases as the proportion of the distance that passes through urban areas increases. Therefore, a candidate driving route that has a high proportion of the distance that passes through urban areas can be evaluated as a candidate with "strict constraints regarding driving safety." Note that the distinction between urban areas and suburban areas can be made based on map information (population density information).

[0040] In another example, consider a case where multiple candidates for a driving route include information on traffic volume (e.g., the number of vehicles and pedestrians passing through per unit time) in the area through which the driving route passes. In this case, it is expected that the amount of information that a vehicle must recognize for driving safety increases as the traffic volume increases. Therefore, a candidate driving route with a high traffic volume can be evaluated as a candidate with "strict constraints regarding driving safety." The area through which the driving route passes can be, for example, divided into a predetermined area increment (e.g., 50 to 100 m). 2 The unit areas of a map divided into 1000m² (100m²) can be connected along this driving route. The traffic volume in the area that the driving route passes through can be calculated by adding up the traffic volume in the unit areas connected along the driving route.

[0041] According to the evaluation items such as the ratio of the distance passing through general roads, the ratio of the distance passing through urban areas, and the traffic volume in the area through which the travel route passes, a plurality of travel route candidates can be ranked in terms of "strictness of constraints on travel safety". In the embodiment, a process is performed in which these candidates are associated with the above-mentioned four types of vehicle control modes MD (i.e., the four types of vehicle control modes MD excluding the safe stop mode) according to the level of the rank.

[0042] Another example of the assessment of the "strictness of constraints regarding driving safety" is the various limit values, threshold values, and variables used in vehicle control for autonomous driving.

[0043] Examples of various limit values ​​used in vehicle control include upper and lower limits of target control values ​​such as speed, acceleration (or deceleration), jerk, and steering angular velocity. By setting the upper and lower limits of the target control values ​​in multiple stages, it is possible to provide different "strictness of constraints regarding driving safety."

[0044] Examples of various thresholds used in vehicle control include the following distance (or following time) when vehicle control is performed to follow a preceding vehicle, the lateral margin distance when vehicle control is performed to avoid a collision with an obstacle, the speed when passing by this obstacle, and the allowable deviation from the currently traveling lane when passing by this obstacle. Another example of a threshold is the distance used to determine whether or not to execute vehicle control to change lanes (for example, the distance between two vehicles traveling side by side when changing lanes to wed between these vehicles). By setting such thresholds in multiple stages, it is possible to create differences in the "strictness of constraints regarding driving safety."

[0045] Examples of various variables used in vehicle control include variables used to calculate the risk of collision with an obstacle, the risk of a moving object jumping out of the vehicle's blind spot, etc. Examples of such variables include variables (expected acceleration, allowable error, etc.) that are input into a model that predicts the future position of an obstacle or moving object. Variables used in vehicle control also include the reliability of the recognition results of objects recognized by the vehicle and their states (for example, traffic lights and the colors of their lights). By setting such variables at multiple stages, it is possible to create differences in the "strictness of constraints regarding driving safety."

[0046] In the embodiment, the various limit values, threshold values, and variables described above are each ranked in advance into at least four stages from the viewpoint of "strictness of constraints on driving safety." Furthermore, the various ranked limit values, threshold values, and variables are associated with the four vehicle control modes MD described above.

[0047] 4. Example of vehicle control mode MD selection In an embodiment, the selection of the above-mentioned five types of vehicle control modes MD (i.e., all vehicle control modes MD including the safe stop mode) is made based on at least one of the need for remote support NDS for vehicle 2 and the status CND of the remote support side corresponding to this remote support.

[0048] 4-1.Necessity of remote supportNDS The presence or absence of the necessity NDS is determined in the management server 1. Information for determining the presence or absence of the necessity NDS is provided from the vehicle 2, the management server 1, or an arbitrary prediction device.

[0049] For example, vehicle 2 recognizes objects contained in a camera image showing the surroundings of vehicle 2. Vehicle 2 also detects the movement of the recognized object. For example, if it is difficult to recognize an object contained in the surrounding image, vehicle 2 requests management server 1 to recognize the object. When management server 1 receives this request information, it is determined that there is a necessity NDS. In another example, when an object is recognized but an unnatural movement of the object is detected, vehicle 2 requests management server 1 to check the state of the object. When management server 1 receives this request information, it is also determined that there is a necessity NDS.

[0050] The vehicle 2 may recognize the state of the occupant (driver) contained in a camera image showing the interior of the vehicle 2. Then, when an abnormal state of the driver is recognized, the vehicle 2 may request the management server 1 to confirm this abnormal state. When the management server 1 receives this request information, it is also determined that there is a necessity NDS. The vehicle 2 may detect the movement of an object around the vehicle 2 based on information from a recognition sensor other than the camera. Then, when an unnatural movement of this object is detected, the vehicle 2 may request the management server 1 to confirm the state of this object. When the management server 1 receives this request information, it is also determined that there is a necessity NDS.

[0051] The management server 1 can appropriately acquire camera images of the vehicle 2 (for example, surrounding images, interior images) and information other than camera images (for example, information from recognition sensors other than cameras, information from internal sensors of the vehicle 2). Therefore, if the vehicle 2 is provided with an object recognition function and a driver state recognition function, the management server 1 can recognize objects included in the camera images of the vehicle 2, detect the motion of the recognized object, and recognize the state of the driver of the vehicle 2. Then, if an unnatural motion of an object is detected, if an abnormal state of the driver is recognized, or if an abnormal state of the vehicle 2 is detected, the management server 1 determines that there is a need NDS.

[0052] The arbitrary predictor is formed, for example, inside the management server 1. The arbitrary predictor may be formed outside the management server 1. The arbitrary predictor predicts the occurrence of remote support for the vehicle 2 by machine learning using, for example, time series data of camera images of the vehicle 2, time series data of camera images of other vehicles, time series data of images of infrastructure cameras installed at intersections, or remote support service provision history data (for example, time period and location). Then, when the occurrence of remote support for the vehicle 2 is predicted, the arbitrary predictor generates prediction information and transmits it to the management server 1. When this prediction information is received, the management server 1 determines that there is a need NDS.

[0053] Based on the information provided by the vehicle 2, the management server 1, or any predictor, the management server 1 judges whether or not there is a necessity NDS. Then, based on the result of this judgment, the management server 1 selects one vehicle control mode MD from the above-mentioned five types of vehicle control modes MD.

[0054] Fig. 4 is a diagram for explaining an example of selection of a vehicle control mode MD based on the result of determining whether or not there is a necessity NDS. In the first example shown in Fig. 4, if it is determined that there is no necessity NDS (NO), the AGG mode is selected, and if it is determined that there is a necessity NDS (YES), the MDR mode is selected. In this example, the AGG mode corresponds to the "first mode" of the present disclosure, and the MDR mode corresponds to the "second mode" of the present disclosure.

[0055] Here, the difference between the first mode and the second mode is the "strictness of the constraints on safety." In other words, the constraints on driving safety in the second mode are stricter than those in the first mode. The relationship between the AGG mode and the MDR mode is the same as the relationship between the first mode and the second mode.

[0056] In the second example shown in Fig. 4, when it is determined that there is no need for NDS (NO), the MDR mode is selected, and when it is determined that there is need for NDS (YES), the SCN mode is selected. In this example, the MDR mode corresponds to the "first mode" of the present disclosure, and the SCN mode corresponds to the "second mode" of the present disclosure. The relationship between the MDR mode and the CR mode is that between the first mode and the second mode.

[0057] 4-2. Status of remote support (CND) The remote support side refers to the entire system that provides remote support to the vehicle 2, including the management server 1, the operator OP, and the operator terminal 3. The state CND of the remote support side is broadly divided into a ready state (RD state) in which it is ready to respond to remote support, and an unready state (URD state) in which it is not ready to respond to remote support. The unready state is further divided into an available state (AV state) in which it is ready to switch to the ready state, and an unavailable state (UAV state) in which it is not ready to switch to the ready state.

[0058] Identification of which of the three types of states the status CND is is performed, for example, based on the selection state of an operator OP (i.e., a candidate responder) scheduled to respond to remote support for the vehicle 2. Specifically, when the selection of a candidate responder is completed and an approval signal from this candidate is detected, the status CND is identified as corresponding to a ready state. When the selection of a candidate responder is completed but an approval signal from this candidate is not detected, the status CND is identified as corresponding to an unready state (available state). When the selection of a candidate responder is not completed and there are a shortage of candidate responders, the status CND is identified as corresponding to an unready state (unavailable state).

[0059] In another example, the status CND is determined based on the status of an operator OP (i.e., a practical responder) selected from among candidates for responders when remote support is performed. Specifically, when the selection of a practical responder is completed and an approval signal from this practical responder is detected, the status CND is determined to correspond to a ready state. In the case of a method in which the practical responder notifies the management server 1 of whether or not the understanding of the situation in which the vehicle 2 is placed is completed, the status CND is determined to correspond to an unready state (available state) until a signal indicating that the understanding is completed is detected from a notification device such as a switch or button. In the case of a method in which the practical responder notifies the management server 1 of whether or not the understanding of the situation in which the vehicle 2 is placed is possible, when a signal indicating that the understanding is impossible is detected from a notification device such as a switch or button, the status CND is determined to correspond to an unready state (unavailable state).

[0060] In another example, the status CND is determined based on the communication state between the management server 1 and the vehicle 2 and the communication state between the management server 1 and the terminal of the operator OP. Specifically, when a communication delay occurs between the management server 1 and the vehicle 2 or between the management server 1 and the operator terminal 3, the status CND is determined to be an unready state (available state or unavailable state) depending on the level of this communication delay.

[0061] In yet another example, the status CND is determined based on the status of a system that remotely assists the vehicle 2. Specifically, when the system status is normal, the status CND is determined to correspond to a ready status. When the system status is abnormal, the status CND is determined to correspond to an unready status (available status or unavailable status) depending on the level of the abnormality.

[0062] Based on the information on the selection status of the candidate responders, the status of the practical responders, the communication status between the management server 1 and the vehicle 2 or between the management server 1 and the operator terminal 3, or the status of the system that remotely supports the vehicle 2, the management server 1 specifies which of the three types of statuses the status CND is. Then, based on the result of this specification, the management server 1 selects one vehicle control mode MD from the five types of vehicle control modes MD described above.

[0063] 5 and 6 are diagrams for explaining an example of selection of a vehicle control mode MD based on the result of identifying the state CND. In the first example shown in FIG. 5, when the state CND is identified as the RD state, the MDR mode is selected, and when the state CND is identified as the URD state, the SCN mode is selected. In this example, the MDR mode corresponds to the "first mode" of the present disclosure, and the SCN mode corresponds to the "second mode" of the present disclosure. As described above, the relationship between the MDR mode and the SCN mode is that between the first mode and the second mode.

[0064] In the second example shown in Fig. 5, if the status CND is identified as the RD state, the SCN mode is selected, and if the status CND is identified as the URD state, the CNS mode is selected. In this example, the SCN mode corresponds to the "first mode" of the present disclosure, and the CNS mode corresponds to the "second mode" of the present disclosure. The relationship between the SCN mode and the CNS mode is that between the first mode and the second mode.

[0065] 6, the MDR mode is selected when the state CND is identified as the RD state, the SCN mode is selected when the state CND is identified as the URD state (AV state), and the CNS mode is selected when the state CND is identified as the URD state (UAV state). In this example, the MDR mode corresponds to the "first mode" of the present disclosure, the SCN mode corresponds to the "third mode" of the present disclosure, and the CNS mode corresponds to the "second mode" of the present disclosure.

[0066] Here, the difference between the first, second and third modes is the "strictness of safety constraints." That is, the second mode has stricter constraints on driving safety than the first mode. Also, the third mode has stricter constraints on driving safety than the first mode, but looser constraints on driving safety than the second mode. The relationship between the MDR mode, the CNS mode and the SCN mode is the same as the relationship between the first mode, the second mode and the third mode.

[0067] In the second example shown in Fig. 6, when the state CND is identified as the RD state, the SCN mode is selected, when the state CND is identified as the URD state (AV state), the CNS mode is selected, and when the state CND is identified as the URD state (UAV state), the safe stop mode is selected. In this example, the SCN mode corresponds to the "first mode" of the present disclosure, the CNS mode corresponds to the "second mode" of the present disclosure, and the safe stop mode corresponds to the "fourth mode" of the present disclosure. As described above, the relationship between the SCN mode and the CNS mode is the relationship between the first mode and the second mode.

[0068] 4-3. Combination of Necessity NDS and Status CND In the example shown in Fig. 4, the vehicle control mode MD is selected based on the necessity NDS of remote support. In the examples shown in Figs. 5 and 6, the vehicle control mode MD is selected based on the status CND of the remote support side. In the example shown in Fig. 7, the vehicle control mode MD is selected based on a combination of the necessity NDS of remote support and the status CND of the remote support side.

[0069] In the first example shown in Fig. 7, when it is determined that there is no necessity NDS (NO), if the state CND is specified to be the RD state, the MDR mode is selected, if the state CND is specified to be the URD state (AV state), the SCN mode is selected, and if the state CND is specified to be the URD state (UAV state), the CNS mode is selected. In other words, this first example is an example in which the first example of Fig. 6 is applied when it is determined that there is no necessity NDS (NO).

[0070] In the second example shown in Fig. 7, when it is determined that there is a necessity NDS (YES), the SCN mode is selected when the state CND is specified to be the RD state, the CNS mode is selected when the state CND is specified to be the URD state (AV state), and the safe stop mode is selected when the state CND is specified to be the URD state (UAV state). In other words, this second example is an example in which the second example in Fig. 6 is applied when it is determined that there is a necessity NDS (YES).

[0071] Thus, according to the embodiment, the vehicle control mode MD is set based on at least one of the necessity NDS of remote support for the vehicle 2 and the state CND of the remote support side corresponding to the remote support, and vehicle control for automatic driving of the vehicle 2 is performed according to the vehicle control mode MD. Therefore, for example, when the necessity NDS switches from absent (NO) to present (YES), it becomes possible to appropriately perform automatic driving until remote support is started. Even when the necessity NDS switches from present (YES) to absent (NO), it becomes possible to appropriately perform vehicle control when automatic driving is resumed.

[0072] Moreover, according to the embodiment, it is possible to appropriately perform automatic driving until remote assistance is started, depending on the state CND of the remote assistance side when the necessity NDS switches from no (NO) to yes (YES). Also, it is possible to appropriately perform vehicle control when automatic driving is resumed, depending on the state CND of the remote assistance side when the necessity NDS switches from yes to no (NO). This is expected to increase the stability of the execution of automatic driving when the necessity NDS frequently switches. Therefore, according to the embodiment, it is expected to give a sense of security to the occupants of the vehicle 2, or to minimize the impact on the traffic flow around the vehicle 2.

[0073] 5. System configuration example An example of the configuration of the remote support system will be described with reference to Figs. 8 to 10. Fig. 8 is a block diagram showing an example of the configuration of the management server 1. Fig. 9 is a block diagram showing an example of the configuration of the vehicle 2. Fig. 10 is a block diagram showing an example of the configuration of the operator terminal 3.

[0074] 5-1. Example of management server 1 configuration 8, the management server 1 includes a data processing device 11, a database 12, and a communication device 13. The database 12 and the communication device 13 are connected to the data processing device 11 via a predetermined network.

[0075] The data processing device 11 includes at least one processor 14 and at least one memory 15. The processor 14 includes a CPU (Central Processing Unit). The memory 15 is a volatile memory such as a DDR memory, and expands various programs used by the processor 14 and temporarily stores various data. The various programs used by the processor 14 include a control program according to the embodiment. The various data used by the processor 14 includes data stored in a database 12.

[0076] An example of the data stored in the database 12 is data DNDS used to determine whether or not there is a necessity NDS. The data DNDS includes, for example, data of a camera image (e.g., an image of the surroundings, an image of the interior of the vehicle 2), time series data of the camera image, data other than the camera image, and time series data other than the camera image. The data DNDS also includes data of prediction information received from the above-mentioned arbitrary predictor. When the management server 1 has a function as this arbitrary predictor, the data DNDS also includes time series data of a camera image of another vehicle, time series data of an image of an infrastructure camera, and provision history data of a remote support service.

[0077] Another example of data stored in the database 12 is data DCND used to specify the status CND of the remote support side. The data DCND includes, for example, data on the selection status of an operator OP (i.e., a candidate responder) who is scheduled to respond to remote support for the vehicle 2, and data on whether an approval signal has been received from this candidate. In another example, the data DCND also includes data on the status of an operator OP (i.e., a practical responder) selected from the candidate responders when remote support is performed, and data on whether an approval signal has been received from this practical responder. In the case of a method in which the practical responder notifies the management server 1 of whether understanding of the situation in which the vehicle 2 is placed has been completed, the data DCND also includes data on whether a signal indicating that understanding has been completed has been received, and data on whether a signal indicating that understanding is impossible has been received.

[0078] In another example, the data DCND includes data on the communication status between the management server 1 and the vehicle 2, and data on the communication status between the management server 1 and the terminal of the operator OP. In yet another example, data on the status of a system that provides remote support for the vehicle 2 is included in the data DCND.

[0079] The communication device 13 connects to an external device via a communication network. The communication network is not particularly limited, and wired and wireless networks can be used. Examples of the communication network include an Internet line, a World Wide Web (WWW), a telephone line, a Local Area Network (LAN), a Storage Area Network (SAN), and a Delay Tolerant Network (DTN). Examples of wireless communication include Wireless Fidelity (WiFi) and Bluetooth (registered trademark). The wireless communication may be in a form in which the management server 1 directly communicates (Ad Hoc communication), or indirect communication via an access point. The communication destinations of the communication device 13 include the vehicle 2 and the operator terminal 3.

[0080] 5-2. Example of vehicle 2 configuration 9, the vehicle 2 includes a data processing device 21, a camera 22, sensors 23, a communication device 24, and a traveling device 25. The elements such as the camera 22 and the traveling device 25 and the data processing device 21 are connected via a predetermined network.

[0081] The data processing device 21 is a computer for processing various data acquired by the vehicle 2. The data processing device 21 includes at least one processor 26 and at least one memory 27. The processor 26 includes a CPU. The memory 27 develops various programs used by the processor 26 and temporarily stores various data. The various data acquired by the data processing device 21 is stored in the memory 27.

[0082] Processor 26 executes a program stored in memory 27 to perform a process of ranking a plurality of travel route candidates sequentially calculated by the navigation system from the viewpoint of "strictness of constraints regarding travel safety." When processor 26 receives mode information MDE from management server 1, processor 26 executes a program stored in memory 27 to perform a process of selecting a candidate corresponding to the mode information MDE from among the ranked travel route candidates.

[0083] Processor 26 also executes programs stored in memory 27 to set various limit values, threshold values, and variables used in vehicle control for automatic driving of vehicle 2. When mode information MDE is received from management server 1, processor 26 sets various limit values, threshold values, and variables corresponding to this mode information MDE. As described above, these limit values, threshold values, and variables are each ranked in advance into at least four stages from the perspective of "strictness of constraints regarding driving safety."

[0084] The processor 26 also executes a program stored in the memory 27 to perform control for remote support of the vehicle 2. For example, the vehicle 2 determines whether or not remote support is necessary by executing a program stored in the memory 27. When it is determined that remote support is necessary, the processor 26 generates request information for remote support and transmits it to the management server 1 via the communication device 24.

[0085] The camera 22 captures images of the surroundings of the vehicle 2 and the interior of the vehicle 2. The sensors 23 include recognition sensors (external sensors) other than cameras. Examples of the recognition sensors include LiDAR (Laser Imaging Detection and Ranging) and radar. The sensors 23 also include internal sensors of the vehicle 2. Examples of the internal sensors include a vehicle speed sensor, an acceleration sensor, and a yaw rate sensor. The sensors 23 also include a sensor (GPS sensor) that acquires position information of the vehicle 2.

[0086] The communication device 24 performs wireless communication with a base station of a wireless network. Examples of communication standards for this wireless communication include mobile communication standards such as 4G, LTE, and 5G. The connection destinations of the communication device 24 include at least the management server 1. In communication with the management server 1, the communication device 24 transmits various data received from the camera 22 and the sensors 23 to the management server 1. When request information for remote support is generated, the communication device 24 transmits data of this request information to the management server 1. The communication device 24 also receives data of mode information MDE from the management server 1.

[0087] The traveling device 25 includes, for example, a drive device, a steering device, and a brake device. The drive device drives the tires of the vehicle 2. The steering device steers the tires of the vehicle 2. The brake device applies a braking force to the vehicle 2. The acceleration of the vehicle 2 is performed by controlling the drive device. The deceleration of the vehicle 2 is performed by controlling the brake device. If the drive device is a motor, the braking of the vehicle 2 may be performed by utilizing regenerative braking controlled by the motor. The steering of the vehicle 2 is performed by controlling the steering device.

[0088] 5-3. Example of configuration of operator terminal 3 10, the operator terminal 3 includes a data processing device 31, a display 32, an input device 33, and a communication device 34. The elements such as the display 32 and the input device 33 and the data processing device 31 are connected via a predetermined network.

[0089] The data processing device 31 is a computer for processing various data acquired by the vehicle 2. The data processing device 31 includes at least one processor 35 and at least one memory 36. The processor 35 includes a CPU. The memory 36 deploys various programs used by the processor 35 and temporarily stores various data. The various data acquired by the data processing device 31 and various data generated based on an input signal from the input device 33 are stored in the memory 36. An example of the former data is camera image data of the vehicle 2 received from the management server 1. An example of the latter data is recognition support and judgment support data. When the vehicle 2 is remotely driven, the latter data also includes driving operation data.

[0090] The display 32 is a device that outputs camera images for providing remote support to the vehicle 2. The total number of displays 32 is at least 1. In order to separately output camera images of the surroundings of the vehicle 2 and camera images of the interior of the vehicle 2, it is desirable that the total number of displays 32 is at least 2.

[0091] The input device 33 is a device operated by an operator OP. The input device 33 includes, for example, an input unit that accepts an input by the operator OP, and a control circuit that generates and outputs data for recognition support and judgment support based on the input. Examples of the input unit include a touch panel, a mouse, a keyboard, a button, and a switch. Examples of the input by the operator OP include a movement operation of a cursor output on the display 32, and a selection operation of a button output on the display 32.

[0092] When the vehicle 2 is remotely driven, the input device 33 may include an input device for driving the vehicle 2. Examples of the input device for driving the vehicle 2 include a steering wheel, a shift lever, an accelerator pedal, and a brake pedal.

[0093] The communication device 34 connects to an external device via a communication line network. The communication line network is not particularly limited, and wired and wireless networks can be used. The communication destination of the communication device 34 includes at least the management server 1. In communication with the management server 1, the communication device 34 transmits various data used to specify the state CND of the remote support side to the management server 1. Examples of the various data include an approval signal of an operator OP scheduled to respond to remote support for the vehicle 2, and data on the state of an operator OP selected from among candidates for responders when remote support is performed. When remote support for the vehicle 2 is performed, the communication device 34 transmits data on recognition support and judgment support to the management server 1. The communication device 34 also receives data on camera images of the vehicle 2 from the management server 1.

[0094] 6. Data processing example Fig. 11 is a flowchart showing the flow of processing executed in the management server 1 (processor 14) that is particularly related to the embodiment. In order to avoid duplication of explanation, Fig. 11 explains an example of the selection processing of the vehicle control mode MD based on the combination of the necessity NDS and the status CND explained in Fig. 7. The routine shown in Fig. 11 is executed repeatedly at a predetermined control period, for example.

[0095] In the routine shown in Fig. 11, first, it is determined whether or not there is a need NDS for remote assistance for the vehicle 2 (step S1). The determination of whether or not there is a need NDS is made based on the data DNDS stored in the database 12. If the determination result of step S1 is positive (i.e., if there is a need NDS (YES)), processing from step S2 onwards is performed. If the determination result of step S1 is negative (i.e., if there is a need NDS (NO)), processing from step S7 onwards is performed.

[0096] In the process of step S2, it is determined whether the status CND of the remote support side is the RD status. The status CND is specified based on the data DCND stored in the database 12. As described above, the status in which the vehicle 2 is ready to respond to remote support is the RD status.

[0097] If the determination result of step S2 is positive (i.e., if the state CND is the RD state), the SCN mode is selected as the vehicle control mode MD (step S3). If the determination result of step S2 is negative (i.e., if the state CND is the URD state), the processing of step S4 and subsequent steps is performed. As described above, the URD state is a state in which the vehicle 2 is not prepared to respond to remote assistance.

[0098] In the process of step S4, it is determined whether the status CND of the remote support side is the AV state. The status CND has already been specified in the process of step S2. The process of step S4 is performed using the processing result of step S2. As described above, the AV state is a state in which the remote support side is ready to switch to the RD state.

[0099] If the determination result of step S4 is positive (i.e., if the state CND is the AV state), the CNS mode is selected as the vehicle control mode MD (step S5). If the determination result of step S4 is negative (i.e., if the state CND is the UAV state), the safe stop mode is selected as the vehicle control mode MD (step S6). As described above, the UAV state is a state in which the vehicle is not ready to switch to the RD state.

[0100] In the process of step S7, it is determined whether the status CND of the remote support side is the RD state. In other words, the content of the process of step S7 is the same as that of step S2. If the determination result of step S7 is positive (i.e., if the status CND is the RD state), the MDR mode is selected as the vehicle control mode MD (step S8). If the determination result of step S7 is negative (i.e., if the status CND is the URD state), the processes of steps S9 and onward are performed.

[0101] In the process of step S9, it is determined whether the state CND of the remote support side is the AV state. That is, the content of the process of step S9 is the same as that of step S4. If the determination result of step S9 is positive (that is, if the state CND is the AV state), the SCN mode is selected as the vehicle control mode MD (step S10). If the determination result of step S9 is negative (that is, if the state CND is the UAV state), the CNS mode is selected as the vehicle control mode MD (step S11).

[0102] Following the processing of steps S3, S5, S6, S8, S10 or S11, information on the vehicle control mode MD selected in the processing of these steps (that is, mode information MDE) is transmitted to the vehicle 2 (step S12).

[0103] 7.Effects According to the embodiment described above, the vehicle control mode MD is set based on at least one of the necessity NDS of remote assistance for the vehicle 2 and the state CND of the remote assistance side corresponding to the remote assistance, and vehicle control for automatic driving of the vehicle 2 is performed according to the information of the vehicle control mode MD. Therefore, for example, when the necessity NDS switches from absent (NO) to present (YES), it becomes possible to appropriately perform automatic driving until remote assistance for the vehicle 2 is started. Even when the necessity NDS switches from present (YES) to absent (NO), it becomes possible to appropriately perform vehicle control when automatic driving is resumed.

[0104] Moreover, according to the embodiment, it is possible to appropriately perform automatic driving until remote assistance is started, depending on the state CND of the remote assistance side when the necessity NDS switches from no (NO) to yes (YES). Also, it is possible to appropriately perform vehicle control when automatic driving is resumed, depending on the state CND of the remote assistance side when the necessity NDS switches from yes to no (NO). This is expected to increase the stability of the execution of automatic driving when the necessity NDS frequently switches. Therefore, according to the embodiment, it is expected to give a sense of security to the occupants of the vehicle 2, or to minimize the impact on the traffic flow around the vehicle 2. [Explanation of symbols]

[0105] 1 Management Server 2 Vehicles 3 Operator terminal 11, 21, 31 Data processing device 13,24,34 Communication equipment 14,26,35 processor 15,27,36 Memory MD Vehicle Control Mode CND Remote support status MDE Mode Information NDS Remote Support Necessity

Claims

1. A method for controlling a moving object having an autonomous driving function and a remote assistance function, comprising: selecting a control mode for automatic driving of the moving object; transmitting information of the selected control mode to the moving body; Including, The control modes include a first mode and a second mode in which restrictions on driving safety are stricter than those in the first mode, The step of selecting a control mode comprises: determining whether remote assistance is required for the moving object; selecting the first mode as the control mode when it is determined that the remote assistance is not necessary, and selecting the second mode as the control mode when it is determined that the remote assistance is necessary; A method for controlling a moving object, comprising:

2. A method for controlling a moving object having an autonomous driving function and a remote assistance function, comprising: selecting a control mode for automatic driving of the moving object; transmitting information of the selected control mode to the moving body; Including, The control modes include a first mode and a second mode in which restrictions on driving safety are stricter than those in the first mode, The step of selecting a control mode comprises: Identifying a state of a remote support side corresponding to remote support for the mobile object; selecting the first mode as the control mode when the state of the remote support side is identified as a ready state in which the remote support side is ready to respond to the remote support, and selecting the second mode as the control mode when the state of the remote support side is identified as an unready state in which the remote support side is not ready to respond to the remote support; A method for controlling a moving object, comprising:

3. 3. The method of claim 2, The control modes further include a third mode in which the constraint is stricter than that in the first mode and is looser than that in the second mode; the unready state includes an available state in which the state is ready to switch to the ready state, and an unavailable state in which the state is not ready to switch, the step of identifying the state of the remote support side includes a step of identifying whether the state of the remote support side is the available state or the unavailable state when the state of the remote support side is identified as the unready state; When the state of the remote support side is identified as the unready state and the available state, the third mode is selected as the control mode; When the state of the remote support side is determined to be the unready state and the unavailable state, the second mode is selected as the control mode. A method for controlling a moving object comprising:

4. 4. The method according to claim 2 or 3, The control mode further includes a fourth mode in which the moving object is stopped on a road shoulder or a roadside strip, The state of the remote support side includes a ready state in which the remote support side is ready to respond to the remote support, and an unready state in which the remote support side is not ready to respond to the remote support, the unready state includes an available state in which the state is ready to switch to the ready state, and an unavailable state in which the state is not ready to switch, the step of identifying the state of the remote support side includes a step of identifying whether the state of the remote support side is the available state or the unavailable state when the state of the remote support side is identified as the unready state; In the step of selecting a control mode, When the state of the remote support side is identified as the unready state and the available state, the second mode is selected as the control mode; When the state of the remote support side is determined to be the unready state and the unavailable state, the fourth mode is selected as the control mode. A method for controlling a moving object comprising:

5. A method for controlling a moving object having an autonomous driving function and a remote assistance function, comprising: selecting a control mode for automatic driving of the moving object; transmitting information of the selected control mode to the moving body; Including, the control modes include a first mode, a second mode in which restrictions on driving safety are stricter than those in the first mode, and a third mode in which the restrictions are stricter than those in the first mode and less restrictive than those in the second mode; The step of selecting a control mode comprises: determining whether remote assistance is required for the moving object; Identifying a state of a remote support side corresponding to remote support for the mobile object; selecting a control mode corresponding to a combination of a determination result of whether or not the remote support is necessary and a result of identifying a state of the remote support side from among options including the first, second, and third modes; A method for controlling a moving object, comprising:

6. 6. The method of claim 5, The state of the remote support side includes a ready state in which the remote support side is ready to respond to the remote support, and an unready state in which the remote support side is not ready to respond to the remote support, In the step of selecting a control mode, When it is determined that the remote support is not necessary and the state of the remote support side is specified as the ready state, the first mode is selected as the control mode corresponding to the combination; When it is determined that the remote support is not necessary and the state of the remote support side is specified as the unready state, the third mode is selected as the control mode corresponding to the combination. A method for controlling a moving object comprising:

7. 7. The method according to claim 5 or 6, The state of the remote support side includes a ready state in which the remote support side is ready to respond to the remote support, and an unready state in which the remote support side is not ready to respond to the remote support, In the step of selecting a control mode, When it is determined that the remote support is necessary and the state of the remote support side is specified as the ready state, the third mode is selected as the control mode corresponding to the combination; When it is determined that the remote support is necessary and the state of the remote support side is specified as the unready state, the second mode is selected as the control mode corresponding to the combination. A method for controlling a moving object comprising:

8. 6. The method of claim 5, The state of the remote support side includes a ready state in which the remote support side is ready to respond to the remote support, and an unready state in which the remote support side is not ready to respond to the remote support, the unready state includes an available state in which the state is ready to switch to the ready state, and an unavailable state in which the state is not ready to switch, the step of identifying the state of the remote support side includes a step of identifying whether the state of the remote support side is the available state or the unavailable state when the state of the remote support side is identified as the unready state; In the step of selecting a control mode, When it is determined that the remote support is not necessary and the state of the remote support side is specified to be the unready state and the available state, the third mode is selected as the control mode corresponding to the combination; When it is determined that the remote support is not necessary and the state of the remote support side is specified to be the unready state and the unavailable state, the second mode is selected as the control mode corresponding to the combination. A method for controlling a moving object comprising:

9. 9. The method according to claim 5 or 8, The state of the remote support side includes a ready state in which the remote support side is ready to respond to the remote support, and an unready state in which the remote support side is not ready to respond to the remote support, the unready state includes an available state in which the state is ready to switch to the ready state, and an unavailable state in which the state is not ready to switch, the step of identifying the state of the remote support side includes a step of identifying whether the state of the remote support side is the available state or the unavailable state when the state of the remote support side is identified as the unready state; The control mode further includes a fourth mode in which the moving object is stopped on a road shoulder or a roadside strip, The fourth mode is included in the options, In the step of selecting a control mode, When it is determined that the remote support is necessary and the state of the remote support side is specified to be the unready state and the available state, the second mode is selected as the control mode corresponding to the combination; When it is determined that the remote support is necessary and the state of the remote support side is specified to be the unready state and the unavailable state, the fourth mode is selected as the control mode corresponding to the combination. A method for controlling a moving object comprising:

10. An apparatus for controlling a moving object having an automatic driving function and a remote assistance function, A process of selecting a control mode for automatic driving of the moving body; A process of transmitting information of the selected control mode to the moving body; a processor configured to: the control modes include a first mode, a second mode in which restrictions on driving safety are stricter than those in the first mode, and a third mode in which the restrictions are stricter than those in the first mode and less restrictive than those in the second mode; In the process of selecting the control mode, the processor A process of determining whether remote support for the moving object is required; A process of identifying a state of a remote support side corresponding to remote support for the mobile object; A process of selecting a control mode corresponding to a combination of a determination result of whether or not the remote support is necessary and a result of identifying a state of the remote support side from among options including the first, second, and third modes; A control device for a moving object, comprising:

11. A program for controlling a moving object having an automatic driving function and a remote assistance function, A process of selecting a control mode for automatic driving of the moving body; A process of transmitting information of the selected control mode to the moving body; Run the following on your computer: the control modes include a first mode, a second mode in which restrictions on driving safety are stricter than those in the first mode, and a third mode in which the restrictions are stricter than those in the first mode and less restrictive than those in the second mode; In the process of selecting the control mode, A process of determining whether remote support for the moving object is required; A process of identifying a state of a remote support side corresponding to remote support for the mobile object; A process of selecting a control mode corresponding to a combination of a determination result of whether or not the remote support is necessary and a result of identifying a state of the remote support side from among options including the first, second, and third modes; A control program for a moving object, comprising:

Citation Information

Patent Citations

  • Drive control device, drive control method, drive control program, and recording medium

    JP2017174282A

  • Vehicle control device and program

    JP2019191893A

  • Vehicle travel control device

    JP2021022319A

  • Vehicle remote instruction system

    JP2021033612A

  • Autonomous Vehicle Systems

    JP2022525586A