Information processing method, information processing device, and program
By predicting and judging the behavior of the mobile body and outputting appropriate control instructions, the remote operation problem when multiple mobile bodies conflict in the risk area is solved, and safe stop and efficient utilization in the risk area are achieved.
Patent Information
- Application Number
- CN202380033324.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-15
- Filing Date
- 2023-03-27
- Publication Date
- 2024-11-26
AI Technical Summary
Existing autonomous vehicles or robots cannot be sure to perform remote operation or remote monitoring in the risk zone, especially when there is a conflict between more than two mobile bodies, and cannot be stopped safely, resulting in increased operational risks.
By obtaining the movement information of multiple moving objects and the location information of the risk area, we predict the moving objects entering the risk area, judge whether other moving objects will catch up, and output instructions of follow-up control or individual control based on the judgment to ensure that in the risk area The moving body inside can be stopped safely.
Real remote operation and monitoring in the risk area is achieved, the utilization rate of mobile bodies is improved, the stop time is reduced, the operation risk is reduced, and the safety of mobile bodies is ensured.
Smart Images

Figure CN119032386A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an information processing method, an information processing device, and a program. Background Art
[0002] In recent years, in order to improve convenience, it has been considered to allow mobile bodies such as vehicles and robots to autonomously travel on roads to provide services such as delivering food or picking up people.
[0003] However, at the current stage, for example, if there are obstacles such as fallen objects on the road, the vehicle or robot cannot drive autonomously, and therefore needs to be stopped by remote control.
[0004] In this regard, for example, Patent Document 1 discloses a method of generating operator instruction data for an operator to remotely operate an autonomous vehicle.
[0005] (Prior art literature)
[0006] (Patent Document)
[0007] Patent Document 1: Japanese Patent Application No. 2019-505059 Summary of the invention
[0008] Problems to be solved by the invention
[0009] However, in the method of Patent Document 1, when two or more moving bodies are located in a risk zone, which is an area requiring at least one of remote operation and remote monitoring, at the same time, one of the two or more moving bodies cannot be remotely operated or remotely monitored. Therefore, there is a problem that the moving body that cannot accept remote operation or remote monitoring cannot reliably accept remote operation after it stops safely in the risk zone.
[0010] In view of the above-mentioned problems, an object of the present disclosure is to provide an information processing method and the like that can reliably perform remote operations in a risk area.
[0011] Means for solving problems
[0012] In an information processing method involved in one embodiment of the present disclosure, movement information related to the movement of two or more moving bodies is obtained, the two or more moving bodies are moving bodies that can move autonomously and at least one of which can accept remote operation and remote monitoring, and a first moving body is predicted based on the movement information and position information of a first area, the first moving body is a moving body among the two or more moving bodies whose movement path will pass through the first area and will enter the first area, and the first area is an area that requires at least one of the remote operation and the remote monitoring, and a second moving body different from the first moving body is determined based on the movement information and the position information, and the second moving body is also a moving body whose movement path will pass through the first area, and it is determined whether the second moving body will catch up with the first moving body until the first moving body enters the first area, and when it is determined that the second moving body will catch up with the first moving body until the first moving body enters the first area, instruction information for causing the second moving body to perform follow-up control is output to the second moving body so that the second moving body follows the movement of the first moving body.
[0013] In addition, these general or specific aspects may be implemented by a system, method, integrated circuit, computer program, or a computer-readable CD-ROM or other recording medium, or by any combination of a system, method, integrated circuit, computer program, and recording medium. Furthermore, the recording medium may be a non-transitory recording medium.
[0014] Effects of the Invention
[0015] The information processing method and the like disclosed herein make it possible to reliably perform remote operations in risk areas.
[0016] In addition, better effects and advantages of one embodiment of the present disclosure can be clearly seen from the specification and the drawings. Although the relevant advantages and / or effects are provided by the features described in several embodiments, the specification and the drawings, it is not necessary to provide all of them in order to obtain one or more of the same features. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 This is a schematic diagram showing the remote control system according to the first embodiment.
[0018] Figure 2 This is a block diagram showing an example of the configuration of the remote control server according to the first embodiment.
[0019] Figure 3 This is a diagram for explaining the waiting time and the catching-up time involved in the first embodiment.
[0020] Figure 4A This is a diagram for explaining the individual control according to the first embodiment.
[0021] Figure 4B This is a diagram for explaining the following control according to the first embodiment.
[0022] Figure 5 This is a flowchart showing the operation of the information processing device according to the first embodiment.
[0023] Figure 6 This is a flowchart showing an operation example of the information processing device according to the first embodiment.
[0024] Figure 7 This is a diagram showing an example of remote operation risk information according to the second embodiment.
[0025] Figure 8 This is a flowchart showing an example of the operation of the information processing device involved in the second embodiment.
[0026] Fig. 9 This is a diagram showing an example of past history related to Modification 1 of Implementation Example 2.
[0027] Fig.10 This is a flowchart showing an example of basic determination processing of the information processing device according to the third embodiment.
[0028] Fig.11 This is a flowchart showing another example of the basic determination process of the information processing device according to the third embodiment. DETAILED DESCRIPTION
[0029] In order to solve the above-mentioned problem, in an information processing method of Example 1 involved in one embodiment of the present disclosure, movement information related to the movement of two or more moving bodies is obtained, the two or more moving bodies are moving bodies that can move autonomously and can accept at least one of remote operation and remote monitoring, and a first moving body is predicted based on the movement information and position information of a first area, the first moving body is a moving body whose movement path will pass through the first area and will enter the first area among the two or more moving bodies, and the first area is an area that requires at least one of the remote operation and the remote monitoring, and a second moving body that is different from the first moving body and the second moving body is also a moving body whose movement path will pass through the first area is determined based on the movement information and the position information, and it is determined whether the second moving body will catch up with the first moving body until the first moving body enters the first area, and when it is determined that the second moving body will catch up with the first moving body until the first moving body enters the first area, instruction information for causing the second moving body to perform follow-up control is output to the second moving body so that the second moving body follows the movement of the first moving body.
[0030] Accordingly, since the mobile body to be remotely operated or remotely monitored can be limited to the first mobile body in the first area as the risk area, the mobile body can be remotely operated reliably in the risk area. Moreover, the operator can make the second mobile body under follow-up control move together with the first mobile body by remotely operating only the first mobile body. In this way, since it is not necessary to make the second mobile body that moves autonomously enter the first area and it is not necessary to wait until the first mobile body passes through the first area, the utilization rate of the second mobile body can be improved. In other words, since multiple mobile bodies can enter the first area, the stop time of the mobile body can be reduced, etc., and the utilization rate can be improved.
[0031] It may also be that the information processing method of Example 2 is an information processing method based on the information processing method of Example 1, and further, when it is determined that the second moving body cannot catch up with the first moving body until the first moving body enters the first area, instruction information is output to the second moving body to enable the second moving body to continue to execute separate control, and the separate control is a control that causes the second moving body to move independently of the first moving body.
[0032] According to this, the independent control mode and the following control mode can be adaptively switched according to whether the second moving body will catch up with the first moving body. In addition, when the second moving body cannot catch up with the first moving body, the first moving body and the second moving body can move independently and efficiently.
[0033] It may also be that the information processing method of Example 3 is an information processing method based on the information processing method of Example 1 or Example 2, and in judging whether the second mobile body will catch up with the first mobile body, whether the second mobile body will catch up with the first mobile body is judged based on (i) or (ii), (i) is the time from the arrival of the first mobile body at the first area until entering the first area, i.e., the waiting time, and the time from the first moment when the first mobile body arrives at the first area until the second moment when the second mobile body arrives at the position of the first mobile body, i.e., the catching-up time, and (ii) is the distance between the first mobile body and the second mobile body on the path, and a reference value for the distance.
[0034] According to this, whether or not the second moving object can be caused to perform the following control can be easily determined based on (i) the relationship between the waiting time and the catching-up time, or (ii) the relationship between the distance and the threshold.
[0035] Furthermore, the information processing method of Example 4 may be an information processing method based on the information processing method of Example 3, and the second moment is a moment when the second moving body autonomously moves by accelerating to reach the position of the first moving body.
[0036] According to this, since more second moving bodies can be controlled to follow, the number of second moving bodies that do not enter the first area and wait until the first moving body passes through the first area can be reduced, and the utilization rate of the second moving bodies can be improved. In other words, since the possibility of multiple moving bodies entering the first area can be further increased, the stop time of the moving bodies can be reduced, and the utilization rate can be further improved.
[0037] It may also be that the information processing method of Example 5 is an information processing method based on any one of the information processing methods of Examples 1 to 4, and further, when it is determined that the second mobile body will catch up with the first mobile body until the first mobile body enters the first area, the risk of causing the second mobile body to perform the following control within the first area is calculated based on the condition of the first area, and it is determined whether the calculated risk exceeds a prescribed baseline value. When it is determined that the calculated risk exceeds the prescribed baseline value, the instruction information for causing the second mobile body to perform the following control is not output to the second mobile body.
[0038] According to this, when the first moving body and the second moving body move together in the first area, the second moving body can be prevented from performing follow-up control in the case of high risk such as stop risk. Therefore, only the moving body of the remote operation target in the first area can be the first moving body that can be remotely operated safely and reliably.
[0039] Furthermore, the information processing method of Example 6 may be an information processing method based on the information processing method of Example 5, wherein the risk is the difficulty of remotely operating the first moving body while causing the second moving body to perform the following control within the first area.
[0040] Thus, when it is difficult for the first mobile body and the second mobile body to move together in the first area, the second mobile body can be prevented from performing follow-up control. Therefore, only the mobile body to be remotely operated in the first area can be regarded as the first mobile body that can be remotely operated reliably.
[0041] It may also be that the information processing method of Example 7 is an information processing method based on any one of the information processing methods of Examples 1 to 6, and further, when it is determined that the second moving body will catch up with the first moving body until the first moving body enters the first area, it is determined whether the number of times included in the previous history exceeds a threshold, the previous history is the history of moving bodies that have passed through the first area in the past, and the number of times is the number of times the moving body in autonomous movement stops in the first area, and when it is determined that the number of times exceeds the threshold, the instruction information for causing the second moving body to perform the following control is not output to the second moving body.
[0042] According to this, when the number of times the moving body stops during the movement in the first area in the past is a certain number, it can be inferred that it is difficult for the first moving body and the second moving body to move together in the first area, so the second moving body can be prevented from performing the following control. Therefore, only the moving body of the remote operation target in the first area can be regarded as the first moving body that can be remotely operated reliably.
[0043] It may also be that the information processing method of Example 8 is an information processing method based on any one of the information processing methods of Examples 1 to 7, and further, when it is determined that the second moving body will catch up with the first moving body until the first moving body enters the first area, it is determined whether the length of the planned passing path exceeds a specified value, and the planned passing path is a path that the first moving body plans to pass through the first area. When it is determined that the length of the planned passing path exceeds the specified value, the instruction information for causing the second moving body to perform the following control is not output to the second moving body.
[0044] According to this, when the length of the path of the moving body when passing through the first area is greater than a certain value, it is inferred that the operator has a high degree of difficulty in performing remote operation to move the first moving body and the second moving body together in the first area, so the second moving body can be prevented from performing follow-up control. Therefore, only the moving body that is the target of remote operation in the first area can be regarded as the first moving body that can be remotely operated reliably.
[0045] It may also be that the information processing method of Example 9 is an information processing method based on any one of the information processing methods of Examples 1 to 8, and further, when it is determined that the second moving body will catch up with the first moving body until the first moving body enters the first area, a planned passing path is confirmed, the planned passing path is the path that the first moving body plans to pass through the first area, and it is determined whether the planned passing path is composed of straight roads above a threshold value. When it is determined that the planned passing path is not composed of straight roads above the threshold value, the instruction information for causing the second moving body to perform the following control is not output to the second moving body.
[0046] According to this, when the moving body has many left and right turns in the path when passing through the first area, it is inferred that the operator has a high degree of difficulty in performing remote operation to move the first moving body and the second moving body together in the first area, so the second moving body can not perform follow-up control. Therefore, only the moving body of the remote operation target in the first area can be regarded as the first moving body that can be remotely operated reliably.
[0047] Furthermore, the information processing method of Example 10 may be an information processing method based on any one of the information processing methods of Examples 1 to 9, and further, in a case where it is determined that the second moving body will catch up with the first moving body until the first moving body enters the first area, it is determined whether the first moving body can wait in an open space around the moving path where the first moving body enters the first area until the second moving body catches up with the first moving body, and in a case where it is determined that the first moving body cannot wait, the instruction information for causing the second moving body to perform the following control is not output to the second moving body.
[0048] For example, when there is a lot of traffic or the road is narrow, so that there is no space for the first moving body to wait for the second moving body, it is estimated that the first moving body cannot safely wait until the second moving body catches up with the first moving body. Thus, even if the second moving body will catch up with the first moving body before the first moving body enters the first area, the second moving body can be prevented from performing follow-up control in consideration of the safety of the first moving body. Therefore, only the moving body of the remote operation target in the first area can be regarded as the first moving body that can be remotely operated reliably.
[0049] It may also be that the information processing method of Example 11 is an information processing method based on any one of the information processing methods of Examples 1 to 10, and further, when it is determined that the second moving body will catch up with the first moving body until the first moving body enters the first area, it is determined whether the skill level of the operator exceeds a prescribed level, and the operator is an operator who performs at least one of the remote operation and the remote monitoring of the first moving body in the first area. When it is determined that the skill level does not exceed the prescribed level, the instruction information for causing the second moving body to perform the following control is not output to the second moving body.
[0050] For example, if the operator is a novice and has a low skill level, when performing remote control on a first moving body followed by a second moving body, it is expected that the first moving body and the second moving body cannot be moved safely together. Thus, even if the second moving body catches up with the first moving body before it enters the first area, the second moving body can be prevented from performing follow-up control in consideration of the skill level of the operator. Therefore, only the moving body to be remotely operated in the first area can be regarded as the first moving body that can be remotely operated reliably.
[0051] It may also be that the information processing method of Example 12 is an information processing method based on any one of the information processing methods of Examples 1 to 11, and in determining the second mobile body, each of the plurality of second mobile bodies is determined as the second mobile body, and further, when it is determined that the plurality of second mobile bodies will catch up with the first mobile body until the first mobile body enters the first area, the number of one or more second mobile bodies among the plurality of second mobile bodies that perform the following control is determined, and in outputting indication information for executing the following control, the indication information for executing the following control is output for the one or more second mobile bodies specified by the determined number.
[0052] For example, when the number of second moving bodies following the first moving body is large, it is expected that the first moving body and the second moving bodies cannot be safely moved together depending on the operator's proficiency and the condition of the moving path. Thus, even if a plurality of second moving bodies catch up with the first moving body before it enters the first area, by determining the number of second moving bodies to follow the first moving body, the first moving body can be safely moved together with the determined number of second moving bodies.
[0053] Furthermore, the information processing method of Example 13 may be an information processing method based on any one of the information processing methods of Examples 1 to 12, wherein in determining the second mobile body, each of the plurality of second mobile bodies is determined as the second mobile body, and further, when it is determined that the plurality of second mobile bodies will catch up with the first mobile body until the first mobile body enters the first area, the second mobile body to perform the following control is selected from the plurality of second mobile bodies, and in outputting the indication information for executing the following control, the indication information for executing the following control is output for the selected second mobile body.
[0054] According to this, even if a plurality of second moving objects catch up with the first moving object before the first moving object enters the first area, by selecting a second moving object to follow the first moving object, the first moving object can be safely moved together with the selected second moving object.
[0055] It may also be that the information processing method of Example 14 is an information processing method based on any one of the information processing methods of Examples 1 to 13, and the movement information includes information showing the moving path of the moving body, information showing the position of the moving body, and information showing the moving speed of the moving body.
[0056] This makes it possible to easily predict not only the timing at which the first moving object enters the first area, but also to easily identify the second moving object that will pass through the first area and to easily determine whether the second moving object will catch up with the first moving object.
[0057] It may also be that the information processing method of Example 15 is an information processing method based on any one of the information processing methods of Examples 1 to 14, and as the first moving body, a prediction is made for each of more than one first moving bodies, and the number of the more than one first moving bodies is less than the number of operators performing at least one of the remote operation and the remote monitoring.
[0058] According to this, since the number of the first moving objects is equal to or smaller than the number of operators who perform at least one of remote operation and remote monitoring, the moving objects can be remotely operated reliably in the risk area.
[0059] Furthermore, an information processing device of Example 16 involved in one embodiment of the present disclosure comprises: an obtaining unit, which obtains movement information related to the movement of two or more moving bodies, wherein the two or more moving bodies are moving bodies that can move autonomously and can accept at least one of remote operation and remote monitoring; a prediction unit, which predicts a first moving body based on the movement information and position information of a first area, wherein the first moving body is a moving body among the two or more moving bodies whose movement path will pass through the first area and will enter the first area, and the first area is an area that requires at least one of the remote operation and the remote monitoring; a determination unit, which determines a second moving body that is different from the first moving body and whose movement path will pass through the first area based on the movement information and the position information; a judgment unit, which judges whether the second moving body will catch up with the first moving body until the first moving body enters the first area; and an output unit, which, when it is judged that the second moving body will catch up with the first moving body until the first moving body enters the first area, outputs instruction information for causing the second moving body to perform follow-up control for the second moving body so that the second moving body follows the movement of the first moving body.
[0060] According to this, the same effects as those of the above-mentioned information processing method can be achieved.
[0061] Furthermore, the program of Example 17 involved in one method of the present disclosure is used to cause a computer to perform the following processing: obtaining movement information related to the movement of two or more moving bodies, the two or more moving bodies are moving bodies that can move autonomously and at least one of which can accept remote operation and remote monitoring, predicting a first moving body based on the movement information and position information of a first area, the first moving body being a moving body whose movement path will pass through the first area and will enter the first area among the two or more moving bodies, the first area being an area that requires at least one of the remote operation and the remote monitoring, determining a second moving body different from the first moving body based on the movement information and the position information, and the second moving body is also a moving body whose movement path will pass through the first area, judging whether the second moving body will catch up with the first moving body until the first moving body enters the first area, and if it is judged that the second moving body will catch up with the first moving body until the first moving body enters the first area, outputting instruction information for causing the second moving body to perform follow-up control for the second moving body so that the second moving body follows the movement of the first moving body.
[0062] According to this, the same effects as those of the above-mentioned information processing method can be achieved.
[0063] Hereinafter, the embodiments will be described in detail with reference to the drawings.
[0064] In addition, the embodiments described below are all general or specific examples. The values, shapes, materials, components, configuration positions and connection methods of components, steps and the order of steps shown in the following embodiments are all examples, and their purpose is not to limit the present disclosure. Moreover, the components of the following embodiments that are not recorded in the independent technical solutions will be described as arbitrary components.
[0065] In addition, each figure is a schematic diagram and is not a strict illustration. In addition, in each figure, the same components are given the same reference numerals.
[0066] (Implementation Method 1)
[0067] Hereinafter, the information processing method and remote control system, etc. according to the first embodiment will be described.
[0068] [1 Configuration of Remote Control System 100]
[0069] Figure 1 This is a schematic diagram showing the remote control system 100 according to the first embodiment.
[0070] The remote control system 100 is a system for monitoring mobile objects in order to remotely operate two or more mobile objects, and for instructing the remote operation of the two or more mobile objects. The remote control system 100 manages multiple mobile objects in an area (risk area) with a high risk of safety stopping, and only allows a number of mobile objects less than the number of operators capable of remote operation to enter, thereby suppressing the simultaneous entry of multiple mobile objects. In this way, the risk of the number of mobile objects requiring remote operation becoming greater than the number of operators is reduced.
[0071] Figure 1 The remote control system 100 shown includes a remote control server 1 , two or more mobile bodies 21 and 22 , and a plurality of remote operation devices 31 .
[0072] The remote control server 1, two or more mobile bodies 21 and 22, and a plurality of remote control devices 31 are connected to each other via a network 5 so as to be able to communicate with each other. The network 5 is a predetermined wired or wireless communication line such as a network or a dedicated line. Figure 1 As shown in the figure, the remote control system 100 is described as including two moving bodies (moving bodies 21 and 22 ) and two remote control devices 31 , but the present invention is not limited thereto. The remote control system 100 may include more than two moving bodies and more than two remote control devices 31 .
[0073] [1.1 Moving body]
[0074] Each of the two or more moving bodies can move autonomously and can accept at least one of remote operation and remote monitoring. More specifically, each of the two or more moving bodies can switch between an autonomous mode and a remote operation mode of being remotely operated. In the autonomous mode, it is possible to further select a separate control mode for independent movement, a remote monitoring mode for remote monitoring, or a follow-up control mode for the movement of a moving body following an object. In this way, each of the two or more moving bodies can switch the control mode. In addition, details about the separate control mode and the follow-up control mode will be described later. Furthermore, when each of the two or more moving bodies is moving in the autonomous mode, if an unexpected phenomenon occurs or an unsafe situation is identified, safety is ensured by safely stopping. An unsafe situation refers to, for example, a situation where a pedestrian, bicycle or car is approaching, or a situation where there is a roadside parking on the moving path. Furthermore, each of the two or more moving bodies can be, for example, a vehicle or robot that can move autonomously to a destination, or a drone.
[0075] Furthermore, each of the two or more moving bodies may be equipped with a camera, and data obtained by the camera may be sent to the remote control server 1. Furthermore, each of the two or more moving bodies may be equipped with a positioning system such as a GPS (Global Positioning System), and information indicating the current position of the moving body may be sent to the remote control server 1.
[0076] In this embodiment, the moving body 21 is described as a first moving body whose moving path will pass through the first area as a risk area and will enter the first area among two or more moving bodies. Furthermore, the moving body 22 is described as a second moving body different from the first moving body among the two or more moving bodies, and the moving body 22 is also a moving body whose moving path will pass through the first area. Furthermore, in this embodiment, the case where the moving body 21 as the first moving body arrives at the first area before the moving body 22 as the second moving body is described.
[0077] Here, the risk area is explained.
[0078] The risk area is an area where at least one of remote control and remote monitoring of the moving body passing through is required, and it is also referred to as the first area. Risk areas include, for example, areas around intersections, areas with heavy traffic, areas where the moving body has stopped safely many times in the past, narrow roads, etc., and are areas where the risk of the moving body stopping safely and performing a remote control request during autonomous movement is high.
[0079] In this embodiment, the number of mobile bodies that can pass through the risk zone is less than the number of operators who perform remote operation and remote monitoring via the remote operation device 31. This is because it is necessary to ensure that the mobile bodies can continue to operate safely. Therefore, in the risk zone, all mobile bodies except the mobile bodies that are remotely operated need to stop moving, or need to stop and wait before entering the risk zone.
[0080] Alternatively, remote operation of the mobile object may not be necessary in the risk zone. For example, in response to a request for remote operation of the mobile object, if an operator can immediately intervene in the remote operation of the mobile object, the mobile object may move autonomously in the risk zone. Specifically, for example, a number of mobile objects less than the number of operators may simultaneously move autonomously in the risk zone.
[0081] Alternatively, for example, a mobile body that is not remotely controlled may be allowed to move autonomously in a risk zone by limiting its moving speed. Alternatively, for example, a mobile body in a follow-up control mode may move autonomously in a risk zone by following other mobile bodies that are remotely controlled. Under such control, multiple mobile bodies exceeding the number of operators may pass through the risk zone at the same time.
[0082] [1.2 Remote control device]
[0083] The remote operation device 31 obtains and displays the movement information and vehicle information of two or more moving objects. The remote operation device 31 can remotely monitor or remotely operate a moving object through the operation of an operator (P1 or P2, etc.). More specifically, the remote operation device 31 sends the control command for remote operation input by the operator performing the remote operation to the moving object of the remote operation. The remote operation device 31 can also send the control command for remote operation to the moving object via the output unit 15.
[0084] For example, the remote operation device 31 includes an operation unit for remotely operating the moving object, and a display unit for displaying an image of the surroundings of the moving object based on data from a camera of the moving object. The operator can remotely operate the moving object by operating the operation unit while viewing the display unit.
[0085] In addition, the remote control device 31 and the remote control server 1 may be installed in the same facility, or the remote control device 31 and the remote control server 1 may be integrated so that all functions of the remote control device 31 are included in the remote control server 1 .
[0086] [1.3 Remote Control Server]
[0087] Next, use Figure 2 The configuration of the remote control server 1 will be described.
[0088] Figure 2 This is a block diagram showing an example of the configuration of the remote control server 1 according to the first embodiment.
[0089] The remote control server 1 includes an information processing device 10 , a storage unit 16 , a remote operation management unit 17 , a remote operation assignment unit 18 , and a remote operation unit 19 .
[0090] For example, the remote control server 1 is a computer including a processor and a memory. The memory is a ROM (Read Only Memory) and a RAM (Random Access Memory), etc., and can store programs executed by the processor. The information processing device 10, the remote operation management unit 17, the remote operation allocation unit 18, and the remote operation unit 19 are implemented by a processor that executes the programs stored in the memory. The memory that stores the program may be the storage unit 16 or a memory other than the storage unit 16. Furthermore, for example, the components constituting the remote control server 1 may be distributed in a plurality of servers.
[0091] The information processing device 10 will be described in detail later.
[0092] [1.3.1 Storage unit]
[0093] The storage unit 16 is constituted by, for example, a HDD or a semiconductor memory, etc. In the present embodiment, the storage unit 16 stores, for example, vehicle information, movement information, and risk area information.
[0094] The vehicle information is, for example, an identification number of a mobile body. The identification number of a mobile body may be, for example, an IP address of each mobile body.
[0095] Movement information is information related to the movement of each of two or more moving bodies. Movement information includes, for example, information showing the movement path of the moving body, information showing the position of the moving body, etc., and may also include information showing the moving speed of the moving body. Information showing the movement path is map information showing the path (route) that the moving body will move from now on, showing a map with the path of the moving body, etc. In addition, information showing the position of the moving body is information showing the current position of the moving body, such as coordinate information showing the position of the moving body. Information showing the moving speed of the moving body is, for example, speed information showing a speed value, etc., and shows the speed at which the moving body can move or the speed at which the moving body actually moves. For example, the speed at which the moving body can move is the legal speed of the moving body on the road on which it is moving, etc.
[0096] Risk zone information is, for example, information showing risk zones where the risk of a moving body stopping safely while moving is high, such as areas around intersections, areas with heavy traffic, areas where the moving body has stopped safely many times in the past, and narrow roads, and includes information showing the location of the risk zone. In addition, in such risk zones as described above, the moving body to be passed through requires at least one of remote operation and remote monitoring. The risk zone information may also include at least one of the time when the risk zone occurs and the conditions for becoming a risk zone. The location of the risk zone may be, for example, the location of the risk zone in the map information, or it may be latitude and longitude information, or it may be coordinate information, etc. The conditions for becoming a risk zone include, for example, at least one party requiring remote operation and remote monitoring due to laws and other rules, the traffic volume of vehicles and people being above a specified amount, the passage of specified vehicles, a specified date and time, and a specified event to be held nearby.
[0097] [1.3.2 Remote Operation Management Department]
[0098] The remote operation management unit 17 manages the number of operators who can perform remote operation and the like.
[0099] [1.3.3 Remote Operation Distribution Department]
[0100] The remote operation assignment unit 18 assigns an operator to perform remote operation to a mobile object that has issued a remote operation request. In the present embodiment, the remote operation assignment unit 18 assigns an operator to a mobile object 21 that is about to enter a risk zone.
[0101] [1.3.4 Remote Operation Department]
[0102] The remote operation unit 19 connects the mobile body with the operator (e.g., P1) who remotely operates the mobile body to remotely operate the mobile body. In this embodiment, the remote operation unit 19 prompts the operator with information about the mobile body, or performs an operation requesting confirmation of the mobile body. For example, the remote operation unit 19 receives an operation performed by the operator on the mobile body 21 that is the remote operation object, and operates the mobile body 21 according to the operation so that the mobile body 21 enters the risk zone.
[0103] [1.3.5 Information processing device]
[0104] The information processing device 10 is a device that outputs information for controlling each of the plurality of moving bodies. In the present embodiment, the information processing device 10 controls the moving body 21 as the first moving body in the risk area. Furthermore, the information processing device 10 controls the moving body 22 as the second moving body to perform a following control of the moving body 22 to follow the moving body 21 in the risk area or to continue to perform a separate control to move independently of the moving body 21.
[0105] In this embodiment, for example Figure 2 As shown, the information processing device 10 includes an acquisition unit 11 , a prediction unit 12 , a determination unit 13 , a conversion determination unit 14 , and an output unit 15 .
[0106] [1.3.5.1 Acquisition section]
[0107] The obtaining unit 11 obtains movement information related to the movement of two or more moving objects and position information of a first area as a risk area. In this embodiment, the obtaining unit 11 obtains the movement information of each of the two or more moving objects by obtaining vehicle information and movement information from the storage unit 16. In addition, the obtaining unit 11 obtains the position information of the risk area by obtaining the risk area information from the storage unit 16.
[0108] Furthermore, the acquisition unit 11 can also acquire remote operation requests from two or more moving objects.
[0109] [1.3.5.2 Forecasting Department]
[0110] The prediction unit 12 predicts a moving object 21 that is a first moving object whose moving path will pass through the first area and will enter the first area among the two or more moving objects based on the movement information obtained by the acquisition unit 11 and the position information of the first area as a risk area.
[0111] In this embodiment, the prediction unit 12 predicts the positions of the two or more moving bodies at a certain time interval based on the risk zone information, vehicle information, and movement information. More specifically, the prediction unit 12 determines the positions and movement paths of the two or more moving bodies based on the vehicle information and movement information, and determines the position of the risk zone (first area) based on the risk zone information. The prediction unit 12 predicts the moving body 21 among the two or more moving bodies whose movement path will pass through the risk zone and is scheduled to arrive at the risk zone first and enter the risk zone.
[0112] [1.3.5.3 Determination section]
[0113] The determination unit 13 determines a moving body 22 which is a second moving body different from the first moving body among the two or more moving bodies and whose moving path will pass through the first area based on the movement information obtained by the acquisition unit 11 and the position information of the first area as a risk area. The moving body 22 is a second moving body different from the first moving body among the two or more moving bodies.
[0114] In this embodiment, the determination unit 13 determines the positions and movement paths of the two or more moving bodies according to the vehicle information and the movement information, and determines the position of the risk area according to the risk area information. Furthermore, the determination unit 13 determines the moving body 22 among the two or more moving bodies whose movement path will pass through the risk area and is scheduled to arrive after the moving body 21 and enter the risk area.
[0115] [1.3.5.4 Conversion judgment unit]
[0116] The conversion judgment unit 14 judges whether the second moving body 22 will catch up with the moving body 21 until the moving body 21 as the first moving body enters the first area as the risk area. In the present embodiment, the conversion judgment unit 14 judges whether the moving body 22 will catch up with the moving body 21 based on the waiting time of the moving body 21 and the catching-up time of the moving body 22. Alternatively, the conversion judgment unit 14 may judge whether the moving body 22 will catch up with the moving body 21 based on whether the distance between the moving body 21 and the moving body 22 on the moving path is below a reference value such as 30 m.
[0117] Figure 3 This is a diagram for explaining the waiting time and the catching-up time involved in the first embodiment.
[0118] The waiting time w of the moving body 21 is the time from when the moving body 21 arrives at the risk area 50 (first area) to when it enters the risk area 50. Figure 3 In the example shown, the waiting time w [sec] of the moving body 21 is the time that the moving body 21 closest to the risk zone 50 waits before entering the risk zone 50, that is, at a position close to the risk zone 50 on the moving path (referred to as in front of the risk zone 50). The waiting time w [sec] of the moving body 21 can be, for example, the average value of the allocated waiting times of operators capable of remote operation.
[0119] Furthermore, the pursuit time t of the moving body 22 is the time from the first moment when the moving body 21 arrives at the risk zone 50 (first area) to the second moment when the moving body 22 arrives at the position of the moving body 21. Figure 3 In the example shown, the catching-up time t [sec] of the moving body 22 is the time from when the moving body 21 reaches a position close to the risk zone 50 (referred to as the front) until the moving body 22 moves on the moving path and reaches the position of the moving body 21 .
[0120] In addition, the catch-up time t[sec] corresponds to the time taken by the moving body 22 to move from the position of the moving body 22 to the position of the moving body 21 at the first moment. The catch-up time t[sec] is not limited to the time taken by the moving body 22 to move on the moving path from the position of the moving body 22 to the position of the moving body 21 while maintaining the current speed at the first moment. The catch-up time t[sec] may also be the time taken by the moving body 22 to move on the moving path from the position of the moving body 22 to the position of the moving body 21 at a speed faster than the current speed at the first moment.
[0121] More specifically, the catch-up time t[sec] may also be the moving time when the moving body 22 accelerates and autonomously moves from the position of the moving body 22 to the position of the moving body 21 at the first moment when the moving body 21 reaches the risk zone 50. For example, the moving body 22 may normally move at a speed of about 80% of the maximum speed, and move to the position of the moving body 21 at a speed as close to the maximum speed as possible during acceleration.
[0122] In this embodiment, the switching determination unit 14 compares the waiting time w of the moving body 21 with the catching-up time t of the moving body 22 , and if t≤w, determines that the control mode of the moving body 22 can be switched to the following control mode of autonomously following the moving body 21 .
[0123] Here, using Figure 4A as well as Figure 4B , the independent control and the following control of the moving body 22 are explained.
[0124] Figure 4A This is a diagram for explaining the individual control according to the first embodiment. Figure 4B This is a diagram for explaining the following control according to the first embodiment.
[0125] like Figure 4A As shown, the independent control of the moving body 22 is a control method in which the moving body 22 moves autonomously independently of the moving body 21 in the autonomous mode. The moving body 22 maintains the independent control mode or switches to the independent control mode by obtaining instruction information for selecting the independent control mode.
[0126] In addition, the independent control of the mobile body 22 is not limited to the autonomous movement of the mobile body 22. In the independent control of the mobile body 22, the mobile body 22 may be controlled to move independently of the mobile body 21 by remotely operating the mobile body 22 independently of the remote operation of the mobile body 21.
[0127] like Figure 4BAs shown, the following control of the mobile body 22 is a control method of following the mobile body 21 in the autonomous mode capable of autonomous movement. The mobile body 22 switches from the independent control mode to the following control mode by obtaining information of the mobile body 21 to be followed and instruction information for selecting the following control mode.
[0128] In addition, the following control of the mobile body 22 is not limited to the autonomous movement of the mobile body 22. The mobile body 22 may be controlled to follow the movement of the mobile body 21 by performing a remote operation corresponding to the remote operation on the mobile body 21 on the mobile body 22. For example, when the remote operation unit 19 performs a remote operation on the mobile body 21, it may be possible to perform a remote operation on the mobile body 21 in a spatially or temporally staggered manner and perform a remote operation on the mobile body 22 in the same manner.
[0129] Thus, the moving body 22 moves similarly to the moving body 21 although being spaced or timed apart from the moving body 21. Therefore, the moving body 22 moves following the moving body 21 by the above control, just like the case where the moving body 22 moves autonomously following the moving body 21.
[0130] In this way, the transition determination unit 14 compares the waiting time of the mobile body 21 waiting in front of the risk zone with the catching-up time of the following mobile body 22, or compares the distance between the mobile body 21 and the mobile body 22 with the reference value. Based on this, the transition determination unit 14 can determine whether the mobile body 22 will catch up with the mobile body 21 before the mobile body 21 enters the risk zone.
[0131] [1.3.5.5 Output section]
[0132] When the transition determination unit 14 determines that the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone (first area), the output unit 15 outputs instruction information for causing the mobile body 22 to perform a follow-up control to follow the mobile body 21. On the other hand, when the transition determination unit 14 determines that the mobile body 22 will not catch up with the mobile body 21 until the mobile body 21 enters the risk zone (first area), the output unit 15 outputs instruction information for causing the mobile body 22 to continue to perform a separate control to move independently of the mobile body 21.
[0133] In the present embodiment, when the transition determination unit 14 determines that the catching-up time of the mobile body 22 is less than the waiting time of the mobile body 21, the output unit 15 outputs instruction information for causing the mobile body 22 to transition to the following control mode for following the mobile body 21. On the other hand, when the transition determination unit 14 determines that the catching-up time of the mobile body 22 is longer than the waiting time of the mobile body 21, the output unit 15 outputs instruction information for causing the mobile body 22 to maintain the independent control mode.
[0134] In this way, the output unit 15 creates and outputs instruction information for the moving object 22 to maintain the individual control mode or to switch to the following control mode.
[0135] Alternatively, the output unit 15 may output instruction information indicating that there is a following (following) moving body 22 and that the moving body 21 itself is the moving body traveling ahead, when outputting instruction information for executing the following control to the moving body 22. In this case, the operation of switching to the following control mode in which the moving body 21 traveling ahead itself travels ahead can also be processed.
[0136] Furthermore, the output unit 15 determines the driving information for the moving body and outputs the determined driving information. Here, the output unit 15 determines the driving information based on the vehicle information, movement information and risk zone information stored in the storage unit 16 and the number of operators capable of remote operation managed by the remote operation management unit 17, so that only the moving bodies whose number is less than the number of operators enter the risk zone. Here, the driving information includes the speed of the moving body when it moves on the moving path. For example, the driving information of the moving bodies 21 and 22 includes not only the speed of the moving bodies 21 and 22 when they move on the moving path, but also information indicating that they have stopped at a position in front of the risk zone (the speed is 0).
[0137] Furthermore, the output unit 15 may output instruction information for accelerating the mobile body 22 so that the mobile body 22 catches up with the mobile body 21. The output unit 15 may output driving information indicating a speed for accelerating the mobile body 22 as instruction information. Furthermore, the output unit 15 may send a control instruction for performing a remote operation according to the remote operation device 31 to the mobile bodies 21 and 22. The output unit 15 may send a control instruction for remote operation in independent control as instruction information, and may send a control instruction for remote operation in follow-up control as instruction information.
[0138] [1.4 Operation of information processing device]
[0139] The information processing method executed by the information processing device 10 configured as described above, that is, the operation of the information processing device 10 will be described below.
[0140] Figure 5 This is a flowchart showing the operation of the information processing device 10 according to the first embodiment.
[0141] like Figure 5As shown, first, the information processing device 10 obtains movement information of two or more moving objects (S11). More specifically, the information processing device 10 obtains movement information about the movement of two or more moving objects that can move autonomously and can accept at least one of remote control and remote monitoring.
[0142] Next, the information processing device 10 predicts the first moving body based on the movement information obtained in step S11 and the position information of the risk zone of at least one party requiring remote operation and remote monitoring (S12). More specifically, the information processing device 10 predicts the moving body 21 whose movement path will pass through the risk zone and will enter the risk zone among the two or more moving bodies based on the movement information obtained in step S11 and the position information of the risk zone.
[0143] Next, the information processing device 10 determines a second moving body based on the movement information obtained in step S11 and the position information of the risk zone (S13). More specifically, the information processing device 10 determines a moving body 22 that is different from the moving body 21 and is also a moving body whose movement path will pass through the risk zone based on the movement information obtained in step S11 and the position information of the risk zone.
[0144] Next, the information processing device 10 determines whether the second moving body determined in step S13 will catch up with the first moving body until the first moving body predicted in step S12 enters the risk zone (S14). In the present embodiment, the information processing device 10 determines whether the moving body 22 will catch up with the moving body 21 based on the waiting time of the moving body 21 predicted in step S12 and the catching-up time of the moving body 22 determined in step S13. Here, the waiting time of the moving body 21 is the time from the time when the moving body 21 arrives at the risk zone until it enters the risk zone. The catching-up time of the moving body 22 is the time from the first moment when the moving body 21 arrives at the risk zone until the second moment when the moving body 22 arrives at the position of the moving body 21.
[0145] In step S14, when the second moving body determined in step S13 will catch up with the first moving body ("Yes" in S14), the information processing device 10 outputs instruction information for causing the second moving body to perform follow-up control for the second moving body (S15). In the present embodiment, when the information processing device 10 determines that the catch-up time of the moving body 22 is less than the waiting time of the moving body 21, it outputs instruction information for causing the moving body 22 to switch to the follow-up control mode of following the moving body 21.
[0146] On the other hand, in step S14, when the second moving body determined in step S13 cannot catch up with the first moving body ("No" in S14), the operation may be terminated. In addition, in the present embodiment, when the catching-up time of the moving body 22 is longer than the waiting time of the moving body 21, the information processing device 10 outputs instruction information for maintaining the moving body 22 in the independent control mode.
[0147] Next, use the specific information to Figure 5 An example (operation example) of the operation of the information processing device 10 according to the first embodiment described in the description will be described.
[0148] Figure 6 This is a flowchart showing an example of the operation of the information processing device 10 according to the first embodiment.
[0149] like Figure 6 As shown, first, the information processing device 10 confirms whether a certain period of time has passed (S101).
[0150] In step S101, if a certain time has passed ("Yes" in S101), the information processing device 10 obtains the movement information of each of the two or more moving objects (S102). For example, the obtaining unit 11 obtains the vehicle information and the movement information from the storage unit 16, thereby obtaining the movement information of each of the two or more moving objects. In addition, in step S101, if a certain time has not passed ("No" in S101), the processing of step S101 is repeated.
[0151] Next, the information processing device 10 obtains the risk zone information (S103). For example, the obtaining unit 11 obtains the risk zone information from the storage unit 16, and obtains the position information of the risk zone.
[0152] Next, the information processing device 10 determines the moving body that will pass through the same risk zone based on the position information of the risk zone obtained in step S103 (S104). For example, the prediction unit 12 determines the positions and moving paths of the two or more moving bodies based on the vehicle information and movement information obtained from the storage unit 16, and determines the position of the risk zone based on the risk zone information. In addition, the prediction unit 12 predicts the moving body 21 among the two or more moving bodies, whose moving path will pass through the risk zone and is scheduled to arrive at the risk zone first and enter the risk zone. The determination unit 13 determines the moving body 22 among the two or more moving bodies, whose moving path will pass through the risk zone and is scheduled to arrive after the moving body 21 and enter the risk zone. In this way, the information processing device 10 can determine the moving body 21 and the moving body 22 that will pass through the same risk zone. In addition, the moving body 21 and the moving body 22 are not limited to one, and can also be multiple.
[0153] Next, the information processing device 10 determines whether the distance between the moving body 21 and the moving body 22 on the path determined in step S104 is below the reference value (S105). For example, the conversion judgment unit 14 determines whether the distance between the moving body 21 and the moving body 22 on the path is below a reference value such as 30m. Based on this, the conversion judgment unit 14 can determine whether the moving body 22 will catch up with the moving body 21 until the moving body 21 enters the risk area. In addition, the method for determining whether the moving body 22 will catch up with the moving body 21 is not limited to the distance, and can also be a method for determining by comparing the waiting time of the moving body 21 and the catching-up time of the moving body 22.
[0154] In step S105, when the distance between the moving body 21 and the moving body 22 on the path determined in step S104 is less than the reference value ("Yes" in S105), the information processing device 10 determines to switch the control mode of the moving body 22 to the following control (S106). For example, the output unit 15 determines to switch the moving body 22 to the following control mode of following the moving body 21 when the distance between the moving body 21 and the moving body 22 on the path is less than the reference value.
[0155] In addition, in step S105, when the distance between the moving body 21 and the moving body 22 on the path determined in step S104 is greater than the reference value ("No" in S105), the information processing device 10 returns to step S104 and re-determines the moving body 21 and the moving body 22. In this case, the control method of the moving body 22 before re-determination remains in the independent control mode.
[0156] The above steps S101 to S106 are hereinafter referred to as basic judgment.
[0157] Next, the information processing device 10 instructs the moving body 22 according to the determination result of step S105 ( S107 ). More specifically, the output unit 15 generates instruction information for switching the control method of the moving body 22 to the following control mode of following the moving body 21 , and outputs the instruction information to the moving body 22 .
[0158] In addition, the waiting time from when the moving body 21 arrives at the risk area to when it enters the risk area may be a fixed time or a variable time. For example, the waiting time may be extendable.
[0159] Furthermore, it is also possible to control one moving body 21 and a plurality of moving bodies 22 so that the plurality of moving bodies 22 follow one moving body 21. The more moving bodies 22 are moved together in one remote operation, the higher the work efficiency. Therefore, if more moving bodies 22 can be made to wait, the information processing device 10 can also extend the waiting time. Furthermore, the information processing device 10 can also increase the number of moving bodies 22 that follow the moving body 21.
[0160] However, the stopping of the moving body 21 may hinder the travel of other moving bodies. For example, when other moving bodies such as manually driven vehicles follow the moving body 21, the stopping of the moving body 21 may hinder the travel of other moving bodies. Thus, when the stopping of the moving body 21 hinders the travel of other moving bodies, the information processing device 10 may extend the waiting time.
[0161] For example, the information processing device 10 predicts the time from when the mobile body 21 arrives at the risk zone to when it enters the risk zone as the waiting time. However, the allocation of operators capable of remote operation may take time or not. Therefore, the actual waiting time from when the mobile body 21 arrives at the risk zone to when it enters the risk zone may be longer or shorter than the predicted time.
[0162] For example, when the waiting time becomes shorter than the predicted time, the moving body 22 that is scheduled to arrive at the position of the moving body 21 during the waiting time becomes difficult to arrive at the position of the moving body 21. In this case, the following control may be canceled. In particular, when the stopping of the moving body 21 may hinder the travel of other moving bodies, the following control may be canceled. Specifically, when other moving bodies such as manually driven vehicles follow the moving body 21, the stopping of the moving body 21 may hinder the travel of other moving bodies, so the following control may be canceled.
[0163] Alternatively, even if an operator capable of remote operation is assigned earlier than the predicted time and the preparation for the moving body 21 to enter the risk zone is completed, the waiting time can be maintained at the predicted time. In particular, when the parking of the moving body 21 does not hinder the travel of other moving bodies, the waiting time can be maintained. Specifically, when other moving bodies such as manually driven vehicles are not following the moving body 21, the parking of the moving body 21 does not hinder the travel of other moving bodies, so the waiting time can be maintained.
[0164] Furthermore, when the waiting time becomes longer than the predicted time, the information processing device 10 may cause another moving object that reaches the position of the moving object 21 within the longer waiting time and can follow the moving object 21 to follow the moving object 21 .
[0165] The above-mentioned change of the waiting time may also be performed by the conversion determination unit 14 of the information processing device 10. Furthermore, the addition of the moving body to perform the following control may be performed by repeatedly performing the following control. Figure 5 or Figure 6 The following control may be performed by the processing shown in the figure, or by specifying an additional moving body in the specification of the moving body. Furthermore, the following control may be canceled by the conversion determination unit 14 of the information processing device 10 via the output unit 15 of the information processing device 10. Specifically, instruction information for canceling the following control may be output.
[0166] Furthermore, when the information processing device 10 determines that the mobile body 22 performs the follow-up control of the mobile body 21, it may also assign an operator to the mobile body 21 and notify the operator in advance that the follow-up control will be performed. In the remote operation in the follow-up control, for example, more screens are used or more careful operation is required compared to the remote operation in the individual control. By notifying the operator in advance that the follow-up control is performed, it is possible to prepare physically or mentally for such remote operation.
[0167] For example, when the information processing device 10 determines to make the moving body 22 perform the following control of the moving body 21, it determines the operator assigned to the moving body 21 from among the plurality of operators according to the skills of each operator. Here, the following control requires higher skills than the individual control.
[0168] Therefore, the information processing device 10 may perform control such that the operator assigned to the mobile body 21 is not assigned to other mobile bodies until the operator starts remote operation in the follow-up control. For example, the information processing device 10 may assign an operator different from the operator assigned to the mobile body 21 to other mobile bodies when a request for remote operation is made by other mobile bodies.
[0169] The notification of the follow-up control and the control of the allocation described above may also be performed by the remote operation allocation unit 18 .
[0170] [1.5 Effects, etc.]
[0171] The remote control system 100 according to the present embodiment manages a plurality of moving bodies in a manner that only moving bodies whose number is less than the number of operators capable of remote operation are allowed to enter a risk zone with a high risk of safety stopping, thereby suppressing the simultaneous entry of a plurality of moving bodies. In this way, the risk of a plurality of moving bodies requiring remote operation is reduced at the same time, and the operator is allowed to remotely operate or remotely monitor the moving bodies in the risk zone reliably.
[0172] However, when simultaneous entry into the risk zone is restricted, the moving object needs to wait in front of the risk zone, or slow down to arrive at the risk zone later, or change to a moving path that does not pass through the risk zone, which will reduce the utilization rate of the moving object. In addition, the moving object waiting in front of the risk zone may hinder the passage of people.
[0173] Thus, the remote control system 100 obtains the movement information related to the movement of the two or more moving bodies. Then, based on the movement information and the position information of the risk zone, it predicts the moving body 21 among the two or more moving bodies whose movement path will pass through the risk zone and will enter the risk zone. And, based on the movement information and the position information, it determines the moving body 22 which is different from the moving body 21 and is also the moving body whose movement path will pass through the risk zone.
[0174] Furthermore, the remote control system 100 determines whether the mobile body 22 will catch up with the mobile body 21 before the mobile body 21 enters the risk zone. If it is determined that the mobile body 22 will catch up with the mobile body 21 before the mobile body 21 enters the risk zone, instruction information for causing the mobile body 22 to perform following control of the mobile body 21 is output to the mobile body 22.
[0175] In this way, when the mobile body 22 catches up with the mobile body 21, the mobile body 22 performs the following control. Therefore, since the remote control system 100 can limit the mobile bodies of the remote operation object or the remote monitoring object in the risk zone (first area) to the mobile bodies 21 that the operator can remotely operate, the mobile body 21 can be remotely operated reliably in the risk zone.
[0176] Furthermore, the operator can make the mobile body 22 under follow-up control move together with the mobile body 21 by only remotely operating the mobile body 21. Therefore, the remote control system 100 can improve the utilization rate of the mobile body 22 because the mobile body 22 does not enter the risk zone and the mobile body 22 does not need to wait until the mobile body 21 passes through the risk zone. In other words, since multiple mobile bodies (mobile body 21, mobile body 22) can enter the risk zone, the stop time of the mobile body 22 can be reduced, and the utilization rate can be improved.
[0177] In addition, when the mobile body 22 cannot catch up with the mobile body 21, the mobile body 22 does not perform the following control, but performs the independent control. Even in this case, since the mobile body 22 will not reach the risk zone until the mobile body 21 enters the risk zone, the remote control system 100 can limit the mobile body of the remote operation object or the remote monitoring object in the risk zone to the mobile body 21 that the operator can remotely operate. As a result, the operator can remotely operate or remotely monitor the mobile body 21 in the risk zone reliably.
[0178] Here, the remote control system 100 may judge whether the mobile body 22 will catch up with the mobile body 21 by comparing the waiting time of the mobile body 21 waiting in front of the risk area and the time for the mobile body 22 to catch up with the mobile body 21 in front of the risk area. Accordingly, by comparing the waiting time and the catching-up time, it is possible to easily judge whether the mobile body 22 can perform the following control of following the mobile body 21.
[0179] Furthermore, the pursuit time may be calculated based on the time required to accelerate the moving body 22 to reach the position of the moving body 21 in front of the risk zone.
[0180] Accordingly, the remote control system 100 can make more mobile bodies 22 applicable to follow-up control. Therefore, the number of mobile bodies 22 that do not enter the risk zone and wait until the mobile body 21 passes through the risk zone can be further reduced. Therefore, the utilization rate of the mobile body 22 can be further improved. In other words, since it is possible to make it possible for multiple mobile bodies (mobile body 21, mobile body 22) to enter the risk zone in more cases, the stop time of the mobile body 22 can be reduced, and the utilization rate can be improved.
[0181] Furthermore, when the mobile body 22 cannot catch up with the mobile body 21, the number of mobile bodies moving in the risk zone, including the mobile bodies 21 and 22, is maintained below the number of operators as a condition, and the mobile bodies 21 and 22 each move autonomously while maintaining individual control and enter the risk zone. Alternatively, in this case, the mobile bodies 21 and 22 each enter the risk zone according to the remote operation of the operator.
[0182] (Implementation Method 2)
[0183] When the operator remotely controls the mobile body 21, when the mobile body 21 followed by the mobile body 22 is remotely controlled, it is necessary to check the surrounding conditions of the mobile body 21 in a wider range than when only the mobile body 21 is remotely controlled. Therefore, depending on the surrounding conditions, it may be difficult for the operator to remotely control the mobile body 21 followed by the mobile body 22. In this case, from the perspective of safety, the mobile body 22 may not be switched to the follow-up control mode but may be maintained in the independent control mode.
[0184] Therefore, in the above-mentioned embodiment, although the basic judgment of whether the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 waiting in front of the risk zone enters the risk zone is described, and whether to make the mobile body 22 perform the following control is determined, it is not limited to this. Even if the mobile body 22 will catch up with the mobile body 21 and can perform the following control, in the risk zone, when the mobile body 21 and the mobile body 22 move together, the mobile body 22 may not perform the following control when the risk is high, such as the risk of stopping. In the following, this case is described as the second embodiment. In addition, the following description focuses on the differences from the first embodiment.
[0185] The conversion judgment unit 14 involved in the second embodiment makes a basic judgment on whether the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, and then makes a judgment on whether the mobile body 22 can be converted to the following control, that is, a conversion re-judgment. More specifically, when the conversion judgment unit 14 judges (basic judgment) that the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone (first area), it further calculates the risk of making the mobile body 22 perform the following control in the risk zone according to the condition of the risk zone. Then, the conversion judgment unit 14 judges (conversion re-judgment) whether the calculated risk exceeds a prescribed reference value. Alternatively, the conversion judgment unit 14 may refer to the condition of the risk zone indicated by the risk zone information stored in the storage unit 16, and calculate the risk according to conditions such as the traffic volume in the risk zone, the condition of roadside parking, and whether it is night. The condition of roadside parking is, for example, the number of roadside parked vehicles in the risk zone, the size of the roadside parked vehicles (whether it is a large truck), etc. The status of the risk area can be obtained from information obtained from other preceding moving objects or from infrastructure cameras such as cameras included in roadside units other than moving objects.
[0186] Alternatively, the risk of making the mobile body 22 perform follow-up control in the risk zone may be the degree of difficulty in performing remote control on the mobile body 21 while making the mobile body 22 perform follow-up control in the risk zone. In this case, the risk zone information also includes remote operation risk information showing the regional conditions according to each risk zone, and the remote operation risk information is updated regularly. For example, the remote operation risk information may be updated whenever relevant information of each of two or more mobile bodies is obtained, or the relevant information may be updated based on information that can be obtained from an infrastructure camera such as a camera possessed by a roadside unit other than the mobile body.
[0187] Figure 7: is a diagram showing an example of remote operation risk information involved in Implementation Example 2. The risk zone ID is an identifier that uniquely identifies the risk zone. Traffic volume (vehicles), traffic volume (people), road surface conditions, and brightness are relevant information in the corresponding risk zone. Traffic volume (vehicles) and traffic volume (people) indicate the traffic volume of vehicles and people passing through the corresponding risk zone, indicating the number of vehicles and the number of people per minute. The road surface information indicates the number of vehicles parked on the road in the corresponding risk zone and their sizes. Regarding brightness, the brightness of the surroundings in the corresponding risk zone is expressed in lux.
[0188] exist Figure 7 In the example shown, the switching judgment unit 14 refers to the remote operation risk information and judges that it is difficult to remotely control the mobile body 21 accompanied by the mobile body 22 under follow-up control when the traffic volume (people) exceeds a predetermined reference value such as 1 person / minute. Figure 7 In the example shown, the switching judgment unit 14 refers to the remote operation risk information and judges that it is difficult to remotely control the mobile body 21 accompanied by the mobile body 22 under follow-up control when the traffic volume (vehicles) exceeds a predetermined reference value such as 1 vehicle / minute. Figure 7 In the example shown, the transition determination unit 14 refers to the remote operation risk information and determines that it is difficult to remotely operate the mobile body 21 accompanied by the mobile body 22 under follow-up control when the number of parked vehicles in the road condition exceeds a predetermined reference value such as two. The transition determination unit 14 refers to the remote operation risk information and determines that it is difficult to remotely operate the mobile body 21 accompanied by the mobile body 22 under follow-up control when the road condition is set to exceed the predetermined reference value as long as one large vehicle is parked on the road regardless of the number of parked vehicles. Furthermore, the transition determination unit 14 refers to the remote operation risk information and determines that it is difficult to remotely operate the mobile body 21 accompanied by the mobile body 22 under follow-up control when the brightness is less than 100 lux.
[0189] Furthermore, when the operator can complement the field of view of the mobile object 21 to be remotely operated by cooperating with the infrastructure camera, the operator can lower the above-mentioned predetermined reference value, so the switch determination unit 14 can lower the predetermined reference value to perform switch re-determination.
[0190] When determining that the risk exceeds a predetermined reference value, the output unit 15 does not output instruction information for causing the moving body 22 to perform follow-up control, but outputs instruction information for continuing to perform individual control for movement independently of the moving body 21 .
[0191] On the other hand, when the output unit 15 determines that the risk is equal to or less than a predetermined reference value, the output unit 15 outputs instruction information for causing the mobile object 22 to execute the follow-up control.
[0192] In this way, the output unit 15 creates and outputs instruction information for maintaining the individual control mode or switching to the following control mode with respect to the moving body 22 in accordance with the determination result of the switching re-determination by the switching determination unit 14 .
[0193] The following describes the conversion re-determination operation performed by the information processing device 10 according to the second embodiment configured as described above.
[0194] Figure 8 This is a flowchart showing an example of the operation of the information processing device 10 according to the second embodiment.
[0195] like Figure 8 As shown, first, the information processing device 10 performs a basic judgment (S100). Figure 6 The description has been given, so the description is omitted here.
[0196] In step S100, when the result of the basic judgment is to switch the control mode of the mobile body 22 to the follow-up control mode (switch to follow-up control in S100), the information processing device 10 calculates the difficulty level of the remote operation (S201). For example, the switch judgment unit 14 refers to the remote operation risk information included in the risk zone information stored in the storage unit 16, and calculates the difficulty level of remotely operating the mobile body 21 while making the mobile body 22 perform follow-up control in the risk zone. In addition, in step S100, when the result of the basic judgment is not to switch the control mode of the mobile body 22 to the follow-up control mode (not switch to follow-up control in S100), the process returns to step S100.
[0197] Next, the information processing device 10 performs a conversion re-determination (S202). For example, the conversion determination unit 14 performs a conversion re-determination by determining whether the difficulty calculated in step S201 exceeds a predetermined reference value.
[0198] In step S202, when the result of the conversion re-judgment is to convert the control mode of the mobile body 22 to the following control mode (converted to the following control in S202), the information processing device 10 instructs the mobile body 22 according to the judgment result of step S202 (S203). More specifically, when it is determined in step S202 that the difficulty level is below a predetermined reference value, the output unit 15 generates instruction information for converting the control mode of the mobile body 22 to the following control mode that follows the mobile body 21, and outputs it to the mobile body 22.
[0199] In step S202, if the result of the conversion re-judgment is that the control mode of the mobile body 22 is not converted to the follow-up control mode (not converted to the follow-up control in S202), the information processing device 10 does not output the instruction information for making the mobile body 22 perform the follow-up control, and returns to step S100. For example, if the control mode of the mobile body 22 is not converted to the follow-up control mode, the output unit 15 does not output the instruction information for making the mobile body 22 perform the follow-up control, but outputs the instruction information for making the mobile body 22 continue to perform the independent control of moving independently of the mobile body 21, and returns to step S100.
[0200] As described above, through the second embodiment, the remote control system 100 makes a basic judgment on whether to maintain the control mode in the independent control mode or switch to the follow-up control mode before the mobile body 21 enters the risk zone. Then, the risk of switching the control mode to the follow-up control mode is calculated according to the condition of the risk zone. In addition, a re-judgment is made on whether the control mode is actually switched to the follow-up control mode.
[0201] Accordingly, when the mobile body 21 moves together with the mobile body 22 in the risk zone, the remote control system 100 can prevent the mobile body 22 from performing the follow-up control in the case of high risk such as the stop risk. Therefore, only the mobile body of the remote operation target in the risk zone can be regarded as the mobile body 21 that can be remotely operated safely and reliably. Thus, since the control mode can be switched or not switched to the follow-up control mode according to the risk, it is possible to prevent the utilization rate of multiple mobile bodies from decreasing, and also to achieve safe remote control.
[0202] In the second embodiment, the remote control system 100 calculates the risk of switching to the follow-up control mode according to the condition of the risk zone, specifically, calculates the difficulty of remotely operating the mobile body 21 accompanied by the mobile body 22 under the follow-up control, and performs a switch re-determination. The switch re-determination is not limited to this example. A modification of the switch re-determination is described below as a modification example.
[0203] (Variant 1)
[0204] For example, the conversion re-determination may be performed based on past history.
[0205] After the conversion judgment unit 14 involved in the modification example 1 makes a judgment (basic judgment) that the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, it makes a judgment (conversion re-judgment) on whether the control mode of the mobile body 22 can actually be converted to the following control mode. That is, the conversion judgment unit 14 further makes a conversion re-judgment when judging (basic judgment) that the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone (first area). As a conversion re-judgment, the conversion judgment unit 14 judges whether the number of times included in the past history exceeds a threshold value, and the past history is the history of the mobile body that has passed through the risk zone in the past, and the number is the number of times the mobile body in autonomous movement stops in the risk zone. In this case, the risk zone information includes the history of the mobile body that has passed through the risk zone in the past, that is, the past history. The past history is a history related to safety and will be updated regularly.
[0206] Fig. 9 This is a diagram showing an example of the past history involved in the variant 1 of the second embodiment. The risk zone ID is an identifier that uniquely identifies the risk zone. The number of safe stops indicates the number of times the mobile body stops in the corresponding risk zone for safety during autonomous movement. The number of remote stops indicates the number of times the mobile body controlled by remote control stops in the corresponding risk zone for safety during movement.
[0207] exist Fig. 9 In the example shown, the transition determination unit 14 refers to the past history to determine whether the number of unsafe times, such as the number of times the mobile body 21 to be remotely operated stops safely in the risk zone that is about to enter, exceeds a predetermined threshold. The transition determination unit 14 refers to the past history and determines that it is difficult to remotely operate the mobile body 21 accompanied by the mobile body 22 under follow-up control if, for example, 1 exceeds the threshold.
[0208] When the output unit 15 determines that the number of stops of the autonomously moving moving body in the risk zone exceeds the threshold, the output unit 15 does not output instruction information for causing the moving body 22 to perform follow-up control, but outputs instruction information for causing it to continue to perform individual control to move independently of the moving body 21.
[0209] On the other hand, when the output unit 15 determines that the number of stops of the mobile body autonomously moving in the risk zone is equal to or less than the threshold value, the output unit 15 outputs instruction information for causing the mobile body 22 to perform follow-up control.
[0210] In this way, the transition determination unit 14 performs transition re-determination, and the output unit 15 generates and outputs instruction information for causing the moving body 22 to execute the independent control or the follow-up control according to the determination result.
[0211] As described above, through this modification, when the mobile body stops a certain number of times while moving in the risk zone in the past history, it can be inferred that the difficulty of the mobile body 21 and the mobile body 22 moving together in the risk zone is high. Therefore, when the mobile body stops a certain number of times while moving in the risk zone in the past history, the control method of the mobile body 22 is not switched to the follow-up control mode. Therefore, only the mobile body of the remote operation target in the risk zone can be regarded as the mobile body 21 that can be remotely operated.
[0212] (Variant 2)
[0213] Furthermore, it is also possible to perform conversion and re-judgment, for example, based on the size of the risk area.
[0214] The conversion judgment unit 14 involved in the second modification makes a basic judgment that the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, and then makes a conversion re-judgment of whether the mobile body 22 can be converted to the following control. More specifically, when the conversion judgment unit 14 judges (basic judgment) that the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, it further judges (conversion re-judgment) whether the length of the path that the mobile body 21 will pass through the risk zone, that is, the length of the predetermined passing path, exceeds a prescribed value. In this case, the risk zone information includes the size of the risk zone. The conversion judgment unit 14 can calculate the moving distance of the mobile body 21 in the risk zone, that is, the length of the predetermined passing path, based on the risk zone information, the vehicle information, and the movement information. When the length of the predetermined passing path exceeds a prescribed value such as 50 m, it is judged that the load of the remote operation of the operator when the mobile body 21 following the mobile body 22 becomes remotely operated is high, and the control method of the mobile body 22 is not converted to the following control mode.
[0215] When determining that the length of the planned passage path of the moving body 21 exceeds a predetermined value, the output unit 15 does not output instruction information for causing the moving body 22 to execute follow-up control, but outputs instruction information for causing the moving body 22 to continue to execute individual control to move independently of the moving body 21 .
[0216] On the other hand, when the output unit 15 determines that the length of the planned passage path of the moving body 21 is equal to or smaller than the predetermined value, the output unit 15 outputs instruction information for causing the moving body 22 to perform the follow-up control.
[0217] In this way, the output unit 15 creates and outputs instruction information for maintaining the individual control mode or switching to the following control mode with respect to the moving body 22 in accordance with the determination result of the switching re-determination by the switching determination unit 14 .
[0218] As described above, through this modification, when the length of the path of the mobile body 21 when passing through the risk zone is greater than a certain value, it can be inferred that the operator's operation difficulty is high when performing remote operation to move the mobile body 21 and the mobile body 22 together in the risk zone. Therefore, when the length of the path of the mobile body 21 when passing through the risk zone is greater than a certain value, the control method of the mobile body 22 is not converted to the follow-up control mode. Therefore, only the mobile body that is the remote operation target in the risk zone can be regarded as the mobile body 21 that can be remotely operated.
[0219] (Variant 3)
[0220] Furthermore, for example, the decision to switch again may be made based on the characteristics of the planned passage route when passing through the risk zone.
[0221] After making a basic judgment that the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, the conversion judgment unit 14 involved in the modification 3 makes a conversion re-judgment of whether the mobile body 22 can be converted to the following control. More specifically, as a conversion re-judgment, the conversion judgment unit 14 confirms the path that the mobile body 21 will take through the risk zone, that is, the scheduled passing path, and judges (conversion re-judgment) whether the scheduled passing path consists of straight roads above a threshold. In this case, the conversion judgment unit 14 can confirm the scheduled passing path of the mobile body 21 in the risk zone based on the risk zone information, vehicle information, and movement information. In the case where the scheduled passing path of the mobile body 21 is mostly straight lines, since it can be judged that the difficulty of the operator's operation when the mobile body 21 followed by the mobile body 22 needs to be remotely operated is low, the control method of the mobile body 22 can also be converted to the following control mode. On the other hand, when the planned passage path of the moving body 21 has few straight lines and many left and right turns, it can be determined that the operator's operation difficulty is high when the moving body 21 following the moving body 22 needs remote control, so the control method of the moving body 22 is not switched to the following control mode. In addition, the operator's operation difficulty can be determined by whether the planned passage path of the moving body 21 is composed of straight roads of, for example, 80% or more (threshold).
[0222] When the output unit 15 determines that the planned passage path of the moving body 21 does not consist of straight roads with a length greater than a threshold, the output unit 15 does not output instruction information for causing the moving body 22 to perform follow-up control, but outputs instruction information for causing the moving body 22 to continue to perform individual control to move independently of the moving body 21.
[0223] On the other hand, when the output unit 15 determines that the planned passage route of the moving body 21 is composed of a straight road equal to or larger than the threshold value, the output unit 15 outputs instruction information for causing the moving body 22 to execute the following control.
[0224] In this way, the output unit 15 creates and outputs instruction information for causing the moving body 22 to execute the independent control or the follow-up control according to the determination result of the transition re-determination by the transition determination unit 14 .
[0225] As described above, through this modification, when there are many left and right turns in the path of the mobile body 21 when passing through the risk zone, it can be inferred that the operator's operation difficulty is high when performing remote operation to move the mobile body 21 and the mobile body 22 together in the risk zone. As a result, the control method of the mobile body 22 can be prevented from being converted to the follow-up control mode. Therefore, only the mobile body that is the remote operation target in the risk zone can be regarded as the mobile body 21 that can be remotely operated reliably.
[0226] (Variant 4)
[0227] Furthermore, for example, the re-judgment of switching may be performed based on the surrounding conditions of the place that the mobile body 21 is about to enter in the risk zone.
[0228] The conversion judgment unit 14 involved in the modification example 4 performs a conversion re-judgment of whether the mobile body 22 can be converted to the following control after performing a basic judgment that the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone. More specifically, as the conversion re-judgment, the conversion judgment unit 14 judges (conversion re-judgment) whether the mobile body 21 can wait in an open space around the moving path until the mobile body 21 enters the risk zone until the mobile body 22 catches up with the mobile body 21.
[0229] In this case, the risk zone information may also include information indicating whether there is an open space where multiple moving bodies can stop, whether the traffic volume is large or small, and other conditions around the risk zone. In addition, the conversion judgment unit 14 may also confirm the surrounding conditions of the place where the moving body 21 is to enter in the risk zone based on the risk zone information, vehicle information, and movement information. In addition, the conversion judgment unit 14 may also determine whether the moving body 21 can wait in the open space around the moving path until the moving body 21 enters the risk zone based on the confirmed surrounding conditions.
[0230] Alternatively, the transition determination unit 14 may obtain information showing the surrounding conditions of the actual scene from a camera of the moving body 21, etc. Furthermore, the transition determination unit 14 may confirm the surrounding conditions of the actual scene based on the obtained information. Furthermore, the transition determination unit 14 may determine whether the moving body 21 can wait in an open space around the moving path until the moving body 21 enters the risk zone based on the surrounding conditions of the actual scene.
[0231] As for the conditions around the place that the moving body 21 is to enter in the risk zone, when the traffic volume is small and the road width is large, or when there is an open space for the moving body 21 to wait until the moving body 22 catches up with the moving body 21, the moving body 21 can be made to wait until the moving body 22 catches up with itself. In this case, the control method of the moving body 22 can also be switched to the following control mode.
[0232] When determining that there is no open space for the moving body 21 to wait, the output unit 15 does not output instruction information for causing the moving body 22 to execute follow-up control, but outputs instruction information for causing the moving body 22 to continue to execute individual control for moving independently of the moving body 21 .
[0233] On the other hand, when it is determined that there is an open space where the moving body 21 can wait, the output unit 15 outputs instruction information for causing the moving body 22 to execute the following control.
[0234] In this way, the output unit 15 creates and outputs instruction information for maintaining the individual control mode or switching to the following control mode with respect to the moving body 22 in accordance with the determination result of the switching re-determination by the switching determination unit 14 .
[0235] As described above, through this modification, for example, when there is no open space for the mobile body 21 to wait for the mobile body 22 due to heavy traffic or narrow road width, it is estimated that the mobile body 21 cannot wait safely until the mobile body 22 catches up with the mobile body 21. Therefore, even if the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, the control method of the mobile body 22 can be kept from being converted to the follow-up control mode in consideration of the safety of the mobile body 21. Therefore, only the mobile body of the remote operation target in the risk zone can be regarded as the mobile body 21 that can be remotely operated.
[0236] (Variant 5)
[0237] Furthermore, the re-determination of switching may be performed based on the skills or experience of an operator who remotely operates the moving body 21, for example.
[0238] The conversion judgment unit 14 involved in the modification 5 performs a conversion re-judgment of whether the mobile body 22 can be converted to the follow-up control after performing a basic judgment that the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone. More specifically, as the conversion re-judgment, the conversion judgment unit 14 judges (conversion re-judgment) whether the skill level of at least one of the operators who remotely operates and remotely monitors the mobile body 21 in the risk zone exceeds a prescribed level. In this case, the remote operation management unit 17 may also include information indicating the skill level of the operator such as the time of experience in remote operation or the level corresponding to the time of experience in remote operation. Accordingly, the conversion judgment unit 14 can confirm the skill level of at least one of the operators who remotely operates and remotely monitors the mobile body 21 in the risk zone by referring to the remote operation management unit 17. For example, in the case where an operator who is an experience person (novice) with less than 100 hours is assigned as an operator who performs remote operation of the mobile body 21 following the mobile body 22, it can be judged that it is likely that it is difficult to remotely operate the mobile body 21 following the mobile body 22. Thus, for example, when an operator with less than 100 hours of experience is assigned as an operator to perform remote control of the moving object 21 following the moving object 22, the control method of the moving object 22 is not switched to the following control mode.
[0239] When determining that the skill level of the operator is below a predetermined level, the output unit 15 does not output instruction information for causing the moving body 22 to execute follow-up control, but outputs instruction information for causing the moving body 22 to continue to execute individual control for moving independently of the moving body 21 .
[0240] On the other hand, when it is determined that the skill level of the operator exceeds the predetermined level, the output unit 15 outputs instruction information for causing the mobile object 22 to execute follow-up control.
[0241] In this way, the output unit 15 creates and outputs instruction information for maintaining the individual control mode or switching to the following control mode with respect to the moving body 22 in accordance with the determination result of the switching re-determination by the switching determination unit 14 .
[0242] As described above, according to this modification, when the operator is a novice and the operator's skill level is low, for example, when the mobile body 21 followed by the mobile body 22 is remotely operated, it can be expected that the mobile body 21 and the mobile body 22 cannot move safely together. Therefore, even if the mobile body 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, the control method of the mobile body 22 can be kept from being converted to the follow-up control mode in consideration of the operator's skill level. Therefore, only the mobile body to be remotely operated in the risk zone can be the mobile body 21 that can be remotely operated even by a novice operator.
[0243] (Variant 6)
[0244] In the risk zone, there are cases where the planned passage path of the moving body 21 and the planned passage path of the moving body 22 are completely consistent, and there are also cases where they diverge in the middle. For example, in the case where the planned passage path of the moving body 21 and the planned passage path of the moving body 22 diverge in the middle of the risk zone, the information processing device 10 performs follow-up control on the moving bodies 21 and 22 until the divergence point, and performs independent control from the divergence point. In this case, for example, the operator performs remote control on the moving bodies 21 and 22 independently of each other from the divergence point.
[0245] Alternatively, when the planned passage path of the moving body 21 in the risk zone and the planned passage path of the moving body 22 diverge midway, the information processing device 10 does not perform the follow-up control but performs the independent control. For example, the switching judgment unit 14 may judge (switch again to judge) whether the planned passage path of the moving body 21 in the risk zone and the planned passage path of the moving body 22 diverge midway after making a basic judgment that the moving body 22 will catch up with the moving body 21 until the moving body 21 enters the risk zone.
[0246] When the output unit 15 determines that the planned passage path of the moving body 21 and the planned passage path of the moving body 22 will diverge midway, the output unit 15 does not output instruction information for causing the moving body 22 to perform follow-up control, but outputs instruction information for causing the moving body 22 to continue to perform individual control for moving independently of the moving body 21. On the other hand, when the output unit 15 determines that the planned passage path of the moving body 21 and the planned passage path of the moving body 22 will not diverge midway, the output unit 15 outputs instruction information for causing the moving body 22 to perform follow-up control.
[0247] In this way, the output unit 15 creates and outputs instruction information for maintaining the individual control mode or switching to the following control mode with respect to the moving body 22 in accordance with the determination result of the switching re-determination by the switching determination unit 14 .
[0248] According to this, the individual control mode and the follow-up control mode can be adaptively switched according to whether the planned passage path of the moving body 21 and the planned passage path of the moving body 22 will diverge in the risk area.
[0249] Alternatively, when the planned path of the moving body 21 in the risk area and the planned path of the moving body 22 diverge in the middle, the information processing device 10 determines whether to perform follow-up control or independent control according to the overlapping distance of these paths in the risk area. In other words, the switching and re-judgment can also be performed according to the overlapping distance, which refers to the overlapping distance of the planned path of the moving body 21 in the risk area and the planned path of the moving body 22.
[0250] For example, after making a basic judgment that the moving body 22 will catch up with the moving body 21 until the moving body 21 enters the risk zone, the switching judgment unit 14 judges (switches the judgment again) whether the overlapping distance is larger than a threshold value.
[0251] The threshold value may be a fixed value or may be determined according to the size of the risk zone, etc. Furthermore, the threshold value may be determined by the distance of the planned passage path of the mobile body 21 in the risk zone, the distance of the planned passage path of the mobile body 22 in the risk zone, or a fixed ratio relative to the sum of these distances.
[0252] When the output unit 15 determines that the overlap distance is less than the threshold value, the output unit 15 does not output instruction information for causing the moving body 22 to perform the following control, but outputs instruction information for causing the moving body 22 to continue to perform the independent control of moving independently of the moving body 21. On the other hand, when the output unit 15 determines that the overlap distance is greater than the threshold value, the output unit 15 outputs instruction information for causing the moving body 22 to perform the following control.
[0253] In this way, the output unit 15 creates and outputs instruction information for maintaining the individual control mode or switching to the following control mode with respect to the moving body 22 in accordance with the determination result of the switching re-determination by the switching determination unit 14 .
[0254] According to this, the individual control mode and the follow-up control mode can be switched adaptively according to the branching in the planned passage path of the moving body 21 and the planned passage path of the moving body 22 in the risk area.
[0255] Alternatively, when the planned passage path of the moving body 21 in the risk zone and the planned passage path of the moving body 22 diverge in the middle, the information processing device 10 determines whether to perform follow-up control or independent control according to whether the operator can be assigned until the divergence. In other words, the switching can be determined again according to whether the operator can be assigned to the moving body 21 and the moving body 22 respectively until the moving body 21 and the moving body 22 in the risk zone diverge.
[0256] For example, after making a basic judgment that the moving body 22 will catch up with the moving body 21 until the moving body 21 enters the risk zone, the conversion judgment unit 14 judges (converts to a second judgment) whether the operators can be respectively assigned to the moving body 21 and the moving body 22 until the branching. For example, the conversion judgment unit 14 may judge whether the operators can be assigned based on whether there is a surplus number of operators and whether there are operators who can cope with the situation.
[0257] When the output unit 15 determines that the operator cannot be assigned, the output unit 15 does not output instruction information for causing the mobile body 22 to perform follow-up control, but outputs instruction information for causing the mobile body 22 to continue to perform individual control for moving independently of the mobile body 21. On the other hand, when the output unit 15 determines that the operator can be assigned, the output unit 15 outputs instruction information for causing the mobile body 22 to perform follow-up control.
[0258] In this way, the output unit 15 creates and outputs instruction information for maintaining the individual control mode or switching to the following control mode with respect to the moving body 22 in accordance with the determination result of the switching re-determination by the switching determination unit 14 .
[0259] According to this, the individual control mode and the follow-up control mode can be switched adaptively according to whether or not the operators can be respectively assigned to the moving body 21 and the moving body 22 to be separated in the risk zone.
[0260] (Variant 7)
[0261] In the above-described embodiment and modified example, the basic determination of whether to switch the control method of the moving body 22 is performed before the moving body 21 enters the risk zone. The timing of the determination is not limited to this.
[0262] For example, among the multiple mobile bodies that are autonomously moving in the individual control mode in the risk area, there is a possibility that a certain mobile body (referred to as mobile body A) needs remote control. In this case, if there is a mobile body B that is located near the mobile body A and can wait for the mobile body A among the multiple mobile bodies, the remote control system 100 can also switch the mobile body B to the follow-up control mode of following the mobile body A when the mobile body B meets the mobile body A. Here, the switch can also be made when there is an open space for the mobile bodies A and B to wait.
[0263] According to this, the remote control system 100 can assign the operator not to the mobile object B but to the mobile object waiting in front of the risk area, thereby improving the utilization rate of the plurality of mobile objects.
[0264] (Implementation 3)
[0265] Before the moving body 21 enters the risk zone, in the case where a plurality of moving bodies 22 will catch up with a moving body 21 , the number of moving bodies 22 that follow the moving body 21 may be determined, or the moving body 22 that follows the moving body 21 may be selected.
[0266] Fig.10 This is a flowchart showing an example of basic determination processing of the information processing device 10 according to the third embodiment.
[0267] like Fig.10 As shown, first, the information processing device 10 performs a basic judgment (S100). The details of step S100 are as follows: Figure 6 In addition, in the present embodiment, a plurality of moving bodies 22 are identified and judged to catch up with the moving body 21 in the basic judgment.
[0268] In step S100, when the result of the basic judgment is to switch the control mode of the mobile body 22 to the follow-up control mode (switched to the follow-up control in S100), the information processing device 10 determines the number of followers to be controlled, that is, the number of mobile bodies 22 switched to the follow-up control mode to follow the mobile body 21 (S301). The determination of the number of followers may be determined by an operator who remotely controls the mobile body 21 or may be performed automatically. As a basis for determining the number of followers, the characteristics of the planned passage path of the mobile body 21 when passing through the risk area, the risk when the mobile body 22 is controlled to perform the follow-up control in the risk area, and the sizes of the mobile body 21 and the mobile body 22 may be used. Furthermore, as a basis for determining the number of followers, the skills or experience of the operator who remotely controls the mobile body 21 may be used.
[0269] For example, when the characteristics of the planned passage path of the moving body 21 when passing through the risk area are used as the basis for determining the number of following bodies, and when the ratio of straight lanes in the planned passage path is large, the number of following bodies 22 following the moving body 21 is increased to the maximum.
[0270] For example, when the risk of causing the moving object 22 to perform following control in the risk area is used as a criterion for determining the number of following objects, and when the risk is high, the number of following moving objects 22 following the moving object 21 may be minimized.
[0271] For example, when the sizes of the moving bodies 21 and 22 are used as a criterion for determining the number of following bodies, the maximum number of bodies may be determined so that the total length of the moving body 22 following the moving body 21 does not exceed a threshold.
[0272] For example, in a case where the skill or experience of an operator who remotely operates the mobile body 21 is used as a basis for determining the number of following units, the number of mobile bodies 22 may be determined to be the maximum when the mobile body 21 accompanied by the following mobile body 22 can be safely remotely operated according to the skill or experience of the operator.
[0273] In this way, when a plurality of mobile bodies 22 are determined and it is determined that the plurality of mobile bodies 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, the information processing device 10 may further determine the number of mobile bodies 22 among the plurality of mobile bodies 22 for which the following control is to be executed. Therefore, the information processing device 10 may also output the instruction information for executing the following control for the determined number of mobile bodies 22 in the output of the instruction information for executing the following control. For example, if the number of mobile bodies 22 following the mobile body 21 is large, it is expected that the mobile body 21 and the mobile body 22 cannot move safely together depending on the proficiency of the operator and the condition of the moving path. Thus, even in the case where a plurality of mobile bodies 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, by determining the number of mobile bodies 22 following the mobile body 21, the mobile body 21 can be safely moved together with the determined number of mobile bodies 22.
[0274] Fig.11 This is a flowchart showing another example of the basic determination process of the information processing device 10 according to the third embodiment.
[0275] like Fig.11 As shown, first, the information processing device 10 performs a basic judgment (S100). The details of step S100 are as follows: Figure 6 In addition, in the present embodiment, a plurality of moving bodies 22 are identified and judged to catch up with the moving body 21 in the basic judgment.
[0276] In step S100, when the result of the basic judgment is to switch the control mode of the mobile body 22 to the follow-up control mode (switch to the follow-up control at S100), the information processing device 10 requests the operator to confirm the follow-up control (S302). More specifically, as confirmation of the follow-up control, the information processing device 10 issues a request to the operator who performs remote control of the mobile body 21, etc., to select the mobile body 22 to follow the mobile body 21. Alternatively, the information processing device 10 may further issue a request to determine the start timing of entering the risk zone of the mobile body 21 accompanied by the mobile body 22 under the follow-up control. According to this, after confirming the safety of the surroundings with a stricter standard than controlling the mobile body 21 alone, the movement of the mobile body 21 can be started.
[0277] In this way, when a plurality of mobile bodies 22 are determined and it is determined that the plurality of mobile bodies 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, the information processing device 10 may further select the mobile body 22 to perform the following control from the plurality of mobile bodies 22. Therefore, the information processing device 10 may also output the instruction information for executing the following control for the selected mobile body 22 in the output of the instruction information for executing the following control. Accordingly, even in the case where a plurality of mobile bodies 22 will catch up with the mobile body 21 until the mobile body 21 enters the risk zone, by selecting the mobile body 22 that follows the mobile body 21, the mobile body 21 can be safely moved together with the selected mobile body 22.
[0278] (Other Embodiments, etc.)
[0279] Although the above describes information processing methods and the like involved in more than one method based on implementation methods and variations, the present disclosure is not limited to these implementation methods and variations. Without departing from the scope of the present disclosure, various modifications that can be thought of by those skilled in the art are performed on the implementation methods and variations, which may be included in the scope of the present disclosure.
[0280] For example, in the embodiment, another constituent element may replace a specific constituent element to perform the processing performed by the specific constituent element. In addition, the order of multiple processing may be changed, and multiple processing may be performed in parallel. In addition, the ordinal numbers such as "first" and "second" used in the description may be appropriately replaced, removed, or newly assigned. These ordinals may not necessarily correspond to a meaningful order, but may be used to identify the elements.
[0281] In addition, in the above-mentioned embodiments, each component can be formed by dedicated hardware or implemented by executing a software program suitable for each component. Each component can also be implemented by a program execution unit such as a CPU (Central Processing Unit) or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. Here, the software that implements the device of the above-mentioned embodiment is a program that enables a computer to execute Figure 5 The flowchart shown includes the procedures of each step.
[0282] Furthermore, the following cases are also included in the present disclosure.
[0283] (1) Specifically, the at least one device mentioned above is a computer system composed of a microprocessor, ROM, RAM, hard disk unit, display unit, keyboard, mouse, etc. A computer program is stored in the RAM or hard disk unit. The microprocessor operates according to the computer program, so that the at least one device mentioned above realizes its function. Here, the computer program is a combination of multiple command codes that issue instructions to the computer in order to realize the specified function.
[0284] (2) Part or all of the components constituting at least one of the above-mentioned devices may be constituted by a system LSI (Large Scale Integration). System LSI is a multifunctional LSI in which multiple components are integrated and manufactured on a single chip, and specifically is a computer system constituted by a microprocessor, ROM, RAM, etc. Computer programs are stored in the RAM. The microprocessor operates according to the computer program, so that the system LSI realizes its functions.
[0285] (3) A part or all of the components constituting at least one of the above-mentioned devices may be constituted by an IC card or a single module that can be attached to or detached from the device. The IC card or module is a computer system composed of a microprocessor, ROM, RAM, etc. The IC card or module may include the above-mentioned ultra-multifunctional LSI. The IC card or module realizes its functions by operating the microprocessor according to the computer program. The IC card or module may also be tamper-resistant.
[0286] (4) The present disclosure may be the methods shown above, a computer program for realizing these methods by a computer, or a digital signal composed of the computer program.
[0287] Furthermore, the present disclosure may also be implemented as a computer-readable recording medium that records a computer program or a digital signal, such as a floppy disk, a hard disk, a CD (Compact Disc)-ROM, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory, etc. Furthermore, the present disclosure may also be implemented as a digital signal recorded on these recording media.
[0288] Furthermore, the present disclosure may transmit the computer program or digital signal via an electronic communication line, a wireless or wired communication line, a network represented by the Internet, data broadcasting, and the like.
[0289] Furthermore, the program or digital signal may be recorded on a recording medium and then transferred, or the program or digital signal may be transferred via a network or the like, thereby being executed by another independent computer system.
[0290] Industrial Availability
[0291] The present disclosure can be utilized in a method of outputting control information for controlling a moving object, and the like.
[0292] Explanation of symbols
[0293] 1 Remote Control Server
[0294] 5 Network
[0295] 10 Information processing device
[0296] 11. Acquisition Department
[0297] 12 Forecasting Department
[0298] 13 Determination
[0299] 14 Conversion judgment unit
[0300] 15 Output
[0301] 16 Storage
[0302] 17 Remote Operation Management Department
[0303] 18 Remote Operation Distribution Department
[0304] 19 Remote Operation Department
[0305] 21, 22 Mobile
[0306] 31 Remote control device
[0307] 50 Risk Zone
[0308] 100 Remote Control System
Claims
1. An information processing method, in which: obtaining movement information related to the movement of two or more moving objects, the two or more moving objects being moving objects capable of autonomous movement and capable of at least one of remote operation and remote monitoring, A first moving object is predicted based on the movement information and the position information of the first area, wherein the first moving object is a moving object whose movement path will pass through the first area and will enter the first area among the two or more moving objects, and the first area is an area requiring at least one of the remote operation and the remote monitoring, According to the movement information and the position information, a second moving object different from the first moving object is determined, and the second moving object is also a moving object whose movement path will pass through the first area. determining whether the second moving object will catch up with the first moving object before the first moving object enters the first area, When it is determined that the second moving body will catch up with the first moving body before the first moving body enters the first area, instruction information for causing the second moving body to perform following control is output to the second moving body, wherein the following control is control for causing the second moving body to follow the movement of the first moving body.
2. The information processing method according to claim 1, Furthermore, when it is determined that the second moving body cannot catch up with the first moving body until the first moving body enters the first area, instruction information is output to the second moving body to enable the second moving body to continue to perform independent control, and the independent control is control that causes the second moving body to move independently of the first moving body.
3. The information processing method according to claim 1, In judging whether the second moving body will catch up with the first moving body, whether the second moving body will catch up with the first moving body is judged based on (i) or (ii), (i) is the time from the first moving body arriving at the first area until entering the first area, i.e., the waiting time, and the time from the first moment when the first moving body arrives at the first area until the second moment when the second moving body arrives at the position of the first moving body, i.e., the catching-up time, and (ii) is the distance on the path between the first moving body and the second moving body, and a reference value for the distance.
4. The information processing method according to claim 3, The second time is a time when the second moving body autonomously moves by accelerating to reach the position of the first moving body.
5. The information processing method according to any one of claims 1 to 4, further, If it is determined that the second moving object will catch up with the first moving object before the first moving object enters the first area, calculating a risk of causing the second mobile body to perform the following control in the first area according to the condition of the first area, and determining whether the calculated risk exceeds a predetermined reference value, When it is determined that the calculated risk exceeds a predetermined reference value, instruction information for causing the second moving object to execute the following control is not outputted.
6. The information processing method according to claim 5, The risk is the degree of difficulty in remotely operating the first moving object while causing the second moving object to execute the following control in the first area.
7. The information processing method according to any one of claims 1 to 4, further, If it is determined that the second moving object will catch up with the first moving object before the first moving object enters the first area, determining whether the number of times included in the past history exceeds a threshold, the past history being the history of the moving body that has passed through the first area in the past, and the number of times being the number of times the moving body in autonomous movement stops in the first area, If it is determined that the number of times exceeds the threshold, instruction information for causing the second moving object to execute the following control is not outputted to the second moving object.
8. The information processing method according to any one of claims 1 to 4, further, If it is determined that the second moving object will catch up with the first moving object before the first moving object enters the first area, determining whether the length of a planned passage path exceeds a predetermined value, the planned passage path being a path along which the first moving body is planned to pass through the first area, When it is determined that the length of the planned passage path exceeds the predetermined value, instruction information for causing the second moving body to execute the following control is not outputted to the second moving body.
9. The information processing method according to any one of claims 1 to 4, further, If it is determined that the second moving object will catch up with the first moving object before the first moving object enters the first area, confirming a planned passage path, wherein the planned passage path is a path that the first moving body is planned to pass through the first area, Determine whether the planned passing path consists of straight roads above a threshold value, When it is determined that the planned passage route does not consist of a straight road having a value greater than or equal to the threshold, instruction information for causing the second moving object to execute the following control is not outputted.
10. The information processing method according to any one of claims 1 to 4, further, If it is determined that the second moving object will catch up with the first moving object before the first moving object enters the first area, determining whether the first moving body can wait in a space around a moving path until the second moving body catches up with the first moving body until the first moving body enters the first area, If it is determined that the first moving object cannot wait, instruction information for causing the second moving object to execute the following control is not outputted to the second moving object.
11. The information processing method according to any one of claims 1 to 4, further, If it is determined that the second moving object will catch up with the first moving object before the first moving object enters the first area, determining whether a skill level of an operator who performs at least one of the remote operation and the remote monitoring of the first moving object in the first area exceeds a predetermined level; When it is determined that the skill level does not exceed the predetermined level, instruction information for causing the second moving object to execute the following control is not outputted to the second moving object.
12. The information processing method according to any one of claims 1 to 4, In determining the second moving object, each of a plurality of second moving objects is determined as the second moving object. Further, when it is determined that the plurality of second moving bodies will catch up with the first moving body before the first moving body enters the first area, the number of at least one second moving body that performs the following control among the plurality of second moving bodies is determined, In outputting the instruction information for causing the following control to be executed, the instruction information for causing the following control to be executed is outputted for the one or more second moving bodies specified by the determined number.
13. The information processing method according to any one of claims 1 to 4, In determining the second moving object, each of a plurality of second moving objects is determined as the second moving object. Further, when it is determined that the plurality of second moving bodies will catch up with the first moving body until the first moving body enters the first area, a second moving body that performs the following control is selected from the plurality of second moving bodies, In the output of the instruction information for causing the following control to be executed, the instruction information for causing the following control to be executed is output with respect to the selected second moving body.
14. An information processing device comprising: An acquisition unit that acquires movement information related to movement of two or more moving objects, wherein the two or more moving objects are moving objects that can move autonomously and can be remotely operated and remotely monitored; a prediction unit, which predicts a first moving object based on the movement information and the position information of the first area, wherein the first moving object is a moving object whose movement path will pass through the first area and will enter the first area among the two or more moving objects, and the first area is an area requiring at least one of the remote operation and the remote monitoring; a determination unit that determines, based on the movement information and the position information, a second moving object that is different from the first moving object and whose moving path will pass through the first area; A determination unit, configured to determine whether the second moving body will catch up with the first moving body before the first moving body enters the first area; as well as The output unit outputs instruction information for causing the second mobile body to perform following control when it is determined that the second mobile body will catch up with the first mobile body until the first mobile body enters the first area. The following control is a control that causes the second mobile body to follow the movement of the first mobile body.
15. A program for causing a computer to execute the following processing: obtaining movement information related to the movement of two or more moving objects, the two or more moving objects being moving objects capable of autonomous movement and capable of at least one of remote operation and remote monitoring, A first moving object is predicted based on the movement information and the position information of the first area, wherein the first moving object is a moving object whose movement path will pass through the first area and will enter the first area among the two or more moving objects, and the first area is an area requiring at least one of the remote operation and the remote monitoring, According to the movement information and the position information, a second moving object different from the first moving object is determined, and the second moving object is also a moving object whose movement path will pass through the first area. determining whether the second moving object will catch up with the first moving object before the first moving object enters the first area, When it is determined that the second moving body will catch up with the first moving body before the first moving body enters the first area, instruction information for causing the second moving body to perform following control is output to the second moving body, wherein the following control is control for causing the second moving body to follow the movement of the first moving body.
