Air traffic control system
The control system for autonomous vehicles addresses the limitation of existing systems by enabling operators to mark and register desired information into map information, enhancing safety and efficiency in managing areas through image-based registration and recommendation.
Patent Information
- Application Number
- JP2025077406
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-05-07
- Publication Date
- 2026-11-19
AI Technical Summary
Existing systems for managing map information in predetermined areas, such as those described in Patent Document 1, do not allow administrators to easily register desired information, limiting the flexibility and accuracy of area management.
A control system for autonomous vehicles that includes a user interface and processors to obtain images of the surrounding conditions, display them, accept marking operations, and register marked portions into map information, or automatically extract recommended portions for registration.
Enables efficient and accurate registration of desired information into map information by allowing operators to mark and recommend areas of interest directly on displayed images, improving safety and efficiency in managing predetermined areas.
Smart Images

Figure 2026181760000001_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to a technology for managing a predetermined area using an autonomous driving vehicle.
BACKGROUND ART
[0002] Patent Document 1 discloses an autonomous driving vehicle control system. A camera is installed on a ceiling, and captures an overhead view of a driving environment including obstacles. A server acquires an image captured by the camera, and identifies an obstacle in the driving environment based on the image. Furthermore, the server automatically creates an environment map in which a no-entry area including the identified obstacle is set. The server provides the created environment map to the autonomous driving vehicle. The autonomous driving vehicle travels in the driving environment based on the environment map.
PRIOR ART DOCUMENTS
PATENT DOCUMENTS
[0003]
PATENT DOCUMENT 1
SUMMARY OF THE INVENTION
PROBLEMS TO BE SOLVED BY THE INVENTION
[0004] Consider performing management of a predetermined area. For example, managing map information of a predetermined area is useful. At this time, it is desired that an administrator can register (reflect) desired information in the map information. However, with the technology described in Patent Document 1, the administrator cannot register desired information in the map information.
MEANS FOR SOLVING THE PROBLEMS
[0005] A first aspect relates to a control system for performing management of a predetermined area. The control system includes one or more processors and a user interface. One or more processors obtain one or more images showing the surrounding conditions of the autonomous vehicle within a predetermined area, obtained by using sensors mounted on the autonomous vehicle within the predetermined area. One or more processors display one or more images on the user interface display device. One or more processors accept an operation, input through a user interface, to mark one or more parts of an image. One or more processors register the marked portions within one or more images into the map information of a predetermined area.
[0006] The second aspect concerns control systems for managing designated areas. The control system comprises one or more processors and a user interface. One or more processors obtain one or more images showing the surrounding conditions of the autonomous vehicle within a predetermined area, obtained by using sensors mounted on the autonomous vehicle within the predetermined area. One or more processors automatically extract recommended portions from one or more images that are recommended for registration in the map information of a predetermined area. One or more processors display one or more images on the user interface display device and indicate the recommended portion. [Effects of the Invention]
[0007] From the first perspective, the control system displays an image on the user interface display device showing the surrounding conditions of an autonomous vehicle within a designated area. The control system also accepts marking operations through the user interface to mark parts of the image. The control system then registers the marked parts in the image into the map information of the designated area. This marking function allows the operator to efficiently register (reflect) desired information into the map information.
[0008] From a second perspective, the control system acquires images showing the surroundings of an autonomous vehicle within a designated area. Furthermore, it automatically extracts recommended portions from these images that are deemed suitable for registration in the map information of the designated area. The control system displays the images on the user interface display device and points to the recommended portions. This recommendation function makes it easier for operators to register (reflect) desired information in the map information MAP. [Brief explanation of the drawing]
[0009] [Figure 1] This is a conceptual diagram illustrating an example of a designated area to be managed. [Figure 2] This is a conceptual diagram illustrating remote monitoring using autonomous vehicles. [Figure 3] This is a conceptual diagram illustrating the overview of the area management system. [Figure 4] This is a conceptual diagram illustrating the overview of the marking function. [Figure 5] This is a conceptual diagram illustrating the first example of the marking function. [Figure 6] This is a conceptual diagram illustrating a second example of the marking function. [Figure 7] This is a conceptual diagram illustrating a third example of the marking function. [Figure 8] This is a conceptual diagram illustrating a fourth example of the marking function. [Figure 9] This is a block diagram showing an example configuration for an autonomous vehicle. [Figure 10] This is a conceptual diagram illustrating the generation of the first image in an autonomous vehicle. [Figure 11] This is a conceptual diagram to explain the marking reference information. [Figure 12] This is a block diagram showing an example of an air traffic control system configuration. [Figure 13] This is a conceptual diagram illustrating the marking acceptance process in the air traffic control system. [Figure 14]This is a conceptual diagram for explaining an example of registration processing in a control system. [Figure 15] This is a conceptual diagram for explaining an example of a recommendation function. [Figure 16] This is a block diagram showing an example of a functional configuration related to the recommendation function. [Mode for Carrying Out the Invention]
[0010] Embodiments of the present disclosure will be described with reference to the accompanying drawings.
[0011] 1. Management of Predetermined Area Consider the management of a predetermined area AR. Management is a concept that includes monitoring, maintenance, operation, investigation, information collection, information update, and the like. The predetermined area AR to be managed has at least a size large enough to allow vehicles to travel. For example, the predetermined area AR is an outdoor area having a certain extent of size.
[0012] In the example shown in Figure 1, the predetermined area AR is a work area of a mine. In the work area of a mine, roads are not paved, and the road surface is often made of sand or gravel. In the example shown in Figure 1, an autonomous unmanned dump truck AH capable of autonomous traveling is used for various types of work. It is important to manage the predetermined area AR so that such an unmanned dump truck AH can safely travel autonomously. For example, it is useful to correctly recognize the travelable area and the non-travelable area (restricted area) in the predetermined area AR. For that purpose, it is useful to correctly recognize the edges of embankments and cliffs, that is, the boundary line between the travelable area and the non-travelable area. It is also useful to correctly recognize obstacles on the road (e.g., falling rocks, dropped objects, etc.) and irregularities (e.g., puddles, depressions, large ruts, etc.).
[0013] As an example, let's consider the task of recognizing the edge of an embankment in a designated area AR (mine), referring to Figure 2. (A) in Figure 2 shows a comparative example. In the comparative example, a manually operated vehicle (manned vehicle) is used. More specifically, a person gets into the vehicle and manually drives it so that it travels along the edge of the embankment. The vehicle measures its position using GNSS (Global Navigation Satellite System) and transmits the vehicle position to the control system in real time. The control system approximately recognizes the set of vehicle positions, i.e., the vehicle's travel trajectory, as the edge of the embankment. However, it is dangerous for a manned vehicle to travel along the edge of an embankment. Furthermore, the coexistence of manned vehicles and unmanned dump trucks AH in a designated area AR is undesirable from a safety standpoint.
[0014] On the other hand, (B) in Figure 2 shows an example in which an autonomous vehicle (unmanned vehicle) is used. Autonomous vehicles are also called ALVs (Autonomous Light Vehicles). Autonomous vehicles are equipped with recognition sensors such as cameras. Autonomous vehicles can recognize their surroundings through remote sensing using recognition sensors. Therefore, autonomous vehicles do not need to get close to the edge of the embankment and can recognize the edge of the embankment from a position a certain distance away. Autonomous vehicles transmit images obtained using recognition sensors to the control system. Operators can view the images transmitted from the autonomous vehicle to recognize and confirm the edge of the embankment. The timing at which the operator views the images to recognize and confirm the edge is at the operator's discretion. Operators can check the accumulated images at a convenient time and do not necessarily need to check the images in real time.
[0015] When autonomous vehicles (unmanned vehicles) are used in this way, there is no need for humans to ride in the vehicles and travel directly to the site, and the time required for human intervention is also reduced. These factors contribute to improved safety, efficiency, and productivity. Furthermore, the fact that it is not necessary to approach the edge of the embankment also contributes to improved safety.
[0016] From the above perspective, according to this embodiment, the management of a predetermined area AR is performed by using an autonomous vehicle.
[0017] Figure 3 is a conceptual diagram illustrating the overview of the area management system 1 according to this embodiment. The area management system 1 is applied to a predetermined area AR and is configured to manage the predetermined area AR. More specifically, the area management system 1 includes an autonomous vehicle 100 and a control system (information processing system) 200. The autonomous vehicle 100 is capable of autonomously driving within the predetermined area AR. Here, autonomous driving (autonomous driving) means that steering, acceleration, and deceleration are performed automatically, independently of the driver's operation. The autonomous vehicle 100 is typically an unmanned vehicle. The control system 200 is an information processing system located outside the autonomous vehicle 100 that performs various information processing. The autonomous vehicle 100 and the control system 200 can communicate with each other. The control system 200 manages the predetermined area AR and the autonomous vehicle 100.
[0018] The control system 200 according to this embodiment includes a user interface 230 for providing user interface functions. The user interface 230 is configured to provide various information to the operator (user) and to accept various inputs from the user. For this purpose, the user interface 230 includes a display device and an input device. The user interface functions of the control system 200 according to this embodiment will be described in more detail below.
[0019] 2. User Interface: Marking Function The control system 200 according to this embodiment provides the operator with a "marking function" using the user interface 230. The outline of the marking function will be explained with reference to Figure 4.
[0020] First, the control system 200 acquires one or more image IMGs showing the surrounding conditions of the autonomous vehicle 100 within a predetermined area AR. These image IMGs are obtained using recognition sensors mounted on the autonomous vehicle 100 within the predetermined area AR. Typically, the image IMGs are transmitted from the autonomous vehicle 100 within the predetermined area AR to the control system 200. However, the method by which the control system 200 can acquire the image IMGs is not limited. In any case, the control system 200 acquires one or more image IMGs obtained by the autonomous vehicle 100 within the predetermined area AR. The control system 200 presents the acquired one or more image IMGs to the operator by displaying them on the display device of the user interface 230.
[0021] The operator views one or more images (IMG) displayed on the display device of the user interface 230. The operator can mark any part of the displayed image (IMG) using the input device of the user interface 230. "Marking" can also be rephrased as "specifying". This type of input operation by the operator to mark (specify) a part of the image (IMG) will be referred to below as a "marking operation". For example, the operator may focus on the edge of a bank or cliff in the image (IMG) and perform a marking operation that traces the edge in the image (IMG). As another example, the operator may focus on an obstacle in the image (IMG) and perform a marking operation that encloses the obstacle in the image (IMG).
[0022] The control system 200 accepts marking operations input through the user interface 230. The control system 200 then registers (reflects) the "marked portion" marked by the marking operation in the map information MAP of a predetermined area AR. More specifically, the control system 200 converts the position of the marked portion in the image coordinate system (U,V) of the image IMG to the corresponding position in the map coordinate system (S,T) of the map information MAP (further details of the conversion process will be described later). The control system 200 then registers the portion at the corresponding position in the map information MAP as the marked portion. For example, if an operator performs a marking operation that traces an edge in the image IMG, the traced portion is registered as an edge in the map information MAP. In other words, by tracing an edge in the image IMG, the operator can draw an edge in the map information MAP. As another example, if an operator performs a marking operation that encloses an obstacle in the image IMG, the enclosed portion is registered as an obstacle in the map information MAP.
[0023] After receiving a marking operation, the control system 200 may overlay the marked portion in the map coordinate system (S, T) onto the map information MAP and display it.
[0024] After receiving the marking operation, the control system 200 may confirm with the operator whether or not to register the marked portion in the map information MAP. If the operator makes a final decision to register the marked portion in the map information MAP, the control system 200 registers the marked portion in the map information MAP. The operator may repeat the marking operation.
[0025] As described above, according to this embodiment, the control system 200 displays an image IMG showing the surrounding conditions of the autonomous vehicle 100 within a predetermined area AR on the display device of the user interface 230. The control system 200 also accepts marking operations through the user interface 230 to mark a portion of the image IMG. The control system 200 then registers the marked portion of the image IMG into the map information MAP of the predetermined area AR. This marking function allows the operator to efficiently register (reflect) desired information into the map information MAP.
[0026] The following describes various examples of one or more images (IMG) and marking functions.
[0027] 2-1. Example 1 Figure 5 is a conceptual diagram illustrating a first example of the marking function. The autonomous vehicle 100 is equipped with a 3D measurement sensor 111. The 3D measurement sensor 111 is configured to acquire 3D structural data around the autonomous vehicle 100. For example, the 3D measurement sensor 111 is a LIDAR (Laser Imaging Detection and Ranging) sensor. In the case of LIDAR, point cloud data around the autonomous vehicle 100 is obtained as 3D structural data.
[0028] The first image, IMG1, is an image obtained using a 3D measurement sensor 111. More specifically, the first image, IMG1, is an image of the 3D structure surrounding the autonomous vehicle 100 within a predetermined area AR, viewed from above the autonomous vehicle 100. This first image, IMG1, is generated by converting the 3D structure data obtained by the 3D measurement sensor 111 into a 2D image when viewed from above. Further details of the first image, IMG1, will be described later.
[0029] The autonomous vehicle 100 generates a first image IMG1 and transmits the first image IMG1 to the control system 200.
[0030] The control system 200 acquires a first image IMG1 from the autonomous vehicle 100. The control system 200 presents the acquired first image IMG1 to the operator by displaying it on the display device of the user interface 230. The operator marks a first portion of the first image IMG1 using the input device of the user interface 230. The control system 200 accepts the marking operation input through the user interface 230. The control system 200 then registers (reflects) the first portion marked by the marking operation in the map information MAP of a predetermined area AR.
[0031] Thus, in the first example, the first image IMG1 obtained by using the 3D measurement sensor 111 is used. The positional accuracy of the objects shown in the first image IMG1 is high. By performing a marking operation on such a first image IMG1, it becomes possible to register the desired portion in the map information MAP with high accuracy.
[0032] 2-2. Second Example Figure 6 is a conceptual diagram illustrating a second example of the marking function. The autonomous vehicle 100 is equipped with a camera 112 that takes pictures of its surroundings. The second image IMG2 is an image IMG taken by the camera 112 mounted on the autonomous vehicle 100 within a predetermined area AR. The autonomous vehicle 100 transmits the second image IMG2 to the control system 200.
[0033] The control system 200 acquires a second image IMG2 from the autonomous vehicle 100. The control system 200 presents the acquired second image IMG2 to the operator by displaying it on the display device of the user interface 230. The operator marks a second portion of the second image IMG2 using the input device of the user interface 230. The control system 200 accepts the marking operation input through the user interface 230. The control system 200 then registers (reflects) the second portion marked by the marking operation in the map information MAP of the predetermined area AR.
[0034] Thus, in the second example, the second image IMG2, captured by camera 112, is used. In the case of the second image IMG2, it is easy to grasp the texture and physical properties of the objects depicted. This is advantageous when determining which parts should be registered in the map information MAP. By performing a marking operation on such a second image IMG2, it becomes possible to register the appropriate parts in the map information MAP.
[0035] 2-3. Third Example Figure 7 is a conceptual diagram illustrating a third example of the marking function. This third example is a combination of the first and second examples described above. Explanations that overlap with the first and second examples above are omitted as appropriate.
[0036] The autonomous vehicle 100 acquires both the first image IMG1 and the second image IMG2. Here, the first image IMG1 and the second image IMG2 are synchronized. That is, the first image IMG1 and the second image IMG2 show the surrounding conditions of the autonomous vehicle 100 at the same time. The autonomous vehicle 100 transmits the first image IMG1 and the second image IMG2 to the control system 200.
[0037] The control system 200 presents both the first image IMG1 and the second image IMG2 to the operator by displaying them on the display device of the user interface 230. The operator marks a first portion of the first image IMG1 using the input device of the user interface 230. The control system 200 accepts the marking operation input through the user interface 230.
[0038] A portion corresponding to the first portion marked in the first image IMG1 exists in the second image IMG2. The second portion in the second image IMG2 is the portion corresponding to the first portion marked in the first image IMG1. In response to a marking operation on the first image IMG1, the control system 200 automatically marks the second portion in the second image IMG2. More specifically, the control system 200 converts the position of the first portion in the first image coordinate system (U1,V1) of the first image IMG1 to its corresponding position in the second image coordinate system (U2,V2) of the second image IMG2 (further details of the conversion process will be described later). Then, the control system 200 automatically marks the portion at the corresponding position in the second image IMG2 as the second portion.
[0039] In this way, in response to a marking operation on the first image IMG1, the corresponding portion in the second image IMG2 is automatically marked. This allows the operator to double-check the marked portion. As mentioned above, the positional accuracy of objects shown in the first image IMG1 is high, and the texture and physical properties of objects shown in the second image IMG2 are easy to grasp. By checking the second portion in the second image IMG2 for the first portion marked in the first image IMG1, it becomes possible to appropriately determine whether or not to register the first portion in the map information MAP.
[0040] Once the operator makes the final decision to register the first portion to the map information MAP, the control system 200 registers the first portion to the map information MAP. The operator may repeat the marking operation.
[0041] 2-4. The fourth example Figure 8 is a conceptual diagram illustrating a fourth example of the marking function. The fourth example is a combination of the first and second examples described above, and the reverse of the third example described above. Explanations that overlap with the first to third examples described above are omitted as appropriate.
[0042] The control system 200 presents both the first image IMG1 and the second image IMG2 to the operator by displaying them on the display device of the user interface 230. The operator marks a second portion of the second image IMG2 using the input device of the user interface 230. The control system 200 accepts the marking operation input through the user interface 230.
[0043] A portion corresponding to the second portion marked in the second image IMG2 exists in the first image IMG1. The first portion in the first image IMG1 is the portion corresponding to the second portion marked in the second image IMG2. In response to a marking operation on the second image IMG2, the control system 200 automatically marks the first portion in the first image IMG1. More specifically, the control system 200 converts the position of the second portion in the second image coordinate system (U2,V2) of the second image IMG2 to its corresponding position in the first image coordinate system (U1,V1) of the first image IMG1 (further details of the conversion process will be described later). Then, the control system 200 automatically marks the portion at the corresponding position in the first image IMG1 as the first portion.
[0044] In this way, in response to a marking operation on the second image IMG2, the corresponding portion in the first image IMG1 is automatically marked. This allows the operator to double-check the marked portion. As mentioned above, the positional accuracy of objects shown in the first image IMG1 is high, and the texture and physical properties of objects shown in the second image IMG2 are easy to grasp. By checking the first portion in the first image IMG1 for the second portion marked in the second image IMG2, it becomes possible to appropriately determine whether or not to register the second portion in the map information MAP.
[0045] Once the operator makes the final decision to register the second portion to the map information MAP, the control system 200 registers the second portion to the map information MAP. The operator may repeat the marking operation.
[0046] 3. Details of autonomous vehicles 3-1. Example Configuration Figure 9 is a block diagram showing an example configuration of an autonomous vehicle 100 according to this embodiment. The autonomous vehicle 100 includes a recognition sensor 110, a vehicle state sensor 120, a position and attitude sensor 130, a communication device 140, a driving device 150, and a control device 160.
[0047] The recognition sensor 110 recognizes (detects) the surrounding environment of the autonomous vehicle 100. The recognition sensor 110 includes one or more 3D measurement sensors 111, one or more cameras 112, etc. The 3D measurement sensor 111 is configured to acquire 3D structural data of the surrounding environment of the autonomous vehicle 100. For example, the 3D measurement sensor 111 is LIDAR (Laser Imaging Detection and Ranging). As another example, the 3D measurement sensor 111 may be radar. The cameras 112 capture images of the surrounding environment of the autonomous vehicle 100. Multiple cameras 112 (e.g., front camera, left camera, right camera, rear camera) may be mounted on the autonomous vehicle 100.
[0048] The vehicle condition sensor 120 detects the state of the autonomous vehicle 100. For example, the vehicle condition sensor 120 includes a speed sensor, an acceleration sensor, a yaw rate sensor, a steering angle sensor, and so on.
[0049] The position and attitude sensor 130 detects the position and attitude (orientation) of the autonomous vehicle 100 in an absolute coordinate system. For example, the position and attitude sensor 130 includes a GNSS (Global Navigation Satellite System), an IMU (Inertial Measurement Unit), etc.
[0050] The communication device 140 communicates with the outside world via a communication network. For example, the communication device 140 communicates with the control system 200. Examples of communication methods include mobile communication such as 4G and 5G, and wireless LAN.
[0051] The running gear 150 includes a steering gear, a drive gear, and a braking gear. The steering gear steers the wheels. For example, the steering gear includes an electric power steering (EPS) system. The drive gear is a power source that generates driving force. Examples of drive gears include an engine, an electric motor, an in-wheel motor, etc. The braking gear generates braking force.
[0052] The control device 160 is a computer that controls the autonomous vehicle 100. The control device 160 includes one or more processors 161 (hereinafter simply referred to as processor 161) and one or more storage devices 162 (hereinafter simply referred to as storage devices 162). The processor 161 performs various processes. Examples of processors 161 include general-purpose processors, application-specific processors, CPUs (Central Processing Units), GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), FPGAs (Field-Programmable Gate Arrays), etc. The processor 161 can also be called a processing circuitry. The storage devices 162 store various information. Examples of storage devices 162 include volatile memory, non-volatile memory, HDDs (Hard Disk Drives), SSDs (Solid State Drives), etc.
[0053] The control program 170 is a computer program for controlling the autonomous vehicle 100. The functions of the control device 160 may be realized through the cooperation of the processor 161 that executes the control program 170 and the storage device 162. The control program 170 is stored in the storage device 162. Alternatively, the control program 170 may be recorded on a computer-readable recording medium.
[0054] The control device 160 acquires driving environment information 180 that indicates the driving environment of the autonomous vehicle 100. The driving environment information 180 is stored in the storage device 162. The driving environment information 180 includes surrounding situation information 181, vehicle status information 182, position and orientation information 183, and map information 184.
[0055] The surrounding situation information 181 is information obtained based on the recognition results of the recognition sensor 110 and indicates the situation around the autonomous vehicle 100. The control device 160 recognizes the situation around the autonomous vehicle 100 using the recognition sensor 110 and acquires the surrounding situation information 181. For example, the surrounding situation information 181 includes 3D structural data (point cloud data) obtained by the 3D measurement sensor 111. As another example, the surrounding situation information 181 includes images captured by the camera 112.
[0056] The surrounding environment information 181 may further include object information about objects around the autonomous vehicle 100. Examples of objects include other vehicles, embankments, cliffs, obstacles, etc. The object information indicates the relative position and relative velocity of the object with respect to the autonomous vehicle 100. For example, by analyzing images obtained by the camera 112, an object can be identified and its relative position can be calculated. Alternatively, an object can be identified and its relative position and relative velocity can be obtained based on 3D structural data (point cloud data) obtained by the 3D measurement sensor 111.
[0057] Vehicle status information 182 is information detected by the vehicle status sensor 120 and indicates the status of the autonomous vehicle 100. The status of the autonomous vehicle 100 includes vehicle speed, acceleration, yaw rate, steering angle, etc. The control device 160 acquires the vehicle status information 182 from the vehicle status sensor 120.
[0058] The position and attitude information 183 indicates the position and attitude (orientation) of the autonomous vehicle 100 in an absolute coordinate system. The control device 160 acquires the position and attitude information 183 from the detection results of the position and attitude sensor 130.
[0059] Map information 184 shows a map of a predetermined area AR. Map information 184 may be the same as map information MAP managed by the control system 200. Map information 184 is provided by the control system 200. The control device 160 communicates with the control system 200 via the communication device 140 and obtains map information 184.
[0060] The control device 160 communicates with the control system 200 via the communication device 140. The control device 160 may transmit at least a portion of the driving environment information 180 to the control system 200. For example, the control device 160 may transmit images captured by the camera 112 to the control system 200 in real time. The control device 160 may transmit vehicle status information 182 to the control system 200 in real time. The control device 160 may transmit position and attitude information 183 to the control system 200 in real time.
[0061] Furthermore, the control device 160 performs vehicle driving control to control the movement of the autonomous vehicle 100. Vehicle driving control includes steering control, acceleration control, and deceleration control. The control device 160 performs vehicle driving control by controlling the driving device 150 (steering device, drive device, braking device).
[0062] Furthermore, the control device 160 performs autonomous driving control to control the autonomous driving of the autonomous vehicle 100. More specifically, the control device 160 generates a driving plan for the autonomous vehicle 100 based on the driving environment information 180. The driving plan includes a route plan and a speed plan for the autonomous vehicle 100. The route plan is a set of target positions for the autonomous vehicle 100. The speed plan is a set of target speeds for each target position. The combination of the route plan and the speed plan is also called the "target trajectory". That is, the target trajectory includes the target position and target speed for the autonomous vehicle 100. The control device 160 performs vehicle driving control so that the autonomous vehicle 100 follows the target trajectory.
[0063] 3-2. Monitoring Driving Mode When monitoring a designated area AR, the autonomous vehicle 100 is set to monitoring driving mode. For example, an operator uses the user interface 230 of the control system 200 to instruct the start of monitoring driving mode. The control system 200 communicates with the autonomous vehicle 100 and instructs the autonomous vehicle 100 to start monitoring driving mode. The control device 160 of the autonomous vehicle 100 starts monitoring driving mode in response to the instruction from the control system 200. The control device 160 performs autonomous driving control so that the autonomous vehicle 100 drives autonomously within the designated area AR.
[0064] The target driving route in the designated area AR may be specified in advance by the operator. In this case, the operator inputs the target driving route in the designated area AR using the user interface 230 of the control system 200. The control system 200 communicates with the autonomous vehicle 100 and provides the autonomous vehicle 100 with information on the target driving route. The control device 160 of the autonomous vehicle 100 performs autonomous driving control so that the autonomous vehicle 100 follows the target driving route.
[0065] During the monitoring driving mode, the control device 160 may transmit at least a portion of the driving environment information 180 to the control system 200. For example, the control device 160 may transmit images captured by the camera 112 to the control system 200 in real time. The control device 160 may transmit vehicle status information 182 to the control system 200 in real time. The control device 160 may transmit position and attitude information 183 to the control system 200 in real time.
[0066] 3-2-1. Target detection process During the monitoring driving mode, the control device 160 recognizes the surrounding conditions of the autonomous vehicle 100 using the recognition sensor 110 and acquires surrounding condition information 181. For example, the surrounding condition information 181 includes images captured by the camera 112. The surrounding condition information 181 may also include 3D structural data (point cloud data) obtained by the 3D measurement sensor 111.
[0067] Within the designated AR area, "objects" that should be of particular interest include embankments, cliffs, obstacles (e.g., falling rocks, fallen objects, etc.), uneven surfaces (e.g., puddles, sinkholes, large ruts, etc.). The control device 160 detects the presence of such objects based on the surrounding situation information 181. For example, a machine learning model (AI model) capable of detecting objects from the surrounding situation information 181 is prepared in advance and stored in the storage device 162. By inputting the surrounding situation information 181 into the machine learning model, the control device 160 can automatically detect objects around the autonomous vehicle 100.
[0068] 3-2-2. Target Image Acquisition Process When the autonomous vehicle 100 detects an object in its vicinity, the control device 160 acquires an image IMG (target image) containing the detected object. For example, the image IMG (target image) may include a second image IMG2 captured by the camera 112. In another example, the image IMG (target image) may include a first image IMG1, which shows the three-dimensional structure around the autonomous vehicle 100 as seen from above the autonomous vehicle 100.
[0069] Figure 10 is a conceptual diagram illustrating the generation of the first image IMG1 in the autonomous vehicle 100. The 3D measurement sensor 111 acquires 3D structural data PC (point cloud data) around the autonomous vehicle 100. This 3D structural data PC is represented in the sensor coordinate system of the 3D measurement sensor 111.
[0070] The coordinate transformation unit 163 of the control device 160 performs a coordinate transformation from the sensor coordinate system to the vehicle coordinate system (X, Y, Z). The vehicle coordinate system (X, Y, Z) is a coordinate system fixed to the autonomous vehicle 100. The X direction represents the forward direction, the Y direction represents the lateral direction, and the Z direction represents the vertical direction. The installation information (installation position and orientation) of the 3D measurement sensor 111 in the vehicle coordinate system (X, Y, Z) of the autonomous vehicle 100 is known information. The coordinate transformation matrix between the sensor coordinate system and the vehicle coordinate system (X, Y, Z) is predetermined based on the installation information (installation position and orientation) of the 3D measurement sensor 111 in the vehicle coordinate system (X, Y, Z). This coordinate transformation matrix information is stored in the storage device 162 in advance. The coordinate transformation unit 163 uses the coordinate transformation matrix to convert the 3D structure data PC in the sensor coordinate system to the 3D structure data PC in the vehicle coordinate system (X, Y, Z).
[0071] Next, the image generation unit 164 of the control device 160 generates the first image IMG1 from the 3D structural data PC in the vehicle coordinate system (X, Y, Z). In other words, the image generation unit 164 generates the first image IMG1 by converting the 3D structure in the vehicle coordinate system (X, Y, Z) into a 2D image when viewed from above. To put it another way, the image generation unit 164 generates the first image IMG1 by rendering the 3D structure in the vehicle coordinate system (X, Y, Z) while viewing it from above.
[0072] In the first image IMG1, the height (value in the Z direction) of the three-dimensional structure surrounding the autonomous vehicle 100 may be represented by color (RGB). In other words, the first image IMG1 may be a color map image that represents the planar position of the three-dimensional structure while representing the height of the three-dimensional structure by color. The correspondence between height (Z) and color (RGB) is predetermined. This correspondence information is stored in the storage device 162 in advance. The image generation unit 164 converts the height (Z) of the three-dimensional structure to color (RGB) based on the correspondence information and generates the first image IMG1.
[0073] The image generation unit 164 generates a first image IMG1 and also generates scale information 191 related to the first image IMG1. The scale information 191 is information for linking points (pixels) on the first image IMG1 with points in the vehicle coordinate system (X, Y, Z). In other words, the scale information 191 is transformation information for performing coordinate transformations between the first image coordinate system (U1, V1) of the first image IMG1 and the vehicle coordinate system (X, Y, Z). For example, the scale information 191 indicates the position (pixel) of the origin of the vehicle coordinate system (X, Y, Z) within the first image IMG1. The origin of the vehicle coordinate system (X, Y, Z) can also be called the reference point. Furthermore, the scale information 191 shows the correspondence between one pixel on the first image IMG1 and the actual distance. In addition, the scale information 191 shows the correspondence between the color (RGB) of a pixel on the first image IMG1 and its height (Z) in the vehicle coordinate system. This scale information 191 is used for marking processing in the control system 200.
[0074] The image IMG is obtained at the first timing. In other words, the image IMG shows the surrounding conditions of the autonomous vehicle 100 at the first timing. The control device 160 holds position and orientation information 183 at the first timing when the image IMG was acquired. The position and orientation information 183 shows the position and orientation (direction) of the autonomous vehicle 100 in the map coordinate system. This position and orientation information 183 at the first timing is also used in the marking process in the control system 200.
[0075] Furthermore, in order to suppress image blurring, an upper limit may be set for the speed of the autonomous vehicle 100 when acquiring the image. The upper limit is set low enough to sufficiently suppress image blurring. The autonomous vehicle 100 may stop when acquiring the image (i.e., upper limit = 0). When an object is detected around the autonomous vehicle 100, the control device 160 decelerates the autonomous vehicle 100 so that its speed is below the upper limit, and then acquires the image.
[0076] 3-2-3. Information transmission process After acquiring the image IMG, the control device 160 communicates with the control system 200 via the communication device 140 and sends "Marking Reference Information REF" to the control system 200.
[0077] Figure 11 is a conceptual diagram illustrating the marking reference information REF. The marking reference information REF includes one or more images IMG obtained by the target image acquisition process described above. The one or more images IMG include at least one of the first image IMG1 and the second image IMG2. The marking reference information REF also includes position and orientation information 183 at the first timing when the image IMG was acquired.
[0078] Furthermore, the marking reference information REF includes transformation information 190. Transformation information 190 is information for performing coordinate transformations between the image coordinate system (U, V) of the image IMG and the vehicle coordinate system (X, Y, Z). For example, transformation information 190 includes scale information 191 for performing coordinate transformations between the first image coordinate system (U1, V1) of the first image IMG1 and the vehicle coordinate system (X, Y, Z).
[0079] The conversion information 190 may include camera parameter information 192 relating to a camera 112 mounted on the autonomous vehicle 100. The camera parameters include intrinsic parameters and extrinsic parameters. Intrinsic parameters include distortion parameters, focal length, etc. Extrinsic parameters include the installation position and orientation of the camera 112 in the vehicle coordinate system (X, Y, Z). The camera parameter information 192 may be stored in the control system 200 in advance. In that case, it is not necessary to transmit the camera parameter information 192 from the autonomous vehicle 100 to the control system 200.
[0080] 4. Air traffic control system 4-1. Example Configuration Figure 12 is a block diagram showing an example configuration of the control system 200 according to this embodiment. The control system 200 is composed of one or more nodes. The control system 200 includes a communication device 220, a user interface 230, and an information processing device 260.
[0081] The communication device 220 communicates via a communication network. For example, the communication device 220 communicates with an autonomous vehicle 100 within a predetermined area AR. Examples of communication methods include mobile communication such as 4G and 5G, and wireless LAN.
[0082] The user interface 230 provides (presents) various information to the operator (user) and accepts various inputs from the user. The user interface 230 includes a display device 240 and an input device 250. Examples of the display device 240 include a display, touch panel, head-up display, etc. Examples of the input device 250 include a touch panel, mouse, keyboard, microphone, etc. The display device 240 and the input device 250 may be the same touch panel.
[0083] The information processing device 260 includes one or more processors 261 (hereinafter simply referred to as processor 261) and one or more storage devices 262 (hereinafter simply referred to as storage devices 262). The processor 261 performs various processes. Examples of processors 261 include general-purpose processors, application-specific processors, CPUs, GPUs, ASICs, FPGAs, etc. The processor 261 can also be called a processing circuit. The storage devices 262 store various information. Examples of storage devices 262 include volatile memory, non-volatile memory, HDDs, SSDs, etc. For example, the storage device 262 stores map information MAP of a predetermined area AR.
[0084] The information processing device 260 (processor 261) can communicate with the autonomous vehicle 100 via the communication device 220. The information processing device 260 receives the marking reference information REF transmitted from the autonomous vehicle 100. The information processing device 260 may receive the marking reference information REF in real time. The marking reference information REF is stored in the storage device 262. The information processing device 260 may also receive driving environment information 180 transmitted from the autonomous vehicle 100.
[0085] Furthermore, the information processing device 260 (processor 261) can provide (present) various information to the operator via the user interface 230 (display device 240). In addition, the information processing device 260 (processor 261) can receive various inputs from the operator via the user interface 230 (input device 250).
[0086] The control program 270 is a computer program for controlling the control system 200. The functions of the information processing device 260 may be realized through the cooperation of the processor 261 that executes the control program 270 and the storage device 262. The control program 270 is stored in the storage device 262. Alternatively, the control program 270 may be recorded on a computer-readable recording medium.
[0087] 4-2. Information Display Processing The information processing device 260 displays one or more images (IMG) included in the marking reference information REF acquired from the autonomous vehicle 100 on the display device 240. The one or more images (IMG) include at least one of a first image (IMG1) and a second image (IMG2).
[0088] The information processing device 260 may receive an image IMG from the autonomous vehicle 100 in real time and display the received image IMG on the display device 240. When the information processing device 260 receives an image IMG from the autonomous vehicle 100, it may notify the operator through the user interface 230. The notification may be visible information displayed on the display device 240 or audio information output from the speaker.
[0089] Furthermore, the information processing device 260 displays map information MAP of a predetermined area AR on the display device 240.
[0090] Furthermore, the information processing device 260 may display the driving environment information 180 acquired from the autonomous vehicle 100 on the display device 240.
[0091] 4-3. Marking Reception Processing Figure 13 is a conceptual diagram illustrating the marking acceptance process. The information processing device 260 accepts marking operations input through the input device 250.
[0092] For example, the operator marks a first portion of the first image IMG1 using the input device 250. The information processing device 260 acquires information about the first portion of the first image IMG1. This information includes the in-image position (pixels) of the first portion of the first image IMG1. It also includes the color (RGB) of the first portion of the first image IMG1. Based on the scale information 191, the information processing device 260 calculates the position of the first portion in the vehicle coordinate system (X, Y, Z) from the information about the first portion of the first image IMG1. More specifically, the scale information 191 includes the position of the origin of the vehicle coordinate system (X, Y, Z) in the first image IMG1 and the correspondence between one pixel on the first image IMG1 and the actual distance. Based on this scale information 191, the in-image position of the first portion of the first image IMG1 can be converted to a planar position in the vehicle coordinate system (X, Y, Z). Furthermore, the scale information 191 shows the correspondence between the color (RGB) of a pixel on the first image IMG1 and its height (Z) in the vehicle coordinate system. Based on this correspondence, the color of the first part within the first image IMG1 can be converted to the height (Z) of the first part in the vehicle coordinate system (X, Y, Z).
[0093] To convert the position (planar position and height) of the first part in the vehicle coordinate system (X, Y, Z) into information about the first part in the first image IMG1, the reverse of the above conversion process should be performed.
[0094] As an example, the operator marks a second portion of the second image IMG2 using the input device 250. The information processing device 260 acquires information about the second portion of the second image IMG2. This information includes the in-image position (pixels) of the second portion of the second image IMG2. Based on the camera parameter information 192, the information processing device 260 calculates the position of the second portion in the vehicle coordinate system (X, Y, Z) from the in-image position of the second portion of the second image IMG2. Specifically, based on the camera parameter information 192, the information processing device 260 performs a well-known inverse transformation of perspective projection.
[0095] To convert the position of the second part in the vehicle coordinate system (X, Y, Z) to the image position (pixels) of the second part within the second image IMG2, simply perform the reverse of the conversion process described above.
[0096] As described above, a first coordinate transformation is possible between the first image coordinate system (U1, V1) of the first image IMG1 and the vehicle coordinate system (X, Y, Z), and a second coordinate transformation is also possible between the second image coordinate system (U2, V2) of the second image IMG2 and the vehicle coordinate system (X, Y, Z). Therefore, a coordinate transformation is also possible between the first image coordinate system (U1, V1) of the first image IMG1 and the second image coordinate system (U2, V2) of the second image IMG2. Thus, as shown in Figure 7, the information processing device 260 can automatically mark the corresponding portion in the second image IMG2 in response to a marking operation on the first image IMG1. Also, as shown in Figure 8, the information processing device 260 can automatically mark the corresponding portion in the first image IMG1 in response to a marking operation on the second image IMG2.
[0097] The information processing device 260 registers the marked portion (first or second portion) in the image IMG in the map information MAP of a predetermined area AR. As described above, the information processing device 260 obtains the position of the marked portion (first or second portion) in the vehicle coordinate system (X, Y, Z). The marking reference information REF includes position and orientation information 183 at the first timing when the image IMG was acquired. The position and orientation information 183 indicates the position and orientation of the autonomous vehicle 100 in the map coordinate system (S, T) of the map information MAP. Based on the position and orientation information 183, the information processing device 260 converts the position of the marked portion in the vehicle coordinate system (X, Y, Z) to its position in the map coordinate system (S, T). The information processing device 260 displays the marked portion in the map coordinate system (S, T) superimposed on the map information MAP.
[0098] 4-4. Registration Process The information processing device 260 registers the marked portion in the map information MAP based on its position in the map coordinate system (S, T). In other words, the information processing device 260 updates the map information MAP. The information processing device 260 displays the updated map information MAP on the display device 240.
[0099] Figure 14 is a conceptual diagram illustrating an example of the registration process. In the example shown in Figure 14, the information processing device 260 asks the operator via the user interface 230 whether or not to register the marked portion in the map information MAP. For example, an inquiry window is displayed on the display device 240. The operator approves or rejects using the input device 250. If approval to register the marked portion in the map information MAP is received, the information processing device 260 registers the marked portion in the map information MAP and updates the map information MAP. On the other hand, if the operator rejects, the information processing device 260 resets the marking operation. The operator may then repeat the marking operation.
[0100] 5. Recommendation function Parts within an image (IMG) that are recommended to be registered in the map information (MAP) are hereinafter referred to as "recommended parts." For example, recommended parts are the edges of embankments and cliffs. Another example is road obstacles (e.g., rockfalls, fallen objects, etc.). Yet another example is road irregularities (e.g., puddles, sinkholes, large ruts, etc.). The information processing device 260 may automatically extract recommended parts from the image (IMG) and suggest their registration to the operator. This function is hereinafter referred to as the "recommendation function."
[0101] Figure 15 is a conceptual diagram illustrating an example of the recommendation function. In the example shown in Figure 15, obstacles within the image (IMG) are automatically extracted as recommended areas. The information processing device 260 displays the image (IMG) on the display device 240 and points to the recommended areas within the image (IMG). Furthermore, the information processing device 260 asks the operator via the user interface 230 whether or not to register the recommended areas in the map information MAP. For example, an inquiry window is displayed on the display device 240. The operator approves or rejects using the input device 250. Upon receiving approval to register the recommended areas in the map information MAP, the information processing device 260 registers the recommended areas in the map information MAP and updates the map information MAP. The information processing device 260 displays the updated map information MAP on the display device 240.
[0102] Figure 16 is a block diagram showing an example of a functional configuration related to the recommendation function. The recommendation part extraction unit 300 takes an image IMG as input and automatically extracts the recommended part within the image IMG. For example, a machine learning model (AI model) capable of detecting the recommended part within an image IMG is prepared in advance. The recommendation part extraction unit 300 automatically detects and extracts the recommended part within the image IMG by inputting the image IMG into the machine learning model. The machine learning model may output the in-image position of the recommended part within the image IMG. The machine learning model may also output the class (type) of the recommended part.
[0103] In example (B) in Figure 16, the recommended section extraction unit 300 also refers to the current map information MAP. The recommended section extraction unit 300 extracts only recommended sections that are not registered in the current map information MAP. The recommended section extraction unit 300 does not extract recommended sections that are already registered in the current map information MAP. This prevents unnecessary recommendations.
[0104] In example (C) in Figure 16, the recommended portion extraction unit 300 also refers to the marking history information HST, which shows the operator's past marking history. By referring to the marking history information HST, it is possible to understand which parts the operator mainly wants to mark. In other words, by referring to the marking history information HST, it becomes possible to extract recommended portions that should be recommended to the operator with greater accuracy. That is, recommendation accuracy is improved. A machine learning model may also be trained based on the marking history information HST.
[0105] Furthermore, the recommended portion extraction unit 300 may be included in the autonomous vehicle 100 or in the control system 200. In other words, the control device 160 of the autonomous vehicle 100 may automatically extract the recommended portion from the image IMG, or the information processing device 260 of the control system 200 may automatically extract the recommended portion from the image IMG.
[0106] The recommended portion information 310 is information about the extracted recommended portion. The recommended portion information 310 includes the in-image location of the recommended portion within the image IMG. The recommended portion information 310 may also include the class (type) of the recommended portion.
[0107] The information processing device 260 of the control system 200 acquires recommended portion information 310. If the recommended portion extraction unit 300 is included in the autonomous vehicle 100, the information processing device 260 acquires the recommended portion information 310 from the autonomous vehicle 100 via communication. The information processing device 260 displays the image IMG on the display device 240 and points to the recommended portion within the image IMG.
[0108] Furthermore, the information processing device 260 asks the operator via the user interface 230 whether or not to register the recommended portion in the map information MAP. The operator approves or rejects using the input device 250. Upon receiving approval to register the recommended portion in the map information MAP, the information processing device 260 registers the recommended portion in the map information MAP and updates the map information MAP. The conversion from the in-image position of the recommended portion in the image IMG to the position of the recommended portion in the map information MAP is the same as for the marked portion (see Figure 13). The information processing device 260 displays the updated map information MAP on the display device 240.
[0109] On the other hand, if the operator denies it, the information processing device 260 does not register the recommended portion in the map information MAP.
[0110] The operator may perform the marking operation themselves, referring to the recommended section. In other words, the operator may make minor modifications to the recommended section. The processing when the operator performs the marking operation is as described in sections 4-3 and 4-4 above.
[0111] As described above, according to this embodiment, recommended portions of the image (IMG) that are recommended to be registered in the map information MAP of a predetermined area (AR) are automatically extracted. The control system 200 displays the image (IMG) on the display device of the user interface 230 and points to the recommended portions. This recommendation function makes it easier for operators to register (reflect) desired information in the map information MAP. [Explanation of Symbols]
[0112] 1 Area Management System 100 autonomous vehicles 200 Control System 230 User Interfaces AR designated area IMG image MAP Map Information
Claims
1. A control system for managing a designated area, One or more processors, User interface and Equipped with, The one or more processors described above are: By using sensors mounted on the autonomous vehicle within the predetermined area, one or more images showing the surrounding conditions of the autonomous vehicle within the predetermined area are obtained. The one or more images mentioned above are displayed on the display device of the user interface. An operation input through the user interface, which accepts marking a portion of one or more images, The marked portion within the one or more images is registered in the map information of the predetermined area. It is configured in such a way Air traffic control system.
2. A control system according to claim 1, The one or more images mentioned above include a first image showing the three-dimensional structure surrounding the autonomous vehicle within the predetermined area, viewed from above the autonomous vehicle. Air traffic control system.
3. A control system according to claim 2, In the first image, the height of the three-dimensional structure is represented by color. Air traffic control system.
4. A control system according to claim 2, The sensor includes a three-dimensional measurement sensor configured to acquire data of the three-dimensional structure around the autonomous vehicle. The first image is generated by converting the three-dimensional structure into a two-dimensional image when viewed from above. Air traffic control system.
5. A control system according to claim 4, The first image is generated by the autonomous vehicle and transmitted from the autonomous vehicle to the control system. Air traffic control system.
6. A control system according to claim 1, The aforementioned one or more images include a second image captured by a camera mounted on the autonomous vehicle within the predetermined area. Air traffic control system.
7. A control system according to claim 1, The above one or more images are A first image shows the three-dimensional structure surrounding the autonomous vehicle within the predetermined area, viewed from above the autonomous vehicle. A second image captured by a camera mounted on the autonomous vehicle within the predetermined area, and including Air traffic control system.
8. A control system according to claim 7, The one or more processors further include: The first image and the second image are displayed on the display device. An operation input through the user interface, which accepts marking a first portion of the first image, The second image is automatically marked with the second portion corresponding to the first portion. It is configured in such a way Air traffic control system.
9. A control system according to claim 7, The one or more processors further include: The first image and the second image are displayed on the display device. An operation input through the user interface, which accepts marking a second portion within the second image, The first image is automatically marked with the first portion corresponding to the second portion. It is configured in such a way Air traffic control system.
10. A control system according to claim 1, The one or more processors further include: Transformation information is obtained to perform a coordinate transformation between the image coordinate system of the one or more images and the vehicle coordinate system. Based on the conversion information, the in-image position of the marked portion in the one or more images is converted to a position in the vehicle coordinate system. Based on the position in the vehicle coordinate system, the marked portion is registered in the map information of the predetermined area. It is configured in such a way Air traffic control system.
11. A control system according to claim 10, The one or more images mentioned above include a first image showing the three-dimensional structure around the autonomous vehicle as viewed from above the autonomous vehicle. The conversion information includes scale information that shows the correspondence between pixels on the first image and actual distances, The one or more processors further include: An operation input through the user interface, which accepts marking a first portion of the first image, Based on the scale information, the in-image position of the first portion within the first image is converted to a position in the vehicle coordinate system. It is configured in such a way Air traffic control system.
12. A control system according to claim 11, In the first image, the height of the three-dimensional structure is represented by color. The scale information further indicates the correspondence between the color and the height. The one or more processors further include: Based on the correspondence between the color and the height, the color of the first portion in the first image is converted to the height of the first portion in the vehicle coordinate system. It is configured in such a way Air traffic control system.
13. A control system according to claim 10, The map coordinate system is the coordinate system of the map information for the predetermined area. The above one or more images show the surrounding conditions of the autonomous vehicle at the first timing. The one or more processors further include: Position and orientation information indicating the position and orientation of the autonomous vehicle at the first timing in the map coordinate system is acquired. Based on the position and orientation information, the position in the vehicle coordinate system is converted to the position in the map coordinate system. Based on the position in the aforementioned map coordinate system, the marked portion is registered in the map information of the predetermined area. It is configured in such a way Air traffic control system.
14. A control system according to claim 1, The one or more processors further include: The system automatically extracts recommended portions from the one or more images that are recommended to be registered in the map information. The above one or more images are displayed on the display device, and the recommended portion is indicated. It is configured in such a way Air traffic control system.
15. A control system according to claim 14, The one or more processors further include: The user interface inquires whether or not to register the recommended portion in the map information. If approval is received to register the recommended portion in the map information, the recommended portion will be registered in the map information. It is configured in such a way Air traffic control system.
16. A control system for managing a designated area, One or more processors, User interface and Equipped with, The one or more processors described above are: By using sensors mounted on the autonomous vehicle within the predetermined area, one or more images showing the surrounding conditions of the autonomous vehicle within the predetermined area are obtained. The system automatically extracts recommended portions from the one or more images that are recommended to be registered in the map information of the predetermined area. The above one or more images are displayed on the user interface display device, and the recommended portion is indicated. It is configured in such a way Air traffic control system.
17. A control system according to claim 16, The one or more processors further include: The user interface inquires whether or not to register the recommended portion in the map information. If approval is received to register the recommended portion in the map information, the recommended portion will be registered in the map information. It is configured in such a way Air traffic control system.
Citation Information
Patent Citations
Autonomous travel vehicle control system and autonomous travel vehicle control method
JP2024166875A
