Control device

By using measurement and reference point cloud data matching in the control device and adjusting point cloud density according to the appearance characteristics of the moving object, the problem of insufficient position matching accuracy in the prior art is solved, and more accurate driverless driving control is achieved .

CN119065359APending Publication Date: 2024-12-03TOYOTA JIDOSHA KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410670705.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-11-02
Filing Date
2024-05-28
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In the prior art, when using the three-dimensional point cloud data acquired by the distance measurement device to match the position and orientation of the moving object, the accuracy is insufficient, and it is difficult to appropriately control the movement of the moving object.

Method used

By generating the control device, the measured point cloud data and reference point cloud data are used to match, the appearance characteristic information of the moving object is obtained, and the density of the point cloud data is adjusted based on this information to improve the matching accuracy.

Benefits of technology

The accuracy of matching the position and orientation of moving objects is improved, making the generation of driverless driving control commands more accurate, and achieving more accurate moving object control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119065359A_ABST
    Figure CN119065359A_ABST
Patent Text Reader

Abstract

The control apparatus for generating a control command for moving a moving object by driver-free driving includes: a matching section configured to perform matching using measurement point cloud data and reference point cloud data to generate a control command; and a moving object information acquisition section configured to acquire moving object information identifying an appearance feature of the moving object. The matching section is configured to perform matching in accordance with the moving object information. The measured point cloud data is three-dimensional point cloud data about the moving object acquired by using a distance measuring device. The reference point cloud data is data representing three-dimensional point cloud data for reference.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a control device. Background Art

[0002] Japanese Unexamined Patent Application Publication No. 2017-538619 (a translation of a PCT application) discloses a technology in which, in the process of manufacturing a vehicle, the vehicle is caused to travel autonomously or by remote control. Summary of the invention

[0003] In order to control the movement of a mobile object such as a vehicle by autonomous control or remote control, a technology is known in which the position and orientation of the mobile object are estimated by matching using three-dimensional point cloud data about the mobile object acquired by using a distance measuring device. In order to appropriately control the movement of the mobile object, a technology for improving the accuracy in such matching is desired.

[0004] The present disclosure can be implemented in the following forms.

[0005] According to a first aspect of the present disclosure, a control device for generating a control command for moving a mobile object by driving without a driver includes: a matching unit configured to match using measured point cloud data and reference point cloud data to generate a control command; and a mobile object information acquisition unit configured to acquire mobile object information for identifying appearance features of the mobile object. The matching unit is configured to perform matching based on the mobile object information. The measured point cloud data is three-dimensional point cloud data about the mobile object acquired by using a distance measuring device. The reference point cloud data is data representing three-dimensional point cloud data for reference. According to this form, matching using the measured point cloud data about the mobile object can be performed based on the appearance features of the mobile object. Therefore, the possibility of being able to perform matching with accuracy increases.

[0006] In the control device according to the first aspect of the present disclosure, the mobile object information may include model information for identifying the model of the mobile object. The reference point cloud data may include model point cloud data corresponding to the model. The matching unit may be configured to perform matching by using the model point cloud data according to the model information. According to this form, since the model point cloud data corresponding to the model of the mobile object can be used in the matching, the possibility of being able to perform matching with accuracy is further increased.

[0007] In the control device according to the first aspect of the present disclosure, the mobile object information may include manufacturing information for managing a process of manufacturing the mobile object as the model information. According to this form, the manufacturing information may be used for the model information.

[0008] In the control device according to the first aspect of the present disclosure, the matching section may be configured to change at least one of the density of the point cloud in the measurement point cloud data and the density of the point cloud in the reference point cloud data according to the mobile object information. According to this form, by changing at least one of the density of the point cloud in the measurement point cloud data and the density of the point cloud in the reference point cloud data in matching according to the mobile object information, the possibility of being able to perform matching with accuracy can be increased.

[0009] In the control device according to the first aspect of the present disclosure, the matching section may be configured to change at least one of the density of the point cloud in the measurement point cloud data and the density of the point cloud in the reference point cloud data according to the distance between the distance measuring device and the mobile object. According to this form, since at least one of the density of the point cloud in the measurement point cloud data and the density of the point cloud in the reference point cloud data in the matching is changed according to the distance between the distance measuring device and the mobile object in addition to the mobile object information, the possibility of being able to accurately perform matching can be further increased.

[0010] According to a second aspect of the present disclosure, a control device for generating a control command for moving a mobile object by driving without a driver includes a processor. The processor is configured to match using measured point cloud data and reference point cloud data to generate a control command. The processor is configured to obtain mobile object information for identifying appearance features of the mobile object. The processor is configured to perform matching based on the mobile object information. The measured point cloud data is three-dimensional point cloud data about the mobile object obtained by using a distance measuring device. The reference point cloud data is data representing three-dimensional point cloud data for reference.

[0011] The present disclosure may be realized in a form other than the above-described form as a control device, for example, as a system, a control method, a computer program for realizing the control method, a non-transitory storage medium storing the computer program, or the like. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described below with reference to the accompanying drawings, in which like symbols represent like elements, and in which: Figure 1 is a conceptual diagram showing the configuration of the system; Figure 2 is a block diagram showing the configuration of a vehicle and a control device; Figure 3 is an explanatory diagram showing an example of a matching condition in the first embodiment; Figure 4A is a flowchart showing a processing procedure for vehicle travel control in the first embodiment; Figure 4B is a flowchart of the command generation process; Figure 5 is an explanatory diagram showing an example of a matching condition in the second embodiment; Figure 6 is a conceptual diagram showing the configuration of a system in a third embodiment; and Figure 7 is a flowchart showing a processing procedure for vehicle travel control in the third embodiment. DETAILED DESCRIPTION A. First Embodiment

[0013] Figure 1 is a conceptual diagram showing the configuration of the system 10 in the present embodiment. The system 10 includes: one or more vehicles 100 each as a moving object, a server 200 for generating a control command for remotely controlling the vehicle 100, a plurality of distance measuring devices 300 for measuring three-dimensional point cloud data about the vehicle 100, and a process management device 400 for managing the process of manufacturing the vehicle 100. In the first embodiment, the server 200 is an example of a “control device” in the present disclosure.

[0014] In the present disclosure, a "mobile object" refers to an object that can move, and examples thereof include vehicles and electric vertical take-off and landing aircraft (so-called flying cars). The vehicle 100 may be a vehicle that travels using wheels or a vehicle that travels using a circular track, and examples thereof include passenger cars, motor trucks, buses, two-wheeled vehicles, four-wheeled vehicles, tanks, construction vehicles, and the like. The vehicle 100 includes a pure electric vehicle (Battery Electric Vehicle, BEV), a gasoline vehicle, a hybrid electric vehicle, and a fuel cell electric vehicle. When the mobile object is not the vehicle 100, the expressions "vehicle" and "car" in the present disclosure may be replaced with "mobile object" when appropriate, and the expression "travel" may be replaced with "move" when appropriate.

[0015] The vehicle 100 is configured to be able to travel by driverless driving. "Driverless driving" refers to driving that is not based on driving manipulation by an occupant. Driving manipulation refers to manipulation related to at least any one of "driving", "steering" and "stopping" of the vehicle 100. Driverless driving is achieved by automatic or manual remote control using a device located outside the vehicle 100 or by autonomous control of the vehicle 100. Occupants who do not perform driving manipulations can ride in the vehicle 100 that travels by driverless driving. Examples of occupants who do not perform driving manipulations include people who simply sit on a seat of the vehicle 100 and people who perform work other than driving manipulations (such as installation, inspection, or operation of switches, etc.) while riding in the vehicle 100. Note that in some cases, driving based on driving manipulations by an occupant is referred to as "manned driving".

[0016] In this specification, “remote control” includes “full remote control” in which all operations of the vehicle 100 are completely determined from the outside of the vehicle 100 and “partial remote control” in which one or some operations of the vehicle 100 are determined from the outside of the vehicle 100. “Autonomous control” includes “full autonomous control” in which the vehicle 100 autonomously controls its own operation without receiving any information from a device outside the vehicle 100 and “partial autonomous control” in which the vehicle 100 autonomously controls its own operation by using information received from a device outside the vehicle 100.

[0017] Preferably, the vehicle 100 is a battery electric vehicle (BEV).

[0018] The system 10 in this embodiment is configured as a remote control system that causes the vehicle 100 to travel by remote control. In this embodiment, the remote control of the vehicle 100 is performed in a factory that manufactures the vehicle 100. The factory includes a first location PL1 and a second location PL2. The first location PL1 is, for example, a location where the assembly of the vehicle 100 is performed, and the second location PL2 is, for example, a location where the inspection of the vehicle 100 is performed. The first location PL1 and the second location PL2 are connected by a driving lane SR on which the vehicle 100 can travel. Any position in the factory is represented by an xyz coordinate value of a standard coordinate system ∑r.

[0019] With respect to the vehicle 100 as the object of measurement, a plurality of distance measuring devices 300 are installed around the driving lane SR. The server 200 can obtain the relative position and relative orientation of the vehicle 100 relative to the target route TR and the direction in which the vehicle 100 is traveling in real time by using the three-dimensional point cloud data measured by each distance measuring device 300. For the distance measuring device 300, a camera or light detection and ranging (LiDAR) can be used. In particular, LiDAR is preferred in terms of being able to obtain high-precision three-dimensional point cloud data. Each distance measuring device 300 in the present embodiment is configured by using LiDAR. In the present embodiment, the position of each distance measuring device 300 is fixed, and the relative relationship between the standard coordinate system ∑r and the device coordinate system of each distance measuring device 300 is known. A coordinate transformation matrix for transforming the coordinate values ​​of the standard coordinate system ∑r into the coordinate values ​​of the device coordinate system of each distance measuring device 300 (and vice versa) is pre-stored in the server 200.

[0020] The server 200 in the present embodiment is configured to generate a control command for remote control of the vehicle 100 and transmit it to the remote control device of the vehicle 100. More specifically, the server 200 generates a control command for causing the vehicle 100 to travel along the target route TR and transmits the control command to the vehicle 100. The vehicle 100 travels according to the received control command. Therefore, using the system 10, the vehicle 100 can be moved from the first location PL1 to the second location PL2 by remote control without using a transport device such as a crane or a conveyor. Note that the target route TR in the present embodiment corresponds to a reference path to be described later. The details of the control command will be described later.

[0021] Figure 2 1 is a block diagram showing the configuration of the vehicle 100 and the server 200. The vehicle 100 includes: a vehicle control device 110 for controlling each part of the vehicle 100, an actuator 120 driven under the control of the vehicle control device 110, a communication device 130 for communicating with the server 200 through wireless communication; and a Global Navigation Satellite System (GNSS) receiver 140 for acquiring position information about the vehicle 100. In the present embodiment, the actuator 120 includes an actuator of a drive train for accelerating the vehicle 100, an actuator of a steering system for changing the driving direction of the vehicle 100, and an actuator of a braking device for decelerating the vehicle 100. The drive train includes a battery, a traction motor driven by power from the battery, and a drive wheel rotated by the traction motor. The actuator of the drive train includes a traction motor. Note that the actuator 120 may also include an actuator for swinging a wiper of the vehicle 100, an actuator for opening and closing an electric window of the vehicle 100, and the like.

[0022] The vehicle control device 110 is configured by using a computer including a processor 111, a memory 112, an input-output interface 113, and an internal bus 114. The processor 111, the memory 112, and the input-output interface 113 are connected through the internal bus 114 in a manner capable of two-way communication. The actuator 120, the communication device 130, and the GNSS receiver 140 are connected to the input-output interface 113.

[0023] In the present embodiment, the processor 111 functions as a vehicle control unit 115 and a position information acquisition unit 116 by executing a program PG1 pre-stored in the memory 112. The vehicle control unit 115 controls the actuator 120. When the driver rides on the vehicle 100, the vehicle control unit 115 can make the vehicle 100 travel by controlling the actuator 120 according to the driver's manipulation. The vehicle control unit 115 can also make the vehicle 100 travel by controlling the actuator 120 according to a control command sent from the server 200 regardless of whether the driver rides on the vehicle 100. The position information acquisition unit 116 acquires position information indicating the current position of the vehicle 100 by using the GNSS receiver 140. However, the position information acquisition unit 116 and the GNSS receiver 140 may be omitted.

[0024] The server 200 is configured by using a computer including a processor 201, a memory 202, an input-output interface 203, and an internal bus 204. The processor 201, the memory 202, and the input-output interface 203 are connected through the internal bus 204 in a manner capable of two-way communication. A communication device 205 for communicating with the vehicle 100, the distance measurement device 300, and the process management device 400 by wireless communication is connected to the input-output interface 203.

[0025] In the present embodiment, the processor 201 functions as a three-dimensional point cloud data acquisition unit 210, a vehicle information acquisition unit 215, a matching unit 220, a matching condition determination unit 225, an estimation unit 230, and a command generation unit 240 by executing a program PG2 pre-stored in the memory 202. In addition to the program PG2, reference point cloud data 250, a target route TR, and correction data 260, which will be described later, are stored in the memory 202.

[0026] The three-dimensional point cloud data acquisition section 210 acquires three-dimensional point cloud data about the vehicle 100 measured by each distance measuring device 300. The three-dimensional point cloud data is data indicating the three-dimensional position of a point detected by each distance measuring device 300. The three-dimensional point cloud data about the mobile object measured by the distance measuring device 300 is also referred to as measured point cloud data.

[0027] The vehicle information acquisition unit 215 acquires vehicle information capable of identifying the appearance features of the vehicle 100. The vehicle information acquisition unit 215 corresponds to a mobile object information acquisition unit that acquires mobile object information capable of identifying the appearance features of the mobile object. The vehicle information is information capable of identifying the appearance features of the vehicle 100, such as shape, color, pattern, gloss, etc. More specifically, the vehicle information may be information capable of identifying, for example, the body shape of the vehicle 100, the presence or absence and type of external components, the body color, the body material, or the state of the body coating. The state of the body coating is, for example, the presence or absence of the body coating, the number of times the body coating is applied, or the type of coating material.

[0028] The vehicle information in the present embodiment includes identification information Vi about the vehicle 100. The identification information Vi is an example of manufacturing information for managing the process of manufacturing the vehicle 100. The identification information Vi includes model information Ti capable of identifying the model of the vehicle 100. In addition, the identification information Vi in the present embodiment includes body color information Ci capable of identifying the body color of the vehicle 100. In this specification, "model" refers to information that specifies at least the body shape of the vehicle 100 among the appearance features of the vehicle 100. In another embodiment, the "model" may be information that specifies various appearance features of the vehicle 100 (such as the body color of the vehicle 100 and the presence or absence and type of external components) in addition to the body shape.

[0029] The matching unit 220 performs template matching (hereinafter, also referred to as matching) using the measured point cloud data and the reference point cloud data 250. The matching is performed to generate a control command for the vehicle 100. For the matching algorithm, any of various algorithms can be used, such as iterative closest point (ICP) and normal distribution transform (NDT).

[0030] The reference point cloud data 250 in this embodiment includes model point cloud data 251 corresponding to the model of the vehicle 100. More specifically, in order to correspond to a plurality of models, the reference point cloud data 250 includes a plurality of model point cloud data 251 respectively associated with the respective models.

[0031] The matching condition decision unit 225 decides the matching condition based on the vehicle information acquired by the vehicle information acquisition unit 215. The matching unit 220 performs matching based on the matching condition decided by the matching condition decision unit 225. That is, the matching unit 220 performs matching based on the vehicle information. The details of the matching condition will be described later.

[0032] Figure 3 : is an explanatory diagram showing an example of the matching condition determined in the present embodiment. Figure 3The corresponding relationship between the identification information Vi and the matching condition is shown. More specifically, Figure 3 Identification information Vi, appearance features (appearance specifications) identified by the identification information Vi, and matching conditions determined based on the identification information Vi are shown.

[0033] Figure 3 The identification information Vi1 shown in includes model information Ti1 and body color information Ci1. The identification information Vi2 includes model information Ti2 and body color information Ci2. The identification information Vi3 includes model information Ti1 and body color information Ci3. Model information Ti1 is model information Ti capable of identifying a model of a specified body shape BS1. Model information Ti2 is model information Ti capable of identifying a model of a specified body shape BS2. The body color information Ci1 and the body color information Ci2 are each information that specifies white as the body color. The body color information Ci3 is information that specifies black as the body color. That is, for example, the vehicle 100 identified by the identification information Vi1 has a body shape BS1 and a body color of white.

[0034] like Figure 3 As shown, matching condition MC1 is correspondingly applied to identification information Vi1. Matching condition MC1 stipulates that model point cloud data TP1 is used in matching and the density of the point cloud in model point cloud data TP1 is set to density ds1. Matching condition MC2 is correspondingly applied to identification information Vi2. Matching condition MC2 stipulates that model point cloud data TP2 is used in matching and the density of the point cloud in model point cloud data TP2 is set to density ds1. Matching condition MC3 is correspondingly applied to identification information Vi3. Matching condition MC3 stipulates that model point cloud data TP1 is used in matching and the density of the point cloud in model point cloud data TP1 is set to density ds2. Density ds2 is a lower density than density ds1.

[0035] The estimation unit 230 estimates the position and orientation of the vehicle 100 by using the result of the matching performed by the matching unit 220. The position and orientation estimated by the estimation unit 230 correspond to the vehicle position information to be described later. In the present embodiment, the position of the vehicle 100 is estimated as the xyz coordinates of a predetermined detection point on the vehicle 100. The orientation of the vehicle 100 is calculated as the orientation of a vector that travels from the rear side of the vehicle 100 toward the front side along the central axis of the vehicle 100. For example, the vector is identified by using the coordinates of the center position in the vehicle width direction of the front side of the vehicle 100 and the coordinates of the center position in the vehicle width direction of the rear side of the vehicle 100. Note that the position and orientation of the vehicle 100 only need to be estimated in a manner that can be used in the generation of a control command for driverless driving, and the manner of position estimation and orientation estimation is not limited thereto. When three-dimensional point cloud data cannot be used, the estimation unit 230 can estimate the position and orientation of the vehicle 100 by using the driving history of the vehicle 100 or the position information detected by the GNSS receiver 140 installed in the vehicle 100. The estimation section 230 may estimate only one of the position and orientation of the vehicle 100. In this case, the other of the position and orientation of the vehicle 100 is determined, for example, by using the travel history of the vehicle 100. Note that the travel direction of the vehicle 100 may be estimated by using, for example, any one or more of the orientation of the vehicle 100, the travel history, and the history of control commands.

[0036] By using the estimated position and orientation of the vehicle 100, the command generation section 240 generates a control command for causing the vehicle 100 to travel by driverless driving and transmits the control command to the vehicle 100. In the present embodiment, the control command is a command for causing the vehicle 100 to travel according to the target route TR stored in the memory 202. Specifically, the control command in the present embodiment is a travel control signal to be described later.

[0037] Note that the control command for driving the vehicle 100 by driving without a driver may include at least one of a driving control signal and generation information for generating the driving control signal. Therefore, in another embodiment, the control command may further include generation information instead of or in addition to the driving control signal. For the generation information, for example, vehicle position information, a path, or a target position to be described later may be used.

[0038] The process management device 400 in this embodiment is configured by using a computer. The process management device 400 manages the overall process of manufacturing the vehicle 100 in the factory based on the various manufacturing information included in the manufacturing information data Pi. The manufacturing information data Pi includes the above-mentioned identification information Vi. For example, the identification information Vi is acquired by the process management device 400 from a radio frequency identification (RF-ID) tag attached to the vehicle 100 via short-range wireless communication. For example, when a vehicle 100 starts traveling along the target route TR, the identification information Vi identifying the vehicle 100 is sent from the process management device 400 to the server 200. The position of the vehicle 100 detected by the server 200 is also sent to the process management device 400. Note that the functions of the process management device 400 can be implemented in the same device as the server 200.

[0039] Figure 4A 1 is a flowchart showing a processing procedure for driving control of the vehicle 100 in the first embodiment. In S1, the server 200 obtains vehicle position information about the vehicle 100 by using a detection result output from an external sensor as a sensor located outside the vehicle 100. The vehicle position information is position information used as a basis for generating a driving control signal. In the present embodiment, the vehicle position information includes the position and orientation of the vehicle 100 in the standard coordinate system ∑r of the factory. In the present embodiment, the standard coordinate system ∑r of the factory is a global coordinate system, and an arbitrary position in the factory is represented by X, Y, and Z coordinates in the global coordinate system. In the present embodiment, the external sensor is a distance measuring device 300 installed in the factory, and measurement point cloud data as a detection result is output from each distance measuring device 300. In other words, in S1, the server 200 obtains the vehicle position information by using the measurement point cloud data acquired from the distance measuring device 300 as an external sensor. Specifically, the server 200 obtains the vehicle position information by template matching using the measurement point cloud data and the reference point cloud data 250.

[0040] In S2, the server 200 determines the target position that the vehicle 100 is to go to next. In the present embodiment, the target position is represented by X, Y, and Z coordinates in a global coordinate system. In addition, a reference path, which is a path along which the vehicle 100 travels, is pre-stored in the memory of the server 200. The path is represented by a node indicating a starting point, a node indicating a waypoint, a node indicating a destination, and a link connecting each node. The server 200 determines the target position that the vehicle 100 is to go to next by using the vehicle position information and the reference path. The server 200 determines the target position on the reference path ahead of the current position of the vehicle 100.

[0041] In S3, the server 200 generates a driving control signal for driving the vehicle 100 toward the determined target position. In the present embodiment, the driving control signal includes the acceleration rate and the steering wheel angle of the vehicle 100 as parameters. The server 200 calculates the driving speed of the vehicle 100 from the change in the position of the vehicle 100, and compares the calculated driving speed with the target speed. The server 200 determines the acceleration rate to accelerate the vehicle 100 when the driving speed is less than the target speed as a whole, and determines the acceleration rate to decelerate the vehicle 100 when the driving speed is greater than the target speed as a whole. In addition, the server 200 determines the steering wheel angle and the acceleration rate when the vehicle 100 is located on the reference path so that the vehicle 100 does not deviate from the reference path, and when the vehicle 100 is not located on the reference path, in other words, when the vehicle 100 deviates from the reference path, the steering wheel angle and the acceleration rate are determined so that the vehicle 100 returns to the reference path. In another embodiment, instead of or in addition to the acceleration rate of the vehicle 100, the driving control signal may include the speed of the vehicle 100 as a parameter.

[0042] In S4, the server 200 transmits the generated travel control signal to the vehicle 100. The server 200 repeats a cycle of obtaining vehicle position information, determining a target position, generating a travel control signal, transmitting the travel control signal, etc. in each predetermined period.

[0043] Note that in S1 to S4 in the present embodiment, specifically, a command generation process to be described later is performed.

[0044] In S5, the vehicle 100 receives the travel control signal transmitted from the server 200. In S6, the vehicle 100 controls the actuator of the vehicle 100 by using the received travel control signal, thereby causing the vehicle 100 to travel at the acceleration rate and the steering wheel angle indicated by the travel control signal. The vehicle 100 repeats a cycle of receiving the travel control signal and controlling the actuator of the vehicle 100 in each predetermined cycle. According to the system 10 in the present embodiment, the vehicle 100 can be caused to travel by remote control, and the vehicle 100 can be moved without using transportation equipment such as a crane or a conveyor.

[0045] Figure 4B is a flowchart of the command generation process for implementing the control method in this embodiment. The command generation process is performed whenever the three-dimensional point cloud data acquisition unit 210 acquires new measurement point cloud data from the distance measurement device 300 responsible for measuring the vehicle 100 without a driver. For example, before starting the command generation process, the three-dimensional point cloud data acquisition unit 210 may perform preprocessing to remove background point cloud data representing a stationary object from the newly acquired measurement point cloud data. Hereinafter, the vehicle 100 without a driver is also referred to as the target vehicle 100.

[0046] In S100, the vehicle information acquisition unit 215 acquires vehicle information about the target vehicle 100. In the present embodiment, in S100, the vehicle information acquisition unit 215 acquires the identification information Vi sent from the process management device 400 as vehicle information. In S110, the matching condition determination unit 225 determines the matching condition based on the vehicle information acquired in S100. In S120, the matching unit 220 performs matching based on the matching condition determined in S110.

[0047] In this embodiment, in S120, the matching unit 220 performs matching according to the model information Ti by using the model point cloud data TP1 or the model point cloud data TP2. For example, in S100, when the body shape of the target vehicle 100 is the body shape BS1 and its body color is white, the target vehicle 100 is obtained. Figure 3 As vehicle information about the vehicle 100, identification information Vi1 shown in S120 is used. In this case, in S120, according to the matching condition MC1 decided in S110, the model point cloud data TP1 is used in the matching. In S100, when the body shape of the target vehicle 100 is the body shape BS2 and its body color is white, identification information Vi2 is acquired as vehicle information about the target vehicle 100. In this case, in S120, according to the matching condition MC2 decided in S110, the model point cloud data TP2 is used in the matching.

[0048] Furthermore, in the present embodiment, in S120, the matching section 220 changes the density of the point cloud in the matching according to the vehicle information. More specifically, the matching section 220 changes the density of the point cloud in the reference point cloud data 250 according to the vehicle body color information Ci. For example, when the body shape of the target vehicle 100 is the body shape BS1 and its body color is black, in S100, the identification information Vi3 is acquired as the vehicle information about the target vehicle 100. In this case, in S120, according to the matching condition MC3 decided in S110, the matching is performed in a state where the density of the point cloud in the model point cloud data TP1 is set to the density ds2. When the identification information Vi1 is acquired in S100 as described above, in S120, according to the matching condition MC1, the matching is performed in a state where the density of the point cloud in the model point cloud data TP1 is set to the density ds1.

[0049] The matching section 220 in the present embodiment uses the correction data 260 to implement the density change of the point cloud according to the vehicle information. The correction data 260 is data for correcting the density of the point cloud in the reference point cloud data 250, and is data that records, for example, a reduction rate of reducing the density of the point cloud in the reference point cloud data 250 for each vehicle body color. Note that in another embodiment, for example, the reference point cloud data 250 including a density different from that of other vehicle body colors may be recorded in the memory 202 for each vehicle body color, and the matching section 220 may use the reference point cloud data 250 according to the vehicle information in the matching, thereby enabling the density change of the point cloud according to the vehicle information to be implemented.

[0050] The appearance features of the vehicle 100, in particular, the state of the body color or the body coating, affect the density of the point cloud in the measured point cloud data about the vehicle 100. For example, when the body color of the vehicle 100 is white, the light reflectivity of the body surface of the vehicle 100 is higher than, for example, when the body color is black, and therefore the density of the point cloud in the measured point cloud data is higher. Therefore, as in the present embodiment, by setting the density of the point cloud in the reference point cloud data 250 to the density ds1 of the vehicle 100 having the body color of white for matching, and by setting the density of the point cloud in the reference point cloud data 250 to the density ds2 lower than the density ds1 of the vehicle 100 having the body color of black for matching, the possibility that the accuracy of matching for each vehicle 100 can be improved increases. The above-mentioned correction data 260 is defined based on the results of experiments or simulations, for example, in such a way that the matching accuracy of each vehicle 100 with each body color becomes a predetermined accuracy or more. Note that in another embodiment, in matching, the density of the point cloud in the measured point cloud data can be changed according to the vehicle information. Furthermore, in the matching, both the density of the point cloud in the measurement point cloud data and the density of the point cloud in the reference point cloud data 250 may be changed according to the vehicle information.

[0051] In S130, the estimation section 230 estimates the position and orientation of the target vehicle 100 by using the result of the matching performed in S120. In S140, the command generation section 240 generates a control command by using the position and orientation estimated in S130. The control command thus generated is sent to the target vehicle 100. The vehicle control section 115 of the target vehicle 100 controls the actuator 120 by using the received control command to drive the target vehicle 100.

[0052] According to the server 200 in the present embodiment described above, the matching unit 220 performs matching based on the vehicle information capable of identifying the appearance features of the vehicle 100 under control. Therefore, matching can be performed based on the appearance features of the vehicle 100. Therefore, for example, even if various vehicles 100 having appearance features different from each other are to be remotely controlled, matching can be performed based on the appearance features of each vehicle 100. Therefore, the possibility of being able to perform matching with accuracy in the system 10 increases.

[0053] Furthermore, in the present embodiment, the matching section 220 performs matching according to the model information Ti by using the model point cloud data 251. Therefore, since the model point cloud data 251 corresponding to the model of the vehicle 100 can be used for matching, the possibility of being able to perform matching with accuracy further increases.

[0054] Furthermore, in the present embodiment, the vehicle information includes manufacturing information about the vehicle 100 as the model information Ti. Thus, the manufacturing information about the vehicle 100 can be used for the model information Ti. Therefore, for example, in a factory that manufactures the vehicle 100, by using the manufacturing information about the vehicle 100 for the model information Ti, matching using the model point cloud data 251 can be easily performed.

[0055] In addition, in the present embodiment, the matching unit 220 changes at least one of the density of the point cloud in the measurement point cloud data and the density of the point cloud in the reference point cloud data 250 according to the vehicle information. Therefore, by changing the density of the point cloud in matching according to the vehicle information, the possibility of being able to perform matching with accuracy can be increased. B. Second Embodiment

[0056] Figure 5 is a schematic diagram for describing an example of a matching condition decided in the second embodiment. Figure 5 The correspondence between the combination of vehicle information and separation distance and the matching condition is shown. "Separation distance" means the distance between the target vehicle 100 and the distance measuring device 300 responsible for measuring the target vehicle 100. In the present embodiment, for the separation distance of the vehicle 100, the distance measured by the distance measuring device 300 is used. In the second embodiment, unlike the first embodiment, in addition to the vehicle information, the density of the point cloud in the matching is changed according to the separation distance. In the configuration of the server 200 and the system 10 in the second embodiment, the parts not specifically described are similar to those in the first embodiment.

[0057] exist Figure 5In the example of , the matching condition MC1 is correspondingly applied to the combination of the identification information Vi1 and the separation distance d1. The matching condition MC2 is correspondingly applied to the combination of the identification information Vi2 and the separation distance d1. The matching condition MC2b is correspondingly applied to the combination of the identification information Vi2 and the separation distance d2. The separation distance d2 is longer than the separation distance d1. The matching condition MC2b specifies that the density of the point cloud in the match is a density ds1b lower than the density ds1 specified by the matching condition MC2. The matching condition MC3 is correspondingly applied to the combination of the identification information Vi3 and the separation distance d1. The matching condition MC3b is correspondingly applied to the combination of the identification information Vi3 and the separation distance d2. The matching condition MC3b specifies that the density of the point cloud in the match is a density ds2b lower than the density ds2 specified by the matching condition MC3. Generally, the density of the point cloud in the measured point cloud data about the vehicle 100 becomes higher as the separation distance relative to the vehicle 100 becomes shorter, and becomes lower as the separation distance relative to the vehicle 100 becomes longer. Therefore, as in the present embodiment, when the separation distance is longer, the density of the point cloud in the reference point cloud data 250 is made lower in matching, thereby further increasing the possibility that the accuracy of matching can be improved.

[0058] In addition to the vehicle information, for example, by defining the correction data 260 in such a manner as to correct the density of the point cloud in the reference point cloud data 250 according to the separation distance, the change in the density of the point cloud according to the separation distance as described above can be achieved. In this case, the correction data 260 is defined based on the results of an experiment or simulation, for example, in such a manner that the matching accuracy in each case of different separation distances becomes a predetermined accuracy or more. Note that in another embodiment, in matching, the density of the point cloud in the measurement point cloud data may be changed according to the separation distance. Furthermore, in matching, both the density of the point cloud in the measurement point cloud data and the density of the point cloud in the reference point cloud data 250 may be changed according to the separation distance.

[0059] According to the second embodiment, the matching unit 220 changes at least one of the density of the point cloud in the measurement point cloud data and the density of the point cloud in the reference point cloud data 250 according to the separation distance between the distance measurement device 300 and the vehicle 100. Therefore, the possibility of being able to match with accuracy can be further increased. C. Third Embodiment

[0060] Figure 6 2 is a conceptual diagram showing the configuration of the system 10v in the third embodiment. Unlike the first embodiment, the system 10v in the present embodiment does not include the server 200. In addition, the vehicle 100v of the present embodiment is capable of traveling by autonomous control of the vehicle 100v. In the configuration of the system 10v and the vehicle 100v in the third embodiment, parts not specifically described are similar to those in the first embodiment.

[0061] In the present embodiment, the communication device 130 of the vehicle 100v can communicate with the distance measuring device 300 and the process management device 400. The processor 111v of the vehicle control device 110v functions as a vehicle control unit 115v, a position information acquisition unit 116, a three-dimensional point cloud data acquisition unit 210, a vehicle information acquisition unit 215, a matching unit 220, a matching condition determination unit 225, an estimation unit 230, and a command generation unit 240 by executing the program PG3 stored in the memory 112v. The vehicle control unit 115v acquires the detection result of the sensor, generates a travel control signal by using the detection result, and operates the actuator 120 by outputting the generated travel control signal, thereby enabling the vehicle 100v to travel by autonomous control. In addition, in the present embodiment, the vehicle control unit 115v functions as the command generation unit 240. In addition to the program PG3, reference point cloud data 250 including model point cloud data 251, target route TR, and correction data 260 is stored in the memory 112v. The vehicle control device 110v in the third embodiment is an example of a “control device” in the present disclosure.

[0062] Figure 7 1 is a flowchart showing a processing procedure for driving control of a vehicle 100v in a third embodiment. In S11, the vehicle 100v obtains vehicle position information by using the detection result output from the distance measuring device 300 as an external sensor. In S21, the vehicle 100v determines the target position to which the vehicle 100v is to go next. In S31, the vehicle 100v generates a driving control signal for causing the vehicle 100v to travel toward the determined target position. In S41, the vehicle 100v controls the actuator of the vehicle 100v by using the generated driving control signal, thereby causing the vehicle 100v to travel according to the parameters indicated by the driving control signal. The vehicle 100v repeats a cycle of obtaining vehicle position information, determining the target position, generating a driving control signal, and controlling the actuator in each predetermined cycle. According to the system 10v in this embodiment, the vehicle 100v can be driven by autonomous control of the vehicle 100v without remote control of the vehicle 100v by the server 200.

[0063] In S11 to S41 of this embodiment, the following steps are performed: Figure 4B Similar command generation processing. The command generation processing is executed every time the three-dimensional point cloud data acquisition section 210 of the vehicle 100v acquires new measurement point cloud data from the distance measurement device 300 responsible for measuring the target vehicle 100v. In addition, in the present embodiment, the target vehicle 100v refers to the own vehicle.

[0064] In this embodiment, the processor 111v of the vehicle 100v executes Figure 4BIn each step. In addition, in the present embodiment, in S100, for example, the vehicle information acquisition unit 215 of the vehicle 100v may acquire the identification information Vi sent from the process management device 400, or may acquire the identification information Vi pre-stored in the memory 112v. In S140, the command generation unit 240 of the vehicle 100v generates and outputs a control command by using the position and orientation estimated in S130. Specifically, the command generation unit 240 in the present embodiment generates a driving control signal by using the vehicle position information including the position and orientation, and outputs the driving control signal. The vehicle control unit 115v controls the actuator 120 by using the driving control signal to make the vehicle 100v drive.

[0065] The vehicle control device 110v in the present embodiment described above can also perform matching based on the appearance features of the vehicle 100. Therefore, for example, even if various vehicles 100 having appearance features different from each other are to be autonomously controlled, matching can be performed based on the appearance features of each vehicle 100. Therefore, the possibility of being able to perform matching with accuracy in the system 10 increases.

[0066] Note that in another embodiment in which the vehicle 100v travels by autonomous control as in the present embodiment, as in the second embodiment, the matching section 220 of the vehicle 100v may change at least one of the density of the point cloud in the measurement point cloud data and the density of the point cloud in the reference point cloud data 250 according to the separation distance. Furthermore, in another embodiment in which the vehicle 100v travels by autonomous control, for example, the server 200 may be included in the system 10. D. Other Embodiments

[0067] (D1) Although the mobile object information includes the model information Ti in the embodiment, it is not necessary to include the model information Ti. For example, the mobile object information may include only the vehicle body color information Ci.

[0068] (D2) In the embodiment, the manufacturing information on the mobile object is used for the model information Ti on the mobile object. On the other hand, the manufacturing information is not necessarily used for the model information Ti.

[0069] (D3) Although the matching section 220 changes the density of the point cloud in matching according to the mobile object information in the embodiment, the density of the point cloud does not necessarily need to be changed according to the mobile object information.

[0070] (D4) In each embodiment, the vehicle 100 only needs to include components that are movable by driving without a driver, and may be in the form of a platform including the components described below, for example. Specifically, the vehicle 100 may include at least a control device for controlling the driving of the vehicle 100 and an actuator of the vehicle 100v to realize the three functions of "driving", "steering" and "stopping" by driving without a driver. When the vehicle 100 obtains information for driving without a driver from the outside, the vehicle 100 may further include a communication device. In other words, the vehicle 100 that is movable by driving without a driver may not be equipped with at least one or some internal components such as a driving seat and an instrument panel, may not be equipped with at least one or some external components such as a bumper and a fender, and may not be equipped with a body shell. In this case, the remaining components such as the body shell may be attached to the vehicle 100 when the vehicle 100 is shipped from the factory, or the remaining components such as the body shell may be attached to the vehicle 100 after the vehicle 100 is shipped from the factory in a state where the remaining components such as the body shell are not equipped. Each component can be attached in any direction, such as from the upper side, lower side, front side, rear side, right side or left side of the vehicle 100, can be attached in the same direction, or can be attached in directions different from each other. In addition, in the form of the platform, position determination can also be performed similarly to the vehicle 100 in the first embodiment. When matching in any embodiment is performed for the form of the platform, the mobile object information only needs to be information that can identify the appearance characteristics of the form of the platform, and can be, for example, information that can identify whether each external component is attached. For such mobile object information, for example, manufacturing information about the mobile object can be used.

[0071] (D5) In each embodiment, each of the various functional sections such as the three-dimensional point cloud data acquisition section 210, the vehicle information acquisition section 215, the matching section 220, the matching condition decision section 225, the estimation section 230, and the command generation section 240 may be included in the vehicle 100 in the system 10. In this case, as described in the third embodiment, the three-dimensional point cloud data acquisition section 210, the vehicle information acquisition section 215, the matching section 220, the matching condition decision section 225, the estimation section 230, and the command generation section 240 may all be included in the vehicle 100, or one or some of the functional sections may be included in the vehicle 100. In the system 10, one, some, or all of the functional sections may be included in an external device outside the server 200 and the vehicle 100.

[0072] (D6) In the first embodiment, the processing from obtaining the vehicle position information to generating the travel control signal is performed by the server 200. In contrast, the vehicle 100 may also perform at least one or some of the processing from obtaining the vehicle position information to generating the travel control signal. For example, the embodiments described in (1) to (3) below may be possible.

[0073] (1) The server 200 can obtain vehicle position information, can determine the target position to which the vehicle 100 is to go next, and can generate a path from the current position of the vehicle 100 indicated in the obtained vehicle position information to the target position. The server 200 can generate a path to the target position between the current position and the destination, or can generate a path to the destination. The server 200 can send the generated path to the vehicle 100. The vehicle 100 can generate a travel control signal so that the vehicle 100 travels on the path received from the server 200, and can control the actuator of the vehicle 100v by using the generated travel control signal.

[0074] (2) The server 200 may obtain the vehicle position information, and may transmit the obtained vehicle position information to the vehicle 100. The vehicle 100 may determine the target position to which the vehicle 100 is to go next, may generate a path from the current position of the vehicle 100 indicated in the received vehicle position information to the target position, may generate a travel control signal so that the vehicle 100 travels on the generated path, and may control an actuator of the vehicle 100v by using the generated travel control signal.

[0075] (3) In the embodiments described in (1) and (2), an internal sensor may be installed in the vehicle 100, and the detection result output from the internal sensor may be used for at least one of the generation of the path and the generation of the driving control signal. The internal sensor is a sensor installed in the vehicle 100. Specifically, examples of the internal sensor may include a camera, a LiDAR, a millimeter wave radar, an ultrasonic sensor, a GPS sensor, an accelerometer, a gyroscope sensor, and the like. For example, in the embodiment described in (1), the server 200 may obtain the detection result of the internal sensor, and when generating the path, the detection result of the internal sensor may be reflected in the path. In the embodiment described in (1), the vehicle 100 may obtain the detection result of the internal sensor, and when generating the driving control signal, the detection result of the internal sensor may be reflected in the driving control signal. In the embodiment described in (2), the vehicle 100 may obtain the detection result of the internal sensor, and when generating the path, the detection result of the internal sensor may be reflected in the path. In the embodiment described in (2), the vehicle 100 can acquire the detection result of the internal sensor, and when generating the travel control signal, the detection result of the internal sensor can be reflected in the travel control signal.

[0076] (D7) In the third embodiment, an internal sensor may be installed in the vehicle 100v, and a detection result output from the internal sensor may be used for at least one of the generation of a route and the generation of a travel control signal. For example, the vehicle 100v may acquire the detection result of the internal sensor, and when generating a route, the detection result of the internal sensor may be reflected in the route. The vehicle 100v may acquire the detection result of the internal sensor, and when generating a travel control signal, the detection result of the internal sensor may be reflected in the travel control signal.

[0077] (D8) In the first embodiment, the server 200 automatically generates a travel control signal to be sent to the vehicle 100. In contrast, the server 200 may generate a travel control signal to be sent to the vehicle 100 according to the operation of an external operator located outside the vehicle 100. For example, the external operator may operate a manipulation device including a display for displaying a captured image output from each external sensor, a steering wheel, an accelerator and a brake pedal for remotely controlling the vehicle 100, and a communication device for communicating with the server 200 through wired communication or wireless communication, and the server 200 may generate a travel control signal according to the operation applied to the manipulation device. Hereinafter, driving of the vehicle 100 by such control is also referred to as "remote manual driving". For example, in an embodiment in which remote manual driving is performed, the estimation result of the position or orientation of the vehicle 100 estimated by the estimation unit 230 may be displayed on a display included in the manipulation device. In this case, on the display, the result of the position or orientation estimation may be displayed by using, for example, letters, characters or symbols, or the result of the position or orientation estimation may be displayed on a map.

[0078] (D9) The vehicle 100 can be manufactured by combining a plurality of modules. A module refers to a unit including a plurality of components assembled according to each part or each function of the vehicle 100. For example, the platform of the vehicle 100 can be manufactured by combining a front module constituting the front of the platform, a central module constituting the middle of the platform, and a rear module constituting the rear of the platform. Note that the number of modules included in the platform is not limited to three, and may be two or less, or four or more. In addition, in addition to or instead of the components included in the platform, the components included in the portion of the vehicle 100 different from the platform may be modularized. Various modules may include any external components such as a bumper and a grille and any internal components such as a seat and a console. Not only the vehicle 100, but any aspect of a mobile object may be manufactured by combining a plurality of modules. For example, such a module may be manufactured by welding, joining a plurality of components with a fastening device, etc., or may be manufactured by casting at least some of the components included in the module into an integral component. The casting scheme for forming an integral component (especially a relatively large component) is also referred to as giga casting or mega casting. For example, the front module, the center module, and the rear module may be manufactured by using one-piece casting.

[0079] (D10) Transporting the vehicle 100 by driving without a driver by utilizing the vehicle 100 is also referred to as "self-propelled transportation". The configuration for realizing self-propelled transportation is also referred to as "vehicle remote-controlled self-driven transportation system". In addition, the production method of producing the vehicle 100 by utilizing self-propelled transportation is also referred to as "self-propelled production". In self-propelled production, for example, in a factory that manufactures the vehicle 100, at least a part of the transportation of the vehicle 100 is realized by self-propelled transportation.

[0080] (D11) In each embodiment, one or some or all of the functions and processes implemented by using software may be implemented by using hardware. One or some or all of the functions and processes implemented by using hardware may be implemented by using software. For example, as hardware for implementing various functions in each embodiment, various circuits such as integrated circuits and discrete circuits may be used.

[0081] The present disclosure is not limited to the above-described embodiments, and can be implemented in various configurations without departing from its main purpose. For example, the technical features corresponding to the technical features of a separate form in the embodiments can be appropriately replaced or combined to solve one or some or all problems, or to achieve one or some or all effects. Unless the technical feature is described as necessary in this specification, the technical feature can be appropriately excluded.

Claims

1. A control device for generating a control command for moving a mobile object by driving without a driver, characterized in that: The control device comprises: a matching unit configured to match the measured point cloud data with the reference point cloud data to generate a control command; and A mobile object information acquisition unit is configured to acquire mobile object information for identifying appearance features of the mobile object, wherein The matching unit is configured to perform matching according to the mobile object information. The measured point cloud data is three-dimensional point cloud data about the moving object acquired by using a distance measuring device, The reference point cloud data is data representing three-dimensional point cloud data for reference.

2. The control device according to claim 1, characterized in that: The mobile object information includes model information identifying the model of the mobile object; The reference point cloud data includes model point cloud data corresponding to the model; and The matching section is configured to perform matching by using the model point cloud data according to the model information.

3. The control device according to claim 2, characterized in that: The mobile object information includes manufacturing information for managing a process of manufacturing the mobile object as the model information.

4. The control device according to any one of claims 1 to 3, characterized in that: The matching section is configured to change at least one of a density of a point cloud in the measurement point cloud data and a density of a point cloud in the reference point cloud data according to the mobile object information.

5. The control device according to claim 4, characterized in that: The matching section is configured to change at least one of a density of a point cloud in the measurement point cloud data and a density of a point cloud in the reference point cloud data according to a distance between the distance measurement device and the mobile object.

6. A control device for generating a control command for moving a mobile object by driving without a driver, characterized in that The control device comprises a processor, wherein the processor is configured to execute: Use the measured point cloud data and the reference point cloud data for matching to generate control commands; Acquiring moving object information for identifying appearance features of the moving object; and Matching is performed based on the mobile object information, wherein The measured point cloud data is three-dimensional point cloud data about the moving object acquired by using a distance measuring device, and The reference point cloud data is data representing three-dimensional point cloud data for reference.