System and method
By combining mobile body detectors and blind spot detectors in the unmanned driving system, a synthetic map is generated, which solves the blind spot problem when remotely controlling mobile bodies, and realizes comprehensive monitoring and precise control of the surrounding environment of mobile bodies.
Patent Information
- Application Number
- CN202410657308.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-01-17
- Filing Date
- 2024-05-25
- Publication Date
- 2024-11-29
AI Technical Summary
When the mobile body (such as a vehicle) is remotely controlled to move, there is a blind spot problem, that is, the detector cannot detect certain areas around the mobile body, resulting in the inability to fully understand the position and orientation of the mobile body, which will affect the safety and effectiveness of the mobile body. control.
A system is designed, including a mobile body detector, a position estimation unit, a controller and a blind spot detector. By detecting the image of the mobile body and three-dimensional point cloud data, the position and orientation of the mobile body are estimated, and the blind spot detector is detected. Objects in, generate synthetic maps for surrounding monitoring and control.
The system can effectively detect and process blind spot information around the moving body, ensure the safe movement of the moving body and the monitoring of the surrounding environment, and improve the control accuracy and reliability of the unmanned driving system.
Smart Images

Figure CN119045475A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a technology for moving a moving object by unmanned driving. Background Art
[0002] For example, Japanese Unexamined Patent Application Publication (Translation of PCT Application) No. 2017-538619 (JP2017-538619A) discloses a vehicle driving method in a manufacturing system for manufacturing vehicles, which drives the vehicle from the terminal of an assembly line of the manufacturing system to a parking lot of the manufacturing system via remote control. Summary of the invention
[0003] When a moving body (such as a vehicle) is moved by remote control, a process of estimating the position or orientation of the moving body may be performed. In the estimation of the position or orientation of the moving body, data of the moving body detected by a detector (such as a camera or a sensor) may be used. However, depending on the positional relationship between the moving body and the detector, a blind spot that cannot be detected by the detector may be generated near the moving body. Therefore, a technology for detecting objects, etc., present in a blind spot around a moving body is desired.
[0004] The present disclosure can be implemented as follows.
[0005] A first aspect of the present disclosure relates to a system configured to move a mobile body via unmanned driving. The system includes at least one mobile body detector, a position estimation unit, a controller, and at least one blind spot detector. The at least one mobile body detector is configured to detect mobile body information, which includes at least any one of an image of the mobile body and three-dimensional point cloud data of the mobile body. The position estimation unit is configured to estimate at least any one of the position and orientation of the mobile body by using the detected mobile body information. The controller is configured to generate a control command for driving the mobile body by using the estimated position and orientation of the mobile body. The at least one blind spot detector is configured to detect blind spot information, which includes at least any one of an image of a blind spot of the mobile body not detected by the mobile body detector, three-dimensional point cloud data of the blind spot, and the presence of an object in the blind spot. With the system according to the first aspect, an object or the like existing in a blind spot generated around a moving body can be detected by the blind spot detector that acquires blind spot information. In the system according to the first aspect, the at least one blind spot detector may include a plurality of blind spot detectors, and the system may further include a blind spot detector determination unit configured to determine, from among the blind spot detectors, a blind spot detector that is capable of detecting blind spot information corresponding to a blind spot for each position of the mobile body relative to the mobile body detector. With the system according to the first aspect, by appropriately switching the blind spot detector for each position of the traveling moving body, it is possible to detect blind spot information of a blind spot that dynamically changes in response to the movement of the moving body. The system according to the first aspect may further include a blind spot estimation unit configured to estimate a position of the blind spot depending on a relative position of the moving object with respect to the moving object detector. With the system according to the first aspect, it is possible to detect blind spot information of a blind spot that changes dynamically in response to the movement of a moving body. In the system according to the first aspect, the blind spot estimation unit may be configured to estimate the position of the blind spot by considering a set of straight lines directed from the moving object detector to the moving object and passing through the moving object that cross the moving object and are on the opposite side of the moving object detector as the blind spot. With the system according to the first aspect, the position of the blind spot can be easily estimated. In the system according to the first aspect, the at least one moving object detector and the at least one blind spot detector include different kinds of detectors. With the system according to the first aspect, objects present in the blind area can be detected from multiple directions by using different kinds of detectors. In the system according to the first aspect, the at least one moving body detector may be any one of a distance measuring device and a camera; and the at least one blind spot detector may be the other of the distance measuring device and the camera. According to a first aspect, distance measuring devices and cameras can be used as different kinds of detectors. The system according to the first aspect may further include: a synthetic map generation unit configured to generate a synthetic map by synthesizing the detected moving body information and the detected blind spot information; and a surrounding monitoring unit configured to monitor the surroundings of the moving body. The generated synthetic map can be used for both surrounding monitoring performed by the surrounding monitoring unit and movement control of the moving body performed by the controller. With the system according to the first aspect, by using the shared map in the movement control of the mobile body and the surrounding monitoring of the mobile body, it is easy to simultaneously perform the process of the movement control and the process of the surrounding monitoring. A second aspect of the present disclosure relates to a method for moving a mobile body via unmanned driving. The method includes: detecting mobile body information via at least one mobile body detector, the mobile body information including at least any one of an image of the mobile body and three-dimensional point cloud data of the mobile body. The method includes: estimating at least any one of the position and orientation of the mobile body by using the detected mobile body information. The method includes: generating a control command for driving the mobile body by using the estimated position and orientation of the mobile body. The method includes: detecting blind spot information via the at least one blind spot detector, the blind spot information including at least any one of an image of a blind spot of the mobile body not detected by the mobile body detector, three-dimensional point cloud data of the blind spot, and the presence of an object in the blind spot. With the method according to the second aspect, it is possible to detect an object or the like existing in a blind spot generated around a moving body by the blind spot detector that acquires blind spot information. The present disclosure may also be implemented in various aspects other than systems and methods. For example, the present disclosure may be implemented in various aspects such as a control device, a method of moving a mobile body, a method of manufacturing a mobile body, a method of monitoring the surrounding environment of a mobile body, a blind spot detection device, a method of detecting a blind spot, a method of controlling a control system, a method of controlling a control device, a computer program for implementing the control method, and a non-transitory recording medium having the computer program recorded thereon. BRIEF DESCRIPTION OF THE DRAWINGS
[0006] Features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described below with reference to the accompanying drawings, in which like numerals represent like elements, and in which: Figure 1 is a diagram showing a schematic configuration of a system according to a first embodiment; Figure 2A is a flow chart showing a processing routine for autonomous driving and surrounding monitoring of a vehicle; Figure 2B is a flowchart showing a processing flow for driving control of a vehicle according to the first embodiment; Figure 3 is a diagram schematically showing an example of a method of acquiring blind spot information during driving of a vehicle; Figure 4 is a diagram showing an overall configuration of a system according to a second embodiment; Figure 5 is a top view showing the overall configuration of a system according to a third embodiment; Figure 6 is a block diagram showing a functional configuration of a control device; and Figure 7 is a flowchart showing a flow of processing for travel control of a vehicle according to the fourth embodiment. DETAILED DESCRIPTION A. First Embodiment
[0007] Figure 1 is a diagram showing a schematic configuration of a system 500 according to a first embodiment of the present disclosure. The system 500 includes a vehicle detector 80 as one or more moving body detectors, one or more blind spot detectors 90, and a control device 300. The control device 300 generates a control command for moving a vehicle 100 as a moving body via unmanned driving, and transmits the generated control command to the vehicle 100. For example, the system 500 is used in a factory for manufacturing vehicles 100 that can be moved by unmanned driving. The vehicle detector 80 and the blind spot detector 90 are external sensors provided outside the vehicle 100.
[0008] Examples of the vehicle 100 include passenger cars, trucks, buses, and construction vehicles. The vehicle 100 is preferably a pure electric vehicle (Battery Electric Vehicle, BEV). The vehicle 100 is not limited to a pure electric vehicle, but may be, for example, a gasoline vehicle, a hybrid electric vehicle, or a fuel cell electric vehicle. The vehicle 100 includes a vehicle communication device 190, an actuator 140, and an electronic control unit (Electronic Control Unit, ECU) 200. The vehicle communication device 190 performs wireless communication with an external device (such as a control device 300) of the vehicle 100 connected to a network via an access point in a factory or the like.
[0009] The vehicle 100 is configured to travel via unmanned driving. "Unmanned driving" refers to driving that does not rely on the driving operation of the occupants. The driving operation refers to an operation related to at least one of "driving", "steering" and "stopping" of the vehicle 100. Unmanned driving is implemented by automatic or manual remote control using a device located outside the vehicle 100 or by autonomous control of the vehicle 100. The vehicle 100 that travels via unmanned driving may carry occupants who do not perform driving operations. Examples of occupants who do not perform driving operations include persons who simply sit in a seat of the vehicle 100, and persons who perform work different from driving operations (such as assembly, inspection, or operating switches, etc.) while riding in the vehicle 100. Driving performed via the driving operation of the occupants may be referred to as "manned driving".
[0010] In this specification, “remote control” includes “full remote control” in which all operations of the vehicle 100 are completely determined from the outside of the vehicle 100, and “partial remote control” in which a part of the operations of the vehicle 100 are determined from the outside of the vehicle 100. In addition, “autonomous control” includes “full autonomous control” in which the vehicle 100 autonomously controls its operation without receiving any information from an external device of the vehicle 100, and “partial autonomous control” in which the vehicle 100 autonomously controls its operation by using information received from an external device of the vehicle 100.
[0011] The ECU 200 is mounted on the vehicle 100 and performs various controls of the vehicle 100. The ECU 200 includes a storage device 220 (such as a hard disk drive (HDD), a solid state drive (SSD), an optical recording medium, or a semiconductor memory), a CPU 210 as a central processing unit, and an interface circuit 230. The CPU 210, the storage device 220, and the interface circuit 230 are connected to each other via an internal bus to enable bidirectional communication with each other. The actuator 140 and the vehicle communication device 190 are connected to the interface circuit 230.
[0012] The writable area of the storage device 220 stores computer programs for implementing at least a part of the functions provided in this embodiment. The CPU 210 executes various computer programs stored in the memory to implement the functions of the driving controller 212 and the like.
[0013] The driving controller 212 performs driving control of the vehicle 100. "Driving control" refers to various controls for driving the various actuators 140 that exhibit the "driving", "steering" and "stopping" functions of the vehicle 100, such as acceleration, speed and steering angle adjustment. In the present embodiment, the actuator 140 includes an actuator of a driving device for accelerating the vehicle 100, an actuator of a steering device for changing the driving direction of the vehicle 100, and an actuator of a braking device for decelerating the vehicle 100. The driving device includes a battery, a driving motor driven by the power of the battery, and a driving wheel rotated by the driving motor. The actuator of the driving device includes a driving motor. The actuator 140 may also include an actuator for shaking the windshield wipers of the vehicle 100 or an actuator for opening and closing the electric windows of the vehicle 100.
[0014] The driving controller 212 can drive the vehicle 100 by controlling the actuator 140 in response to the operation of the driver when the driver is riding in the vehicle 100. The driving controller 212 can also drive the vehicle 100 by controlling the actuator 140 in response to the control command transmitted from the control device 300, regardless of whether the driver is riding in the vehicle 100.
[0015] The vehicle detector 80 is a device that detects vehicle information as mobile body information. "Vehicle information" is various information used to estimate at least one of the position of the vehicle 100 and the orientation of the vehicle 100. In the present embodiment, the vehicle information is three-dimensional point cloud data of the vehicle 100. Three-dimensional point cloud data is data indicating the three-dimensional position of the point cloud. The vehicle detector 80 uses Light Detection And Ranging (LiDAR) as a distance measuring device for measuring the three-dimensional point cloud data of the vehicle 100. By using LiDAR, high-precision three-dimensional point cloud data can be obtained. The position of the vehicle 100 can be acquired only by the vehicle detector 80, and the time change of the vehicle 100, etc. can be acquired to estimate the orientation of the vehicle 100 or the driving direction of the vehicle 100.
[0016] The vehicle detector 80 is connected to the control device 300 via wireless communication or wired communication. The control device 300 can obtain the relative position and orientation of the vehicle 100 relative to the target route RT in real time by acquiring three-dimensional point cloud data from the vehicle detector 80. In this embodiment, the position of the vehicle detector 80 is fixed near the driving road SR, and the relative relationship between the reference coordinate system Σr and the device coordinate system of the vehicle detector 80 is known. The control device 300 pre-stores a coordinate transformation matrix for mutually transforming the coordinate values of the reference coordinate system Σr and the coordinate values of the device coordinate system of the vehicle detector 80.
[0017] The blind spot detector 90 is a device for acquiring blind spot information. The "blind spot information" is various information about the blind spot BS around the vehicle 100 that is not detected by the vehicle detector 80. The blind spot information is used to detect objects existing in the blind spot BS. The "blind spot BS" can be defined, for example, as Figure 1As shown, in a straight line from the vehicle detector 80 to the vehicle 100 and passing through the vehicle 100, a collection of parts that cross the vehicle 100 and are on the opposite side of the vehicle detector 80. The blind spot BS only needs to be at least an area for surrounding monitoring of the vehicle 100. In the case where a single blind spot detector 90 is unable to acquire all blind spot information in the blind spot BS, other blind spot detectors may be further added, and one blind spot information may be acquired by a plurality of blind spot detectors 90. In this embodiment, the blind spot information is three-dimensional point cloud data including the blind spot BS. The blind spot detector 90 uses the same type of LiDAR as the vehicle detector 80. Note that, as will be described below, the blind spot detector 90 and the vehicle detector 80 may be different types of detectors. In the case where the blind spot detector 90 and the vehicle detector 80 are the same type of detectors, one detector may have the function of the blind spot detector 90 and the function of the vehicle detector 80, and these functions may be appropriately switched depending on the driving position of the vehicle 100.
[0018] The control device 300 is a server that performs driving control of the vehicle 100 via remote control and surrounding monitoring of the vehicle 100. For example, the control device 300 performs transportation of the vehicle 100 in a manufacturing process in a factory by making the vehicle 100 autonomously drive via remote control. Transportation of the vehicle 100 using autonomous driving via remote control is also referred to as "autonomous transportation." Due to autonomous transportation, the vehicle 100 can be moved without using a transportation device such as a crane or a conveyor belt.
[0019] The control device 300 includes a CPU 310 as a central processing unit, a storage device 340, an interface circuit 350, and a remote communication device 390. The CPU 310, the storage device 340, and the interface circuit 350 are connected to each other via an internal bus so as to be able to communicate with each other bidirectionally. The remote communication device 390 is connected to the interface circuit 350. The remote communication device 390 communicates with the vehicle 100 via a network or the like.
[0020] The storage device 340 is, for example, a RAM, a ROM, a HDD, or an SSD. The storage device 340 stores the vehicle point cloud data VP and the target route RT. The vehicle point cloud data VP is, for example, three-dimensional CAD data of the vehicle 100. The vehicle point cloud data VP includes information for specifying the orientation of the vehicle 100. The target route RT is a predetermined driving route of the vehicle 100 on the driving road SR.
[0021] By executing the computer program stored in the storage device 340, the CPU 310 functions as a point cloud data acquisition unit 312, a position estimation unit 314, a blind spot estimation unit 316, a blind spot detector determination unit 318, a blind spot information acquisition unit 320, a synthetic map generation unit 322, a surrounding monitoring unit 324, and a controller 326. It should be noted that some or all of these functions may be configured by hardware circuits. The point cloud data acquisition unit 312 acquires three-dimensional point cloud data measured by the vehicle detector 80.
[0022] The position estimation unit 314 estimates the position and orientation of the vehicle 100 in the driving environment including the driving road SR by using the acquired three-dimensional point cloud data. In the present embodiment, the position estimation unit 314 performs template matching by using the vehicle point cloud data VP stored in the storage device 340 as a template to estimate the position and orientation of the vehicle 100. For template matching, for example, an iterative closest point (ICP) algorithm or a normal distribution transform (NDT) algorithm can be used. Instead of template matching, the position estimation unit 314 can extract the position and orientation of the vehicle 100 directly from the acquired three-dimensional point cloud data.
[0023] The blind spot estimation unit 316 estimates the position of the blind spot BS around the vehicle 100. The blind spot estimation unit 316 estimates the position of the blind spot BS of the vehicle 100, for example, by using the relative position of the vehicle 100 and the vehicle detector 80 in the measured three-dimensional point cloud data. The "position of the blind spot BS" may be information about the three-dimensional coordinates of the area corresponding to the blind spot BS, or may be simple information such as the direction in which the blind spot BS exists relative to the vehicle 100. The blind spot BS may be estimated as an area around the vehicle 100 where the three-dimensional point cloud data is not measured. For example, the blind spot estimation unit 316 may estimate the position of the blind spot BS by regarding a set (area) on the opposite side of the vehicle detector 80 that crosses the vehicle 100 among the straight lines that point from the vehicle detector 80 to the vehicle 100 and pass through the vehicle 100 as the blind spot BS.
[0024] The blind spot detector determination unit 318 determines a blind spot detector 90 for detecting blind spot information from among the blind spot detectors 90. The blind spot detector determination unit 318 determines a blind spot detector 90 corresponding to the position of the blind spot BS estimated by the blind spot estimation unit 316. In the present embodiment, the blind spot detector determination unit 318 checks the detection range that each blind spot detector 90 can detect, and determines a blind spot detector 90 having a detection range that includes the blind spot BS as the blind spot detector 90 corresponding to the position of the blind spot BS. In the case where the position of the blind spot BS is simple information such as the direction in which the blind spot BS exists relative to the vehicle 100, a blind spot detector 90 located in the direction or a blind spot detector 90 that can detect an area including the direction may be determined.
[0025] The blind spot information acquisition unit 320 acquires three-dimensional point cloud data of an area including the blind spot BS as blind spot information by using the determined blind spot detector 90. The synthetic map generation unit 322 generates a synthetic map synthesized by the three-dimensional point cloud data acquired by the point cloud data acquisition unit 312 and the three-dimensional point cloud data of the blind spot BS acquired by the blind spot information acquisition unit 320. As a result, a synthetic map supplemented with blind spot information can be generated. The surrounding monitoring unit 324 performs surrounding monitoring of the vehicle 100, such as detecting obstacles around the vehicle 100, by using the generated synthetic map.
[0026] The controller 326 generates a control command (driving control signal) for remote control by using the estimated position and orientation of the vehicle 100. The controller 326 transmits the generated control command to the vehicle 100. The control command is a command for causing the vehicle 100 to travel along the target route RT stored in the storage device 340. The control command may be generated as a command including a driving force or a braking force and a steering angle. Alternatively, the control command may be generated as a command including at least one of the position and orientation of the vehicle 100 and a future driving route. In the case where the vehicle 100 receives a request for remote control, the driving control is implemented by the driving controller 212 of the ECU 200, and as a result, the vehicle 100 performs autonomous driving.
[0027] Figure 2A 1 is a flowchart showing a processing routine for autonomous driving of the vehicle 100 and surrounding monitoring of the vehicle 100 via remote control. The current process starts when the vehicle 100 starts traveling on the driving road SR. This process may be repeatedly executed each time the point cloud data acquisition unit 312 newly acquires three-dimensional point cloud data from the vehicle detector 80 responsible for measuring the vehicle 100 as a control target. The point cloud data acquisition unit 312 may perform preprocessing to remove background point cloud data indicating a stationary object from the newly acquired three-dimensional point cloud data.
[0028] In step S10, the point cloud data acquisition unit 312 acquires three-dimensional point cloud data as vehicle information from the vehicle detector 80. In step S20, the position estimation unit 314 estimates the position and orientation of the vehicle 100 by using the acquired three-dimensional point cloud data. In step S30, the blind spot estimation unit 316 estimates the position of the blind spot BS around the vehicle 100 by using the relative position between the vehicle detector 80 responsible for the measurement of the vehicle 100 and the vehicle 100 in the measured three-dimensional point cloud data.
[0029] In step S40, the blind spot detector decision unit 318 decides the blind spot detector 90 capable of acquiring blind spot information of the estimated blind spot BS. In step S50, three-dimensional point cloud data of a region including the blind spot BS is acquired as blind spot information by using the decided blind spot detector 90.
[0030] In step S60, the synthetic map generation unit 322 generates a synthetic map obtained by synthesizing the three-dimensional point cloud data acquired by the point cloud data acquisition unit 312 and the three-dimensional point cloud data of the blind spot BS acquired by the blind spot information acquisition unit 320. In the present embodiment, the generated synthetic map is used for both surrounding monitoring via the surrounding monitoring unit 324 and driving control (also referred to as "mobility control") of the vehicle 100 via the controller 326.
[0031] In step S70, the surrounding monitoring unit 324 performs surrounding monitoring of the vehicle 100 by using the generated synthetic map. Specifically, the surrounding monitoring unit 324 monitors the synthetic map to detect obstacles around the vehicle 100 including the blind spot BS. In step S80, the surrounding monitoring unit 324 checks whether there are obstacles around the vehicle 100 that hinder the travel of the vehicle 100. When there are no obstacles around the vehicle (S80: No), the surrounding monitoring unit 324 advances the processing to step S82 and performs an output for causing the vehicle 100 to travel along the target route RT. In step S90, the controller 326 generates a control command for causing the vehicle 100 to travel along the target route RT by using the estimated position and orientation of the vehicle 100, and transmits the generated control command to the vehicle 100.
[0032] When an obstacle around the vehicle is detected (S80: Yes), the surrounding monitoring unit 324 advances the process to step S84 and performs an output for stopping the vehicle 100. In this case, in step S90, the controller 326 generates a control command for stopping the vehicle 100 and transmits the generated control command to the vehicle 100.
[0033] Figure 2Bis a flowchart showing a processing flow for driving control of the vehicle 100 according to the first embodiment. In step S1, the server 300 (synonymous with "control device 300") acquires vehicle position information by using a detection result output from an external sensor which is a sensor located outside the vehicle 100. The vehicle position information is position information that serves as a basis for generating a driving control signal. In the present embodiment, the vehicle position information includes the position and orientation of the vehicle 100 in the reference coordinate system Σr of the factory. In the present embodiment, the reference coordinate system Σr of the factory is a global coordinate system, and any position in the factory can be represented by X, Y, and Z coordinates in the global coordinate system. In the present embodiment, the external sensor includes at least a vehicle detector 80 installed in the factory. That is, in step S1, the server 300 acquires the vehicle position information by using data acquired from the vehicle detector 30 which is an external sensor.
[0034] Specifically, in step S1, the server 300 performs template matching by using the three-dimensional point cloud data acquired from the distance measuring device as the vehicle detector 30 and the vehicle point cloud data VP as the pre-prepared reference point cloud data to obtain the vehicle position information of the vehicle 100. In the case where the vehicle detector 30 is a camera, the server 300 detects the external shape of the vehicle 100, calculates the coordinates of the positioning points of the vehicle 100 in the captured image coordinate system (i.e., the local coordinate system), and obtains the position of the vehicle 100 by converting the calculated coordinates into coordinates in the global coordinate system. For example, the external shape of the vehicle 100 included in the captured image can be detected by inputting the captured image into a detection model using artificial intelligence. The detection model is prepared, for example, inside the system 500 or outside the system 500, and is pre-stored in the storage device 340 as the memory of the server 300. Examples of the detection model include a trained machine learning model that has been trained to implement any semantic segmentation and instance segmentation. As a machine learning model, for example, a convolutional neural network (CNN) trained by supervised learning using a training data set may be used. The training data set, for example, has a plurality of training images including the vehicle 100 and a label indicating whether each region in the training image indicates a region of the vehicle 100 or indicates a region outside the vehicle 100. When the CNN is trained, the parameters of the CNN are preferably updated by back propagation (error back propagation method) to reduce the error between the output result of the detection model and the label. The server 300 may perform estimation based on the orientation of the motion vector of the vehicle 100 calculated according to the position change of the feature points of the vehicle 100 between the frames of the captured image, by using, for example, an optical flow method, to obtain the orientation of the vehicle 100.
[0035] In step S2, the server 300 determines the target location that the vehicle 100 should go to next. In the present embodiment, the target location is represented by X, Y, and Z coordinates in a global coordinate system. The storage device 340, which is a memory of the server 300, pre-stores a reference route (target route RT) as the route on which the vehicle 100 should travel. The route is represented by a node indicating a starting point, a node indicating a passing point, a node indicating a destination, and a link connecting each node. The server 300 determines the target location that the vehicle 100 should go to next by using the vehicle position information and the reference route. The server 300 determines the target location on the reference route in front of the current position of the vehicle 100.
[0036] In step S3, the server 300 generates a driving control signal (control command value) for driving the vehicle 100 toward the determined target position. In the present embodiment, the driving control signal includes the acceleration and steering angle of the vehicle 100 as parameters. The server 300 calculates the driving speed of the vehicle 100 according to the change of the position of the vehicle 100, and compares the calculated driving speed with the target speed. As a whole, the server 300 determines the acceleration so that the vehicle 100 accelerates when the driving speed is lower than the target speed, and determines the acceleration so that the vehicle 100 decelerates when the driving speed is higher than the target speed. The server 300 determines the steering angle and the acceleration so that the vehicle 100 does not deviate from the reference route when the vehicle 100 is located on the reference route, and determines the steering angle and the acceleration so that the vehicle 100 returns to the reference route when the vehicle 100 is not located on the reference route (in other words, when the vehicle 100 deviates from the reference route). In other embodiments, the driving control signal may include the speed of the vehicle 100 as a parameter instead of or in addition to the acceleration of the vehicle 100.
[0037] In step S4, the controller 300 transmits the generated travel control signal to the vehicle 100. The server 300 repeatedly performs acquisition of vehicle position information, determination of a target position, generation of a travel control signal, and transmission of the travel control signal at a predetermined cycle.
[0038] In step S5, the vehicle 300 receives the travel control signal transmitted from the server 300. In step S6, the vehicle 100 controls the actuator of the vehicle 100 by using the received travel control signal so that the vehicle 100 travels at the acceleration and the steering angle indicated by the travel control signal. The vehicle 100 repeats the reception of the travel control signal and the control of the actuator of the vehicle 100 at a predetermined cycle. With the system 500 according to the present embodiment, the vehicle 100 can be driven via remote control, and the vehicle 100 can be moved without using a transport device such as a crane or a conveyor belt.
[0039] Figure 3 is a diagram schematically showing an example of a method of acquiring blind spot information during travel of the vehicle 100 . Figure 3 The state in which the vehicle 100 is autonomously transported in the factory FC that manufactures the vehicle 100 is shown. The factory FC includes a first process 50 and a second process 60. The first process 50 is, for example, a place where the vehicle 100 is assembled, and the second process 60 is, for example, a place where the vehicle 100 is inspected. The first process 50 and the second process 60 are connected via a travel road SR, and the vehicle 100 can travel on the travel road SR. Any position in the factory FC is represented by an xyz coordinate value in the reference coordinate system Σr.
[0040] A plurality of vehicle detectors 80 including vehicle detectors 80A, 80B, and 80C are installed around the travel road SR, and blind spot detectors 90 including blind spot detectors 90A, 90B, and 90C are installed to detect three-dimensional point cloud data of blind spots BSa, BSb, and BSc not acquired by the vehicle detectors 80A, 80B, and 80C. The controller 326 of the control device 300 causes the ECU 200 to perform driving control of the vehicle 100 while analyzing the three-dimensional point cloud data of the travel road SR and the vehicle 100 acquired by the vehicle detector 80 at predetermined time intervals.
[0041] exist Figure 3 In the example, the target route RT set on the driving road SR includes target routes RT1, RT2, and RT3 that are continuous with each other. The vehicle 100A that starts from the first step 50 travels along the target route RT1 via remote control using the three-dimensional point cloud data acquired by the vehicle detector 80A. In this case, the position of the blind spot BSa is estimated based on the relative position between the vehicle detector 80A and the vehicle 100A, and the blind spot detector 90A for detecting the blind spot information of the estimated blind spot BSa is determined. A synthetic map is generated by synthesizing the three-dimensional point cloud data acquired by the vehicle detector 80A and the three-dimensional point cloud data of the blind spot BSa acquired by the determined blind spot detector 90A. The vehicle 100A performs autonomous driving along the target route RT1 via remote control using the synthetic map.
[0042] When the vehicle 100A reaches the target route RT2, the vehicle detector 80A switches to the vehicle detector 80B suitable for detecting the vehicle 100B. The position of the blind spot BSb is estimated based on the relative position between the vehicle detector 80B and the vehicle 100B, and the blind spot detector 90B corresponding to the blind spot BSb is determined. The vehicle 100B travels along the target route RT2 via remote control using a synthetic map synthesized by the three-dimensional point cloud data acquired by the vehicle detector 80B and the three-dimensional point cloud data of the blind spot BSb acquired by the blind spot detector 90B.
[0043] When the vehicle 100B reaches a predetermined position on the target route RT2, similarly, the vehicle detector 80B switches to the vehicle detector 80C suitable for detecting the vehicle 100C. The position of the blind spot BSc is estimated based on the relative position between the vehicle detector 80C and the vehicle 100C, and the blind spot detector 90C corresponding to the blind spot BSc is determined. The vehicle 100B drives to the target route RT3 via remote control using a synthetic map synthesized by the three-dimensional point cloud data acquired by the vehicle detector 80C and the three-dimensional point cloud data of the blind spot BSc acquired by the blind spot detector 90C.
[0044] As described above, the vehicle detector 80 is appropriately switched depending on the traveling position of the vehicle 100. The position of the blind spot BS is estimated according to the relative position between the switched vehicle detector 80 and the traveling vehicle 100, and the blind spot detector 90 corresponding to the estimated blind spot BS is decided. Using a synthetic map generated by using the decided blind spot detector 90 and the switched vehicle detector 80, surrounding monitoring and driving control of the vehicle 100 are performed.
[0045] As described above, the system 500 according to the present embodiment includes: a vehicle detector 80 configured to detect vehicle information including three-dimensional point cloud data of the vehicle 100; a position estimation unit 314 configured to estimate the position and orientation of the vehicle 100 by using the detected vehicle information; a controller 326 configured to generate a control command for autonomously driving the vehicle 100 via remote control by using the estimated position and orientation of the vehicle 100, and transmit the generated control command to the vehicle 100; and a blind spot detector 90 configured to detect blind spot information including three-dimensional point cloud data of a blind spot BS of the vehicle 100. An object existing in the blind spot BS generated around the vehicle 100 can be detected by the blind spot detector 90 that acquires the three-dimensional point cloud data of the blind spot BS.
[0046] The system 500 according to the present embodiment further includes a blind spot detector determination unit 318 configured to determine, from among the blind spot detectors 90, a blind spot detector 90 capable of detecting blind spot information corresponding to a blind spot BS for each position of the vehicle 100 relative to the vehicle detector 80. By appropriately switching the blind spot detector 90 for each position of the traveling vehicle 100, it is possible to detect blind spot information of the blind spot BS that dynamically changes in response to the traveling of the vehicle 100.
[0047] The system 500 according to the present embodiment further includes a blind spot estimation unit 316 configured to estimate the position of the blind spot BS depending on the relative position of the vehicle 100 with respect to the vehicle detector 80. The position of the blind spot BS that changes in response to the travel of the vehicle 100 may be dynamically detected.
[0048] With the system 500 according to the present embodiment, the synthetic map generated by the synthetic map generation unit 322 is used for both the surrounding monitoring via the surrounding monitoring unit 324 and the movement control of the vehicle 100 via the controller 326. The process of driving the vehicle 100 and the process of surrounding monitoring of the vehicle 100 are easily performed at the same time by using a common map using three-dimensional point cloud data. In addition, compared with the case where the driving control of the vehicle 100 and the surrounding monitoring of the vehicle 100 are performed separately, the process can be simplified. B. Second Embodiment
[0049] Figure 4 is a diagram showing the overall configuration of a system 500 according to a second embodiment of the present disclosure. The system 500 according to the second embodiment is different from the system 500 according to the first embodiment in that a control device 300b is provided to replace the control device 300, and a blind spot detector 90b using a detector other than LiDAR is provided to replace the blind spot detector 90 using LiDAR, and the other configurations are the same.
[0050] The control device 300b is different from the control device 300 shown in the first embodiment in that a CPU 310b in which the functions of the blind spot estimation unit 316 and the synthetic map generation unit 322 are omitted is provided in place of the CPU 310, and a storage device 340b in which the correspondence table TB is also stored is provided, and the other configurations are the same. In this embodiment, since the blind spot detector 90 is a detector different from the vehicle detector 80, a synthetic map is not generated.
[0051] In this embodiment, the blind spot detector 90b is a detector different from LiDAR, for example, a camera that acquires an image including the blind spot BS. The blind spot detector 90b may be a detector other than a camera or LiDAR, for example, various detectors such as an infrared sensor, an ultrasonic sensor, and a millimeter wave radar that can detect the presence of an object in the blind spot BS may be used.
[0052] In the first embodiment, an example has been described in which the blind spot detector 90 is a LiDAR and the same detector as the vehicle detector 80 is used. In contrast, as in the present embodiment, the blind spot detector 90 and the vehicle detector 80 may be different kinds of detectors. With the system 500 configured as described above, objects in the blind spot BS can be detected from multiple directions by using different kinds of detectors. In addition, the process of generating a synthetic map can be omitted, and the processing speed of the system 500 can be increased.
[0053] The correspondence table TB indicates the correspondence between the driving position of the vehicle 100, the vehicle detector 80 capable of detecting the vehicle 100 at the driving position, and the blind spot detector 90 capable of detecting the blind spot information of the blind spot BS generated around the vehicle 100 at the driving position. Since the vehicle 100 travels on the driving road SR along the target route RT, the correspondence between the vehicle detector 80 capable of detecting the vehicle 100 for each driving position of the vehicle 100 and the blind spot detector 90 capable of detecting the blind spot information of the blind spot BS generated around the vehicle 100 for each driving position can be preset. Figure 3 In the example of FIG. 1 , the correspondence table TB defines that the combination of the vehicle detector 80A and the blind spot detector 90A is used when the driving position of the vehicle 100 is the target route RT1, and the combination of the vehicle detector 80B and the blind spot detector 90B and the combination of the vehicle detector 80C and the blind spot detector 90C are used when the driving position of the vehicle 100 is the target route RT2. In the present embodiment, the correspondence table TB using this feature is prepared in advance.
[0054] According to the system 500 of the present embodiment, the correspondence table TB using the driving position of the vehicle 100 is used, whereby the corresponding vehicle detector 80 and the blind spot detector 90 can be determined by a simple method of acquiring the driving position of the vehicle 100 by the position estimation unit 314 or the like. Therefore, the process for determining the vehicle detector 80 and the blind spot detector 90 corresponding to the driving position of the vehicle 100 can be simplified, such as omitting the functions of the blind spot estimation unit 316 and the synthetic map generation unit 322. C. Third Embodiment
[0055] Figure 5 is a top view showing an example of the overall configuration of the system 500c according to the third embodiment. The system 500c according to the present embodiment is different from the system 500c according to the first embodiment in that a control device 300c is provided to replace the control device 300. The control device 300c is an unmanned vehicle also known as so-called guided mobility. As in the first embodiment, the control device 300c has a function of enabling the vehicle 100 to drive autonomously via remote control, and a function of enabling the control device 300c to drive autonomously on the driving road SR. That is, while the control device 300c is performing autonomous driving on the driving road SR, the following vehicle 100 is autonomously driven via remote control.
[0056] The control device 300c includes a driving wheel 142 for autonomous driving, a detector 70 for autonomous driving, and a vehicle detector 80. Since the function of the vehicle detector 80 is the same as that of the vehicle detector 80 shown in the first embodiment, its description will be omitted. The detector 70 for autonomous driving is a distance measuring device, such as a camera or LiDAR. The data acquired by the detector 70 for autonomous driving is used for simultaneous localization and mapping (SLAM) of the self-position estimation and environmental map creation of the autonomous driving of the control device 300c. A stereo camera, a monocular camera, an RGB-D camera (depth camera), etc. can be used as a camera. A ToF sensor, etc. can be used instead of a camera or LiDAR.
[0057] Figure 6 3 is a block diagram showing the functional configuration of the control device 300c provided in the system 500c according to the third embodiment. The control device 300c is different from the control device 300 according to the first embodiment in that a CPU 310c further used as a SLAM unit 328 and an autonomous driving controller 330 is provided instead of the CPU 310, a storage device 340c in which a guide vehicle route GR is also stored is provided instead of the storage device 340, and an actuator 360 is also provided, and the other functions are the same. The guide vehicle route GR is a predetermined target route on which the control device 300c should travel.
[0058] The actuator 360 includes actuators for a driving device, a steering device, and a braking device for controlling the autonomous driving of the device 300c. The driving device includes a battery, a travel motor driven by the power of the battery, and a drive wheel 142 rotated by the travel motor.
[0059] The SLAM unit 328 performs SLAM using data detected by the detector 70 for autonomous driving to perform generation of a map for autonomous driving of the control device 300c. The autonomous driving controller 330 causes the control device 300c to autonomously drive by controlling the actuator 360. The autonomous driving controller 330 uses the generated map to cause the control device 300c to autonomously drive along the guided vehicle route GR stored in the storage device 340c.
[0060] like Figure 5 As shown, the blind spot detector 90 including the blind spot detectors 90P, 90Q, and 90R is installed around the driving road SR. Figure 5 In the example of FIG. 3 , the vehicle detector 80 is installed only on the control device 300 c , but may be installed around the travel road SR similarly to the blind spot detector 90 .
[0061] like Figure 5As shown on the left side of , when the control device 300c travels along the linear guided vehicle route GR1, the vehicle 100P is induced by the remote control of the control device 300c to travel on the same travel route as the control device 300c. In this case, for example, on the opposite side of the vehicle 100P relative to the control device 300c, that is, the back side of the vehicle 100P, there is a possibility that a blind spot BSp that is not detected by the vehicle detector 80 is generated. The blind spot estimation unit 316 estimates the position of the blind spot BSp, and the blind spot detector determination unit 318 determines a blind spot detector 90P that can detect the blind spot BSp. When the vehicle 100P travels further, the blind spot BSp leaves the detection range of the blind spot detector 90A. In this case, the blind spot detector determination unit 318 switches the blind spot detector to, for example, a blind spot detector 90Q.
[0062] Furthermore, if Figure 5 As shown on the right side of FIG. 3 , when the control device 300c travels along the curved guide vehicle route GR2, for example, a blind spot BSr that cannot be detected by the vehicle detector 80 is generated on the back side and the side side of the vehicle 100Q. In this case, the blind spot detector determination unit 318 determines, for example, a blind spot detector 90R that can detect blind spot information of the blind spot BSr.
[0063] As described above, with the system 500c according to the present embodiment, the control device 300c on which the vehicle detector 80 for detecting the vehicle 100 is mounted is configured to perform autonomous driving. The system 500c according to the present embodiment can acquire blind spot information by dynamically switching the blind spot detector 90 even in a case where the blind spot BS around the vehicle 100 dynamically changes due to the autonomous driving of the control device 300c and the autonomous driving of the vehicle 100 via remote control. D. Fourth Embodiment
[0064] Figure 71 is a flowchart showing a processing flow for driving control of a vehicle according to a fourth embodiment. Since the device configuration of the vehicle according to the present embodiment is the same as that in the first embodiment, the vehicle according to the present embodiment is described as a vehicle 100 for convenience. In the fourth embodiment, the control devices 300, 300b, 300c according to the first to third embodiments are mounted on the vehicle 100. That is, in the fourth embodiment, the vehicle 100 has the functions of the CPU 310, 310b, 310c executed in the first to third embodiments and the data stored in the storage devices 340, 340b, 340c. In step S901, the vehicle 100 obtains vehicle position information by using the detection result output from the vehicle detector 80 as an external sensor. In step S902, the vehicle 100 decides the target position to which the vehicle 100 should go next. In step S903, the vehicle 100 generates a driving control signal for driving the vehicle 100 toward the decided target position. In step S904, the vehicle 100 controls the actuator of the vehicle 100 by using the generated travel control signal so that the vehicle 100 travels according to the parameters indicated by the travel control signal. The vehicle 100 repeatedly performs the acquisition of vehicle position information, the determination of the target position, the generation of the travel control signal, and the control of the actuator at a predetermined cycle. According to the travel control of this embodiment, the vehicle 100 can be driven by the autonomous control of the vehicle 100 without remotely controlling the vehicle 100 via the control device 300, 300b, 300c as a server. E. Other embodiments:
[0065] (E1) In the above-mentioned embodiment, an example has been described in which the vehicle detector 80 is a LiDAR. In contrast, as the vehicle detector 80, a camera that acquires an image of the vehicle 100 as vehicle information may be used. The image acquired by the camera is used, for example, for acquiring various information for remote control (such as the position of the vehicle 100 and the orientation of the vehicle 100) by image analysis (such as object recognition using a machine learning model) of the control device 300.
[0066] (E2) In each of the above-described embodiments, an example has been described in which the system 500, 500c includes a plurality of blind spot detectors 90, but a single blind spot detector 90 may be included. In the case of using a single blind spot detector 90, only the determination of whether the blind spot detector 90 is to be used may be performed, instead of the determination of the blind spot detector 90, in which case the function of the blind spot detector determination unit 318 may be omitted, and the blind spot detector determination unit 318 may determine whether the blind spot detector 90 is to be used. Although an example has been described in which the system 500, 500c includes a plurality of vehicle detectors 80, the system 500, 500c may also include a single vehicle detector 80.
[0067] (E3) In the first embodiment, an example has been described in which the generated synthetic map is used for both surrounding monitoring via the surrounding monitoring unit 324 and driving control of the vehicle 100 via the controller 326. In contrast, the synthetic map may be used only for surrounding monitoring. Surrounding monitoring using only blind spot information may be performed without generating a synthetic map, and surrounding monitoring using blind spot information and vehicle information may be performed separately. When a synthetic map is not generated, autonomous driving of the vehicle 100 via remote control may be implemented by using vehicle information acquired by the vehicle detector 80.
[0068] (E4) In each of the above embodiments, examples have been described in which the vehicle 100 is a passenger car, a truck, a bus, or a construction vehicle. It should be noted that the vehicle 100 is not limited to these examples, and may include various vehicles such as motorcycles, four-wheel vehicles, and trains. In addition, various moving bodies other than the vehicle 100 may be used. "Moving body" refers to a movable object. Moving bodies include, for example, vehicles, electric vertical take-off and landing (so-called flying cars), ships, airplanes, robots, and linear motor cars. In this case, the expressions "vehicle" and "car" in the present disclosure may be appropriately replaced with "moving body", and the expression "driving" may be appropriately replaced with "moving".
[0069] (E5) The vehicle 100 only needs to have a configuration that allows it to be moved by unmanned driving. For example, the platform may have the following configuration: Specifically, the vehicle 100 only needs to be configured to exhibit the functions of "driving", "steering" and "stopping" via unmanned driving. That is, the vehicle 100 only needs to include a control device that controls at least the driving of the vehicle 100, and actuators such as a drive device, a steering device, and a braking device. In the case where the vehicle 100 obtains information from the outside for unmanned driving, the vehicle 100 only needs to include a communication device. That is, the vehicle 100 that can be moved by unmanned driving does not need to be equipped with at least a portion of the internal components such as a driver's seat and an instrument panel, nor does it need to be equipped with at least a portion of the external components such as a bumper and a rearview mirror, and does not need to be equipped with a body shell. In this case, the remaining components (such as the body shell, etc.) may be assembled to the vehicle 100 when the vehicle 100 is shipped from the factory, or the remaining components (such as the body shell, etc.) may be assembled to the vehicle 100 after the vehicle 100 is shipped from the factory without being assembled to the vehicle 100. Each component may be assembled from any direction such as the upper side, the lower side, the front side, the rear side, the right side, or the left side of the vehicle 100, and may be assembled from the same direction or different directions. As for the form of the platform, the position may be determined in the same manner as the vehicle 100 in each of the above-described embodiments.
[0070] (E6) In the first to third embodiments, the servers 300, 300b, 300c perform the processing from the acquisition of the vehicle position information to the generation of the travel control signal. In contrast, the vehicle 100 may perform at least a portion of the processing from the acquisition of the vehicle position information to the generation of the travel control signal. For example, the following forms (1) to (3) may be used.
[0071] (1) The server 300, 300b, 300c may acquire vehicle position information, determine a target position to which the vehicle 100 should go next, and generate a route from the current position of the vehicle 100 indicated by the acquired vehicle position information to the target position. The server 300, 300b, 300c may generate a route to a target position between the current position and the destination, or may generate a route to the destination. The server 300, 300b, 300c may transmit the generated route to the vehicle 100. The vehicle 100 may generate a travel control signal for causing the vehicle 100 to travel on the route received from the server 300, 300b, 300c, and control an actuator of the vehicle 100 by using the generated travel control signal.
[0072] (2) The servers 300, 300b, and 300c may acquire vehicle position information and transmit the acquired vehicle position information to the vehicle 100. The vehicle 100 may determine a target position to which the vehicle 100 should go next, generate a route from the current position of the vehicle 100 indicated by the received vehicle position information to the target position, generate a travel control signal for causing the vehicle 100 to travel on the generated route, and control an actuator of the vehicle 100 by using the generated travel control signal.
[0073] (3) In the above forms (1) and (2), an internal sensor may be installed on the vehicle 100, and the detection result output from the internal sensor may be used for at least one of the generation of the route and the generation of the driving control signal. The internal sensor is a sensor installed on the vehicle 100. Specifically, the internal sensor may include, for example, a camera, a LiDAR, a millimeter wave radar, an ultrasonic sensor, a GPS sensor, an acceleration sensor, and a gyroscope sensor. For example, in the above form (1), the server 300 may obtain the detection result of the internal sensor and reflect the detection result of the internal sensor in the route when generating the route. In the above form (1), the vehicle 100 may obtain the detection result of the internal sensor and reflect the detection result of the internal sensor in the driving control signal when generating the driving control signal. In the above form (2), the vehicle 100 may obtain the detection result of the internal sensor and reflect the detection result of the internal sensor in the route when generating the route. In the above form (2), the vehicle 100 may obtain the detection result of the internal sensor and reflect the detection result of the internal sensor in the driving control signal when generating the driving control signal.
[0074] (E7) In the above-mentioned embodiment in which the vehicle 100 can travel via autonomous control, an internal sensor may be installed on the vehicle 100, and the detection result outputted from the internal sensor may be used in at least one of the generation of the route and the generation of the travel control signal. For example, the vehicle 100 may obtain the detection result of the internal sensor, and reflect the detection result of the internal sensor in the route when generating the route. For example, the vehicle 100 may obtain the detection result of the internal sensor, and reflect the detection result of the internal sensor in the travel control signal when generating the travel control signal.
[0075] (E8) In each of the above-described embodiments, the server 300, 300b, 300c automatically generates a travel control signal to be transmitted to the vehicle 100. In contrast, the server 300 may generate a travel control signal to be transmitted to the vehicle 100 in response to an operation of an external operator located outside the vehicle 100. For example, the external operator may operate an operating device including a display that displays a captured image output from an external sensor, a steering wheel, an accelerator pedal, and a brake pedal for remotely operating the vehicle 100, and a communication device that communicates with the server 300 via wired communication or wireless communication, and the server 300, 300b, 300c may generate a travel control signal in response to the operation applied to the operating device.
[0076] (E9) The vehicle 100 can be manufactured by combining a plurality of modules. A module refers to a unit composed of one or more components assembled depending on the configuration or function of the vehicle 100. For example, the platform of the vehicle 100 can be manufactured by combining a front module constituting the front of the platform, a center module constituting the center of the platform, and a rear module constituting the rear of the platform. In addition, the number of modules constituting the platform is not limited to 3, and can be less than 2 or more than 4. In addition to or instead of the platform, the parts of the vehicle 100 that are different from the platform can be modularized. In addition, the various modules can include any external components (such as a bumper or grille) or any internal components (such as a seat or a console). In addition, in addition to the vehicle 100, any aspect of a mobile body can be manufactured by combining modules. Such a module can be manufactured by joining the components via welding or fasteners, etc., or can be manufactured by molding at least a portion of the module into one component as a whole by casting. The molding method of molding at least a portion of the module into one component as a whole is also called giga casting or mega casting. By using one-piece casting, each unit of a moving body formed by joining a plurality of parts in the related art can be formed into one part. For example, a front module, a center module, and a rear module can be manufactured by using one-piece casting.
[0077] (E10) The transportation of the vehicle 100 using unmanned driving to make the vehicle 100 travel is also referred to as "autonomous transportation". The configuration for implementing autonomous transportation is also referred to as "vehicle remote-controlled autonomous driving transportation system". The production method of producing the vehicle 100 by using autonomous transportation is also referred to as "autonomous production". In autonomous production, for example, at a factory that manufactures the vehicle 100, at least a part of the transportation of the vehicle 100 is implemented by autonomous transportation.
[0078] The present disclosure is not limited to the above-described embodiments, and can be implemented in various configurations without departing from the spirit of the present disclosure. For example, the technical features in the embodiments corresponding to the technical features of each form described in the Summary of the Invention section may be appropriately replaced or combined to solve some or all of the above-described purposes, or to achieve some or all of the above-described effects. In the case where technical features are not described as essential features in this specification, these features may be deleted as appropriate.
Claims
1. A system configured to move a moving object by unmanned driving, characterized in that: The system comprises: at least one moving object detector configured to detect moving object information, the moving object information including at least any one of an image of the moving object and three-dimensional point cloud data of the moving object; a position estimating unit configured to estimate at least any one of a position and an orientation of the moving body by using the detected moving body information; A controller configured to generate a control command for causing the moving body to travel by using the estimated position and orientation of the moving body; and At least one blind spot detector is configured to detect blind spot information, wherein the blind spot information includes at least any one of an image of a blind spot of the moving object not detected by the moving object detector, three-dimensional point cloud data of the blind spot, and the presence of an object in the blind spot.
2. The system according to claim 1, characterized in that: The at least one blind spot detector comprises a plurality of blind spot detectors; and The system also includes a blind spot detector determination unit configured to determine, from among the plurality of blind spot detectors, a blind spot detector capable of detecting blind spot information corresponding to a blind spot for each position of the moving body relative to the moving body detector.
3. The system according to claim 1 or 2, characterized in that Also includes: A blind spot estimation unit is configured to estimate a position of the blind spot depending on a relative position of the moving object with respect to the moving object detector.
4. The system according to claim 3, characterized in that The blind spot estimation unit is configured to estimate the position of the blind spot by considering a set of straight lines directed from the moving object detector to the moving object and passing through the moving object that cross the moving object and are on the opposite side from the moving object detector as the blind spot.
5. The system according to claim 1, characterized in that The at least one moving object detector and the at least one blind spot detector include different types of detectors.
6. The system according to claim 5, characterized in that: The at least one moving body detector is any one of a distance measuring device and a camera; and The at least one blind spot detector is the other of the distance measuring device and the camera.
7. The system according to claim 1, characterized in that Also includes: a synthetic map generating unit configured to generate a synthetic map by synthesizing the detected moving body information and the detected blind spot information; as well as a surrounding monitoring unit configured to monitor the surroundings of the moving body, The generated synthetic map is used for both surrounding monitoring by the surrounding monitoring unit and movement control of the moving body by the controller.
8. A method for moving a moving object by unmanned driving, characterized in that: The method comprises: Detecting moving object information via at least one moving object detector, the moving object information including at least any one of an image of the moving object and three-dimensional point cloud data of the moving object; estimating at least any one of a position and an orientation of the moving object by using the detected moving object information; generating a control command for causing the moving body to travel by using the estimated position and orientation of the moving body; and Blind spot information is detected via at least one blind spot detector, the blind spot information including at least any one of an image of a blind spot of the moving object not detected by the moving object detector, three-dimensional point cloud data of the blind spot, and the presence of an object in the blind spot.
Citation Information
Patent Citations
Method for operating a vehicle and method for operating a manufacturing system
JP2017538619A
