Autonomous vehicle control device

The autonomous vehicle control device addresses the issue of sensor obstruction by generating a travel route that accounts for both observed and potential obstacles, enhancing obstacle avoidance and route optimization.

JP7593273B2Active Publication Date: 2024-12-03TOYOTA INDUSTRIES CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2021147009
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-09-09
Publication Date
2024-12-03
Estimated Expiration
2041-09-09

AI Technical Summary

Technical Problem

The observation by a sensor on an autonomous vehicle can be obstructed by obstacles, making it difficult to detect obstacles in shielded areas, which hinders effective obstacle avoidance.

Method used

An autonomous vehicle control device generates a travel route that considers both observed obstacles and potential obstacles in shielded areas by deriving an obstacle point group using sensor observations and auxiliary points, and adjusts the vehicle's path to avoid these areas based on map information and past observations.

Benefits of technology

The device enables the vehicle to effectively avoid obstacles in both observed and unobserved areas, reducing the risk of collisions and optimizing the travel route to minimize redundant path generation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007593273000001
    Figure 0007593273000001
  • Figure 0007593273000002
    Figure 0007593273000002
  • Figure 0007593273000003
    Figure 0007593273000003
Patent Text Reader

Abstract

To allow an autonomous traveling body to avoid an obstacle that may be present in a shielded area.SOLUTION: A control unit 32 executes obstacle point group derivation processing of deriving an obstacle point group PCob, and processing of allowing an autonomous traveling body 10 to avoid an obstacle Ob1 represented by the obstacle point group PCob based on the obstacle point group PCob derived in the obstacle point group derivation processing. The control unit 32 executes, in the obstacle point group derivation processing, processing of acquiring an observation point group PC1 indicating the position of the obstacle Ob1 observed in an observation area A1 of a sensor 31 based on a result of observation performed by the sensor 31, and processing of generating an auxiliary point group PC2 in a shielded area A11 shielded by the obstacle Ob1 in the observation area A1 based on the acquired observation point group PC1. The obstacle point group PCob includes the observation point group PC1 and the auxiliary point group PC2.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an autonomous vehicle control device. [Background technology]

[0002] Patent Document 1 discloses an autonomous vehicle equipped with a sensor capable of observing obstacles in the vicinity. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2014-089740 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the observation by the sensor may be blocked by an obstacle placed in the observation area. In this case, it becomes difficult for the sensor to observe the obstacle that may be present in the blocked area blocked by the obstacle. Therefore, it is desirable to make the autonomous vehicle avoid the obstacle that may be present in such a blocked area. [Means for solving the problem]

[0005] An autonomous vehicle control device that solves the above problem is an autonomous vehicle control device that generates a driving path along which an autonomous vehicle equipped with a sensor configured to observe obstacles will travel, and includes an obstacle point cloud derivation unit that derives an obstacle point cloud indicating the position of the obstacle relative to the autonomous vehicle based on the observation results of the sensor, and an avoidance unit that causes the autonomous vehicle to avoid the obstacle represented by the obstacle point cloud based on the derived obstacle point cloud, where the obstacle point cloud derivation unit includes an observation point cloud acquisition unit that acquires an observation point cloud indicating the position of the obstacle observed within the observation area of ​​the sensor based on the observation results of the sensor, and an auxiliary point cloud generation unit that generates an auxiliary point cloud within a shielded area of ​​the observation area that is blocked by the obstacle based on the observation point cloud acquired by the observation point cloud acquisition unit, and the obstacle point cloud includes the observation point cloud and the auxiliary point cloud.

[0006] According to this, obstacles observed by the sensor are represented as an observation point cloud, and obstacles that may exist in a blocked area that the sensor could not observe due to the obstacle are represented as an auxiliary point cloud. The autonomous vehicle avoids the obstacles represented by the obstacle point cloud based on the obstacle point cloud including the observation point cloud and the auxiliary point cloud. Therefore, the autonomous vehicle can avoid the obstacle while taking into consideration the possibility that the obstacle is in a blocked area that the sensor could not observe due to the obstacle.

[0007] The above-mentioned autonomous vehicle control device may include a map memory unit that stores map information indicating the environment in which the autonomous vehicle travels, an avoidance determination unit that determines whether the autonomous vehicle can avoid the obstacle represented by the obstacle point cloud within the observation area based on the derived obstacle point cloud, and a route generation unit that generates the driving route for avoiding the obstacle when it is determined that the autonomous vehicle cannot avoid the obstacle within the observation area, and the route generation unit may generate the driving route capable of avoiding the obstacle represented by the obstacle point cloud based on the obstacle point cloud from which the auxiliary point cloud has been removed and the map information.

[0008] According to this, the autonomous vehicle control device determines whether or not an obstacle represented by the obstacle point cloud can be avoided within an observation area based on an obstacle point cloud including an observation point cloud and an auxiliary point cloud. If it is determined that the autonomous vehicle cannot avoid the obstacle within the observation area, the autonomous vehicle control device generates a driving route that can avoid the obstacle using the obstacle point cloud from which the auxiliary point cloud has been removed and map information. In this case, the autonomous vehicle control device does not take into account the removed auxiliary point cloud when generating the driving route. Therefore, it is possible to avoid generating a driving route that avoids an obstructed area where the presence or absence of an obstacle is not observed by a sensor. Therefore, it is possible to prevent the driving route for avoiding the obstacle from becoming redundant.

[0009] In the above-mentioned autonomous vehicle control device, if a point cloud indicating the position of the obstacle that was observed by the sensor in the past and that has become located outside the observation area of ​​the sensor due to movement of the autonomous vehicle is defined as a virtual observation point cloud, the obstacle point cloud derivation unit may comprise: a movement amount acquisition unit that acquires the amount of movement of the autonomous vehicle from the acquisition of the past observation point cloud to the acquisition of the observation point cloud by the observation point cloud acquisition unit, a virtual observation point cloud derivation unit that derives the virtual observation point cloud by moving the past observation point cloud by the movement amount, and a virtual auxiliary point cloud derivation unit that derives a virtual auxiliary point cloud located outside the observation area of ​​the sensor by moving the auxiliary point cloud generated in the past by the movement amount, and the obstacle point cloud may include the virtual observation point cloud and the virtual auxiliary point cloud.

[0010] According to this, the virtual observation point cloud is obtained by moving the previously acquired observation point cloud by the movement amount of the autonomous vehicle. The virtual observation point cloud indicates where an obstacle indicated by the previously observed observation point cloud is located at the time when the observation point cloud is acquired by the observation point cloud acquisition unit. Therefore, it is possible to cause the autonomous vehicle to avoid the obstacle while taking into consideration the position of the obstacle that was previously observed by the sensor but is now located outside the observation area due to the movement of the autonomous vehicle.

[0011] In addition, when the previously generated auxiliary point cloud moves outside the observation area of ​​the sensor due to the movement of the autonomous vehicle, the auxiliary point cloud is moved by the amount of movement of the autonomous vehicle to derive a virtual auxiliary point cloud. The virtual auxiliary point cloud derived in this manner indicates the position after the movement of an area that was in the observation area of ​​the sensor but could not be observed by the sensor due to an obstacle. Since the obstacle point cloud includes the virtual auxiliary point cloud, the autonomous vehicle can avoid the area represented by the virtual auxiliary point cloud when avoiding an obstacle. The autonomous vehicle can avoid the obstacle while avoiding the area that could not be observed by the sensor due to the obstacle. Therefore, the possibility that the autonomous vehicle will come into contact with an object in an area blocked by an obstacle can be reduced.

[0012] In the above-mentioned autonomous vehicle control device, the route generation unit may further generate the driving route capable of avoiding the obstacles represented by the observation point group and the virtual observation point group based on the virtual observation point group.

[0013] With this, the autonomous vehicle control device can generate a driving route by taking into account not only the positions of obstacles within the observation area, but also the positions of obstacles that were previously located within the observation area but are now located outside the observation area due to the autonomous vehicle's movement.

[0014] In the above-mentioned autonomous vehicle control device, the direction observed by the sensor is defined as the observation direction, and the direction in which the driving path generated by the path generation unit extends is defined as the route direction.The autonomous vehicle control device is provided with a rotation unit that rotates the autonomous vehicle in a rotation direction from the observation direction toward the route direction, and aligns the observation direction with the route direction, and the obstacle point cloud derivation unit may further derive the obstacle point cloud while the autonomous vehicle is turning by the rotation unit.

[0015] According to this, when the autonomous vehicle turns, the obstacle point cloud acquisition unit acquires an obstacle point cloud including a virtual observation point cloud derived during the turn. Therefore, it is possible to check the presence or absence of obstacles around the autonomous vehicle by turning, and then guide the autonomous vehicle to the travel route generated by the route generation unit.

[0016] In the above-mentioned autonomous vehicle control device, the rotation unit may align the observation direction with the route direction by rotating the autonomous vehicle only in the rotation direction. According to this, the direction in which the autonomous vehicle turns when checking for the presence or absence of obstacles around the autonomous vehicle by turning is the same as the direction in which the autonomous vehicle turns when directing the observation direction toward the route direction. Therefore, it is possible to eliminate the waste of turning operations caused by reversing the turning direction of the autonomous vehicle. Effect of the Invention

[0017] According to the present invention, it is possible to cause an autonomous vehicle to avoid obstacles that may be present in an obstructed area. [Brief description of the drawings]

[0018] [Figure 1] FIG. [Diagram 2] FIG. 2 is a block diagram of an autonomous vehicle. [Diagram 3] 13 is a flowchart showing an obstacle point cloud derivation process. [Figure 4] 13 is a flowchart showing an avoidance process. [Diagram 5] FIG. 11 is a diagram showing an example of the operation of an autonomous vehicle in an autonomous vehicle control process. [Figure 6] FIG. 11 is a diagram showing an example of the operation of an autonomous vehicle in an autonomous vehicle control process. [Figure 7] FIG. 11 is a diagram showing an example of the operation of an autonomous vehicle in an autonomous vehicle control process. [Figure 8] FIG. 11 is a diagram showing an example of the operation of an autonomous vehicle in an autonomous vehicle control process. [Figure 9] FIG. 11 is a diagram showing an example of the operation of an autonomous vehicle in an autonomous vehicle control process. [Figure 10] FIG. 11 is a diagram showing an example of the operation of an autonomous vehicle in an autonomous vehicle control process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] <Configuration> Hereinafter, one embodiment of an autonomous vehicle to which an autonomous vehicle control device is applied will be described. As shown in Fig. 1, the autonomous vehicle 10 includes a vehicle 20, a sensor 31 mounted on the vehicle 20, and a control device 32 mounted on the vehicle 20. The vehicle 20 includes a vehicle body 21 and a plurality of wheels 22. The autonomous vehicle 10 is a transport cart that transports loads. The autonomous vehicle 10 of this embodiment is configured to be movable in all directions and to be able to turn on the spot around the vehicle center position P.

[0020] The wheels 22 in this embodiment are omnidirectional wheels. An omnidirectional wheel is a wheel that rotates together with the axle and also allows movement in the axial direction of the axle. Four wheels 22 are provided. By controlling the number of rotations and the direction of rotation of the wheels 22, the vehicle 20 can move in all directions while maintaining the orientation of the body 21, move while changing the orientation of the body 21, and change the orientation of the body 21 without moving. Note that the above-mentioned "omnidirectional" refers to the direction of movement on the road surface or floor surface on which the vehicle 20 runs. Hereinafter, for convenience of explanation, the surface on which the vehicle 20 runs is referred to as a horizontal plane.

[0021] 2, the autonomous vehicle 10 includes a drive mechanism 41 that drives the wheels 22. The drive mechanism 41 includes a motor 42 for rotating the wheels 22, and a motor driver 43 that drives the motor 42. Although not shown in the figure, the number of motors 42 and motor drivers 43 provided is the same as the number of wheels 22. The motor driver 43 controls the rotation speed of the motor 42 in response to a command from the control device 32. The control device 32 can control the traveling direction of the vehicle 20 by controlling the rotation speed of the motor 42 via the motor driver 43.

[0022] Next, the sensor 31 and the control device 32 will be described in detail. 1, the sensor 31 is configured to be able to observe an obstacle Ob1 within an observation area A1. The sensor 31 in this embodiment is an RGB camera including an imaging element such as a CMOS (Complementary Metal Oxide Transistor).

[0023] The observation area A1 is an area extending from the sensor 31 in the observation direction D1. The observation direction D1 is a direction parallel to the horizontal plane. As the observation area A1 moves from the sensor 31 toward the observation direction D1, it expands in a direction parallel to the horizontal plane and perpendicular to the observation direction D1. The observation direction D1 indicates the center of the observation area A1 based on the sensor 31. The observation area A1 is included in a range of a predetermined observation angle from the observation direction D1 in the horizontal plane. The observation angle is, for example, in a range of ±60 degrees with respect to the observation direction D1. The observation angle in this embodiment is the angle of view of the sensor 31. The sensor 31 is mounted at a sensor position Ps that is a position away from the running object center position P. Hereinafter, for convenience of explanation, a virtual boundary line that extends from the sensor position Ps and whose angle with the observation direction D1 is the above-mentioned observation angle is referred to as the observation boundary line B1, B2. In this embodiment, the direction from the running object center position P toward the sensor position Ps in the horizontal plane coincides with the observation direction D1.

[0024] As shown in FIG. 5, when an obstacle Ob1 exists within an observation area A1, the observation area A1 is made up of a blocked area A11 and an observable area A12. The shielded area A11 is an area in the observation area A1 where the observation by the sensor 31 is blocked by the obstacle Ob1. In other words, the shielded area A11 is a blind spot of the obstacle Ob1 as seen from the sensor 31, such as the depth of the obstacle Ob1 based on the sensor 31. For example, when the obstacle Ob1 exists in the observation area A1, the sensor 31 observes a part of the obstacle Ob1 facing the sensor 31. However, the sensor 31 may not be able to observe an area of ​​the obstacle Ob1 that is blocked by a part observed by the sensor 31. The area blocked by the part of the obstacle Ob1 corresponds to the shielded area A11. In this case, the sensor 31 cannot observe an obstacle that may be located in the shielded area A11. Note that an obstacle that may be located in the shielded area A11 is, for example, a part of the obstacle Ob1 or an obstacle different from the obstacle Ob1.

[0025] The observable area A12 is an area of ​​the observation area A1 other than the blocked area A11. The observable area A12 is an area in which the field of view of the sensor 31 is not blocked by the obstacle Ob1. The observable area A12 is an area in which the obstacle Ob1 can be directly observed by the sensor 31.

[0026] As shown in FIG. 2, the control device 32 includes a CPU 33, a storage unit 34 including a RAM and a ROM, and an auxiliary storage device 35. The storage unit 34 stores various programs for controlling the vehicle 20. The control device 32 may include dedicated hardware for executing at least some of the various processes, such as an application specific integrated circuit (ASIC). The control device 32 may be configured as a circuit including one or more processors that operate according to a computer program, one or more dedicated hardware circuits such as an ASIC, or a combination thereof. The processor includes a CPU and memories such as a RAM and a ROM. The storage unit 34 stores program code or instructions configured to cause the CPU to execute the processes. The storage unit 34, i.e., the computer readable medium, includes anything that can be accessed by a general-purpose or dedicated computer. The auxiliary storage device 35 is a rewritable non-volatile memory. Examples of the auxiliary storage device 35 include an EEPROM (Electrically Erasable Programmable Read-Only Memory) and a flash memory. The auxiliary storage device 35 stores information indicating an environmental map. The environmental map is information about the physical structure of the surrounding environment of the autonomous vehicle 10, such as the shape and size of the environment in which the autonomous vehicle 10 is used. The control device 32 equipped with the auxiliary storage device 35 that stores the environmental map corresponds to the map storage unit of this embodiment.

[0027] As shown in Fig. 1, when the vehicle 20 is driven, the control device 32 generates a driving route R. The driving route R is a route from the current position, which is the starting point of the vehicle 20, to the final destination G. When the vehicle 20 is moving straight, the observation direction D1 is parallel to the driving route R. In Fig. 1, the driving route R and the observation direction D1 overlap. The driving route R can be generated by, for example, converting a drivable route into a grid map and generating a route, or by a potential method using a potential field.

[0028] The control device 32 sets a position on the travel route R a predetermined distance away from the vehicle 20 as a target point, and controls the drive mechanism 41 to travel toward the target point. The control device 32 drives the vehicle 20 so that the observation direction D1 of the sensor 31 faces the traveling direction of the vehicle 20. In the situation shown in FIG. 1, the target point coincides with the final destination point G. Hereinafter, for convenience of explanation, the traveling of the vehicle 20 such that the observation direction D1 coincides with the traveling direction of the vehicle 20 will be referred to as normal traveling. The traveling direction of the vehicle 20 in normal traveling coincides with the direction in which the traveling route R extends.

[0029] The control device 32 performs an autonomous vehicle control process. By performing the autonomous vehicle control process, the control device 32 causes the autonomous vehicle 10 to avoid the obstacle Ob1 observed by the sensor 31, and then causes the autonomous vehicle 10 to travel to the final destination point G. At this time, the control device 32 keeps the distance between the vehicle 20 and the obstacle Ob1 at or above a predetermined value so that the vehicle 20 and the obstacle Ob1 do not come into contact with each other. The control device 32 that performs this process corresponds to the autonomous vehicle control device of this embodiment.

[0030] An example of the autonomous vehicle control process will be described below with reference to Fig. 3 and Fig. 4. The autonomous vehicle control process is performed while the vehicle 20 is traveling. The autonomous vehicle control process includes an obstacle point cloud derivation process and an avoidance process.

[0031] First, an example of the obstacle point cloud derivation process will be described. As shown in Fig. 3, the control device 32 performs an obstacle point cloud derivation process. As a result, as shown in Fig. 5, the control device 32 derives an obstacle point cloud PCob based on the observation results of the sensor 31. The obstacle point cloud derivation process is repeatedly performed at a predetermined update period. As a result, the obstacle point cloud PCob is updated at the update period. The control device 32 that executes the obstacle point cloud derivation process corresponds to an obstacle point cloud derivation unit of this embodiment.

[0032] The obstacle point cloud PCob indicates the position of the obstacle Ob1 relative to the autonomous mobile body 10. The obstacle point cloud PCob is composed of one or more obstacle points Pob. It is a point indicating the position of the obstacle Ob1. For example, the obstacle point cloud PCob is the relative coordinates of the obstacle Ob1 relative to the autonomous mobile body 10 in a horizontal plane. In this embodiment, the obstacle point cloud PCob is a point cloud expressed in mobile body coordinates. The mobile body coordinates are expressed in a two-dimensional coordinate system with the mobile body center position P as the origin. In the mobile body coordinates, the direction parallel to the observation direction D1 is the Y direction, and the direction perpendicular to the observation direction D1 is the X direction. The XY plane is parallel to the horizontal plane.

[0033] 5 to 10, the obstacle point cloud PCob of this embodiment includes an observation point cloud PC1, an auxiliary point cloud PC2, a virtual observation point cloud PCi1, and a virtual auxiliary point cloud PCi2. The obstacle points Pob of this embodiment include an observation point P1, an auxiliary point P2, a virtual observation point Pi1, and a virtual auxiliary point Pi2.

[0034] The observation point group PC1 indicates the position of an obstacle Ob1 within the observation area A1 of the sensor 31. The observation point group PC1 is made up of one or more observation points P1. The auxiliary point group PC2 indicates the position of an obstacle that may be located in the blocked area A11. An obstacle that may be located in the blocked area A11 is, for example, a part of the obstacle Ob1 or an obstacle different from the obstacle Ob1. The auxiliary point group PC2 is composed of one or more auxiliary points P2.

[0035] The virtual observation point group PCi1 indicates the position of an obstacle Ob1 previously observed by the sensor 31. The virtual observation point group PCi1 is made up of one or more virtual observation points Pi1. The virtual auxiliary point group PCi2 indicates the position of an obstacle Ob1 that may be located within the blocked area A11 derived based on the past observation results of the sensor 31. The virtual auxiliary point group PCi2 is made up of one or more virtual auxiliary points Pi2.

[0036] 3, in step S11, the control device 32 acquires an observation point group PC1 and an observation time t1 based on the observation results of the sensor 31. The control device 32 that executes the process of step S11 corresponds to the observation point group acquisition unit of this embodiment.

[0037] Observation time t1 is the time when the observation result of sensor 31 is obtained. Observation time t1 can also be said to be the time when observation point group PC1 is acquired by control device 32. Control device 32 stores observation point group PC1 and observation time t1 acquired in step S11 in auxiliary storage device 35. Note that acquisition and storage of observation time t1 are optional.

[0038] An example of a method for deriving the observation point group PC1 expressed in vehicle coordinates will be described. The control device 32 acquires image data captured by the sensor 31. The image data may include an object located within the observation area A1. Each pixel of the acquired image data is associated with coordinates on the image data and depth information. The image coordinates are, for example, two-dimensional coordinates with an arbitrary point on the image as the origin, and indicate the direction of the object represented in each pixel relative to the sensor 31. The depth information indicates the distance between the object represented in each pixel and the sensor 31. The depth information is obtained, for example, by performing depth estimation on the image data. The specific aspect of the depth estimation is arbitrary, and examples include SfM (Structure from Motion) and machine learning using a convolution neural network (CNN). The depth information may be obtained separately from a distance sensor or the like.

[0039] The control device 32 derives sensor coordinates corresponding to each pixel from the acquired image coordinates and depth information. The sensor coordinates are, for example, a three-dimensional coordinate system with the sensor position Ps as the origin. In the sensor coordinates, the direction parallel to the observation direction D1 is the Y direction, the direction perpendicular to the observation direction D1 is the X direction, and the direction perpendicular to both the X direction and the Y direction is the Z direction. Here, the X direction and the Y direction are each parallel to the horizontal plane. The sensor coordinates may be expressed as polar coordinates with the sensor position Ps as the origin. In this way, the control device 32 derives a point cloud on the sensor coordinates of the target indicated by each pixel.

[0040] The control device 32 converts the point cloud into the vehicle coordinates based on the X and Y coordinates of the point cloud on the derived sensor coordinates. The control device 32 derives the point cloud obtained by the conversion as the observation point cloud PC1. The conversion deletes the Z coordinate included in the point cloud on the sensor coordinates. In other words, the conversion is a projection from the three-dimensional sensor coordinates to the two-dimensional vehicle coordinates. The control device 32 may convert only the Z coordinates of the derived point cloud on the sensor coordinates that are within a predetermined allowable range into the vehicle coordinates. The allowable range may be appropriately set based on, for example, the height of the step on which the autonomous vehicle 10 can travel or the vehicle height of the autonomous vehicle 10. This prevents, for example, the floor on which the autonomous vehicle 10 travels or the step that the autonomous vehicle 10 can overcome from being derived as the observation point cloud PC1.

[0041] For convenience of explanation, each point group described below is represented in a vehicle coordinate system unless otherwise specified. After step S11 is executed, the process proceeds to step S12, where the control device 32 generates an auxiliary point group PC2 in the shielded area A11. The shielded area A11 includes the boundary between the shielded area A11 and the observable area A12. In this embodiment, at least a part of the auxiliary point group PC2 is generated at the boundary between the shielded area A11 and the observable area A12. The auxiliary point group PC2 is composed of a plurality of auxiliary points P2. The distance between the auxiliary points P2 is less than the travelable width of the autonomous vehicle 10. The travelable width of the autonomous vehicle 10 is the width in which the autonomous vehicle 10 can travel. The travelable width is longer than the maximum dimension of the autonomous vehicle 10 in the horizontal direction by a predetermined margin width. The margin width can be arbitrarily set by the user based on the allowable distance between the vehicle 20 and the obstacle Ob1. In addition, since the observation point cloud PC1 is used to derive the auxiliary point cloud PC2, the auxiliary point cloud PC2 is also a point cloud indicating the position of the obstacle Ob1 in the shielded area A11 at the observation time t1. The control device 32 that executes the process of step S12 corresponds to the auxiliary point cloud generation unit of this embodiment.

[0042] The method of generating the auxiliary point group PC2 in the shielded area A11 is arbitrary, but for example, the control device 32 may generate the auxiliary point P2 at a position farther away from the observation point P1 with respect to the sensor position Ps on a straight line connecting the sensor position Ps and the observation point P1. In particular, in this embodiment, when generating the auxiliary point group PC2, the control device 32 selects the observation point P1 having the largest direction from the sensor position Ps toward the observation point P1 with reference to the observation direction D1. The control device 32 generates the auxiliary point P2 at a position farther away from the observation point P1 with respect to the sensor position Ps on a straight line connecting the sensor position Ps and the selected observation point P1. This allows the control device 32 to generate the auxiliary point group PC2 at the boundary between the shielded area A11 and the observable area A12. The distance between the auxiliary points P2 generated at the boundary between the shielded area A11 and the observable area A12 is an arbitrary value less than the travelable width of the autonomous mobile unit 10. Note that the control device 32 may generate the auxiliary point group PC2 by deriving the shielded area A11 based on the observation point group PC1 and placing the auxiliary point P2 at an arbitrary position within the derived shielded area A11.

[0043] Next, the process proceeds to step S13, where the control device 32 acquires a past observation point cloud, a past auxiliary point cloud, and a past observation time t2. The past observation point cloud is the observation point cloud PC1 acquired earlier than the observation point cloud PC1 acquired in step S11. The past auxiliary point cloud is the auxiliary point cloud PC2 generated earlier than the auxiliary point cloud PC2 generated in step S12. The past observation time t2 is the time when the observation point cloud PC1 was acquired in the past step S11. In this embodiment, the past observation time t2 is also the time when the auxiliary point cloud PC2 was generated in the past step S12. In this embodiment, the observation point cloud PC1, the auxiliary point cloud PC2, and the observation time t1 stored in the auxiliary storage device 35 in the obstacle point cloud derivation process performed in the previous update cycle are acquired as the past observation point cloud, the past auxiliary point cloud, and the past observation time t2, respectively. Note that acquisition of the past observation time t2 is optional.

[0044] The control device 32 acquires the amount of movement δ of the autonomous mobile unit 10 from the acquisition of the past observation point group in step S13 to the acquisition of the observation point group PC1 in step S11. The amount of movement δ includes the traveling direction and traveled distance of the autonomous mobile unit 10. In this embodiment, the amount of movement δ is the change in the mobile unit center position P in the absolute coordinate system from the past observation time t2 to the observation time t1. The absolute coordinate system is a coordinate system in which the ground surface on which the wheels 22 are in contact appears stationary.

[0045] The method of acquiring the movement amount δ is arbitrary, but for example, the control device 32 uses odometry to estimate the travel distance and travel direction of the autonomous mobile body 10 from the rotation amount of the wheels 22 and the rotation amount of the motor 42. The control device 32 acquires the movement amount δ from the estimated travel distance and travel direction of the autonomous mobile body 10. Note that the control device 32 may derive the movement amount δ using Simultaneous Localization and Mapping (SLAM). The control device 32 that executes the process of step S14 corresponds to the movement amount acquisition unit of this embodiment.

[0046] Next, the process proceeds to step S15, where the control device 32 derives a virtual observation point group PCi1 and a virtual auxiliary point group PCi2 by moving the past observation point group and the past auxiliary point group by a movement amount δ. In particular, the control device 32 moves any past observation point group whose distance from other past observation point groups is equal to or greater than the omission distance and less than the driving width. The omission distance indicates the resolution of the obstacle Ob1 recognized by the control device 32. The omission distance can be set arbitrarily based on, for example, the observation accuracy of the obstacle Ob1. The control device 32 that executes the process of step S15 corresponds to the virtual observation point group derivation unit and the virtual auxiliary point group derivation unit of this embodiment.

[0047] In this embodiment, the control device 32 selects the past observation point group from the previous update cycle, i.e., the past observation point group acquired in step S13, whose distance from the other past observation point groups is equal to or greater than the omittable distance and less than the driving width. The control device 32 translates the selected past observation point group by the movement amount δ acquired in step S14, to derive the virtual observation point group PCi1.

[0048] As described above, the moving object center position P moves by the movement amount δ from the past observation time t2 to the observation time t1. Therefore, the obstacle Ob1 shown in the past observation point group obtained at the past observation time t2 moves in the direction in which the moving object center position P moved, i.e., in the opposite direction to the traveling direction of the autonomous moving object 10, by the same distance as the movement distance of the moving object center position P.

[0049] Therefore, the virtual observation point group PCi1 is located at a position moved by the movement amount δ from the past observation point group PC1. In detail, the virtual observation point group PCi1 is located at a position moved from the past observation point group PC1 in the opposite direction to the movement direction of the moving object center position P by the same distance as the movement distance of the moving object center position P. Similarly, the virtual auxiliary point group PCi2 is located at a position moved by the movement amount δ from the past auxiliary point group PC2. Therefore, the point group obtained by translating the past observation point group by the movement amount δ becomes the virtual observation point group PCi1 representing the position of the obstacle Ob1 at observation time t1.

[0050] Here, due to the movement of the autonomous mobile unit 10, an obstacle Ob1 that was located within the observation area A1 at the past observation time t2 may be located outside the observation area A1 at the observation time t1. In this case, the virtual observation point group PCi1 and the virtual auxiliary point group PCi2 are located outside the observation area A1. Therefore, the virtual observation point group PCi1 and the virtual auxiliary point group PCi2 indicate the position of the obstacle located outside the observation area A1.

[0051] Next, the process proceeds to step S16, where the control device 32 removes the virtual observation point group PCi1 in the observation area A1 and the virtual auxiliary point group PCi2 in the observation area A1. In other words, the control device 32 leaves the virtual observation point group PCi1 outside the observation area A1 and the virtual auxiliary point group PCi2 outside the observation area A1 as the obstacle point group PCob. Whether the virtual observation point group PCi1 and the virtual auxiliary point group PCi2 are within the observation area A1 can be determined by whether the angle between the direction in the horizontal plane relative to the sensor position Ps of the virtual observation point Pi1 and the virtual auxiliary point Pi2 and the observation direction D1 is within the observation angle range. If the angle is within the observation angle range, the control device 32 determines that the virtual observation point group PCi1 and the virtual auxiliary point group PCi2 are within the observation area A1. On the other hand, if the angle is outside the observation angle range, the control device 32 determines that the virtual observation point group PCi1 and the virtual auxiliary point group PCi2 are outside the observation area A1. The virtual observation point group PCi1 and the virtual auxiliary point group PCi2 that remain without being removed in step S16 are located outside the observation area A1. Therefore, the virtual observation point group PCi1 and the virtual auxiliary point group PCi2 indicate the position of the obstacle Ob1 that has come to be located outside the observation area A1 of the sensor 31 due to the movement of the autonomous mobile body 10. The control device 32 that executes the processing of step S16 corresponds to the auxiliary point group removal unit of this embodiment.

[0052] Next, the process proceeds to step S17, where the control device 32 removes the auxiliary point group PC2 and the virtual auxiliary point group PCi2 from within the observable area A12. Note that in this embodiment, the virtual auxiliary point group PCi2 from within the observable area A12 has been removed in step S16.

[0053] Next, proceeding to step S18, the control device 32 removes the set of observation points PC1, the set of virtual observation points PCi1, the set of auxiliary points PC2, and the set of virtual auxiliary points PCi2 that are located outside the search area A2. As shown in Figs. 5 to 10, the search area A2 includes at least a part of the autonomous vehicle 10. The search area A2 includes the vehicle center position P and the sensor position Ps. In this embodiment, the search area A2 includes the entire autonomous vehicle 10. The search area A2 is rectangular. The size of the search area A2 may be set in advance by a user, or may be set appropriately based on the traveling state of the autonomous vehicle 10, for example, the braking distance of the autonomous vehicle 10 corresponding to the traveling speed.

[0054] 3, the process proceeds to step S19, where the control device 32 derives, as an obstacle point group PCob, those remaining without being removed in the processes from step S16 to step S18, among the observation point group PC1, auxiliary point group PC2, virtual observation point group PCi1, and virtual auxiliary point group PCi2 acquired or derived in the processes from step S11 to step S15. In other words, the control device 32 derives, as an obstacle point group PCob, those located within the search area A2, among the observation point group PC1 in the observation area A1, the auxiliary point group PC2 in the observation area A1, the virtual observation point group PCi1 outside the observation area A1, and the virtual auxiliary point group PCi2 outside the observation area A1.

[0055] The control device 32 updates the obstacle point cloud PCob of the previous update cycle by storing the observation point cloud PC1 and virtual observation point cloud PCi1 derived as the obstacle point cloud PCob as past observation point clouds, the auxiliary point cloud PC2 and virtual auxiliary point cloud PCi2 as past auxiliary point clouds, and the observation time t1 as past observation time t2 in the auxiliary storage device 35. After completing the process of step S19, the control device 32 terminates the obstacle point cloud derivation process.

[0056] Next, the control device 32 performs avoidance processing using the obstacle point cloud PCob derived by the obstacle point cloud derivation processing described above. An example of the avoidance processing will be described below. 4, in step S21, the control device 32 determines whether or not an obstacle Ob1 exists in the search area A2. In detail, the control device 32 determines whether or not the obstacle point cloud PCob derived by the obstacle point cloud derivation process is included in the search area A2. If the determination result in step S21 is negative, the control device 32 ends the avoidance process and causes the autonomous mobile object 10 to continue normal traveling.

[0057] If the determination result of step S21 is positive, the process proceeds to step S22, where the control device 32 determines whether or not the autonomous vehicle 10 can avoid the obstacle Ob1 within the observation area A1. For example, in step S22, the control device 32 determines whether or not an area in which the obstacle point cloud PCob does not exist and which is equal to or larger than the travelable width is within the observation area A1. The control device 32 that executes the process of step S21 corresponds to the avoidance determination unit of this embodiment. If the determination result of step S21 is positive, the process proceeds to step S23, where the control device 32 causes the autonomous vehicle 10 to perform avoidance traveling. The autonomous vehicle 10 is caused to avoid the obstacle Ob1 indicated by the obstacle point cloud PCob. Avoidance traveling is traveling in a direction that can avoid the obstacle Ob1 determined to exist in step S21. As an example of avoidance traveling, the control device 32 determines the traveling direction based on the position of the obstacle point cloud PCob. The control device 32 searches for an area within the search area A2 that does not include the obstacle point cloud PCob and has an interval between the obstacle points Pob that is equal to or greater than the travelable width. The control device 32 determines the direction in which the angle between the direction from the vehicle center position P toward the area and the direction of the travel route R is the smallest as the travel direction of the autonomous vehicle 10. Thereafter, the control device 32 causes the autonomous vehicle 10 to travel in the travel direction. In other words, the control device 32 causes the autonomous vehicle 10 to avoid the obstacle Ob1 by making the autonomous vehicle 10 detour around the area in which the interval between the obstacle points Pob is less than the travelable width, which is the area indicated by the obstacle point Pob in this embodiment. The control device 32 that executes the process of step S23 corresponds to the avoidance unit in this embodiment. After the update period has elapsed since the start of the avoidance travel, the control device 32 returns to step S21 after performing the obstacle point cloud derivation process.

[0058] On the other hand, if the determination result in step S22 is negative, the process proceeds to step S24, where the control device 32 stops the autonomous vehicle 10. For ease of explanation, the position where the autonomous vehicle 10 is stopped by the processing in step S24 will be simply referred to as the stop position. In this embodiment, the stop position is assumed to coincide with the vehicle center position P at the time when the autonomous vehicle 10 stops.

[0059] Next, the process proceeds to step S25, where the control device 32 generates a travel route R from the stop position to the final destination point G based on the obstacle point cloud PCob derived in the obstacle point cloud derivation process and the environmental map. The control device 32 that executes the process of step S25 corresponds to the route generation unit of this embodiment.

[0060] When generating a travel route R to the final destination point G, the control device 32 removes the auxiliary point group PC2 and the virtual auxiliary point group PCi2 from the obstacle point group PCob. The control device 32 generates a travel route R that can avoid the obstacle Ob1 represented by the observation point group PC1 and the virtual observation point group PCi1 based on the obstacle point group PCob from which the observation point group PC1 and the virtual auxiliary point group PCi2 have been removed and the map information. In detail, the control device 32 regards the area represented by the obstacle point group PCob from which the auxiliary point group PC2 and the virtual auxiliary point group PCi2 have been removed as an area on the environmental map in which the autonomous mobile unit 10 cannot travel, and generates a travel route R from the stop position to the final destination point G. The travel route R generated in step S25 extends, for example, outside the observation area A1. The travel route R generated in step S25 may further extend outside the search area A2.

[0061] Next, the process proceeds to step S26, where the control device 32 turns the autonomous vehicle 10 so as to align the observation direction D1 with the route direction D2 along which the travel route R generated in step S25 extends. The control device 32 that executes the process of step S26 corresponds to the turning unit in this embodiment. While the turning is being performed in step S26, the obstacle point cloud derivation process is performed at a predetermined update period.

[0062] As shown in FIG. 7, the control device 32 of this embodiment rotates the autonomous vehicle 10 from the observation direction D1 before the rotation toward the route direction D2. This reduces the possibility that the autonomous vehicle 10 will come into contact with an obstacle Ob1 located outside the observation area A1. Hereinafter, for convenience of explanation, the direction in which the autonomous vehicle 10 rotates from the observation direction D1 toward the travel route R is referred to as a rotation direction D3. The control device 32 aligns the observation direction D1 with the route direction D2 by rotating the autonomous vehicle 10 only in the rotation direction D3. In this embodiment, the control device 32 rotates the autonomous vehicle 10 360 degrees or more in the rotation direction D3, and then further rotates the autonomous vehicle 10 in the rotation direction D3 to align the observation direction D1 with the route direction D2. This eliminates the need to reverse the direction in which the autonomous vehicle 10 rotates when aligning the observation direction D1 with the route direction D2, thereby shortening the time required to align the observation direction D1 with the route direction D2. Furthermore, the turning direction D3 in this embodiment coincides with the direction in which the angle between the observation direction D1 and the route direction D2 is smaller, either clockwise or counterclockwise. This makes the turning angle of the autonomous mobile unit 10 smaller than when the turning direction D3 coincides with the direction in which the angle between the observation direction D1 and the route direction D2 is larger. Therefore, it is possible to align the observation direction D1 with the route direction D2 while checking the surrounding obstacle Ob1 in a shorter time. Note that the turning manner of the autonomous mobile unit 10 is arbitrary, but for example, the control device 32 turns the autonomous mobile unit 10 on the spot in the turning direction D3.

[0063] When the observation direction D1 is aligned with the route direction D2 by the processing of step S26, the process proceeds to step S27, where the control device 32 causes the autonomous mobile device 10 to travel along the travel route R generated in step S25. At this time, as shown in Figs. 8 to 10, the control device 32 updates the obstacle point cloud PCob at an update period in parallel with the travel of the autonomous mobile device 10.

[0064] <effect> Next, the operation of this embodiment will be described. 5, when an obstacle Ob1 exists within the observation area A1, the control device 32 performs an obstacle point cloud derivation process to derive an observation point cloud PC1 and generate an auxiliary point cloud PC2, and derive an obstacle point cloud PCob including the observation point cloud PC1 and the auxiliary point cloud PC2. Since the obstacle point cloud PCob exists within the observation area A1, the determination result of step S21 is positive, and the process proceeds to step S22.

[0065] The interval between the points included in the obstacle point cloud PCob in the observation area A1 is less than the travelable width. In addition, the distance between the observation boundaries B1, B2 and the obstacle point cloud PCob is also less than the travelable width. Therefore, there is no area in the observation area A1 where the obstacle point cloud PCob does not exist and where the width is less than the travelable width. Therefore, the determination result of step S23 is negative, and the process proceeds to step S24, where the control device 32 stops the autonomous vehicle 10. Then, the control device 32 generates a travel route R to the final destination point G by performing the process of step S25.

[0066] 6, the control device 32 generates a driving route R that can avoid the observation point group PC1 based on the environmental map. In other words, when generating the driving route R, the control device 32 generates the driving route R by regarding the area represented by the auxiliary point group PC2 and the virtual auxiliary point group PCi2 as drivable.

[0067] 7 and 8, the process then proceeds to step S26, where the control device 32 aligns the observation direction D1 with the route direction D2 of the travel route R generated in step S25 while rotating the autonomous vehicle 10 by 360 degrees or more in the turning direction D3. At this time, the position of an obstacle Ob2 outside the observation area A1 in the situation shown in Fig. 6 is represented as an obstacle point cloud PCob including a virtual observation point cloud PCi1 and a virtual auxiliary point cloud PCi2.

[0068] Then, as shown in FIGS. 9 and 10, the control device 32 causes the autonomous mobile body 10 to travel along the travel route R to a final destination point G. <Effects> The effects of this embodiment will be described below.

[0069] (1) The control device 32 executes an obstacle point cloud derivation process to derive an obstacle point cloud PCob, and a process of step S23 to cause the autonomous vehicle 10 to avoid an obstacle Ob1 represented by the obstacle point cloud PCob based on the obstacle point cloud PCob derived in the obstacle point cloud derivation process. In the obstacle point cloud derivation process, the control device 32 executes a process of step S11 to acquire an observation point cloud PC1 indicating the position of the obstacle Ob1 observed in the observation area A1 of the sensor 31 based on the observation result of the sensor 31, and a process of step S12 to generate an auxiliary point cloud PC2 in the observation area A1 within the shielded area A11 that is shielded by the obstacle Ob1 based on the observation point cloud PC1 acquired in step S11. The obstacle point cloud PCob includes the observation point cloud PC1 and the auxiliary point cloud PC2.

[0070] According to this, an obstacle Ob1 observed by the sensor 31 is represented as an observation point group PC1, and an obstacle that may exist in the blocked area A11 that the sensor 31 could not observe because of the obstacle Ob1 is represented as an auxiliary point group PC2. The autonomous mobile device 10 avoids the obstacle Ob1 represented by the obstacle point group PCob based on the obstacle point group PCob including the observation point group PC1 and the auxiliary point group PC2. Therefore, it is possible to cause the autonomous mobile device 10 to avoid the obstacle Ob1 after taking into consideration the possibility that there is an obstacle in the blocked area A11 that the sensor 31 could not observe because of the obstacle Ob1.

[0071] (2) The control device 32 includes an auxiliary storage device 35 that stores map information indicating the environment in which the autonomous mobile unit 10 travels. The control device 32 executes a process of step S22 in which it is determined whether the autonomous mobile unit 10 can avoid the obstacle Ob1 represented by the obstacle point cloud PCob within the observation area A1 based on the obstacle point cloud PCob derived in the obstacle point cloud derivation process, and a process of step S25 in which it is determined that the autonomous mobile unit 10 cannot avoid the obstacle Ob1 within the observation area A1 as a result of the determination in step S22, in which it is generated a driving route R for avoiding the obstacle Ob1.

[0072] In step S25, the control device 32 generates a driving route R for avoiding the obstacle Ob1 represented by the obstacle point cloud PCob, based on the obstacle point cloud PCob from which the auxiliary point cloud PC2 has been removed, and on the map information.

[0073] According to this, in step S22, the control device 32 determines whether or not the autonomous vehicle 10 can avoid the obstacle Ob1 represented by the obstacle point cloud PCob within the observation area A1 based on the obstacle point cloud PCob including the observation point cloud PC1 and the auxiliary point cloud PC2. If it is determined that the autonomous vehicle 10 cannot avoid the obstacle Ob1 within the observation area A1, that is, if the determination result of step S22 is negative, the control device 32 uses the obstacle point cloud PCob from which the auxiliary point cloud PC2 has been removed and the map information to generate a travel route R that can avoid the obstacle Ob1, taking into consideration areas outside the observation area A1 in particular. In this case, when generating the travel route R, the control device 32 does not consider the removed auxiliary point cloud PC2. Therefore, it is possible to avoid generating the travel route R by avoiding the blocked area A11 in which the sensor 31 has not observed whether the obstacle Ob1 exists. Therefore, it is possible to prevent the travel route R for avoiding the obstacle Ob1 from becoming redundant.

[0074] (3) The obstacle point cloud PCob includes a virtual observation point cloud PCi1 indicating the position of the obstacle Ob1 that was observed by the sensor 31 in the past and that has come to be located outside the observation area of ​​the sensor 31 due to the movement of the autonomous mobile unit 10. If the observation point cloud PC1 acquired in step S11, which is earlier than the observation point cloud PC1 acquired in step S11, is taken as the past observation point cloud, the control device 32 executes a process of step S14 of acquiring a movement amount δ of the autonomous mobile unit 10 from the past observation time t2 at which the past observation point cloud was acquired in the past step S11 to the observation time t1 at which the observation point cloud PC1 is acquired in step S11, and a process of step S15 of deriving a virtual observation point cloud PCi1 by moving the past observation point cloud by the movement amount δ. In addition, in step S15, the control device 32 derives a virtual auxiliary point cloud PCi2 located outside the observation area A1 of the sensor 31 by moving the auxiliary point cloud PC2 generated in the past by the movement amount δ. The obstacle point cloud PCob includes a virtual observation point cloud PCi1 and a virtual auxiliary point cloud PCi2.

[0075] According to this, the virtual observation point cloud PCi1 is obtained by moving the previously acquired observation point cloud PC1 by the movement amount δ of the autonomous mobile body 10. The virtual observation point cloud PCi1 indicates where the obstacle Ob1 indicated by the previously observed observation point cloud PC1 is located at the observation time t1 when the observation point cloud PC1 is acquired in step S11. Therefore, it is possible to cause the autonomous mobile body 10 to avoid the obstacle Ob1 while taking into consideration the position of the obstacle Ob1 that was previously observed by the sensor 31 but is now located outside the observation area A1 due to the movement of the autonomous mobile body 10.

[0076] In addition, when the previously generated auxiliary point group PC2 moves outside the observation area A1 of the sensor 31 due to the movement of the autonomous vehicle 10, the auxiliary point group PC2 is moved by the movement amount δ of the autonomous vehicle 10 to derive the virtual auxiliary point group PCi2. The virtual auxiliary point group PCi2 derived in this manner indicates the position after the movement of the blocked area A11 that was not observed by the obstacle Ob1 even though it was in the observation area A1 of the sensor 31. Since the obstacle point group PCob includes the virtual auxiliary point group PCi2, the autonomous vehicle 10 can avoid the obstacle while avoiding the area represented by the virtual auxiliary point group PCi2. Therefore, the possibility that the autonomous vehicle 10 will come into contact with an object in the area blocked by the obstacle Ob1 can be reduced.

[0077] (4) In step S25, the control device 32 generates, based on the virtual observation point group PCi1 in addition to the observation point group PC1, a driving route R that can avoid the obstacle Ob1 represented by the observation point group PC1 and the virtual observation point group PCi1.

[0078] According to this, the control device 32 grasps the position of the obstacle Ob1 observed in the past as the virtual observation point group PCi1. Therefore, the control device 32 can generate the travel route R by considering not only the obstacle Ob1 in the observation area A1, but also the positions of obstacles that were located in the observation area A1 in the past but are now located outside the observation area A1 due to the travel of the autonomous mobile device 10.

[0079] (5) If the direction observed by the sensor 31 is the observation direction D1 and the direction in which the travel route R generated in step S25 extends is the route direction D2, the control device 32 executes the process of step S26 to rotate the autonomous vehicle 10 in a rotation direction D3 from the observation direction D1 toward the route direction D2, and then align the observation direction D1 with the route direction D2. The control device 32 executes an obstacle derivation process to derive the obstacle point cloud PCob while the autonomous vehicle 10 is turning in step S26.

[0080] According to this, when the autonomous vehicle 10 turns, the control device 32 acquires an obstacle point cloud PCob including a virtual observation point cloud PCi1 obtained by the obstacle point cloud derivation process during the turning in step S26. Therefore, after checking the presence or absence of obstacles Ob1, Ob2 around the autonomous vehicle 10 by turning, the autonomous vehicle 10 can be guided to the driving route R generated in step S25.

[0081] (6) In step S26, the control device 32 aligns the observation direction D1 with the route direction D2 by turning the autonomous mobile device 10 only in the turning direction D3. According to this, the direction in which the autonomous vehicle 10 turns when checking for the presence or absence of obstacles Ob1, Ob2 around the autonomous vehicle 10 by turning coincides with the direction in which the autonomous vehicle 10 turns when orienting the observation direction D1 toward the route direction D2. This makes it possible to eliminate unnecessary turning operations caused by reversing the turning direction of the autonomous vehicle 10.

[0082] <Modification> The embodiment can be modified as follows: The embodiment and the following modified examples can be combined with each other to the extent that there is no technical contradiction.

[0083] The turning manner in step S26 is arbitrary. For example, the control device 32 may turn the autonomous vehicle 10 in the direction opposite to the turning direction D3 described in the above embodiment. In step S26, the control device 32 does not have to rotate the autonomous vehicle 10 by 360 degrees or more. For example, the control device 32 may rotate the autonomous vehicle 10 so that the observation direction D1 faces a direction within a predetermined angle range including the path direction D2 along which the travel path R extends at least once.

[0084] The turning in step S26 may be performed before the path generation in step S25. For example, the control device 32 may turn the autonomous vehicle 10 after stopping the autonomous vehicle 10 in step S24 and before the path generation in step S25.

[0085] When generating the driving route R in step S25, the control device 32 does not need to take the virtual observation point group PCi1 into consideration. The control device 32 may not perform the processes from step S25 to step S27 even if the obstacle Ob1 cannot be avoided within the observation area A1. In this case, for example, the control device 32 may use a notification device (not shown) to notify the vehicle 1 that it cannot travel to the final destination point G due to the presence of the obstacle Ob1 in the vicinity. The notification may be in the form of light, sound, vibration, or any other suitable form.

[0086] The obstacle point cloud PCob may include the observation point cloud PC1 and the auxiliary point cloud PC2. The search area A2 can be set arbitrarily, and the shape of the search area A2 can be any closed area, such as a polygon such as a rectangle or a trapezoid, a circle, a semicircle, or the like.

[0087] The control device 32 may cause the autonomous vehicle 10 to perform avoidance driving even when an obstacle point cloud PCob exists outside the search area A2. Accordingly, the control device 32 may omit the process of step S19 for removing each point cloud PC1, PCi1, PC2, and PCi2 outside the search area A2. In this case, the search area A2 does not need to be set.

[0088] When deriving the virtual observation point cloud PCi1 in step S16, the control device 32 may use all of the past observation point cloud, not just a part of it. Also, the control device 32 may use any interval between the virtual observation points Pi1 in the virtual observation point cloud PCi1 derived in step S16.

[0089] The control device 32 may omit the process of step S16 for removing the auxiliary point group PC2 and the virtual auxiliary point group PCi2 within the observable area A12. The control device 32 may omit the process of step S13 for generating the auxiliary point group PC2 within the masked area A11.

[0090] The specific form of the sensor 31 is arbitrary as long as it can measure the relative coordinates of the obstacle Ob1 with respect to the autonomous vehicle 10. For example, a plurality of ultrasonic sensors may be used as the sensor 31. The ultrasonic sensor can measure distance by emitting ultrasonic waves. The ultrasonic sensors are mounted on the vehicle body 21 at intervals from each other. The control device 32 can cause the sensor 31 to acquire the distance and angle of the obstacle Ob1, i.e., the relative coordinates of the obstacle Ob1, based on the intensity of the reflected waves detected by each ultrasonic sensor. As another example, the sensor 31 may be one capable of observing the distance and angle to an object, such as a LIDAR (Laser Imaging Detection and Ranging), a laser range finder, a ToF (Time of Flight) camera, or the like.

[0091] The method of acquiring the observation point cloud PC1 in step S11 is arbitrary. For example, the control device 32 may acquire the observation point cloud by converting the point cloud obtained by the sensor 31 using a LIDAR into an appropriate coordinate system.

[0092] The vehicle center position P and the sensor position Ps may coincide with each other. The autonomous vehicle 10 may be implemented in any desired manner. For example, any wheels may be used as the wheels 22, not limited to omnidirectional wheels. The number of wheels 22 is not limited to four, and may be any number. [Explanation of symbols]

[0093] 10...autonomous vehicle, 31...sensor, 32...control device, 35...auxiliary memory device, A1...observation area, A11...obstructed area, A12...observable area, A2...search area, D1...observation direction, D2...route direction, D3...turning direction, Ob1, Ob2...obstacle, PC1...observation point cloud, PC2...auxiliary point cloud, PCi1...virtual observation point cloud, PCi2...virtual auxiliary point cloud, PCob...obstacle point cloud, R...driving route, δ...movement amount.

Claims

1. An autonomous vehicle control device that generates a travel route for an autonomous vehicle having a sensor configured to be able to observe an obstacle, an obstacle point cloud derivation unit that derives an obstacle point cloud that indicates the position of the obstacle relative to the autonomous vehicle based on the observation results of the sensor; an avoidance unit that causes the autonomous vehicle to avoid the obstacles represented by the obstacle point cloud based on the derived obstacle point cloud; The obstacle point cloud derivation unit is an observation point cloud acquisition unit that acquires an observation point cloud indicating the positions of the obstacles observed within an observation area of ​​the sensor based on the observation results of the sensor; an auxiliary point cloud generation unit that generates an auxiliary point cloud within a blocked area that is blocked by the obstacle, of the observation area, based on the observation point cloud acquired by the observation point cloud acquisition unit; a map storage unit that stores map information indicating an environment in which the autonomous vehicle travels; an avoidance determination unit that determines whether or not the autonomous vehicle can avoid the obstacles represented by the obstacle point cloud within the observation area based on the derived obstacle point cloud; a route generation unit that generates the travel route for avoiding the obstacle when it is determined that the autonomous vehicle cannot avoid the obstacle within the observation area, the obstacle point cloud includes the observation point cloud and the auxiliary point cloud; The path generation unit An autonomous vehicle control device that generates a driving route by regarding an area represented by the auxiliary point cloud as drivable, and generates the driving route that can avoid the obstacles represented by the obstacle point cloud based on the obstacle point cloud and the map information.

2. If a point cloud indicating the positions of the obstacles that were observed by the sensor in the past and that are now located outside the observation area of ​​the sensor due to the movement of the autonomous vehicle is defined as a virtual observation point cloud, The obstacle point cloud derivation unit is a movement amount acquisition unit that acquires a movement amount of the autonomous vehicle from the acquisition of the past observation point group to the acquisition of the observation point group by the observation point group acquisition unit, where the observation point group acquired earlier than the observation point group acquired by the observation point group acquisition unit is a past observation point group; a virtual observation point cloud derivation unit that derives the virtual observation point cloud by moving the past observation point cloud by the movement amount; a virtual auxiliary point cloud derivation unit that derives a virtual auxiliary point cloud located outside an observation area of ​​the sensor by moving the previously generated auxiliary point cloud by the movement amount, The autonomous vehicle control device according to claim 1 , wherein the obstacle point cloud includes the virtual observation point cloud and the virtual auxiliary point cloud.

3. The autonomous vehicle control device according to claim 2 , wherein the route generation unit further generates the driving route capable of avoiding the obstacles represented by the observation point group and the virtual observation point group based on the virtual observation point group.

4. The direction observed by the sensor is defined as an observation direction, If the direction in which the travel route generated by the route generation unit extends is defined as a route direction, The autonomous vehicle control device includes a turning unit that turns the autonomous vehicle in a turning direction from the observation direction toward the route direction and aligns the observation direction with the route direction, The autonomous vehicle control device according to claim 2 or 3, wherein the obstacle point cloud derivation unit further derives the obstacle point cloud while the autonomous vehicle is turning by the turning unit.

5. The autonomous vehicle control device according to claim 4 , wherein the rotation unit aligns the observation direction with the route direction by rotating the autonomous vehicle only in the rotation direction.

Citation Information

Patent Citations

  • Movable region extraction device and movable region extraction method

    JP2011253377A

  • Robot system and map update method

    JP2014089740A

  • Mounting determination method, mounting method, mounting determination device, and robot

    JP2015123534A

  • Autonomous travel body

    JP2020140477A