Trajectory generation device, trajectory generation method, program, and moving body

Abstract

To determine a track so as not to interfere with an avoidance object such as an intersection center or a road shoulder when turning at an intersection.SOLUTION: A track generation device that a vehicle comprises generates track information indicating a track for moving from a travel area where a mobile travels to a travel area of a movement destination. In that case, a track in the travel area where the mobile travels and a track in the travel area of the movement destination are outputted as a first point sequence and a second point sequence, and the track information of the track for moving from the travel area where the mobile travels to the travel area of the movement destination is generated as a curve defining a point in the first point sequence as a starting point and a point in the second point sequence as an ending point. On the basis of an image picked up by a camera, an avoidance area that the mobile should avoids when traveling is estimated or detected and in a case where a distance between the avoidance area and the track is shorter than a predetermined distance, the track information is re-generated by re-selecting at least one of the starting point and the ending point in such a manner that the distance becomes equal to or longer than the predetermined distance.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to a trajectory generation device, a trajectory generation method, a program, and a moving body such as a vehicle. [Background technology]

[0002] In recent years, electric vehicles with a passenger capacity of around one to two people, known as ultra-compact mobility (also known as micromobility), have become known. As a technology for controlling the traveling of such vehicles, a technology has been proposed in which road images are acquired using a camera or the like, and the road shape is estimated based on the acquired road images to control the traveling (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-43837 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the technology described in Patent Document 1, although it is possible to control the vehicle to travel along a curved road, it is difficult to control the vehicle to turn right or left at an intersection.

[0005] The present invention has been made in view of the above-mentioned problems, and has as its object to realize driving control for safely turning at an intersection on a driving route. [Means for solving the problem]

[0006] In order to achieve the above object, the present invention has the following configuration: According to one aspect of the present invention, there is provided a trajectory generation device that generates trajectory information indicating a trajectory along which a moving object moves from a travel area in which the moving object travels to a travel area to which the moving object travels, the trajectory generation device comprising: a trajectory generation unit that outputs a trajectory in a travel area in which the moving body travels and a trajectory in a travel area at the destination as a first point sequence and a second point sequence, respectively, and generates trajectory information for a trajectory of the moving body moving from the travel area in which the moving body travels to the travel area at the destination as a curve having a start point at a point in the first point sequence and an end point at a point in the second point sequence; an avoidance area detection unit that estimates or detects an avoidance area in which the vehicle should avoid traveling based on an image captured by the camera; When the distance between the avoidance area and the trajectory is less than a predetermined distance, the trajectory generation unit generates a new trajectory so that the distance becomes equal to or greater than the predetermined distance. Within the first sequence of points The starting point and in the second sequence of points Reselect at least one of the end points and regenerate the trajectory information. death, The intervals between the points in the first point sequence and the second point sequence are determined so that the time intervals at which the moving object passes each point are constant. A trajectory generation device is provided. [Effects of the Invention]

[0007] According to the present invention, it is possible to realize driving control for safely turning at an intersection on a driving route. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a vehicle according to an embodiment of the present invention; [Figure 2] FIG. 1 is a block diagram showing an example of a hardware configuration centered on a control unit of a vehicle according to an embodiment of the present invention. [Figure 3] FIG. 1 is a block diagram showing an example of the configuration of a control function according to the present embodiment. [Figure 4] FIG. 10 is a diagram showing an example of trajectory generation for an intersection according to the present embodiment; [Figure 5] FIG. 10 is a diagram showing an example of trajectory generation for an intersection according to the present embodiment; [Figure 6] 1 is a flowchart showing a trajectory generation process according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention as claimed, and not all combinations of features described in the embodiments are necessarily essential to the invention. Two or more of the features described in the embodiments may be arbitrarily combined. Furthermore, the same reference numerals are used for the same or similar components, and redundant explanations will be omitted.

[0010] ●Vehicle configuration With reference to FIG. 1, the configuration of a vehicle 100, which is an example of a moving body according to this embodiment, will be described. The vehicle 100 is equipped with a battery and is, for example, an ultra-compact mobility vehicle that moves mainly by motor power. An ultra-compact mobility vehicle is more compact than a typical automobile and has a passenger capacity of about one or two people. In this embodiment, the vehicle 100 will be described as an example of an ultra-compact mobility vehicle, but this is not intended to limit the present invention, and the vehicle may be, for example, a three-wheeled vehicle or a saddle-ride vehicle. Furthermore, the vehicle of the present invention is not limited to a vehicle, but may also be a vehicle that carries luggage and travels alongside people walking, or a vehicle that leads people.

[0011] Fig. 1(A) shows a side view of a vehicle 100 according to this embodiment, and Fig. 1(B) shows the internal configuration of the vehicle 100. In the figure, arrow X indicates the longitudinal direction of the vehicle 100, with F indicating the front and R indicating the rear. Arrows Y and Z indicate the width direction (left-right direction) and up-down direction of the vehicle 100.

[0012] Vehicle 100 is an electric autonomous vehicle equipped with a propulsion unit 12 and using a battery 13 as its main power source. Battery 13 is a secondary battery such as a lithium-ion battery, and vehicle 100 is propelled by propulsion unit 12 using power supplied from battery 13. Propulsion unit 12 is a four-wheeled vehicle equipped with a pair of left and right front wheels 20 and a pair of left and right rear wheels 21. Propulsion unit 12 may be in another form, such as a tricycle. Vehicle 100 is equipped with seating 14 for one or two people.

[0013] The traveling unit 12 includes a steering mechanism 22. The steering mechanism 22 is a mechanism that uses a motor 22a as a drive source to change the steering angle of the pair of front wheels 20. By changing the steering angle of the pair of front wheels 20, the traveling direction of the vehicle 100 can be changed. The traveling unit 12 also includes a drive mechanism 23. The drive mechanism 23 is a mechanism that uses a motor 23a as a drive source to rotate the pair of rear wheels 21. By rotating the pair of rear wheels 21, the vehicle 100 can move forward or backward.

[0014] The vehicle 100 is equipped with detection units 15 to 17 that detect targets around the vehicle 100. The detection units 15 to 17 are a group of external sensors that monitor the periphery of the vehicle 100, and in the present embodiment, each is an imaging device that captures an image of the periphery of the vehicle 100, and includes, for example, an optical system such as a lens and an image sensor. However, instead of or in addition to the imaging device, it is also possible to employ radar or lidar (Light Detection and Ranging).

[0015] Two detection units 15 are arranged at the front of the vehicle 100, spaced apart in the Y direction, and mainly detect targets ahead of the vehicle 100. Detection units 16 are arranged on the left and right sides of the vehicle 100, respectively, and mainly detect targets on the sides of the vehicle 100. Detection unit 17 is arranged at the rear of the vehicle 100, and mainly detects targets behind the vehicle 100. In this embodiment, detection unit 16 is a camera that captures images mainly ahead and detects targets included in the images.

[0016] ●Control configuration of moving objects FIG. 2 is a block diagram of a control system of vehicle 100, which is a moving body. Here, the configuration necessary for implementing the present invention will be mainly described. Therefore, other configurations may be included in addition to the configurations described below. Vehicle 100 is equipped with a control unit (ECU) 30. Control unit 30 includes a processor such as a CPU, a storage device such as a semiconductor memory, an interface with external devices, etc. The storage device stores programs executed by the processor and data used by the processor for processing, etc. Multiple sets of processors, storage devices, and interfaces may be provided for different functions of vehicle 100 and configured to be able to communicate with each other.

[0017] The control unit 30 acquires the detection results of the detection units 15 to 17, input information from the operation panel 31, audio information input from the audio input device 33, control commands from the server 110 (for example, transmission of captured images or current location), etc., and executes corresponding processing. The control unit 30 controls the motors 22a and 23a (travel control of the traveling unit 12), controls the display on the operation panel 31, and notifies and outputs information to the occupants of the vehicle 100 by audio. The control unit 30 may be realized by an information processing device or a computer that executes information processing.

[0018] The voice input device 33 collects the voices of the occupants of the vehicle 100. The control unit 30 can recognize the input voices and execute corresponding processing. The Global Navigation Satellite System (GNSS) sensor 34 receives GNSS signals to detect the current position of the vehicle 100. The storage device 35 is a large-capacity storage device that stores map data including information on routes the vehicle 100 can travel, landmarks such as buildings, stores, etc. The storage device 35 may also store programs executed by the processor and data used by the processor for processing. The storage device 35 may store various parameters (e.g., trained parameters and hyperparameters of a deep neural network) of machine learning models for voice recognition and image recognition executed by the control unit 30. The communication unit 36 ​​is a communication device that can be connected to the network 140 via wireless communication such as Wi-Fi or fifth-generation mobile communication.

[0019] The direction indication switch 37 is a switch that the user uses to instruct the vehicle 100 to turn right or left. When a right or left turn is instructed using the direction indication switch 37, the control unit 30 identifies a location where a right or left turn can be made in accordance with the instruction, determines the planned travel route, and controls the right or left turn. The direction indication switch 37 may be a switch on a lever or a joystick. Furthermore, instead of a mechanical or electronic switch, instructions to turn right or left may be received by voice recognition. In this embodiment, the planned travel route is called a track. The track may also be called a path, a route, a travel line, etc.

[0020] ●Functional configuration of the control unit Next, an example of the functional configuration of the control unit 30 will be described with reference to Fig. 3. Each functional unit is realized by the control unit 30, particularly by the CPU or ECU thereof, executing a program.

[0021] The object recognition unit 311 performs image recognition on images captured by the detection unit 15, recognizing and outputting objects contained in the images. Recognition objects include, for example, roads, intersections, vehicles, pedestrians, traffic lights, signs, and obstacles. Each recognition object includes more detailed recognition objects. For example, in the case of a road, these include the road boundary between the road and the rest of the road, white lines including center lines, shoulder lines, and stop lines that separate lanes, and crosswalks. In the case of an intersection, these include road entrances that connect the intersection and the road. Image recognition is performed, for example, by comparing images in which objects are known in advance, and the comparison may be performed based on feature quantities such as edges extracted from the image. Furthermore, machine learning may be used to learn to recognize objects from training images, and recognition may be performed using a trained model.

[0022] In this embodiment, for example, a captured image is flattened by projective transformation or the like, and each recognized object is placed on that plane. This flattened captured image is a local map captured from the vehicle 100, and is referred to here as a local map. The local map may use the position of the vehicle 100 as a reference position, for example. The reference direction may be magnetic north, or the optical axis direction of the camera, which is the detection unit 15. This allows the positions and directions of intersections and roads, as well as road entrances and white lines included therein, to be identified on the local map. Note that although the captured image is flattened here, the captured image may be used as a local map as is, and recognized objects may be identified on the local map.

[0023] In this embodiment, the intersection to be recognized refers to a road structure where a vehicle can select its direction of travel and turn right or left. This includes not only four-way intersections such as crossroads, but also three-way intersections and intersections with more intersecting roads than four-way intersections. Once an intersection is recognized, the road entrance serving as the entrance and the road entrance serving as the exit can be identified, and the trajectory of the host vehicle can be determined in conjunction with the recognized center line on the road. For example, if a vehicle is traveling on the left side of the road entrance serving as the entrance, the lane to the left of the center line becomes the lane for entering the intersection, and the trajectory can be set within this area. A lane is the area between the center line and the shoulder line. The lane corresponding to the direction of travel of the host vehicle is sometimes called the current lane, and the lane on which a vehicle traveling opposite the direction of travel of the host vehicle is sometimes called the oncoming lane. The road entrance serving as the entrance to an intersection and the road entrance serving as the exit from the intersection are sometimes called the intersection entrance and the intersection exit, respectively. Furthermore, the lane to which a vehicle intends to travel after passing through an intersection is sometimes called the destination lane. A lane is also sometimes called a driving area. Furthermore, the trajectories determined within the current lane and the destination lane, respectively, may be referred to as the current trajectory and the destination trajectory.

[0024] The trajectory generation unit 312 determines the trajectory along which the vehicle 100 is scheduled to travel on the local map, and creates and outputs trajectory information for the determined trajectory. A trajectory is also called a track, a driving line, a route, or the like. The trajectory information is expressed as a sequence of points (or vectors) whose positions are specified in the coordinate system of the local map. The interval between the points may be a constant value (i.e., a predetermined value), but considering that travel will be controlled along the determined trajectory, the interval between the points may be changed depending on the expected speed. In other words, the interval between the points may be determined so that the time intervals at which the vehicle passes each point are constant. When the interval between the points is set to a predetermined distance, the interval between the points may be determined based on the speed when traveling at low speed, for example, when turning (e.g., turning left) at an intersection into the travel lane. Specifically, the interval may be approximately the length of the vehicle, for example.

[0025] For example, if the road has no branches, the trajectory is set so that the vehicle travels in the center of the current lane width direction or closer to the shoulder than the center. Similarly, for the lane after passing through an intersection, the trajectory is set so that the vehicle travels in the center of the destination lane width direction or closer to the shoulder than the center. At an intersection, for example, a simple curve with a constant curvature that smoothly connects straight lines may be used. Furthermore, a clothoid curve, Bézier curve, or the like may be used instead of a simple curve. Once the trajectory is finally determined, the trajectory generation unit 312 generates a sequence of points along the determined trajectory as trajectory information. Before the trajectory is finally determined, it is determined whether or not the generated trajectory (called a candidate trajectory) interferes with areas to be avoided, such as the center of the intersection, the shoulder, or an obstacle. If there is interference with any of these, the candidate trajectory is regenerated. The candidate trajectory with no interference becomes the final trajectory.

[0026] The trajectory generation unit 312 generates a trajectory that follows the road recognized by the object recognition unit 311 unless instructed otherwise by the occupant. Even if an intersection is recognized ahead, if it is possible to go straight through the intersection, a trajectory that goes straight through the intersection is generated unless instructed otherwise. In this case, the destination lane becomes the lane that passes through the intersection and continues straight. Also, if the turn signal switch 37 is operated to instruct a right or left turn and an intersection is recognized ahead, a trajectory that turns through the intersection in the instructed direction is selected. In this case, the destination lane becomes the lane that connects to the current lane in the instructed direction among the roads connected to the intersection. This embodiment does not deal with cases where the occupant's instruction does not match the road structure, but in such cases, the safest trajectory can be selected from options, including stopping.

[0027] The avoidance area detection unit 313 detects an avoidance target area, in which the above-mentioned collision with the vehicle is judged, from among the objects recognized by the object recognition unit 311. The avoidance target area may be determined in advance. The avoidance target area includes the center of the intersection, shoulder lines, and other obstacles.

[0028] The vehicle control unit 314 controls the running of the vehicle 100 according to the trajectory information generated by the trajectory generation unit 312. The controlled objects include the steering mechanism 22 and the drive mechanism 23, and the speed of the vehicle 100, including the steering angle and starting and stopping, is controlled. The vehicle 100 may be controlled, for example, so that the center of its front end passes along the trajectory. In this example, the vehicle control unit 314 is also called a running control unit because it mainly controls running.

[0029] - Determining the trajectory when turning into the oncoming lane at an intersection Next, the determination of a trajectory by the vehicle 100 of this embodiment will be described with reference to Figures 4 and 5. Note that in this example, the vehicle is assumed to be traveling on the left side of the road in the direction of travel, but if the vehicle is traveling on the right side, the left and right sides can be reversed in the following description. In this example, a road divided into one lane on each side by a center line will be described as an example.

[0030] FIG. 4(A) shows an example of a trajectory drawn on a local map when turning right at an intersection. Note that the vehicle 100 does not necessarily have to exist on the map, but is drawn here for convenience of explanation. The recognized objects are an intersection 403 and a road connecting to the intersection 403. Within the road, other recognized objects include a road boundary 404, a shoulder line 405, a center line 406, and a stop line 407. A road entrance 408 is also recognized as the connecting area between the intersection 403 and the road. The outside of the shoulder line 405 may be recognized as the shoulder. Note that although only one symbol is assigned to each of the above-mentioned objects in the figure, if there are multiple objects, they are recognized for each road connecting to the intersection 403.

[0031] Intersection center 409 is an area located in the center of intersection 403. If a graphic to guide a right turn, such as an asteroid, is drawn in the center of the intersection, this may be recognized as intersection center 409. Also, if there is no object indicating the intersection center, the center of gravity of the intersection object may be found and used as the intersection center. In this case, intersection center 409 may be a point rather than an area. In the case of a four-way intersection, since the intersection object is rectangular, the intersection point of the diagonals may be used as the center. For a three-way intersection, it is not necessary to determine the intersection center. For a five-way or more intersection, the center of gravity may be found according to the shape of the intersection.

[0032] On a local map including the roads and intersections recognized in this way, trajectory information of the trajectory within the current lane (i.e., the driving area in which the vehicle is traveling) from the current position of vehicle 100 to the position where it enters the intersection is generated as a first sequence of points 401 from point 401A to point 401C. The trajectory may be determined to be the center of the lane, closer to the shoulder, or closer to the center line. When a right turn instruction is given and the road after the right turn at intersection 403 is recognized, trajectory information of the trajectory within the destination lane, i.e., the lane to which the vehicle is moving, is generated as a second sequence of points 402 from point 402A to point 402C. The second sequence of points 402 of the trajectory information after the right turn is generated within the range that can be captured by the cameras of detection unit 15 and detection unit 16. Therefore, the closer to the intersection, the wider the range becomes, and trajectory information can be generated for a further distance.

[0033] Here, once a first sequence of points 401, which represents the trajectory in the currently traveling lane, and a second sequence of points 402, which represents the trajectory in the lane after a right turn, are generated (or have been generated), the curve connecting them is determined as the first candidate trajectory. In this example, the trajectory connecting the current lane and the destination lane may be a simple curve. That is, the trajectory represented by the first sequence of points 401 and the trajectory represented by the second sequence of points 402 are connected by a circular arc with the same slope at the connection point with each trajectory. Of the points connected by the circular arc, the point on the current trajectory side is called the start point, and the point on the destination trajectory side is called the end point. In this example, at least one of the points initially selected as the start point and the end point is a point on the road entrance. The other is a point on the road entrance that can be connected to the point on the road entrance by a simple curve, or a point on the trajectory in the lane connected to the road entrance. The selection of the first connecting point will be explained again with reference to FIG. 5. The position where the trajectory of the current lane reaches the road entrance of the intersection is called the end position of the current lane, and the position where the trajectory of the destination lane departs from the road entrance of the intersection is called the start position of the destination lane.

[0034] In the example of Figure 4(A), the points initially selected as the start point and end point are points on the road entrance in both the first and second point sequences, namely points 401A and 402A, respectively. In this case, the center of a simple curve 411A connecting the start point and end point is the lower right corner point of intersection 403.

[0035] Once a single curved track connecting the start point and the end point has been determined, it is determined whether the vehicle 100 traveling on that track will interfere with the avoidance target area (also referred to as the avoidance area). This determination may be made by determining whether the minimum distance between the avoidance target area and the track is equal to or greater than a predetermined distance. If the minimum distance between the avoidance target area and the track is less than the predetermined distance, it can be determined that the vehicle 100 traveling along the track will interfere with the avoidance target area. Therefore, the predetermined distance may be at least half the width of the vehicle 100, plus a margin. The avoidance target area includes the intersection center 409. The avoidance target area also includes the shoulder line 405, and may further include the center line 406. Here, a state in which the minimum distance between the avoidance target area and the track is less than the predetermined distance is referred to as interference between the avoidance target area and the track.

[0036] If it is determined that there is no interference, trajectory information consisting of a sequence of points on the trajectory is generated based on that trajectory. As a result, the trajectory of the current driving lane and the trajectory of the lane after turning right are all shown as a sequence of points in the trajectory information. Based on this trajectory information, the vehicle 100 is controlled to travel along the trajectory.

[0037] On the other hand, if it is determined that there is interference, a new candidate trajectory is determined. To do this, first, a point in the first sequence of points adjacent to the current starting point, which is located farther from the intersection than the current starting point, is selected as the new starting point. Also, a point in the second sequence of points adjacent to the current ending point, which is located farther from the intersection than the current ending point, is selected as the new ending point. Then, the simple curve connecting these starting and ending points is determined as the next candidate trajectory. After this, as described above, interference with the avoidance target area is determined, and if there is no interference, trajectory information is generated in the same manner as described above. If there is interference, new starting and ending points are selected, and the next candidate trajectory is determined.

[0038] In the example of Figure 4(A), if the track of simple curve 411A connecting start point 401A and end point 402A interferes with intersection center 409, start point 401B and end point 402B are reselected, and simple curve 411B is determined as the track connecting them. If there is still interference, start point 401C and end point 402C are reselected, and simple curve 411C is determined as the track connecting them. In the example of Figure 4(A), vehicle 100' traveling on this track does not interfere with intersection center 409, so simple curve 411C is finally determined as the track, and its track information is generated.

[0039] In this embodiment, if the determined trajectory interferes with the avoidance target area, both the start point and the end point of the simple curve are reselected, but only one of them may be reselected. Furthermore, the generation of trajectory information as described above is performed while the vehicle 100 is traveling. Therefore, the points that can be selected from the first series of points 401 are limited to those between the vehicle 100 and the road entrance of the current traveling lane of the intersection 403, and the number of such points decreases as the vehicle travels. Therefore, if there is no point that can be reselected as the start point, only the end point may be reselected.

[0040] ●Select the initial start point and end point Referring to FIG. 5 here, an example of a method for selecting the first starting point and ending point will be described. FIG. 5 shows a more generalized four-way intersection of FIG. 4(A). In FIG. 5, the intersecting roads are not orthogonal, and the road widths are different. In FIG. 5, the end position of the current lane in which the vehicle is currently traveling is point 501A, and the start position of the target lane to travel after a right turn is point 502A. Due to the difference in road widths, these points cannot be connected by a single curve as the starting point and ending point. What can be connected by a single curve are points that are equidistant from the intersection point (meeting point) of the extension line of the current lane's trajectory and the extension line of the lane's trajectory after a right turn. Therefore, the intersection point 510 of the extension line of the current lane's trajectory and the extension line of the lane's trajectory after a right turn is determined, the distance de between the intersection point 510 and the starting point 501A and the distance dt between the intersection point 510 and the ending point 502A are obtained, and they are compared. If they are the same value, that is, if the difference is within a predetermined value, the starting point 501A and the ending point 502A can be connected by an arc, so each is selected as the starting point and ending point, and the trajectory is determined in the manner described in FIG. 4(A).

[0041] On the other hand, if the difference between the distance de and the distance dt exceeds the predetermined value, reselect the starting point or the ending point according to either one. In FIG. 5, since de<dt, reselect the ending point 502B whose distance from the intersection point 510 is de according to de, or reselect the starting point 501B whose distance from the intersection point 510 is dt according to dt. However, in the former method, the ending point will be located within the intersection, and the curvature of the curve will become large and it will be easy to interfere with the center of the intersection. Therefore, it is possible to reselect such an ending point, but in this example, reselect the other point according to the point with the larger distance from the intersection point 510. In the example of FIG. 5, reselect the starting point 501B whose distance from the intersection point 510 is dt according to the longer distance dt. By doing so, it becomes easier to avoid interference between the center of the intersection and the trajectory. In addition, if the position of the point determined as described above does not match the position of the point included in the first point sequence or the second point sequence, a point closest to the determined position may be selected from the first point sequence and / or the second point sequence.

[0042] The center of the arc connecting the start point and end point selected in this way is the intersection of a line that passes through each point and is perpendicular to each trajectory. In Figure 5, if the start point is 501B and the end point is 502A, the center point is point 511B; if the start point is 501A and the end point is 502B, the center point is point 511A; and if the start point is 501C and the end point is 502C, the center point is point 511C. Note that the start point 501C and the end point 502C are points that are reselected if the trajectory determined as the start point 501B and the end point 502A interferes with the center of the intersection.

[0043] - Determining the trajectory when turning onto the shoulder at an intersection So far, we have explained the trajectory of a vehicle turning right at an intersection, i.e., turning into the oncoming lane. When turning left, i.e., turning into the shoulder, a trajectory is also selected that avoids interference with the avoidance target area. Figure 4(B) shows an example.

[0044] In the case of a left turn, trajectory information is generated in the same way as for a right turn, by connecting the sequence of points on the trajectory of the driving lane and the sequence of points on the trajectory after the left turn with a circular arc. However, in the case of a left turn, interference with the shoulder line (i.e., the shoulder) on the left side of the driving lane (the side where the vehicle is turning) is more likely to occur than interference with the center of the intersection. Therefore, if interference with the shoulder occurs, in order to avoid this, the start and end points are reselected so that the curvature of the curve turning through the intersection is increased, that is, the radius of the simple curve is reduced. In other words, points on the extensions of the end point of the driving lane and the start point of the lane after the left turn are reselected, and the curve connecting these points is determined as the new trajectory.

[0045] In the example of Figure 4(B), in addition to the intersection center 409, interference with the shoulder 413 is also determined. If interference is determined, points 411B and 412B, which are extensions of the initial starting point 411A and the initial starting point 412A into the intersection, are reselected as the starting point and the ending point, respectively. The curve connecting the starting point and the ending point is then determined as the new trajectory. Note that in Figure 4(B), the center part of the shoulder within the intersection, which is thought to be prone to interference, is used as the shoulder 413, but the entire area outside the shoulder line may also be set as the area to be avoided. The minimum distance between this area to be avoided and the curve connecting the selected starting point and ending point is compared with a predetermined value (half the vehicle width + margin) to determine interference. This is the same as for the intersection center.

[0046] However, if a smaller radius single curve track is selected as described above, it may be difficult to navigate due to limitations in cruise control. In such cases, the current lane and destination lane tracks may be reset by shifting them toward the center line, and the radius of the single curve track when turning at an intersection may be increased. Of course, in this case too, the track is shifted so that there is no interference between the center line and the vehicle.

[0047] Although FIG. 4(A) does not explain interference between the trajectory and areas to be avoided other than the center of the intersection, such as road shoulders, interference determination may also be performed for these areas. When multiple areas to be avoided are considered, regeneration of a trajectory to avoid interference with one area to be avoided may result in interference with another area to be avoided. In such cases, priorities may be set in advance for the areas to be avoided, and a trajectory may be determined that preferentially avoids interference with areas to be avoided that have a higher priority.

[0048] ●Trajectory information generation processing An example of a flowchart summarizing the above-described trajectory determination and trajectory information generation processing procedures is shown in FIG. 6. The processing in FIG. 6 is realized by the control unit 30 (also referred to as a control unit), particularly by its CPU, executing a program. This processing corresponds to the processing by the trajectory generation unit 312 and the avoidance area detection unit 313 among the functional modules in FIG. 3. The image recognition processing by the object recognition unit 311 is executed asynchronously with the processing in FIG. 6, and the processing in FIG. 6 is performed by referring to the recognition results. Furthermore, both the image recognition processing by the object recognition unit 311 and the processing in FIG. 6 are executed continuously while the vehicle 100 is traveling.

[0049] First, the current lane and the destination lane are identified from the recognized road objects, and trajectory information for the trajectory passing through them is generated within the range of the acquired image (S610). Note that if there is no intersection, there is no destination lane, so only the current lane may be targeted. Here, for example, a first sequence of points 401 as shown in FIG. 4(A) is generated. Furthermore, if a road connected via an intersection is recognized in the image, the destination lane can be identified, and a second sequence of points 402 may also be generated. However, since it is unknown at this stage which direction the vehicle will travel through the intersection, the second sequence of points 402 may be generated with the straight ahead direction as the destination lane. Alternatively, the destination lanes of all roads that may be traveled may be determined, and a second sequence of points 402 may be generated for each destination lane.

[0050] Next, it is determined whether an instruction to turn right or left has been received from the direction switch 37 (S601). If there is no instruction to turn right or left, step S600 is repeatedly executed. On the other hand, if an instruction to turn right or left has been received, it is determined whether there is an intersection on the path of the vehicle 100 (S602). That is, it is determined whether an intersection object is included in the objects recognized by the object recognition unit 311. If an intersection is not included, the instruction is either a right or left turn at a location other than an intersection, an instruction to change lanes, or an instruction to stop, and a route is determined in accordance with these instructions (S608).

[0051] If it is determined in step S602 that an intersection exists, the object recognition unit 311 detects and identifies an area to be avoided from among the objects recognized by the object recognition unit 311 (S603). As already mentioned, the area to be avoided includes the intersection center area (center of the intersection), the road shoulder, and other obstacles. If there is an object (e.g., an asteroid figure) in the center of the intersection that indicates this, this is set as the center of the intersection and the area to be avoided. However, if there is no such object, the center of gravity of the intersection is found and identified as the center of the intersection. For four-way intersections, this is usually sufficient because the intersection often has a point-symmetric structure with the center of the intersection as the symmetric point. For asymmetric intersections, the position of the intersection center may be adjusted by referring to the center line of the road, for example, and moving the found center of gravity position according to the deviation of the center line.

[0052] Next, a sequence of points indicating the trajectory of the current lane and a sequence of points indicating the trajectory of the destination lane are determined, and the points where these trajectories meet the intersection are identified as the start point and end point, respectively (S604). In this example, the trajectory of the current lane and the trajectory of the destination lane are connected by a simple curve, so the intersection point is determined from each trajectory, and the start point and end point are determined so that they are equidistant from the intersection point. The method for this determination has been explained in Figure 5.

[0053] Once the start point and end point have been determined, the curve connecting them, in this case the circular arc that constitutes a simple curve, is determined (S605). The circular arc is determined by its center and radius, and the center is the intersection of a line that passes through the start point and is perpendicular to the trajectory of the current lane, and a line that passes through the end point and is perpendicular to the trajectory of the target lane. The radius is the distance from the center to the start point or end point.

[0054] Next, it is determined whether there is interference between the determined trajectory and the area to be avoided (S606). As mentioned above, it is determined that there is interference if the minimum distance between the trajectory and the area to be avoided does not exceed a predetermined value that is at least half the width of the vehicle 100. In this example, the area to be avoided includes the center of the intersection and the shoulder of the road, but other obstacles, etc. may also be included in the area to be avoided.

[0055] If it is determined in step S606 that there is interference, the positions of the start point and end point are shifted according to the position of the interfering avoidance target area (S609). If the vehicle is turning right and the avoidance target area is in the center of the intersection, the start point and end point are changed so that the turn will be made from farther away from the center of the intersection and with a larger radius. This is as explained in FIG. 4(A). If the vehicle is turning left and the avoidance target area is on the shoulder, the start point and end point are changed so that the turn will be made from closer to the center of the intersection and with a smaller radius. This is as explained in FIG. 4(B). The process then returns to step S605, where the curve connecting the reselected start point and end point is identified, and the subsequent processes are repeated. In other words, the start point and end point are reselected, and trajectory information is regenerated so that there is no interference with the avoidance target area.

[0056] If it is determined in step S606 that there is no interference, the trajectory determined up to that point does not interfere with the avoidance target area, and trajectory information is generated from that trajectory (S607). That is, a sequence of points on the determined trajectory is generated. Each point in the sequence of points may be indicated by a position on the local map. Then, the process returns to step S600.

[0057] By referring to the trajectory information generated by the above procedure, the vehicle control unit 314 controls the steering of the vehicle 100, and the vehicle 100 travels along the determined trajectory. Since it is determined that the trajectory does not interfere with the area to be avoided, by traveling along the trajectory, it is possible to avoid interference with the area to be avoided, such as stepping on the center of an intersection or the shoulder of the road.

[0058] In this way, when turning at an intersection, a trajectory can be determined that does not interfere with the avoidance target area. More specifically, when turning at an intersection into the oncoming lane, a trajectory can be determined that does not interfere with the center of the intersection. Also, when turning at an intersection into the shoulder, a trajectory can be determined that does not interfere with the shoulder. This allows the vehicle to comply with traffic laws and travel safely.

[0059] Summary of embodiments 1. A trajectory generation device that generates trajectory information indicating a trajectory for a moving body to move from a travel area in which the moving body travels to a travel area of ​​a destination, a trajectory generation unit that outputs a trajectory in a travel area in which the moving body travels and a trajectory in a travel area at the destination as a first point sequence and a second point sequence, respectively, and generates trajectory information for a trajectory of the moving body moving from the travel area in which the moving body travels to the travel area at the destination as a curve having a start point at a point in the first point sequence and an end point at a point in the second point sequence; an avoidance area detection unit that estimates or detects an avoidance area in which the vehicle should avoid traveling based on an image captured by the camera; When the distance between the avoidance area and the trajectory is less than a predetermined distance, the trajectory generation unit reselects at least one of the start point and the end point and regenerates the trajectory information so that the distance is equal to or greater than the predetermined distance. A trajectory generation device is provided. This configuration makes it possible to generate a trajectory from the current area to the destination area that does not interfere with the avoidance area.

[0060] 2. The trajectory generation device according to item 1, The avoidance area includes at least one of the center of the intersection and the shoulder of the road. A trajectory generation device is provided. This configuration makes it possible to generate a trajectory from the current area to the destination area that does not interfere with at least one step of the intersection center or shoulder.

[0061] 3. The trajectory generation device according to item 1 or 2, The starting point is a point at the end position of a travel area in which the moving body travels, or the ending point is a point at the start position of a travel area to which the moving body travels. A trajectory generation device is provided. With this configuration, it is possible to generate a trajectory from the end point of the current area to the start point of the destination area that does not interfere with the avoidance area.

[0062] 4. The trajectory generation device according to item 3, when the starting point is a point at an end position of a travel area in which the moving object travels, the ending point is a point in the second series of points that is connected to the starting point by a simple curve, When the end point is a point at the start position of the travel area of ​​the movement destination, the start point is a point in the first series of points that is connected to the end point by a simple curve. A trajectory generation device is provided. This configuration makes it possible to generate a trajectory that connects the current traveling area to the destination area with a simple curve and does not interfere with the avoidance area.

[0063] 5. A trajectory generation device according to any one of items 1 to 4, When the moving body moves across an oncoming lane and the distance between the avoidance area and the trajectory is less than a predetermined distance, the trajectory generation unit reselects at least one of the start point and the end point so that the start point and the end point are farther apart. A trajectory generation device is provided. With this configuration, when a moving body moves across an oncoming lane, it is possible to check whether or not there is interference with the avoidance area, and generate a trajectory from the area in which it is traveling to the area to which it is moving that does not interfere with the avoidance area.

[0064] 6. A trajectory generation device according to any one of items 1 to 5, When the moving body moves without crossing an oncoming lane and the distance between the avoidance area and the trajectory is less than a predetermined distance, the trajectory generation unit reselects at least one of the start point and the end point so that the start point and the end point are closer to each other. A trajectory generation device is provided. With this configuration, when a moving body moves without crossing the oncoming lane, it is possible to check whether or not there is interference with the avoidance area, and generate a trajectory from the area in which it is traveling to the area to which it is moving that does not interfere with the avoidance area.

[0065] 7. A trajectory generation device according to any one of items 1 to 6, The curved line includes a simple curve that connects a track or an extension thereof in a travel area in which the moving body travels and a track or an extension thereof in a travel area of ​​the destination. A trajectory generation device is provided. With this configuration, it is possible to generate a trajectory consisting of straight lines and simple curves from the current traveling area to the destination area, which does not interfere with the avoidance area.

[0066] 8. A trajectory generation device according to any one of items 1 to 7, The track is a track through which a center portion of a vehicle traveling along the track passes, The predetermined distance is at least half the width of the vehicle. A trajectory generation device is provided. With this configuration, it is possible to generate a trajectory for the vehicle to travel from the current travel area to the destination area without interfering with the avoidance area.

[0067] 9. A trajectory generation device according to any one of items 1 to 8, The travel area of ​​the destination is a travel area connected to the travel area in which the moving body travels via a right turn or a left turn at an intersection. A trajectory generation device is provided. With this configuration, a trajectory can be generated that does not interfere with the avoidance area, from the current traveling area to the destination area that is connected by turning right or left at the intersection.

[0068] 10. A trajectory generation device according to any one of items 1 to 9, a travel control unit that controls travel along a trajectory indicated by the trajectory information generated by the trajectory generation device; A moving object is provided, characterized by having: This configuration allows the moving body to travel from the area where it is currently traveling to the area where it is moving to a destination area along a trajectory that does not interfere with the avoidance area.

[0069] 11. A program for causing a computer to function as the trajectory generation device according to any one of items 1 to 9 is provided. With this configuration, the program allows the robot to travel from the current area to the destination area along a trajectory that does not interfere with the avoidance area.

[0070] 12. A trajectory generation method executed by a control device having a trajectory generation unit and an avoidance area detection unit, which generates trajectory information indicating a trajectory along which a moving body moves from a travel area in which the moving body travels to a travel area to which the moving body travels, the trajectory generation unit outputs a trajectory in a travel area in which the moving body travels and a trajectory in a travel area at the destination as a first sequence of points and a second sequence of points, respectively, and generates trajectory information of a trajectory along which the moving body moves from the travel area in which the moving body travels to the travel area at the destination as a curve having a start point at a point in the first sequence of points and an end point at a point in the second sequence of points; the avoidance area detection unit estimates or detects an avoidance area in which the vehicle should avoid traveling based on an image captured by a camera, When the distance between the avoidance area and the trajectory is less than a predetermined distance, the trajectory generation unit reselects at least one of the start point and the end point and regenerates the trajectory information so that the distance is equal to or greater than the predetermined distance. A trajectory generation method is provided. This configuration makes it possible to generate a trajectory from the current area to the destination area that does not interfere with the avoidance area.

[0071] The invention is not limited to the above-described embodiment, and various modifications and variations are possible within the scope of the gist of the invention. [Explanation of symbols]

[0072] 100...vehicle, 30...control unit, 311...object recognition unit, 312...trajectory generation unit, 313...avoidance area detection unit, 314...vehicle control unit

Claims

1. A trajectory generation device that generates trajectory information indicating a trajectory for a moving body to move from a travel area in which the moving body travels to a travel area of ​​a destination, a trajectory generation unit that outputs a trajectory in a travel area in which the moving body travels and a trajectory in a travel area at the destination as a first point sequence and a second point sequence, respectively, and generates trajectory information for a trajectory of the moving body moving from the travel area in which the moving body travels to the travel area at the destination as a curve having a point in the first point sequence as a start point and a point in the second point sequence as an end point; an avoidance area detection unit that estimates or detects an avoidance area in which the vehicle should avoid traveling based on an image captured by the camera; when the distance between the avoidance region and the trajectory is less than a predetermined distance, the trajectory generation unit regenerates the trajectory information by reselecting at least one of the start point in the first sequence of points and the end point in the second sequence of points so that the distance becomes equal to or greater than the predetermined distance; The intervals between the points in the first point sequence and the second point sequence are determined so that the time intervals at which the moving object passes each point are constant. A trajectory generation device characterized by:

2. 2. The trajectory generation device according to claim 1, The avoidance area includes at least one of the center of the intersection and the shoulder of the road. A trajectory generation device characterized by:

3. 2. The trajectory generation device according to claim 1, The starting point is a point at the end position of a travel area in which the moving body travels, or the ending point is a point at the start position of a travel area to which the moving body travels. A trajectory generation device characterized by:

4. 4. The trajectory generation device according to claim 3, when the starting point is a point at an end position of a travel area in which the moving object travels, the ending point is a point in the second series of points that is connected to the starting point by a simple curve, When the end point is a point at the start position of the travel area of ​​the movement destination, the start point is a point in the first series of points that is connected to the end point by a simple curve. A trajectory generation device characterized by:

5. 2. The trajectory generation device according to claim 1, When the moving body moves across an oncoming lane and the distance between the avoidance area and the trajectory is less than a predetermined distance, the trajectory generation unit reselects at least one of the start point and the end point so that the start point and the end point are farther apart. A trajectory generation device characterized by:

6. 2. The trajectory generation device according to claim 1, When the moving body moves without crossing an oncoming lane and the distance between the avoidance area and the trajectory is less than a predetermined distance, the trajectory generation unit reselects at least one of the start point and the end point so that the start point and the end point are closer to each other. A trajectory generation device characterized by:

7. 2. The trajectory generation device according to claim 1, The curved line includes a simple curve that connects a track or an extension thereof in a travel area in which the moving body travels and a track or an extension thereof in a travel area of ​​the destination. A trajectory generation device characterized by:

8. 2. The trajectory generation device according to claim 1, The track is a track through which a center portion of a vehicle traveling along the track passes, The predetermined distance is at least half the width of the vehicle. A trajectory generation device characterized by:

9. 2. The trajectory generation device according to claim 1, The travel area of ​​the destination is a travel area connected to the travel area in which the moving body travels via a right turn or a left turn at an intersection. A trajectory generation device characterized by:

10. A trajectory generation device according to any one of claims 1 to 9; a travel control unit that controls travel along a trajectory indicated by the trajectory information generated by the trajectory generation device; A moving object characterized by having:

11. A program for causing a computer to function as the trajectory generation device according to any one of claims 1 to 9.

12. A trajectory generation method for generating trajectory information indicating a trajectory along which a moving object moves from a travel area in which the moving object travels to a travel area to which the moving object travels, the method being executed by a control device having a trajectory generation unit and an avoidance area detection unit, the method comprising: the trajectory generation unit outputs a trajectory in a travel area in which the moving body travels and a trajectory in a travel area at the destination as a first sequence of points and a second sequence of points, respectively, and generates trajectory information of a trajectory along which the moving body moves from the travel area in which the moving body travels to the travel area at the destination as a curve having a start point at a point in the first sequence of points and an end point at a point in the second sequence of points; the avoidance area detection unit estimates or detects an avoidance area in which the vehicle should avoid traveling based on an image captured by a camera, when the distance between the avoidance region and the trajectory is less than a predetermined distance, the trajectory generation unit regenerates the trajectory information by reselecting at least one of the start point in the first sequence of points and the end point in the second sequence of points so that the distance becomes equal to or greater than the predetermined distance; The intervals between the points in the first point sequence and the second point sequence are determined so that the time intervals at which the moving object passes each point are constant. A trajectory generation method characterized by:

Images