Locus information collecting device, locus information collecting method, and computer program for collecting locus information
The trajectory information collection device identifies and records abnormal vehicle travel paths by determining deviations from standard ranges, enhancing data accuracy and reducing unnecessary data transmission.
Patent Information
- Application Number
- JP2023077222
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-09
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2043-05-09
AI Technical Summary
Existing vehicle trajectory data collection systems fail to distinguish between normal and abnormal travel trajectories, which can deviate from the intended lane, necessitating a method to separately collect and analyze such deviations.
A trajectory information collection device that determines whether a vehicle's travel trajectory is within a predetermined standard driving range, generating and transmitting information including coordinates and operation amounts when deviations occur, using sensors and cameras to detect lane markings and surrounding conditions.
Enables the collection of abnormal vehicle travel trajectories by distinguishing between standard and deviating paths, reducing data transmission volume by excluding unnecessary information from normal trajectories.
Smart Images

Figure 2024162051000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a locus information collecting device, a locus information collecting method, and a computer program for collecting locus information that collects information representing a locus traveled by a vehicle. [Background technology]
[0002] A technology has been proposed to generate data indicating the areas in which a vehicle can travel on each road section as one type of information to be included in high-precision maps that an autonomous driving system references to control the autonomous driving of a vehicle (see Patent Document 1).
[0003] The map data generating device disclosed in Patent Document 1 statistically processes cross-sectional travel trajectory data from the start section of the first lane to the end section of the second lane. Then, this map data generating device generates driving range data that indicates the driving range when the vehicle actually drives using the autonomous driving function or driving assistance function after excluding cross-sectional travel trajectory data that falls outside a predetermined range. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2020-101745 A Summary of the Invention [Problem to be solved by the invention]
[0005] The travel path of a vehicle when it is actually traveling is affected by the surrounding conditions of the vehicle. Therefore, in some cases, the travel path of the vehicle may be an abnormal path such as deviating from the lane in which the vehicle is traveling. It is desirable to be able to collect such abnormal travel path separately from normal travel path.
[0006] SUMMARY OF THE PRESENT DISCLOSURE In view of the above, an object of the present invention is to provide a trajectory information collection device capable of collecting information on a vehicle's travel trajectory that is an abnormal trajectory. [Means for solving the problem]
[0007] According to one embodiment, a reference information collecting device is provided. The trajectory information collecting device includes a determination unit that determines whether or not a driving trajectory when a vehicle travels through a predetermined section is included in a predetermined standard driving range, a trajectory information generating unit that generates trajectory information by including coordinates of individual positions on the driving trajectory in the trajectory information when the driving trajectory is included in the standard driving range, and generates trajectory information by including coordinates of individual positions on the driving trajectory and operation amount information representing an operation amount of the vehicle by a driver in the predetermined section in the trajectory information when the driving trajectory is outside the standard driving range, and a communication processing unit that transmits the generated trajectory information to a server via a communication device mounted on the vehicle.
[0008] The trajectory information collecting device preferably further includes a storage unit that stores information representing a reference driving trajectory in a predetermined section. The determining unit preferably determines that the driving trajectory deviates from the standard driving range when a deviation between the driving trajectory and the reference driving trajectory at any position on the driving trajectory is greater than a predetermined allowable distance corresponding to the standard driving range.
[0009] Alternatively, the trajectory information collecting device preferably further includes a detection unit that detects lane markings that define the lanes on which the vehicle has traveled in a predetermined section from an image obtained by a camera mounted on the vehicle. The determination unit preferably sets the standard driving range based on the detected lane markings.
[0010] Alternatively, it is preferable that the trajectory information collecting device further includes a vehicle detection unit that detects other vehicles traveling around the vehicle while the vehicle is traveling in a predetermined section from a sensor signal indicating the situation around the vehicle obtained by a sensor mounted on the vehicle, and estimates the relative positional relationship of the detected other vehicles with respect to the vehicle. When the traveling trajectory deviates from the standard traveling range, it is preferable that the trajectory information generating unit includes, in the trajectory information, relative positional information indicating the relative positional relationship of the detected other vehicles with respect to the vehicle at any position on the traveling trajectory.
[0011] According to another embodiment, a trajectory information collecting method is provided, which includes: determining whether or not a travel trajectory when a vehicle travels a predetermined section is included in a predetermined standard travel range; if the travel trajectory is included in the standard travel range, generating the trajectory information by including coordinates of each position on the travel trajectory in the trajectory information; if the travel trajectory is outside the standard travel range, generating the trajectory information by including coordinates of each position on the travel trajectory and operation amount information representing an operation amount of the vehicle by the driver in the predetermined section in the trajectory information; and transmitting the generated trajectory information to a server via a communication device mounted on the vehicle.
[0012] According to yet another embodiment, a computer program for collecting trajectory information is provided. The computer program for collecting trajectory information includes instructions for causing a computer to execute the following: determining whether or not a travel trajectory when a vehicle travels a predetermined section is included in a predetermined standard travel range; if the travel trajectory is included in the standard travel range, generating trajectory information by including coordinates of individual positions on the travel trajectory in the trajectory information; if the travel trajectory is outside the standard travel range, generating trajectory information by including coordinates of individual positions on the travel trajectory and operation amount information representing an operation amount of the vehicle by a driver in the predetermined section in the trajectory information; and transmitting the generated trajectory information to a server via a communication device mounted on the vehicle. Effect of the Invention
[0013] The trajectory information collection device according to the present disclosure has an effect of being able to collect information regarding a vehicle's traveling trajectory that is an abnormal trajectory. [Brief description of the drawings]
[0014] [Figure 1] 1 is a schematic configuration diagram of a trajectory information collection system in which a trajectory information collection device is implemented. [Diagram 2] FIG. 1 is a schematic configuration diagram of a vehicle. [Diagram 3] FIG. 2 is a hardware configuration diagram of a trajectory information collection device according to an embodiment. [Figure 4] FIG. 2 is a functional block diagram of a processor of the trajectory information collection device. [Diagram 5] 1A and 1B are diagrams illustrating an example of a collected travel trajectory. [Figure 6] 13 is an operation flowchart of a trajectory information collection process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] Hereinafter, a trajectory information collecting device, a trajectory information collecting method executed by the trajectory information collecting device, and a computer program for collecting trajectory information will be described with reference to the drawings. The trajectory information collecting device is mounted on a vehicle, generates trajectory information representing a travel trajectory of the vehicle when the vehicle travels a predetermined section, and uploads the trajectory information to a server. In particular, the trajectory information collecting device determines whether or not the travel trajectory when the vehicle travels a predetermined section is included in a predetermined standard travel range. If the travel trajectory is included in the standard travel range, the trajectory information collecting device generates the trajectory information by including in the trajectory information the coordinates of each position on the travel trajectory. On the other hand, if the travel trajectory is outside the standard travel range, the trajectory information collecting device generates the trajectory information by including in the trajectory information the coordinates of each position on the travel trajectory and operation amount information representing the amount of vehicle operation by the driver in the predetermined section.
[0016] FIG. 1 is a schematic diagram of a trajectory information collection system in which a trajectory information collection device is implemented. In this embodiment, the trajectory information collection system 1 has a trajectory information collection device 3 mounted on at least one vehicle 2, and a server 4. The trajectory information collection device 3 is connected to the server 4 via the wireless base station 6 and the communication network 5 by accessing the wireless base station 6 connected to the communication network 5 to which the server 4 is connected via a gateway (not shown), for example. Note that while only one vehicle 2 is illustrated in FIG. 1, the trajectory information collection system 1 may have a plurality of vehicles 2 mounted with the trajectory information collection device 3. Similarly, a plurality of wireless base stations 6 may be connected to the communication network 5.
[0017] The vehicle 2 and the trajectory information collection device 3 will be described below. As described above, the trajectory information collection system 1 may include a plurality of vehicles 2 equipped with trajectory information collection devices 3, but each vehicle 2 and each trajectory information collection device 3 may have the same configuration and execute the same process with respect to trajectory information collection processing. Therefore, one vehicle 2 and one trajectory information collection device 3 will be described below.
[0018] 2 is a schematic diagram of the vehicle 2. The vehicle 2 includes a camera 21 for capturing images of the surroundings of the vehicle 2, a GPS receiver 22, a wireless communication terminal 23, a vehicle control device (ECU) 24, and a trajectory information collection device 3. The camera 21, the GPS receiver 22, the wireless communication terminal 23, the ECU 24, and the trajectory information collection device 3 are communicatively connected via an in-vehicle network conforming to a standard such as a controller area network. The vehicle 2 may further include a distance measurement sensor (not shown) such as a LiDAR sensor for measuring distances to objects around the vehicle 2.
[0019] The camera 21 is an example of a sensor that detects the situation around the vehicle 2, and has a two-dimensional detector configured with an array of photoelectric conversion elements sensitive to visible light, such as a CCD or C-MOS, and an imaging optical system that forms an image of the area to be photographed on the two-dimensional detector. The camera 21 is attached, for example, inside the passenger compartment of the vehicle 2 so as to face the front of the vehicle 2. The camera 21 photographs the area in front of the vehicle 2 at a predetermined photographing period (for example, 1 / 30 to 1 / 10 seconds) and generates an image showing the area in front of the vehicle 2. The image obtained by the camera 21 is an example of a sensor signal that indicates the situation around the vehicle 2, and may be a color image or a gray image. Note that the vehicle 2 may be provided with a plurality of cameras 21 with different photographing directions or focal lengths.
[0020] Every time the camera 21 generates an image, it outputs the generated image together with the generation time to the trajectory information collection device 3 via the in-vehicle network.
[0021] The GPS receiver 22 receives GPS signals from GPS satellites at predetermined intervals and measures the self-position of the vehicle 2 based on the received GPS signals. Then, the GPS receiver 22 outputs positioning information representing the positioning result of the self-position of the vehicle 2 based on the GPS signals, together with the generation time, to the trajectory information collection device 3 via the in-vehicle network at predetermined intervals. Note that the vehicle 2 may have a receiver that complies with a satellite positioning system other than the GPS receiver 22. In this case, it is sufficient that the receiver measures the self-position of the vehicle 2.
[0022] The wireless communication terminal 23 is an example of a communication device, and is a device that executes wireless communication processing in accordance with a predetermined wireless communication standard. For example, by accessing the wireless base station 6, the wireless communication terminal 23 is connected to the server 4 via the wireless base station 6 and the communication network 5. That is, a communication line is established between the wireless communication terminal 23 and the server 4 via the wireless base station 6 and the communication network 5. The wireless communication terminal 23 receives a downlink wireless signal including information indicating a collection target area including a section from which trajectory information is to be collected from the server 4, and outputs the received information to the trajectory information collection device 3. The wireless communication terminal 23 also generates an uplink wireless signal including the trajectory information received from the trajectory information collection device 3. The wireless communication terminal 23 transmits the uplink wireless signal to the wireless base station 6 to transmit the trajectory information to the server 4.
[0023] The ECU 24 controls each part of the vehicle 2 according to the operation by the driver. Furthermore, the ECU 24 outputs operation amount information representing the amount of operation of the vehicle 2 by the driver at every predetermined period to the trajectory information collection device 3. The operation amount information includes at least one of the steering angle, the accelerator opening degree, and the brake operation amount, and the time when the driver's operation amount represented in the operation amount information was detected.
[0024] 3 is a hardware configuration diagram of the trajectory information collection device 3. The trajectory information collection device 3 generates trajectory information representing a travel trajectory when the vehicle 2 travels through a predetermined section, and transmits the generated trajectory information to the server 4 via the wireless communication terminal 23. To this end, the trajectory information collection device 3 has a communication interface 31, a memory 32, and a processor 33.
[0025] The communication interface 31 is an example of an in-vehicle communication unit, and has an interface circuit for connecting the trajectory information collection device 3 to an in-vehicle network. That is, the communication interface 31 is connected to the camera 21, the GPS receiver 22, the wireless communication terminal 23, and the ECU 24 via the in-vehicle network. Then, the communication interface 31 passes the received image to the processor 33 every time it receives an image from the camera 21. Also, the communication interface 31 passes the received positioning information to the processor 33 every time it receives positioning information from the GPS receiver 22. Furthermore, the communication interface 31 passes the information from the server 4, such as information indicating a collection target area, to the processor 33 every time it receives information from the wireless communication terminal 23. Furthermore, the communication interface 31 passes the operation amount information to the processor 33 every time it receives operation amount information from the ECU 24. Furthermore, the communication interface 31 outputs the trajectory information and the like received from the processor 33 to the wireless communication terminal 23 via the in-vehicle network.
[0026] The memory 32 is an example of a storage unit, and includes, for example, a volatile semiconductor memory and a non-volatile semiconductor memory. The memory 32 may further include other storage devices such as a hard disk device. The memory 32 stores various data used in processing related to trajectory information collection executed by the processor 33 of the trajectory information collection device 3. For example, the memory 32 stores identification information of the vehicle 2, parameters of the camera 21 such as the focal length, shooting direction, and installation position of the camera 21, and various parameters for identifying a classifier for detecting detection objects such as lane markings and other vehicles from an image received from the camera 21. The memory 32 also temporarily stores an image received from the camera 21, positioning information received from the GPS receiver 22, operation amount information received from the ECU 24, and the generation times of these. Furthermore, the memory 32 stores information representing a collection target area. The information representing the collection target area includes information indicating the position and range of a predetermined section (for example, coordinates of each end point of the predetermined section). Furthermore, the memory 32 may store a high-precision map representing features, such as lane markings, used to detect the position of the vehicle 2. Furthermore, the memory 32 may store information representing a reference driving trajectory and information representing a standard driving range. Furthermore, the memory 32 may store computer programs for implementing each process executed by the processor 33, and the like.
[0027] The processor 33 has one or more central processing units (CPUs) and their peripheral circuits. The processor 33 may further have other arithmetic circuits such as a logic arithmetic unit, a numerical arithmetic unit, or a graphic processing unit. The processor 33 executes a trajectory information collection process while the vehicle 2 is traveling. Each time the processor 33 receives an image from the camera 21, the processor 33 stores the image together with the time of its generation in the memory 32. Each time the processor 33 receives positioning information from the GPS receiver 22, the processor 33 stores the positioning information together with the time of its generation in the memory 32. Furthermore, each time the processor 33 receives operation amount information from the ECU 24, the processor 33 stores the operation amount information in the memory 32.
[0028] 4 is a functional block diagram of the processor 33 of the trajectory information collection device 3. The processor 33 has a detection unit 41, a vehicle detection unit 42, a determination unit 43, a trajectory information generation unit 44, and a communication processing unit 45. Each of these units in the processor 33 is, for example, a functional module realized by a computer program running on the processor 33. Alternatively, each of these units in the processor 33 may be a dedicated arithmetic circuit provided in the processor 33.
[0029] The processor 33 determines whether the vehicle 2 has entered a predetermined section. When the vehicle 2 has entered the predetermined section, the processor 33 executes a trajectory information collection process. The predetermined section may be a road section included in the collection target area. The predetermined section may be, for example, a section including a curve section, an intersection, a junction, or a branching point. However, the predetermined section is not limited to these sections and may be a simple straight section.
[0030] The processor 33 determines whether the current position of the vehicle 2 indicated by the latest positioning information is included in a predetermined section indicated by the information indicating the collection target area. If the current position of the vehicle 2 is included in the range of the predetermined section included in the information indicating the collection target area, the processor 33 determines that the vehicle 2 has entered the predetermined section, and executes the trajectory information collection process.
[0031] The detection unit 41 detects lane markings that divide the lane on which the vehicle 2 has traveled in a predetermined section (hereinafter, sometimes referred to as the own lane). To this end, when the vehicle 2 enters the predetermined section, the detection unit 41 detects the lane markings by inputting the latest image obtained by the camera 21 at every predetermined period to a classifier that has been trained in advance to detect lane markings. The detection unit 41 then determines the lane markings detected at the positions closest to the vehicle 2 within the areas corresponding to the left and right sides of the vehicle 2 on the image as the lane markings that divide the own lane.
[0032] Furthermore, the detection unit 41 may detect a predetermined feature other than lane markings from the image by inputting the image to the above-mentioned classifier. The detected predetermined feature is used to accurately detect the position of the vehicle 2. The predetermined feature includes at least any of road markings other than lane markings, such as a curb, a guard rail, a road sign, and a stop line.
[0033] The detection unit 41 may use a deep neural network (DNN) having a convolutional neural network (CNN) type architecture, such as Single Shot MultiBox Detector or Faster R-CNN, as a classifier. Alternatively, the detection unit 41 may use a DNN for semantic segmentation, such as a Fully Convolutional Network or U-Net, as a classifier. Alternatively, the detection unit 41 may use a DNN having a self attention network (SAN) type architecture, such as a Vision Transformer, as a classifier. Alternatively, the detection unit 41 may use a classifier based on other machine learning methods, such as an AdaBoost classifier, as a classifier. Such a classifier is trained in advance according to a predetermined learning method, such as an error backpropagation method, using a large number of teacher images in which features such as lane markings to be detected are detected from an image. The classifier then outputs information representing an object region including the feature to be detected on the input image, and information representing the type of feature represented in the object region.
[0034] The detection unit 41 notifies the determination unit 43 of the position and type of the detected feature on the image.
[0035] The vehicle detection unit 42 detects other vehicles (hereinafter, for convenience of explanation, may be referred to as surrounding vehicles) traveling around the vehicle 2. To this end, when the vehicle 2 enters a predetermined section, the vehicle detection unit 42 detects the surrounding vehicles by inputting the latest image obtained by the camera 21 at predetermined intervals to a classifier that has been trained in advance to detect surrounding vehicles.
[0036] As such a classifier, the vehicle detection unit 42 can use a classifier similar to the classifier used by the detection unit 41 to detect lane markings and the like. Note that the classifier used by the detection unit 41 may be trained in advance so as to also detect surrounding vehicles. In this case, the detection unit 41 and the vehicle detection unit 42 are configured integrally.
[0037] Furthermore, if the vehicle 2 has a distance measurement sensor, the vehicle detection unit 42 may detect surrounding vehicles by inputting a distance measurement signal obtained by the distance measurement sensor to a classifier. The distance measurement sensor is another example of a sensor that detects the surrounding conditions of the vehicle 2, and the distance measurement signal is another example of a sensor signal that indicates the surrounding conditions of the vehicle 2. In this case, the vehicle detection unit 42 can use, as a classifier, a DNN having a CNN-type or SAN-type architecture, or a classifier based on another machine learning method such as a support vector machine.
[0038] When the vehicle detection unit 42 detects a surrounding vehicle, it obtains relative position information that indicates a relative positional relationship between the vehicle 2 and the surrounding vehicle. In this embodiment, the relative position information includes the distance between the vehicle 2 and the surrounding vehicle and the direction from the vehicle 2 to the surrounding vehicle. Here, it is assumed that the position of the bottom end of the object area in which the surrounding vehicle is represented on the image indicates the direction to the position where the surrounding vehicle is in contact with the road surface as seen from the camera 21. Therefore, the vehicle detection unit 42 can estimate the distance between the vehicle 2 and the surrounding vehicle based on the position of the bottom end of the object area in which the surrounding vehicle is represented on the image and parameters such as the shooting direction, focal length, and installation height of the camera 21. Furthermore, the vehicle detection unit 42 may determine that the direction from the camera 21 corresponding to the center of gravity position of the object area in which the surrounding vehicle is represented on the image is the direction from the vehicle 2 to the surrounding vehicle. Furthermore, when the vehicle 2 is equipped with a distance measurement sensor, the vehicle detection unit 42 may estimate, as the distance between the vehicle 2 and the surrounding vehicle, the distance measured in the direction corresponding to the center of gravity of the object area in the image in which the surrounding vehicle is represented, which is indicated in the distance measurement signal obtained by the distance measurement sensor at the time of image generation. Alternatively, when the surrounding vehicle is detected based on the distance measurement signal, the vehicle detection unit 42 may estimate, as the distance between the vehicle 2 and the surrounding vehicle, the distance measured in the direction in which the surrounding vehicle is represented, which is indicated in the distance measurement signal.
[0039] When a plurality of surrounding vehicles are detected, the vehicle detection unit 42 may perform the above process for each surrounding vehicle to obtain relative position information for each surrounding vehicle.
[0040] The vehicle detection unit 42 notifies the trajectory information generation unit 44 of the relative position information obtained for each of the surrounding vehicles.
[0041] The determination unit 43 determines whether or not the travel path of the vehicle 2 when it travels through a predetermined section is included in a predetermined standard travel range. To this end, when the vehicle 2 leaves the predetermined section, the determination unit 43 identifies the travel path of the vehicle 2 while it is traveling through the predetermined section. The determination unit 43 may determine whether or not the vehicle 2 has left the predetermined section by comparing the position of the vehicle 2 indicated by the latest positioning information with the predetermined section. Hereinafter, the travel path of the vehicle 2 in the predetermined section may be simply referred to as the travel path.
[0042] The determination unit 43 acquires odometry information of the vehicle 2 from the ECU 24 and determines the amount of movement and directional change of the vehicle 2 for each image generation interval. The determination unit 43 then estimates the position of the vehicle 2 at the time each image is generated according to a so-called Structure from Motion (SfM) technique, based on the features detected from each image and the amount of movement and directional change of the vehicle 2 for each image generation interval. The determination unit 43 then determines the travel trajectory of the vehicle 2 by chronologically arranging the coordinates of the estimated position of the vehicle 2 at the time each image is generated.
[0043] Furthermore, when a high-precision map is stored in the memory 32, the determination unit 43 may detect the position of the vehicle 2 at the time of generating each image by comparing each image with the high-precision map based on features detected from each image. In this case, the determination unit 43 assumes the position and orientation of the vehicle 2 and projects the features detected from the image onto the high-precision map, or projects the features around the vehicle 2 depicted on the high-precision map onto the image. The determination unit 43 then detects the position and orientation of the vehicle 2 when the features detected from the image and the features depicted on the high-precision map most closely match as the actual position and orientation of the vehicle 2.
[0044] In this case, the determination unit 43 may determine the position where the feature is projected on the high-precision map or image by using the assumed position and orientation of the vehicle 2 and parameters of the camera 21 such as the focal length, installation height, and shooting direction. As the initial value of the position and orientation of the vehicle 2, the position of the vehicle 2 represented by the latest positioning information, or the position and orientation of the vehicle 2 estimated at the time of the previous detection of the position of the vehicle 2, corrected by using the odometry information, is used. Then, the determination unit 43 calculates the degree of match between the feature detected from the image and the corresponding feature shown on the high-precision map (for example, the reciprocal of the sum of the squares of the distances between the corresponding features). The determination unit 43 repeats the above process while changing the assumed position and orientation of the vehicle 2. Then, the determination unit 43 may detect the assumed position and orientation when the degree of match is maximum as the actual position and orientation of the vehicle 2.
[0045] If the position of vehicle 2 indicated by the positioning information is sufficiently accurate, determination unit 43 may determine the travel trajectory of vehicle 2 by chronologically arranging the coordinates of the position of vehicle 2 indicated by the positioning information.
[0046] The determination unit 43 compares the obtained travel trajectory with the standard travel range. The standard travel range can be a range that the vehicle 2 is expected to pass through if the vehicle 2 travels without violating road regulations and without causing danger to the vehicle 2 itself or surrounding vehicles. For example, the standard travel range is set so as to be included between two lane markings that divide the vehicle's own lane. In addition, when the specified section is a section that includes an intersection, it is preferable that the standard travel range is set so as not to cross lanes before and after the intersection.
[0047] The determination unit 43 sets the standard driving range based on the two lane markings that divide the own lane, detected by the detection unit 41. In this case, the determination unit 43 determines the positions of the lane markings in real space based on the parameters of the camera 21, such as the installation height, focal length, and shooting direction of the camera 21, and the position and orientation of the vehicle 2 when the image in which the lane markings are detected is generated. The determination unit 43 executes the above process for each image generated while the vehicle 2 is traveling in a predetermined section, and by connecting the lane markings detected from each image and projected into real space, determines the positions of the lane markings in real space throughout the entire predetermined section. The determination unit 43 then sets the standard driving range so that the boundary of the standard driving range is a position that is included between the two lane markings that divide the own lane and is a predetermined safety distance (for example, several tens of centimeters to 2 meters) inside the lane markings.
[0048] When a high-precision map is stored in the memory 32, the determination unit 43 may set the standard driving range by using lane markings in a predetermined section shown on the high-precision map instead of the lane markings detected by the detection unit 41. In this case, the determination unit 43 may determine, as the own lane, a lane that includes the position of the vehicle 2 when the vehicle 2 enters the predetermined section, among the individual lanes in the predetermined section shown on the high-precision map.
[0049] The determination unit 43 compares the set standard driving range with the driving trajectory of the vehicle 2 to determine whether or not the driving trajectory of the vehicle 2 is included in the standard driving range. If the driving trajectory is included in the standard driving range over the entire predetermined section, the determination unit 43 determines that the driving trajectory is included in the standard driving range. On the other hand, if the driving trajectory deviates from the standard driving range at any position in the predetermined section, the determination unit 43 determines that the driving trajectory deviates from the standard driving range.
[0050] The high-precision map may also include information representing a reference driving trajectory for each lane in a given section. The reference driving trajectory for each lane is a standard trajectory that a vehicle follows when driving on that lane unless there are some special circumstances. For example, the reference driving trajectory is set as an average of multiple driving trajectories of vehicles that have actually driven on that lane. Alternatively, the reference driving trajectory may be set to pass through the center of the lane.
[0051] In this case, the standard driving range of each lane can be set to a range centered on the reference driving trajectory of the lane and within a predetermined allowable distance from the reference driving trajectory. The allowable distance of each lane is set to a distance shorter than the width from the reference driving trajectory of the lane to the lane marking that divides the lane by a predetermined safe distance. Therefore, at each position on the driving trajectory, the determination unit 43 calculates the distance from that position to the reference driving trajectory as the deviation between the driving trajectory at that position and the reference driving trajectory. Then, if the deviation at any position on the driving trajectory is equal to or smaller than the allowable distance, the determination unit 43 determines that the driving trajectory is included in the standard driving range. On the other hand, if the deviation at any position on the driving trajectory is greater than the allowable distance, the determination unit 43 determines that the driving trajectory is outside the standard driving range.
[0052] The determination unit 43 notifies the trajectory information generation unit 44 of the coordinates of each position included in the travel trajectory of the vehicle 2 and the time when the vehicle 2 is at each position (i.e., the image generation time or the positioning information generation time corresponding to when each position is detected). Furthermore, the determination unit 43 notifies the trajectory information generation unit 44 of the determination result as to whether or not the travel trajectory is included in the standard travel range.
[0053] The trajectory information generating unit 44 generates trajectory information representing the travel trajectory when the vehicle 2 travels through a predetermined section. In this embodiment, when the travel trajectory is included in the standard travel range, the trajectory information generating unit 44 generates the trajectory information by including the coordinates of each position on the travel trajectory in the trajectory information. On the other hand, when the travel trajectory deviates from the standard travel range, the trajectory information generating unit 44 generates the trajectory information by including the coordinates of each position on the travel trajectory as well as the operation amount information at each position in the trajectory information. In this case, for each position on the travel trajectory, the trajectory information generating unit 44 sets the operation amount information at the time closest to the time when the vehicle 2 is present at that position as the operation amount information at that position. This makes it possible to identify the cause of the abnormal trajectory in which the travel trajectory of the vehicle 2 deviates from the standard travel range. Note that the trajectory information generating unit 44 may include the operation amount information obtained during the period from when the vehicle 2 enters the predetermined section to when it leaves the predetermined section in the trajectory information without associating it with each position on the travel trajectory.
[0054] 5(a) and 5(b) are diagrams showing examples of collected travel trajectories. In the example shown in Fig. 5(a), a travel trajectory 501 is included within a standard travel range 510. Therefore, the coordinates of each position on the travel trajectory 501 are included in the trajectory information.
[0055] 5(b), the traveling trajectory 502 includes some parts outside the standard traveling range 510. Therefore, not only the coordinates of each position on the traveling trajectory 502 but also the operation amount information at each position is included in the trajectory information.
[0056] Furthermore, when the driving trajectory deviates from the standard driving range, the trajectory information generation unit 44 may include in the trajectory information at least one of a flag indicating that the driving trajectory has deviated from the standard driving range, information representing the standard driving range, and the coordinates of the position where the driving trajectory has deviated from the standard driving range.
[0057] Furthermore, the processor 33 may receive information indicating the speed and acceleration / deceleration of the vehicle 2 from the ECU 24 during the period from when the vehicle 2 enters the predetermined section to when it leaves the predetermined section. When the travel trajectory deviates from the standard travel range, the trajectory information generator 44 may include at least one of the speed and acceleration / deceleration of the vehicle 2 during that period in the trajectory information. This makes it possible to analyze the behavior of the vehicle 2 when the travel trajectory of the vehicle 2 becomes an abnormal trajectory that deviates from the standard travel range.
[0058] Furthermore, when the travel trajectory deviates from the standard travel range, the trajectory information generating unit 44 may include relative position information between the vehicle 2 and the surrounding vehicles detected by the vehicle detection unit 42 during the period when the vehicle 2 is traveling in a predetermined section in the trajectory information. This makes it possible to determine whether the cause of the abnormal travel trajectory of the vehicle 2 is due to the relative positional relationship between the surrounding vehicles and the vehicle 2.
[0059] The trajectory information generating unit 44 passes the generated trajectory information to the communication processing unit 45 .
[0060] When the communication processing unit 45 receives the trajectory information, it transmits the trajectory information to the server 4 via the wireless communication terminal 23. The communication processing unit 45 may transmit the trajectory information immediately after the vehicle 2 exits a predetermined section, but the timing is not limited to this and the communication processing unit 45 may transmit the trajectory information at another timing. For example, the communication processing unit 45 may transmit the trajectory information when the ignition switch of the vehicle 2 is turned off.
[0061] Furthermore, the communication processing unit 45 may transmit a series of images generated while the vehicle 2 is traveling through the predetermined section, or a partial image cut out from each of the series of images, to the server 4 via the wireless communication terminal 23. Furthermore, the communication processing unit 45 may transmit data representing a predetermined feature, such as a lane marking, detected from each of the series of images generated while the vehicle 2 is traveling through the predetermined section, to the server 4 via the wireless communication terminal 23.
[0062] 6 is an operational flowchart of the trajectory information collection process. When the vehicle 2 enters a predetermined section, the processor 33 executes the trajectory information collection process in accordance with the following operational flowchart.
[0063] The detection unit 41 of the processor 33 detects lane markings that divide the vehicle's own lane (step S101). The vehicle detection unit 42 of the processor 33 detects surrounding vehicles (step S102).
[0064] The determination unit 43 of the processor 33 determines whether the vehicle 2 has exited the predetermined section (step S103). If the vehicle 2 has not exited the predetermined section (step S103-No), the processor 33 repeats the processes from step S101 onwards.
[0065] On the other hand, when the vehicle 2 exits the predetermined section (step S103-Yes), the determination unit 43 identifies the travel path of the vehicle 2 while it is traveling in the predetermined section (step S104). Furthermore, the determination unit 43 sets a standard travel range based on the lane markings that divide the vehicle's own lane (step S105). Note that, if the determination unit 43 can use a high-precision map, the determination unit 43 may set the standard travel range based on the high-precision map. Then, the determination unit 43 determines whether the travel path of the vehicle 2 is included in the standard travel range (step S106).
[0066] When the travel trajectory of the vehicle 2 is included in the standard travel range (step S106-Yes), the trajectory information generating unit 44 of the processor 33 generates trajectory information by including the coordinates of each position on the travel trajectory in the trajectory information (step S107). On the other hand, when the travel trajectory of the vehicle 2 is out of the standard travel range (step S106-No), the trajectory information generating unit 44 generates trajectory information by including the coordinates of each position on the travel trajectory and the operation amount information at each position in the trajectory information (step S108). Note that in step S108, as described above, the trajectory information generating unit 44 may include information indicating the behavior of the vehicle 2, such as the speed or acceleration / deceleration of the vehicle 2, or relative position information between the vehicle 2 and surrounding vehicles in the trajectory information.
[0067] After step S107 or step S108, the communication processing unit 45 of the processor 33 transmits the trajectory information to the server 4 via the wireless communication terminal 23 (step S109). Then, the processor 33 ends the trajectory information collection process.
[0068] The server 4 generates or updates a high-precision map based on the trajectory information received from the trajectory information collection device 3 of each vehicle 2. For example, the processor of the server 4 averages a plurality of driving trajectories included in a standard driving range for each lane in a specific section to obtain a reference driving trajectory for that lane in the specific section. The processor of the server 4 then includes information representing the reference driving trajectory obtained for each lane in the high-precision map. Furthermore, the processor of the server 4 may include information representing a driving trajectory outside the standard driving range for each lane in the specific section in the high-precision map. Furthermore, the processor of the server 4 may analyze operation amount information included in the trajectory information for a driving trajectory outside the standard driving range.
[0069] As described above, the trajectory information collecting device determines whether or not the travel trajectory when the vehicle travels a predetermined section is included in a predetermined standard travel range. When the travel trajectory is included in the standard travel range, the trajectory information collecting device generates the trajectory information by including the coordinates of each position on the travel trajectory in the trajectory information. On the other hand, when the travel trajectory is outside the standard travel range, the trajectory information collecting device generates the trajectory information by including not only the coordinates of each position on the travel trajectory but also operation amount information representing the amount of vehicle operation by the driver in the trajectory information. Therefore, the trajectory information collecting device can collect information on the travel trajectory of the vehicle that is an abnormal trajectory. Furthermore, the trajectory information collecting device can suppress an unnecessary increase in the amount of data transmitted to the server by not including unnecessary information in the trajectory information for normal travel trajectories included in the standard travel range.
[0070] According to a modified example, if the trajectory information generating unit 44 does not include relative position information between the vehicle 2 and surrounding vehicles in the trajectory information even when the driving trajectory of the vehicle 2 deviates from the standard driving range, the processing of the vehicle detection unit 42 may be omitted. Furthermore, if the standard driving range is set based on a high-precision map and lane markings are not used to detect the position of the vehicle 2, the processing of the detection unit 41 may also be omitted.
[0071] A computer program that causes a computer to realize the functions of each unit of the processor of the trajectory information collection device according to each of the above embodiments or modifications may be provided in a form stored in a computer-readable recording medium. The computer-readable recording medium may be, for example, a magnetic recording medium, an optical recording medium, or a semiconductor memory.
[0072] As described above, those skilled in the art can make various modifications to the embodiments within the scope of the present invention. [Explanation of symbols]
[0073] 1. Trajectory information collection system 2 Vehicles 21 Camera 22 GPS receiver 23 Wireless communication terminals 24 ECU 3. Trajectory information collection device 31 Communication Interface 32 Memory 33 Processors 41 Detection unit 42 Vehicle detection unit 43 Judgment section 44 Trajectory information generation section 45 Communication processing section 4 Server 5. Communication Network 6 Radio base stations
Claims
1. a determination unit that determines whether a travel path of the vehicle when the vehicle travels through a predetermined section is included in a predetermined standard travel range; a trajectory information generating unit that generates the trajectory information by including, in the trajectory information, coordinates of each position on the traveling trajectory when the traveling trajectory is included in the standard traveling range, and generates the trajectory information by including, in the trajectory information, coordinates of each position on the traveling trajectory and operation amount information representing an operation amount of the vehicle by a driver of the vehicle in the specified section when the traveling trajectory is outside the standard traveling range; a communication processing unit that transmits the trajectory information to a server via a communication device mounted on the vehicle; A trajectory information collection device having the above structure.
2. A storage unit for storing information representing a reference travel locus in the predetermined section, 2. The trajectory information collection device according to claim 1, wherein the determination unit determines that the driving trajectory falls outside the standard driving range when a deviation between the driving trajectory and the reference driving trajectory at any position on the driving trajectory becomes larger than a predetermined allowable distance corresponding to the standard driving range.
3. A detection unit detects a lane marking that defines a lane along which the vehicle has traveled in the predetermined section from an image obtained by a camera mounted on the vehicle, The trajectory information collection device according to claim 1 , wherein the determining unit sets the standard driving range based on the lane markings.
4. a vehicle detection unit that detects other vehicles traveling around the vehicle while the vehicle is traveling in the predetermined section from a sensor signal indicating a situation around the vehicle obtained by a sensor mounted on the vehicle, and estimates a relative positional relationship of the detected other vehicles with respect to the vehicle; The trajectory information collection device according to any one of claims 1 to 3, wherein the trajectory information generation unit includes, in the trajectory information, relative position information representing a relative positional relationship of the detected other vehicle to the vehicle at any position on the driving trajectory when the driving trajectory deviates from the standard driving range.
5. determining whether or not a travel path of the vehicle travelling through a predetermined section is included in a predetermined standard travel range; If the travel path is included in the standard travel range, the travel path information is generated by including coordinates of each position on the travel path in the travel path information; When the travel locus deviates from the standard travel range, the travel locus information is generated by including in the travel locus information coordinates of each position on the travel locus and operation amount information representing an operation amount of the vehicle by the driver of the vehicle in the predetermined section; transmitting the trajectory information to a server via a communication device mounted on the vehicle; A trajectory information collection method comprising:
6. determining whether or not a travel path of the vehicle travelling through a predetermined section is included in a predetermined standard travel range; If the travel path is included in the standard travel range, the travel path information is generated by including coordinates of each position on the travel path in the travel path information; When the travel locus deviates from the standard travel range, the travel locus information is generated by including in the travel locus information coordinates of each position on the travel locus and operation amount information representing an operation amount of the vehicle by the driver of the vehicle in the predetermined section; transmitting the trajectory information to a server via a communication device mounted on the vehicle; A computer program for collecting trajectory information to cause a computer to carry out the above.
Citation Information
Patent Citations
Map data-rewriting apparatus and map data-rewriting program
JP2015075423A
Operation support system, operation support method, and program
JP2018081536A
Traffic control system
JP2020154622A
Obstacle information management device, obstacle information management method, and device for vehicle
WO2021261228A1
Map data generation device, on-vehicle machine, map data generation system, map data generation program, map data use program and storage medium
JP2020101745A
