Information processing method and information processing device

Abstract

This information processing method and information processing device involve: generating, on the basis of point cloud data, a cluster comprising ranging points, mutual distances of which are within a prescribed distance; and detecting the moving direction of ranging points included in the cluster in a period from a first timing to a second timing. A case where the height of ranging points, included in the cluster, from a road surface where a vehicle is traveling is at a prescribed height or lower at at least one of the first timing and the second timing is defined as an altitude condition, a case where the position of the ranging points, included in the cluster, projected onto the road surface is aligned along the moving direction at said at least one timing is defined as an alignment condition, and a case where a difference between a first distance to the cluster at the first timing and a second distance to the cluster at the second timing is of a prescribed value or lower is defined as a deviation condition. When main conditions comprising the altitude condition, the alignment condition, and the deviation condition are all determined to be satisfied, the cluster is identified as a curbstone on the road surface.

Description

[Technical Field]

[0001] The present invention relates to an information processing method and an information processing device. [Background technology]

[0002] A technology has been proposed that processes distance data (distance and direction) obtained by a scanning laser radar and determines whether a moving object is a pedestrian or not based on the size and speed of the moving object recognized based on the distance data (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-160116 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the technology described in Patent Document 1, objects are identified based solely on the size and speed of the moving object, so if the density of ranging points around the vehicle obtained by scanning using a sensor is insufficient, there is a risk that stationary structures such as curbs may be mistakenly recognized as moving objects.

[0005] The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to provide an information processing method and an information processing device that can reduce the possibility of erroneously recognizing a stationary structure such as a curb as a moving object even when the density of distance measurement points around a vehicle obtained by scanning using a sensor is insufficient. [Means for solving the problem]

[0006] To solve the above-mentioned problems, an information processing method and an information processing device according to one aspect of the present invention generate clusters of ranging points that are within a predetermined distance from each other based on point cloud data, and detect the movement direction of the ranging points included in the cluster from a first timing to a second timing. The altitude condition is that the height of the ranging points included in the cluster from the road surface on which the vehicle is traveling is equal to or less than the predetermined height at at least one of the first timing and the second timing. The arrangement condition is that the positions of the ranging points included in the cluster projected onto the road surface are arranged along the movement direction at at least one of the timings. The deviation condition is that the difference between the first distance to the cluster at the first timing and the second distance to the cluster at the second timing is equal to or less than a predetermined value. If it is determined that all of the primary conditions, namely the altitude condition, the arrangement condition, and the deviation condition, are satisfied, the cluster is recognized as a curb on the road surface. [Effects of the Invention]

[0007] According to the present invention, even if the density of ranging points around the vehicle obtained by scanning using a sensor is insufficient, the possibility of mistakenly recognizing stationary structures such as curbs as moving objects can be reduced. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing the configuration of an information processing device 1 according to one embodiment of the present invention. [Figure 2] FIG. 2 is a flowchart showing the processing of the information processing device 1 according to one embodiment of the present invention. [Figure 3A] FIG. 3A is a schematic diagram showing the positional relationship between the distance measurement sensor 10 and the distance measurement points on the surface of the curb. [Figure 3B] FIG. 3B is a schematic diagram showing the relationship between the distance measurement points on the surface of the curb and the clusters. [Figure 4A] FIG. 4A is a first plan view showing an example of the positional relationship between the curb and the distance measuring sensor 10. FIG. [Figure 4B]FIG. 4B is a second plan view showing an example of the positional relationship between the curb and the distance measuring sensor 10. As shown in FIG. [Figure 4C] FIG. 4C is a third plan view showing an example of the positional relationship between the curb and the distance measuring sensor 10. DETAILED DESCRIPTION OF THE INVENTION

[0009] Next, an embodiment of the present invention will be described in detail with reference to the drawings. In the description, the same components are designated by the same reference numerals and duplicated explanations will be omitted.

[0010] [Configuration of information processing device] An example of the configuration of an information processing device 1 will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the information processing device 1 according to this embodiment. As shown in Fig. 1, the information processing device 1 includes a distance measurement sensor 10 (sensor) and a controller 20.

[0011] The information processing device 1 may be mounted on a vehicle with an automatic driving function, or on a vehicle without an automatic driving function. The information processing device 1 may also be mounted on a vehicle that is capable of switching between automatic driving and manual driving. The automatic driving function may also be a driving assistance function that automatically controls only some of the vehicle control functions, such as steering control, braking force control, and driving force control, to assist the driver in driving. In this embodiment, the information processing device 1 will be described as being mounted on a vehicle with an automatic driving function.

[0012] 1, the information processing device 1 may control various actuators such as a steering actuator, an accelerator pedal actuator, and a brake actuator based on the recognition results (position, shape, posture, etc. of an object) by the attribute information setting unit 24. This may enable highly accurate autonomous driving.

[0013] The ranging sensor 10 mainly includes a sensor that measures the distance and direction to objects around the vehicle by emitting electromagnetic waves from an emission point around the vehicle and detecting the positions of reflection points based on the waves reflected from the emitted electromagnetic waves. One example of such a sensor is a LIDAR (Laser Imaging Detection and Ranging). A LIDAR is a sensor that emits light (laser light) from an emission point around a predetermined area around the vehicle, detects the positions of reflection points (ranging points) based on the reflected waves, and generates point cloud data related to the ranging points. A LIDAR measures the distance and direction to an object and recognizes the shape of the object by measuring the time it takes for the light (reflected wave) to bounce back after emitting light. Furthermore, a LIDAR can obtain the positional relationship of objects in three dimensions. Mapping can also be performed using the intensity of the reflected wave.

[0014] For example, the LIDAR scans the periphery of the vehicle in the main scanning direction and the sub-scanning direction by changing the direction of light irradiation. As a result, light is sequentially irradiated onto multiple ranging points present around the vehicle. The illumination of all ranging points present around the vehicle with light is repeated at predetermined time intervals. The LIDAR generates information for each ranging point (ranging point information) obtained by irradiating light. The LIDAR then outputs point cloud data consisting of the multiple ranging point information to the controller 20.

[0015] The ranging point information includes position information of the ranging point. The position information is information indicating the position coordinates of the ranging point. The position coordinates may use a polar coordinate system that represents the direction from the lidar to the ranging point (yaw angle, pitch angle) and the distance from the lidar to the ranging point (depth). The position coordinates may use a three-dimensional coordinate system that represents x, y, and z coordinates with the installation position of the lidar as the origin. The ranging point information may also include time information of the ranging point. The time information is information that indicates the time when the position information of the ranging point was generated (when the reflected electromagnetic wave was received). In addition, the ranging point information may include information on the intensity of the reflected wave from the ranging point (intensity information).

[0016] The controller 20 is a general-purpose microcomputer equipped with a CPU (Central Processing Unit), memory, and input / output units. A computer program for causing the microcomputer to function as the information processing device 1 is installed in the microcomputer. By executing the computer program, the microcomputer functions as multiple information processing circuits provided in the information processing device 1. The controller 20 processes data acquired from the distance measurement sensor 10.

[0017] Although an example is shown here in which the multiple information processing circuits provided in the information processing device 1 are realized by software, it is of course also possible to configure the information processing circuits by providing dedicated hardware for executing each of the information processes described below.Furthermore, the multiple information processing circuits may be configured by individual hardware.

[0018] The controller 20 includes, as examples of a plurality of information processing circuits (information processing functions), a point cloud acquisition unit 21, a ranging point extraction unit 23, a clustering unit 25, a cluster tracking unit 27, a speed calculation unit 29, a vehicle information acquisition unit 31, and a determination unit 33. The controller 20 may also be expressed as an ECU (Electronic Control Unit).

[0019] The point cloud acquisition unit 21 acquires point cloud data from the distance measurement sensor 10 .

[0020] Based on the point cloud data, the distance measurement point extraction unit 23 extracts distance measurement points of three-dimensional objects existing around the vehicle, excluding distance measurement points on the road surface on which the vehicle is traveling.

[0021] The clustering unit 25 classifies (clusters) multiple ranging points related to a three-dimensional object into multiple clusters based on the distance between each point. More specifically, the clustering unit 25 performs processing to classify a set of ranging points whose distance to adjacent ranging points is equal to or less than a predetermined value as a cluster of ranging points related to one object. Therefore, each cluster is made up of ranging points whose mutual distances are within a predetermined distance. Note that the predetermined distance may be set in advance, or may be set appropriately based on the circumstances around the vehicle, the vehicle speed, etc.

[0022] Alternatively, the clustering unit 25 may calculate the size of each cluster based on information about the ranging points within the cluster, and if the calculated size of the cluster is within a range that is preset in accordance with a previously registered object, the clustering unit 25 may set the registered object as a candidate for that cluster.

[0023] The clustering process performed by the clustering unit 25 will be described with reference to Fig. 3A and Fig. 3B. Fig. 3A is a schematic diagram showing the positional relationship between the distance measurement sensor 10 and the distance measurement points on the surface of the curb. Fig. 3B is a schematic diagram showing the relationship between the distance measurement points on the surface of the curb and clusters.

[0024] 3A, the area through which the electromagnetic waves emitted from the emission point of the distance measurement sensor 10 pass is represented as a cone BL. The emission point of the distance measurement sensor 10 is located at the apex of the cone BL, and the emitted electromagnetic waves pass through the surface of the cone BL. In addition, multiple distance measurement points P located at the intersections of the cone BL and the surface of the curb LS are indicated by black dots.

[0025] 3B, the intersections of cones BL1 to BL5, which indicate the area through which the electromagnetic waves emitted from the emission point of the distance measurement sensor 10 pass, with a plane including the side surface of the curbstone LS are shown by solid lines (curves). The distance measurement points corresponding to the curbstone LS are shown by black dots. It is assumed that the side surface of the curbstone LS is perpendicular to the road surface on which the vehicle is traveling.

[0026] The electromagnetic waves represented by the cones BL1 to BL5 have different pitch angles (vertical tilt angles based on the horizontal plane) when emitted from the emission point of the distance measuring sensor 10. The direction of propagation of the electromagnetic wave corresponding to cone BL1 has the largest pitch angle, and the pitch angles of the directions of propagation of the electromagnetic waves corresponding to the cones decrease in the order of cones BL2, BL3, BL4, and BL5.

[0027] In FIG. 3B, the measurement points belonging to cones BL1 and BL2 are classified as cluster CL1, and the measurement points belonging to cone BL3 are classified as cluster CL2, which is different from cluster CL1. Since the measurement points belonging to cluster CL1 and the measurement points belonging to cluster CL2 are both measurement points corresponding to curb LS, the measurement points belonging to cluster CL1 and the measurement points belonging to cluster CL2 are classified as cluster CL3. CL2 However, if the curbstone LS is located far from the emission point of the ranging sensor 10 and the density of the ranging points at the position of the curbstone LS is insufficient, the ranging points for the same object may be classified into different clusters, as shown in FIG.

[0028] 3B move along the curb LS as the vehicle moves, and therefore appear to move similarly to a pedestrian or a small animal. Therefore, if an attempt is made to recognize objects corresponding to the clusters based solely on the size and speed of the clusters, there is a risk that the clusters CL1 and CL2 will be mistakenly recognized as moving objects. Therefore, the cluster tracking unit 27 and the determination unit 33, which will be described later, perform processing to reduce the possibility of mistakenly recognizing the clusters CL1 and CL2 as moving objects.

[0029] The cluster tracking unit 27 determines whether each cluster at two consecutive times (first timing and second timing) belongs to the same object based on the clustering results (position, shape, etc. of the cluster) for the ranging points at both times. For example, the cluster tracking unit 27 acquires the movement direction of the ranging points included in the cluster from the first timing to the second timing.

[0030] Furthermore, the cluster tracking unit 27 acquires the heights of the ranging points included in the cluster. The cluster tracking unit 27 may obtain a representative value (for example, an average value) of the heights of the ranging points based on a predetermined ratio or more of the ranging points included in the cluster, and acquire this as the height of the cluster.

[0031] Furthermore, the cluster tracking unit 27 acquires the arrangement direction of the ranging points included in the cluster. More specifically, the cluster tracking unit 27 calculates the positions of the ranging points included in the cluster projected onto the road surface, and acquires the arrangement direction on a two-dimensional plane parallel to the road surface for the multiple positions obtained by projecting the multiple ranging points. The cluster tracking unit 27 may acquire the arrangement direction based on a number of ranging points included in the cluster that is equal to or greater than a predetermined ratio.

[0032] The cluster tracking unit 27 acquires the height of the ranging points and the arrangement direction of the ranging points at at least one of the first timing and the second timing.

[0033] Additionally, the cluster tracking unit 27 acquires the distance from the emission point where the electromagnetic wave is emitted to the ranging point to the cluster. Here, the cluster tracking unit 27 acquires the distance from the emission point to the cluster at the first timing as the first distance, and acquires the distance from the emission point to the cluster at the second timing as the second distance.

[0034] The cluster tracking unit 27 acquires, for each cluster, the height of the cluster, the arrangement direction of the ranging points in the cluster, and the distance from the emission point to the cluster.

[0035] The vehicle information acquisition unit 31 acquires the position, speed, and moving direction of the vehicle. For example, the vehicle information acquisition unit 31 may acquire the position of the vehicle using a GPS receiver or a GNSS receiver (not shown), or may acquire the state of the vehicle using a speed sensor, an acceleration sensor, a steering angle sensor, a gyro sensor, a brake oil pressure sensor, an accelerator opening sensor, etc.

[0036] The speed calculation unit 29 calculates, for each cluster, the expected moving speed when the cluster is a cluster made up of distance measurement points corresponding to curbs. The magnitude W of the expected moving speed of the cluster is calculated by the following equation (1).

number

[0037] The reason why the magnitude of the movement speed of a cluster made up of ranging points corresponding to a curbstone is expressed by the above-mentioned formula (1) will be explained using Figures 4A, 4B, and 4C. Figure 4A is a first plan view showing an example of the positional relationship between the curbstone and the ranging sensor 10. Figure 4B is a second plan view showing an example of the positional relationship between the curbstone and the ranging sensor 10. Figure 4C is a third plan view showing an example of the positional relationship between the curbstone and the ranging sensor 10.

[0038] In Figure 4A, the distance traveled by the ranging sensor 10 during unit time Δt is indicated by "VΔt," and the distance traveled by the cluster during unit time Δt is indicated by "WΔt." The angle between the direction of movement of the ranging sensor 10 and the direction of arrangement of the ranging points included in the cluster is indicated by "θ," and the yaw angle of the cluster relative to the ranging sensor 10 is indicated by "φ." Additionally, the distance from the ranging sensor 10 to the cluster (more precisely, the distance on a plane parallel to the road surface) is indicated by "r." Circles C1 and C2 are circles with a radius of r, and the launch point of the ranging sensor 10, located at the center of circle C1, is shown as being located at the center of circle C2 after the elapse of unit time Δt.

[0039] "WΔt" is "W x Δt” and “Wy Δt”, where W x Δt” is the distance “V ” that the distance measuring sensor 10 moves in a direction parallel to the curb LS during the unit time Δt. x Δt” is the distance the cluster moves. y Δt” is the distance “V ” that the distance measuring sensor 10 moves in a direction perpendicular to the curb LS during the unit time Δt. y Δt” is the distance the cluster moves.

[0040] FIG. 4B shows the distance measuring sensor 10 moving in a direction parallel to the curb LS. From the positional relationship between the circle C1 and the circle C2 shown in FIG. x Δt” and “V x During "Δt", the following equation (2) holds:

number

[0041] FIG. 4C shows how the distance measuring sensor 10 moves in a direction perpendicular to the curb LS. In FIG. 4C, "α" satisfies "α+θ+φ=π / 2". From the positional relationship between the circle C1 and the circle C2 shown in FIG. 4C, "W y Δt” and “V y During "Δt", the following equation (3) holds:

number

[0042] In deriving equation (3), we use the fact that "α+θ+φ=π / 2" and "r" is sufficiently large compared to "VΔt".

[0043] Therefore, "W" shown in equation (2) x Δt” and “W” shown in equation (3) y By dividing the sum of "Δt" by "Δt", we obtain "W" as shown in equation (1).

[0044] Therefore, it was shown that the magnitude of the movement speed of a cluster consisting of measurement points corresponding to a curbstone is expressed by the above formula (1). If the expected movement speed is calculated based on formula (1) for a cluster actually obtained from point cloud data, and the expected movement speed is close to the actual movement speed, it can be determined that the cluster is likely to correspond to a curbstone.

[0045] The determination unit 33 determines for each cluster whether or not a condition indicating "curb-likeness" is met. Here, the following can be cited as conditions indicating "curb-likeness."

[0046] [A.Altitude conditions] The altitude condition is that the height of the measurement points included in the cluster from the road surface on which the vehicle is traveling is equal to or less than a predetermined height at at least one of the first timing and the second timing. Curbs on the road surface are often equal to or less than the predetermined height. Therefore, a cluster for which the altitude condition is met is likely to correspond to a curb.

[0047] [B. Array Conditions] The arrangement condition is that the projected positions of the ranging points included in a cluster onto the road surface are arranged along the movement direction of the cluster at at least one of the first timing and the second timing. The arrangement direction of the projected positions of the ranging points included in a cluster corresponding to a curb onto the road surface matches the movement direction of the cluster. Therefore, a cluster for which the arrangement condition is met is likely to correspond to a curb.

[0048] [C. Deviation conditions] The deviation condition is that the difference between the first distance from the launch point to the cluster at the first timing and the second distance from the launch point to the cluster at the second timing is equal to or less than a predetermined value. The distance from the launch point to the cluster corresponding to the curbstone does not fluctuate significantly. Therefore, a cluster for which the deviation condition is met is likely to correspond to a curbstone.

[0049] [D. Continuing Conditions] The continuation condition is that the arrangement direction of the positions of the ranging points included in the cluster projected onto the road surface at the first timing is the same as the arrangement direction of the positions of the ranging points included in the cluster projected onto the road surface at the second timing. The arrangement direction of the ranging points included in the cluster corresponding to a curbstone does not fluctuate significantly. Therefore, a cluster for which the continuation condition is met is likely to correspond to a curbstone.

[0050] Another continuation condition may be that the height of the ranging points included in the cluster at the first timing is the same as the height of the ranging points included in the cluster at the second timing. The height of the ranging points included in the cluster corresponding to a curbstone does not fluctuate significantly. Therefore, a cluster for which the continuation condition is met is likely to correspond to a curbstone.

[0051] [E. Speed ​​Conditions] The speed condition is that the difference between the movement speed estimated based on equation (1) for a cluster actually obtained from point cloud data and the actual movement speed of the cluster is equal to or less than a predetermined threshold (i.e., the two movement speeds are equal or very close). As described above, the magnitude of the movement speed of a cluster corresponding to a curbstone can be evaluated using equation (1). Therefore, a cluster for which the speed condition is met is likely to correspond to a curbstone.

[0052] [F. Other Conditions] In addition, if one or more of the above conditions are met at two or more times, it can be said that the cluster is likely to be a curb. In particular, if one or more of the above conditions are met at different vehicle speeds after the vehicle accelerates or decelerates, it can be said that the cluster is likely to be a curb.

[0053] Furthermore, if one or more of the above conditions are met for multiple clusters adjacent to the cluster of interest, there is a high possibility that the cluster of interest and the multiple adjacent clusters correspond to the same curbstone.

[0054] The determination unit 33 determines whether the above-described conditions indicating "curb-likeness" are met for each cluster. More specifically, the determination unit 33 determines whether all of the main conditions, which are the altitude condition, the arrangement condition, and the deviation condition, are met. If it is determined that all of the main conditions are met, the determination unit 33 recognizes the cluster as a curb on the road surface.

[0055] Alternatively, the determination unit 33 may recognize a cluster as a curb on the road surface when it is determined that the continuation condition is satisfied in addition to all of the main conditions. Also, the determination unit 33 may recognize a cluster as a curb on the road surface when it is determined that the speed condition is satisfied in addition to all of the main conditions. Furthermore, the determination unit 33 may recognize a cluster as a curb on the road surface when it is determined that other conditions are satisfied in addition to all of the main conditions.

[0056] [Processing procedure of information processing device] Next, a processing procedure of the information processing device 1 according to this embodiment will be described with reference to the flowchart of Fig. 2. Fig. 2 is a flowchart showing the processing of the information processing device 1 according to this embodiment. The processing of the information processing device 1 shown in Fig. 2 may be repeatedly executed at a predetermined cycle.

[0057] First, in step S101 , the point cloud acquisition unit 21 acquires point cloud data from the distance measurement sensor 10 .

[0058] In step S103, the distance measurement point extracting unit 23 extracts distance measurement points of three-dimensional objects existing around the vehicle, excluding distance measurement points on the road surface on which the vehicle is traveling, based on the point cloud data.

[0059] In step S105, the clustering unit 25 classifies (clusters) the multiple distance measurement points related to the three-dimensional object into multiple clusters based on the distances between the points. Additionally, the cluster tracking unit 27 acquires various information related to the clusters and the distance measurement points included in the clusters.

[0060] In step S107, the determination unit 33 selects an unprocessed cluster from among the clusters obtained by the clustering unit 25.

[0061] In steps S109, S111, and S113, the determination unit 33 determines whether or not the condition indicating "curb-likeness" is met for each cluster.

[0062] For example, in step S109, the determination unit 33 determines whether or not an altitude condition is met. In step S111, the determination unit 33 determines whether or not an arrangement condition is met. In step S113, the determination unit 33 determines whether or not a deviation condition is met. The determination unit 33 may also determine whether or not a continuation condition, a speed condition, or other conditions are met.

[0063] If it is determined in steps S109, S111, and S113 that the condition indicating "curb-likeness" is not met (NO in any of steps S109, S111, and S113), in step S117, the judgment unit 33 recognizes the selected cluster as a cluster corresponding to something other than a curb.

[0064] On the other hand, if it is determined in steps S109, S111, and S113 that the conditions indicating "curb-likeness" are met (YES in all of steps S109, S111, and S113), then in step S115, the judgment unit 33 recognizes the selected cluster as a cluster corresponding to a curb.

[0065] In step S119, it is determined whether or not the determination process has been completed for all clusters by the determination unit 33. If it is determined that not all clusters have been processed (NO in step S119), the process returns to step S107.

[0066] On the other hand, if it is determined that all clusters have been processed (YES in step S119), in step S121, the recognition result by the determination unit 33 is output from the input / output unit of the controller 20. Thereafter, the flowchart in FIG. 2 ends.

[0067] [Effects of the embodiment] As described above in detail, the information processing method and information processing device according to this embodiment generate clusters of ranging points that are within a predetermined distance from each other based on point cloud data generated by emitting electromagnetic waves from a launch point within a predetermined range around a vehicle and detecting the positions of ranging points, which are reflection points, based on the reflected waves. Then, the movement direction of the ranging points included in the cluster is detected from a first timing to a second timing. The altitude condition is that the height of the ranging points included in the cluster from the road surface on which the vehicle is traveling is equal to or less than a predetermined height at at least one of the first timing and the second timing. The arrangement condition is that the positions of the ranging points included in the cluster, projected onto the road surface, are arranged along the movement direction at at least one of the first timing and the second timing. The deviation condition is that the difference between a first distance from the launch point to the cluster at the first timing and a second distance from the launch point to the cluster at the second timing is equal to or less than a predetermined value. Then, it is determined whether all of the main conditions, including the altitude condition, the arrangement condition, and the deviation condition, are met. If it is determined that all of the main conditions are met, the cluster is recognized as a curb on the road surface.

[0068] This reduces the possibility of misidentifying a stationary structure such as a curbstone as a moving object, even if the density of ranging points around the vehicle obtained by scanning using the sensor is insufficient.In particular, because the system determines whether a cluster is a curbstone based on the height of the ranging points that make up the cluster, the similarity between the movement direction of the cluster and the arrangement direction of the ranging points within the cluster, and the change in distance from the sensor's emission point over time, it reduces the possibility of misidentifying a curbstone as a moving object.

[0069] Furthermore, the information processing method and information processing device according to this embodiment may recognize a cluster as a curb on a road surface when it is determined that all of the above main conditions are met and the arrangement direction of the positions at the first timing is the same as the arrangement direction of the positions at the second timing. The arrangement direction of the ranging points included in the cluster corresponding to the curb does not change over time if they are at the same location, and changes slowly over space. Therefore, by adding an arrangement condition and making a determination, it is possible to reduce the possibility of misidentifying a moving object as a curb.

[0070] Furthermore, the information processing method and information processing device according to this embodiment may recognize a cluster as a curb on a road surface when it is determined that all of the above main conditions are met and the height of the ranging points included in the cluster at the first timing is the same as the height of the ranging points included in the cluster at the second timing. The height of a cluster corresponding to a curb does not change over time if it is at the same location, and changes slowly over space. Therefore, by adding this condition to the determination, it is possible to reduce the possibility of erroneously determining a moving object as a curb.

[0071] Furthermore, the information processing method and information processing device according to this embodiment determine that all of the above main conditions are satisfied, and the magnitude W of the movement speed of the cluster is determined to be:

number

[0072] Furthermore, the information processing method and information processing device according to this embodiment may recognize a cluster as a curb on a road surface when it is determined that all of the above primary conditions are satisfied and when it is determined that all of the primary conditions are satisfied after the vehicle accelerates or decelerates. If the magnitude of the movement speed of the cluster satisfies the above conditions at multiple points in time when the vehicle is moving at different speeds, the cluster is likely to correspond to a curb. Therefore, by determining the above conditions even after the vehicle accelerates or decelerates, it is possible to reduce the possibility of erroneously determining that a moving object is a curb.

[0073] Furthermore, the information processing method and information processing device according to this embodiment may recognize multiple clusters as curbs on a road surface when it is determined that all of the above main conditions are satisfied for two or more multiple clusters. In the case of spatially continuous curbs, it is highly likely that the above conditions are satisfied for multiple clusters. Therefore, by determining that the above conditions are satisfied for multiple clusters, it is possible to reduce the possibility of erroneously determining a moving object as a curb.

[0074] Each function described in the above embodiments may be implemented by one or more processing circuits, including programmed processors, electrical circuits, and even devices such as application specific integrated circuits (ASICs), circuit components arranged to perform the described functions.

[0075] Although the present invention has been described above based on the embodiments, it will be apparent to those skilled in the art that the present invention is not limited to these descriptions and that various modifications and improvements are possible. The descriptions and drawings that form part of this disclosure should not be understood as limiting the present invention. Various alternative embodiments, examples, and operating techniques will become apparent to those skilled in the art from this disclosure.

[0076] The present invention naturally includes various embodiments not described herein. Therefore, the technical scope of the present invention is defined only by the invention-specifying matters according to the scope of the claims that are appropriate from the above description. [Explanation of symbols]

[0077] 1. Information processing equipment 10. Distance sensor 20 Controller 21 Point cloud acquisition section 23 Range measurement point extraction section 25 Clustering Department 27 Cluster Tracking Unit 29 Speed ​​calculation section 31 Vehicle information acquisition unit 33 Judgment section

Claims

1. a sensor that emits electromagnetic waves from a radiation point within a predetermined range around the vehicle, detects the positions of reflection points, which are distance measurement points, based on the reflected waves, and generates point cloud data relating to the distance measurement points; a controller that processes data acquired from the sensor, The controller generating a cluster made up of the distance measurement points whose mutual distances are within a predetermined distance based on the point cloud data; detecting a movement direction of the distance measurement points included in the cluster from a first timing to a second timing; an altitude condition is that the height of the ranging points included in the cluster from a road surface on which the vehicle is traveling is equal to or less than a predetermined height at at least one of the first timing and the second timing; an arrangement condition is that the positions of the distance measurement points included in the cluster, when projected onto the road surface, are arranged along the movement direction at at least one of the first timing and the second timing; a deviation condition being a difference between a first distance from the launch point to the cluster at the first timing and a second distance from the launch point to the cluster at the second timing being equal to or less than a predetermined value; determining whether or not all of the main conditions, which are the altitude condition, the arrangement condition, and the deviation condition, are satisfied; If it is determined that all of the main conditions are satisfied, the cluster is recognized as a curb on the road surface. An information processing method comprising:

2. 2. An information processing method according to claim 1, The controller When it is determined that all of the main conditions are satisfied and the arrangement direction of the positions at the first timing is the same as the arrangement direction of the positions at the second timing, the cluster is recognized as a curb on the road surface. An information processing method comprising:

3. 3. An information processing method according to claim 1 or 2, The controller When it is determined that all of the primary conditions are satisfied and the height of the distance measurement points included in the cluster at the first timing is the same as the height of the distance measurement points included in the cluster at the second timing, the cluster is recognized as a curb on the road surface. An information processing method comprising:

4. An information processing method according to claim 1 or 2, The controller It is determined that all of the primary conditions are met, and V is the magnitude of the movement speed of the sensor, θ is the angle between the direction of movement of the sensor and the direction of arrangement of the positions, Let φ be the azimuth angle of the cluster relative to the sensor, The magnitude W of the movement speed of the cluster is [Equation 1] and recognizing the cluster as a curb on the road surface if An information processing method comprising:

5. An information processing method according to claim 1 or 2, When it is determined that all of the primary conditions are satisfied and when it is determined that all of the primary conditions are satisfied after acceleration or deceleration of the vehicle, the cluster is recognized as a curb on the road surface. An information processing method comprising:

6. An information processing method according to claim 1 or 2, When it is determined that all of the main conditions are satisfied for two or more clusters, the clusters are recognized as curbs on the road surface. An information processing method comprising:

7. a sensor that emits electromagnetic waves from a radiation point within a predetermined range around the vehicle, detects the positions of reflection points, which are distance measurement points, based on the reflected waves, and generates point cloud data relating to the distance measurement points; a controller for processing data acquired from the sensor; The controller generating a cluster made up of the distance measurement points whose mutual distances are within a predetermined distance based on the point cloud data; detecting a movement direction of the distance measurement points included in the cluster from a first timing to a second timing; an altitude condition is that the height of the ranging points included in the cluster from a road surface on which the vehicle is traveling is equal to or less than a predetermined height at at least one of the first timing and the second timing; an arrangement condition is that the positions of the distance measurement points included in the cluster, when projected onto the road surface, are arranged along the movement direction at at least one of the first timing and the second timing; a deviation condition being a difference between a first distance from the launch point to the cluster at the first timing and a second distance from the launch point to the cluster at the second timing being equal to or less than a predetermined value; determining whether or not all of the main conditions, which are the altitude condition, the arrangement condition, and the deviation condition, are satisfied; If it is determined that all of the main conditions are satisfied, the cluster is recognized as a curb on the road surface. An information processing device characterized by:

Images