Coordinate transformation method, device and data processing device

The method addresses the inaccuracy in coordinate transformation by accounting for radar deflection angle and height, enabling precise conversion to world coordinates for accurate electronic map generation.

JP7585813B2Active Publication Date: 2024-11-19FUJITSU LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021010509
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-02-27
Filing Date
2021-01-26
Publication Date
2024-11-19
Estimated Expiration
2041-01-26

AI Technical Summary

Technical Problem

In the process of generating electronic maps using radar data, the inaccuracy in coordinate transformation arises due to the deflection angle and height of roadside radars installed at intersections, which are not considered in existing methods.

Method used

A coordinate conversion method and apparatus that accounts for the deflection angle and height of radars by converting radar coordinates into rotational coordinates, then horizontal coordinates, and finally into world coordinates, using specific transformation formulas.

Benefits of technology

This approach effectively transforms radar coordinates into accurate world coordinates, ensuring precise electronic map generation by considering the actual installation conditions of roadside radars.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007585813000026
    Figure 0007585813000026
  • Figure 0007585813000027
    Figure 0007585813000027
  • Figure 0007585813000028
    Figure 0007585813000028
Patent Text Reader

Abstract

To provide a method for converting coordinates, a device, and a data processor according to an embodiment.SOLUTION: The method for converting coordinates includes the steps of: determining a deflection angle of a radar (S501); converting radar coordinates of an object detected by the radar into rotational coordinates on the basis of the deflection angle (S502); converting the rotational coordinates of the object into horizontal coordinates on the basis of the height of the radar (S503); and converting the horizontal coordinates of the object into world coordinates on the basis of the direction of the radar to a world coordinate system (S504). According to an embodiment of the present invention, it becomes possible to effectively convert the radar coordinates to world coordinates by considering the deflection angle and the height of the radar when performing a coordinate conversion.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to the technical field of coordinates transformation, and in particular to a coordinates transformation method, device and data processing device. [Background technology]

[0002] A Cooperative Vehicle Infrastructure System (CVIS) is a subsystem of an Intelligent Transportation System (ITS) that obtains vehicle and road information using roadside sensing and wireless communication technology. Compared with autonomous vehicles that rely only on their own sensing systems, a CVIS with roadside sensing provides additional information with extended coverage and more dimensions. Currently, sensing fusion with cameras and radar is the development trend of CVIS, and the fusion results may be used to generate electronic maps.

[0003] The coordinates of the electronic map are called world coordinates, which reflect the position of an object in the real world. In the radar coordinate system, the position of the radar is the origin of the radar coordinate system. The coordinate transformation from the radar coordinates to the world coordinates is an issue to be solved in the process of generating the electronic map.

[0004] The world coordinate system and radar coordinate system of the road intersection are shown in Figure 1. The x-axis and y-axis of the world coordinate system are parallel to the east-west road and the north-south road, respectively, and the origin of the world coordinate system is the intersection of the center lines of the two lanes. The four radars shown in Figure 1 are installed facing north, west, south, and east, respectively. The radar coordinate system of the radar is composed of the u-axis and v-axis, the k-axis and j-axis, the m-axis and n-axis, and the s-axis and t-axis, respectively.

[0005] Fig. 1 shows an ideal situation, in which the horizontal axes (k-axis and s-axis) of radar 2 and radar 4 and the vertical axes (v-axis and n-axis) of radar 1 and radar 3 are perpendicular to the x-axis of the world coordinate system, and the horizontal axes (u-axis and m-axis) of radar 1 and radar 3 and the vertical axes (j-axis and t-axis) of radar 2 and radar 4 are perpendicular to the y-axis of the world coordinate system. Fig. 2 shows an example of a radar coordinate system in an ideal situation. In this case, the vehicle trajectory detected by radar 1 is parallel to the road lanes and the vertical axis (v-axis) of the radar coordinate system.

[0006] It should be noted that the above description of the technical background is for the purpose of making the technical solutions of the present invention clear and complete, and is described for the purpose of making those skilled in the art understand. These technical solutions are merely described as part of the background technology of the present invention, and are not well known to those skilled in the art. Summary of the Invention [Problem to be solved by the invention]

[0007] According to the discovery of the inventor of the present invention, roadside radars are usually installed on high crossbars at road intersections. In real situations, due to installation reasons, the radar has a deflection angle (α). The deflection angle (α) is the angle between the vertical axis v' of the radar coordinate system in an ideal situation (the vertical axis is parallel to the lane) and the vertical axis v of the radar coordinate system in a real situation, as shown in FIG. 3. If the deflection angle of the radar is not taken into account during the coordinate transformation, the coordinate transformation will be inaccurate. In addition, as shown in FIG. 4, the radar has a certain height (h), and the world coordinate system reflects the coordinates of the horizontal plane, so the height of the radar must also be taken into account during the coordinate transformation.

[0008] SUMMARY OF THE PRESENTLY PREFERRED EMBODIMENTS The present invention provides a coordinate transformation method, apparatus and data processing device that can efficiently transform radar coordinates into world coordinates. [Means for solving the problem]

[0009] In a first aspect of an embodiment of the present invention, a coordinate conversion method is provided, comprising the steps of determining a deflection angle of a radar, converting radar coordinates of an object detected by the radar into rotational coordinates based on the deflection angle, converting the rotational coordinates of the object into horizontal coordinates based on a height of the radar, and converting the horizontal coordinates of the object into world coordinates based on an orientation of the radar with respect to a world coordinate system.

[0010] In a second aspect of an embodiment of the present invention, there is provided a coordinate conversion device including: a determination unit that determines a deflection angle of a radar; a first conversion unit that converts radar coordinates of an object detected by the radar into rotational coordinates based on the deflection angle; a second conversion unit that converts the rotational coordinates of the object into horizontal coordinates based on the height of the radar; and a third conversion unit that converts the horizontal coordinates of the object into world coordinates based on an orientation of the radar with respect to a world coordinate system.

[0011] In a third aspect of an embodiment of the present invention, there is provided a data processing device including a processor and a memory, wherein a computer program is stored in the memory, and the processor is configured to realize a coordinate conversion method, when executing the computer program, including the steps of determining a deflection angle of a radar, converting radar coordinates of an object detected by the radar into rotational coordinates based on the deflection angle, converting the rotational coordinates of the object into horizontal coordinates based on the height of the radar, and converting the horizontal coordinates of the object into world coordinates based on an orientation of the radar with respect to a world coordinate system.

[0012] The advantageous effects of the embodiment of the present invention are as follows: According to the method of the embodiment of the present invention, the radar coordinates can be effectively transformed into the world coordinates by taking into account the radar deflection angle (α) and height (h) when performing the coordinate transformation.

[0013] Certain embodiments of the invention are disclosed in detail, as set forth in the following description and in the drawings, which show how the principles of the invention may be employed, but are not intended to be limited in scope, and include all changes, modifications, and equivalents within the spirit and content of the appended claims.

[0014] Features described and / or shown in one embodiment may be used in the same or similar manner in one or more other embodiments, may be combined with features in the other embodiments, or may substitute for features in the other embodiments.

[0015] It should be noted that the term "comprising" when used in the present text means the presence of a feature, element, step or component and does not exclude the presence or addition of one or more other features, elements, steps or components. [Brief description of the drawings]

[0016] Elements and features illustrated in any drawing or embodiment of an embodiment of the invention may be combined with elements and features shown in one or more other drawings or embodiments. In the drawings, like reference numerals represent corresponding components in multiple drawings and may represent corresponding components used in multiple aspects.

[0017] The drawings included herein are for understanding the embodiments of the present invention, constitute a part of this specification, and are for illustrating the embodiments of the present invention, and together with the description of the text, explain the principles of the present invention. Note that the drawings described herein are merely for illustrating the embodiments of the present invention, and those skilled in the art can easily obtain other drawings based on these drawings. [Figure 1] FIG. 1 is a schematic diagram of the world coordinate system and four radar coordinate systems in an ideal situation. [Diagram 2] FIG. 1 is a schematic diagram of a radar coordinate system in an ideal situation. [Diagram 3] FIG. 2 is a schematic diagram of a radar coordinate system with deflection angles in a practical situation. [Figure 4] FIG. 2 is a schematic diagram of a radar coordinate system with height in a practical situation. [Diagram 5] FIG. 2 is a schematic diagram of a coordinate transformation method according to an embodiment of the present invention; [Figure 6] FIG. 2 is a schematic diagram of an example of determining the deflection angle of a radar according to an embodiment of the present invention; [Figure 7] FIG. 2 is a schematic diagram of an example of selected radar data. [Figure 8] FIG. 2 is a schematic diagram of an example of an estimated trajectory line. [Figure 9] 1 is a schematic diagram of a coordinate conversion device according to an embodiment of the present invention; [Figure 10] 2 is a schematic diagram of a determination unit of a coordinate transformation apparatus according to an embodiment of the present invention; FIG. [Figure 11] 1 is a schematic diagram of a data processing apparatus according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] The above and other features of the present invention will become apparent from the drawings and the following description. The specification and drawings disclose specific embodiments of the present invention, i.e., some embodiments according to the principles of the present invention. It is to be understood that the present invention is not limited to the described embodiments, and the present invention includes all modifications, variations, and equivalents within the scope of the appended claims.

[0019] In the embodiments of the present invention, the terms "first" and "second" are used to distinguish different elements by name and do not imply the spatial arrangement or temporal order of these elements, and the elements are not limited to these terms. The term "and / or" includes any one or more of the listed terms and combinations thereof. The terms "including," "including," and "having" refer to the presence of stated features, elements, components or members but do not exclude the presence or addition of one or more other features, elements, components or members.

[0020] In the present embodiment, the singular forms "a", "the", "the" and the like include the plural, meaning "a kind" or "a class", and are not limited to "one". Additionally, the term "said" includes both the singular and the plural, unless the context clearly dictates otherwise. Additionally, the term "according to" means "at least in part depending on" and the term "based on" means "at least in part based on", unless the context clearly dictates otherwise.

[0021] In an embodiment of the present invention, the ideal radar coordinate system (u' and v' axes) is called a rotated coordinate system, as shown in Fig. 3. Also, in an embodiment of the present invention, the coordinate system (u" and v" axes) projected onto the world coordinate system is called a horizontal coordinate system, as shown in Fig. 4.

[0022] In the example of FIG. 1, the x-axis and y-axis of the world coordinate system correspond to the east-west direction and the north-south direction, respectively, and the installation direction of the radar is based on the world coordinate system. The present invention is not limited to this, and the x-axis and y-axis of the world coordinate system may have an angular offset with respect to the east-west direction and the north-south direction. In this case, the installation direction of the radar is also offset by a corresponding angle. For example, if the x-axis of the world coordinate system is offset by 45 degrees with respect to the east-west direction, the radar coordinate system (rotating coordinate system) under ideal circumstances is also offset by 45 degrees, and the deflection angle of the radar is an angle offset from the 45 degrees. For convenience of explanation, the present invention takes as an example that the x-axis and y-axis of the world coordinate system correspond to the east-west direction and the north-south direction, respectively.

[0023] Hereinafter, various aspects of the embodiment of the present invention will be described with reference to the drawings. These aspects are merely illustrative and do not limit the embodiment of the present invention.

[0024] <Example 1> An embodiment of the present invention provides a coordinate transformation method. Figure 5 is a schematic diagram of a coordinate transformation method according to an embodiment of the present invention. As shown in Figure 5, the method includes the following steps:

[0025] Step 501: Determine the radar deflection angle.

[0026] Step 502: Transform the radar coordinates of the object detected by the radar into rotated coordinates based on the deflection angle.

[0027] Step 503: Transform the rotational coordinates of the object into horizontal coordinates based on the radar height.

[0028] Step 504: Transform the horizontal coordinate of the object into world coordinates based on the orientation of the radar relative to the world coordinate system.

[0029] In the embodiment of the present invention, the radar coordinate means the coordinate value of an object detected by the radar in the radar coordinate system, and the rotating coordinate means the coordinate value of an object detected by the radar in the rotating coordinate system. The radar coordinate system means the coordinate system in the actual installation situation of the radar, for example, the horizontal axis u and the vertical axis v shown in FIG. 3. The rotating coordinate system means the coordinate system in the ideal installation situation of the radar, for example, the horizontal axis u' and the vertical axis v' shown in FIG. 3, where the vertical axis v' is parallel to the lane. As shown in FIG. 3, the vertical axis v of the radar coordinate system and the vertical axis v' of the rotating coordinate system have a deflection angle α. In other words, the actual installation position of the radar is offset by an angle α with respect to the ideal installation position.

[0030] According to an embodiment of the present invention, the radar coordinates of an object can be first rotated by an angle α into a rotating coordinate, then the rotating coordinates of the object can be projected into a horizontal coordinate, and finally the horizontal coordinates of the object can be transformed into a world coordinate to obtain the world coordinates of the object detected by the radar, and an electronic map can be generated based on the world coordinates of the object, so that the radar coordinates can be effectively transformed into the world coordinates by taking into account the deflection angle and height of the radar when performing the coordinate transformation.

[0031] In step 501, in some aspects, a radar deflection angle may be determined based on radar data, the radar data including radar coordinates of objects detected by the radar, and the radar data further including other information such as the speed of the objects detected by the radar. In some aspects, the radar coordinates of the objects detected by the radar may be used to determine the radar deflection angle.

[0032] 6 is a schematic diagram of an example of determining a deflection angle of a radar according to an embodiment of the present invention. As shown in FIG. 6, the method includes the following steps:

[0033] Step 601: Obtain radar data including radar coordinates of objects detected by the radar.

[0034] Step 602: From the radar data, radar data in which the movement trajectory of an object is within the range of a straight lane is selected.

[0035] Step 603: Estimate a trajectory line based on the selected radar data.

[0036] Step 604: Calculate the deflection angle of the radar based on the trajectory line.

[0037] In an embodiment of the present invention, the movement trajectory of the object may be calculated based on radar data. The present invention is not limited to a method of calculating the movement trajectory of the object based on radar data. It may be determined whether the movement trajectory of the object is within the range of the straight lane based on the movement trajectory of the object and the range of the straight lane.

[0038] For example, the radar data may obtain the trajectory of a vehicle along a lane (i.e., the object's movement trajectory is within the range of the straight lane) and the trajectory of a vehicle that turns at an intersection (i.e., the object's movement trajectory is not within the range of the straight lane). In order to estimate the radar deflection angle, the present invention removes the trajectory of a vehicle that turns at an intersection by filtering. That is, the trajectory of a vehicle that traveled along a lane is retained, and the trajectory is represented by the radar coordinates of the object. In some aspects, when the x-axis and y-axis of the world coordinate system are the center line of the road, the radar data (radar coordinates) whose horizontal axis value (horizontal coordinate) is greater than half the lane width and whose vertical axis value (vertical coordinate) is less than the lane width may be removed by filtering. In this way, the radar data whose object's movement trajectory is within the range of the straight lane is obtained.

[0039] According to the method of FIG. 6, the deflection angle can be estimated using only a large number of radar data records (i.e., radar data of moving objects) from which background objects have been removed by filtering, thereby making it possible to obtain the radar deflection angle without the need for manual measurement.

[0040] 7 is a schematic diagram of an example of selected radar data RD. In an embodiment of the present invention, a trajectory line TL may be estimated based on the radar data RD, and the trajectory line TL may be used to calculate the deflection angle of the radar. The present invention is not limited to a method of estimating the trajectory line TL based on the radar data RD.

[0041] For example, in some aspects, the correlation between u and v is first analyzed for radar data RD, where u and v are the abscissa and ordinate values ​​of the object in the radar data, respectively. If there is a correlation between u and v, the trajectory line function is set to v=a+bu, and the trajectory line TL is estimated using the least squares method, or the RANSAC (RANdom SAmple Consensus) method, or other methods, and the radar deflection angle is calculated based on the estimated trajectory line TL. The principles of the least squares method and the RANSAC method may refer to related art, and the description thereof will be omitted here. Furthermore, if there is no correlation between u and v, it means that the trajectory line TL is parallel to the v axis or parallel to the u axis, that is, there is no deflection angle, or the deflection angle is 90 degrees.

[0042] In the embodiment of the present invention, the correlation analysis may be performed using the Spearman method, the Pearson method or other methods. The principles of the Spearman method or the Pearson method may be referred to in the related art, and the description thereof is omitted here.

[0043] Fig. 8 is a schematic diagram of an example of an estimated trajectory line TL. As shown in Fig. 8, in an ideal situation, the vertical axis v' of the radar coordinate system is parallel to the trajectory line TL, in other words, the trajectory line TL is parallel to the vertical axis v' of the rotating coordinate system in an ideal situation. Assuming that the function of the trajectory line in the radar coordinate system is expressed as v=a+bu, and u and v are the horizontal and vertical coordinates in the radar coordinate system of the object, respectively, the deflection angle of the radar may be expressed as α=arctan(-1 / b).

[0044] In step 502, since the rotated coordinate system is obtained from the rotation angle α of the radar coordinate system, the radar coordinates of the object may be converted to rotated coordinates based on the radar deflection angle α, for example, converting the radar coordinates (u, v) to rotated coordinates (u', v') as shown in Figure 3. In some aspects, the conversion equation for converting the radar coordinates (u, v) to the rotated coordinates (u', v') may be expressed as the following equation:

number

[0045] Here, (u,v) represents an arbitrary point in the radar coordinate system, u and v are the abscissa and ordinate values ​​in the radar coordinate system of the object, respectively, and (u',v') represents a pair of coordinates (u,v) in the rotating coordinate system, u' and v' are the abscissa and ordinate values ​​in the rotating coordinate system of the object, respectively. The above is merely an example, and other conversion methods from radar coordinates (u,v) to rotating coordinates (u',v') that can be conceived according to the implementation principle of the present invention are also included in the protection scope of the present invention.

[0046] In step 503, once the rotated coordinates of the object, i.e., the radar coordinates in an ideal situation, are obtained, the rotated coordinates may be projected to horizontal coordinates, for example, converting the rotated coordinates (u',v') to horizontal coordinates (u",v") as shown in FIG. 4. In some aspects, the conversion equation for converting the rotated coordinates (u',v') to horizontal coordinates (u",v") may be expressed as the following equation:

number

[0047] Here, (u',v') represents an arbitrary point in the rotating coordinate system, and u' and v' are the abscissa and ordinate values ​​in the rotating coordinate system of the object, respectively. h is the height of the radar, which may be measured manually or obtained from radar installation data, but the present invention is not limited to such an acquisition method. (u",v") represents a coordinate pair of (u',v') in the horizontal coordinate system, and u" and v" are the abscissa and ordinate values ​​in the horizontal coordinate system of the object, respectively. The above merely describes an example, and other conversion methods from the rotating coordinates (u',v') to the horizontal coordinates (u",v") that can be conceived according to the implementation principle of the present invention are also within the scope of protection of the present invention. For example, the rotating coordinates of the object may be projected to the horizontal coordinates according to the following formula:

number

[0048] Once the horizontal coordinates of the object are obtained in step 504, the horizontal coordinates may be translated to world coordinates by translation. Since the orientation of the radar with respect to the world coordinate system is different, the translation method is also different.

[0049] For example, if the horizontal axis of the horizontal coordinate system is parallel to the x-axis of the world coordinate system and the direction of the horizontal axis is the same as the direction of the x-axis of the world coordinate system, and the vertical axis of the horizontal coordinate system is parallel to the y-axis of the world coordinate system and the direction of the vertical axis is the same as the direction of the y-axis of the world coordinate system, like radar 1 shown in Figure 1, the world coordinates (x, y) of the radar may be expressed as follows:

number

[0050] Here, (x 1 ,y 1 ) is a coordinate in the radar's world coordinate system, (u”,v”) represents an arbitrary point in the horizontal coordinate system, and u” and v” are the abscissa and ordinate values, respectively, in the object's horizontal coordinate system.

[0051] Also, for example, if the horizontal axis of the horizontal coordinate system is parallel to the y axis of the world coordinate system and the direction of the horizontal axis is the same as the direction of the y axis of the world coordinate system, and the vertical axis of the horizontal coordinate system is parallel to the x axis of the world coordinate system and the direction of the vertical axis is opposite to the direction of the x axis of the world coordinate system, like radar 2 shown in Figure 1, the world coordinates (x, y) of the radar may be expressed as follows:

number

[0052] Here, (x 2 ,y 2) is a coordinate in the radar's world coordinate system, (j”,k”) represents an arbitrary point in the horizontal coordinate system, and j” and k” are the abscissa and ordinate values ​​in the object's horizontal coordinate system, respectively.

[0053] Also, for example, if the horizontal axis of the horizontal coordinate system is parallel to the x-axis of the world coordinate system and the direction of the horizontal axis is opposite to the direction of the x-axis of the world coordinate system, and the vertical axis of the horizontal coordinate system is parallel to the y-axis of the world coordinate system and the direction of the vertical axis is opposite to the direction of the y-axis of the world coordinate system, like radar 3 shown in Figure 1, the world coordinates (x, y) of the radar may be expressed as follows:

number

[0054] Here, (x 3 ,y 3 ) is a coordinate in the radar's world coordinate system, (m”,n”) represents an arbitrary point in the horizontal coordinate system, and m” and n” are the abscissa and ordinate values, respectively, in the horizontal coordinate system of the object.

[0055] Also, for example, if the horizontal axis of the horizontal coordinate system is parallel to the y axis of the world coordinate system and the direction of the horizontal axis is opposite to the direction of the y axis of the world coordinate system, and the vertical axis of the horizontal coordinate system is parallel to the x axis of the world coordinate system and the direction of the vertical axis is the same as the direction of the x axis of the world coordinate system, like the radar 4 shown in Figure 1, the world coordinates (x, y) of the radar may be expressed as follows:

number

[0056] Here, (x 4 ,y 4 ) are coordinates in the radar's world coordinate system, (t”,s”) represents an arbitrary point in the horizontal coordinate system, and t” and s” are the abscissa and ordinate values, respectively, in the object's horizontal coordinate system.

[0057] In the above example, the coordinates in the world coordinate system of the origin in the radar coordinate system, for example (x 1 ,y 1 ), (x 2 ,y 2 ), (x 3 ,y 3 ), (x 4 ,y 4 ) may be measured manually or obtained from radar installation data, but the present invention is not limited to the method of acquisition.

[0058] It should be noted that the above only describes each step or process related to the present invention, and the present invention is not limited thereto. The method may further include other steps or processes, and the specific contents of these steps or processes may refer to the prior art.

[0059] Roadside radars are usually installed on high crossbars at intersections. In order to generate electronic maps, it is necessary to convert radar coordinates into world coordinates. Usually, there is a radar deflection angle due to the actual installation. According to the coordinate conversion method based on the actual installation of roadside radars according to the embodiment of the present invention, the radar coordinates can be effectively converted into world coordinates by performing coordinate conversion based on the radar deflection angle and the radar height.

[0060] <Example 2> This embodiment provides a coordinate transformation device, the solution principle of which is the same as that of the method of embodiment 1, so the specific implementation of the device may refer to the implementation of the method of embodiment 1, and the description of the similar contents will be omitted.

[0061] 9 is a schematic diagram of a coordinate conversion device according to an embodiment of the present invention. As shown in FIG. 9, the coordinate conversion device 900 according to the embodiment of the present invention includes a determination unit 901, a first conversion unit 902, a second conversion unit 903 and a third conversion unit 904.

[0062] The determination unit 901 determines the deflection angle of the radar. The first conversion unit 902 converts the radar coordinates of an object detected by the radar into rotational coordinates based on the deflection angle determined by the determination unit 901. The second conversion unit 903 converts the rotational coordinates of the object into horizontal coordinates based on the height of the radar. The third conversion unit 904 converts the horizontal coordinates of the object into world coordinates based on the orientation of the radar with respect to the world coordinate system.

[0063] FIG. 10 is a schematic diagram of one of the determining units 901. As shown in FIG. 10, in some aspects, the determining unit 901 includes an acquiring unit 1001, a filtering unit 1002, an estimating unit 1003, and a calculating unit 1004. The acquiring unit 1001 acquires radar data including radar coordinates of an object detected by a radar. The filtering unit 1002 selects radar data in which the movement trajectory of the object is within a range of a straight lane from the radar data. The estimating unit 1003 estimates a trajectory line based on the selected radar data. The calculating unit 1004 calculates a deflection angle of the radar based on the trajectory line.

[0064] In some aspects, the estimation unit 1003 estimates the trajectory line by a least squares method.

[0065] In some aspects, the estimation unit 1003 estimates the trajectory line using the RANSAC method.

[0066] In some aspects, the trajectory function is expressed as v=a+bu, where (u,v) represents any point in the radar coordinate system, u and v are the abscissa and ordinate values ​​of the object in the radar coordinate system, respectively, and the radar deflection angle is α=arctan(−1 / b).

[0067] In some aspects, the first transform unit 902 transforms the radar coordinates of the object into rotated coordinates according to the following equation:

number

[0068] Here, (u,v) represents an arbitrary point in the radar coordinate system, where u and v are the abscissa and ordinate values, respectively, in the radar coordinate system of the object, and (u',v') represents an arbitrary point in the rotating coordinate system, where u' and v' are the abscissa and ordinate values, respectively, in the rotating coordinate system of the object.

[0069] In some aspects, the second transform unit 903 transforms the rotational coordinates of the object into horizontal coordinates according to the following equation:

number

[0070] Here, (u',v') represents an arbitrary point in the rotating coordinate system, u' and v' are the abscissa and ordinate values, respectively, in the rotating coordinate system of the object, h is the height of the radar, (u”,v”) represents an arbitrary point in the horizontal coordinate system, and u” and v” are the abscissa and ordinate values, respectively, in the horizontal coordinate system of the object.

[0071] In some aspects, when the horizontal axis of the horizontal coordinate system is parallel to the x-axis of the world coordinate system and the direction of the horizontal axis is the same as the direction of the x-axis of the world coordinate system, and the vertical axis of the horizontal coordinate system is parallel to the y-axis of the world coordinate system and the direction of the vertical axis is the same as the direction of the y-axis of the world coordinate system, the third conversion unit 904 converts the horizontal coordinate of the object into world coordinates according to the following equation:

number

[0072] Here, (x 1 ,y 1 ) is a coordinate in the radar's world coordinate system, (u”,v”) represents an arbitrary point in the horizontal coordinate system, and u” and v” are the abscissa and ordinate values, respectively, in the object's horizontal coordinate system.

[0073] In some aspects, when the horizontal axis of the horizontal coordinate system is parallel to the y axis of the world coordinate system and the direction of the horizontal axis is the same as the direction of the y axis of the world coordinate system, and the vertical axis of the horizontal coordinate system is parallel to the x axis of the world coordinate system and the direction of the vertical axis is opposite to the direction of the x axis of the world coordinate system, the third conversion unit 904 converts the horizontal coordinate of the object into world coordinates according to the following equation:

number

[0074] Here, (x 2 ,y 2 ) is a coordinate in the radar's world coordinate system, (j”,k”) represents an arbitrary point in the horizontal coordinate system, and j” and k” are the abscissa and ordinate values ​​in the object's horizontal coordinate system, respectively.

[0075] In some aspects, when the horizontal axis of the horizontal coordinate system is parallel to the x-axis of the world coordinate system and the direction of the horizontal axis is opposite to the direction of the x-axis of the world coordinate system, and the vertical axis of the horizontal coordinate system is parallel to the y-axis of the world coordinate system and the direction of the vertical axis is opposite to the direction of the y-axis of the world coordinate system, the third conversion unit 904 converts the horizontal coordinate of the object into world coordinates according to the following equation:

number

[0076] Here, (x 3 ,y 3 ) is a coordinate in the radar's world coordinate system, (m”,n”) represents an arbitrary point in the horizontal coordinate system, and m” and n” are the abscissa and ordinate values, respectively, in the horizontal coordinate system of the object.

[0077] In some aspects, when the horizontal axis of the horizontal coordinate system is parallel to the y axis of the world coordinate system and the direction of the horizontal axis is opposite to the direction of the y axis of the world coordinate system, and the vertical axis of the horizontal coordinate system is parallel to the x axis of the world coordinate system and the direction of the vertical axis is the same as the direction of the x axis of the world coordinate system, the third conversion unit 904 converts the horizontal coordinate of the object into world coordinates according to the following formula:

number

[0078] Here, (x 4 ,y 4 ) are coordinates in the radar's world coordinate system, (t”,s”) represents an arbitrary point in the horizontal coordinate system, and t” and s” are the abscissa and ordinate values, respectively, in the object's horizontal coordinate system.

[0079] According to an embodiment of the present invention, a coordinate transformation based on radar deflection angle and radar height is performed, thereby effectively transforming radar coordinates into world coordinates.

[0080] <Example 3> A third embodiment of the present invention provides a data processing device, which may be, for example, a computer, a server, a workstation, a laptop computer, a smartphone, etc., but the embodiments of the present invention are not limited thereto.

[0081] FIG. 11 is a schematic diagram of a data processing device according to an embodiment of the present invention. As shown in FIG. 11, a data processing device 1100 according to an embodiment of the present invention includes at least one interface (not shown in FIG. 11), a processor (e.g., a central processing unit (CPU)) 1101, and a memory 1102. The memory 1102 is connected to the processor 1101. The memory 1102 may store various data, and may further store a program 1103 for performing coordinate conversion. The program 1103 is executed under the control of the processor 1101. The memory 1102 may also store various predetermined values ​​and predetermined conditions.

[0082] In one aspect, the function of the coordinate conversion device 900 in the second embodiment may be integrated into the processor 1101. Here, the processor 1101 may be configured to realize the coordinate conversion method described in the first embodiment.

[0083] For example, the processor 1101 may be configured to determine a deflection angle of a radar, convert radar coordinates of an object detected by the radar to rotational coordinates based on the deflection angle, convert the rotational coordinates of the object to horizontal coordinates based on the height of the radar, and convert the horizontal coordinates of the object to world coordinates based on an orientation of the radar relative to a world coordinate system.

[0084] In another aspect, the coordinate conversion device 900 of Example 2 may be respectively arranged with the processor 1101, for example, the coordinate conversion device 900 may be a chip connected to the processor 1101, and may be configured to realize the functions of the coordinate conversion device 900 under the control of the processor 1101.

[0085] It should be noted that the data processing device 1100 may further include a display 1105 and an input / output (I / O) device 1104, etc., or may not include all of the components shown in Fig. 11. For example, the data processing device 1100 may further include a camera (not shown) that acquires input image frames. The data processing device 1100 may also include components not shown in Fig. 11, and may refer to the prior art.

[0086] In the embodiment of the present invention, the processor 1101 is also referred to as a controller or an operation control unit, and may include a microprocessor or other processor device and / or logic device. The processor 1101 receives input and controls the operation of each unit of the data processing device 1100.

[0087] In an embodiment of the present invention, the memory 1102 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable devices. The memory 1102 may store various information, and may further store a program for executing the related information. The processor 1101 may also execute the program stored in the memory 1102 to realize the storage or processing of information. The functions of the other members are similar to those of the prior art, and the description thereof is omitted here. The components of the data processing device 1100 may be realized by dedicated hardware, firmware, software, or a combination thereof without departing from the scope of the present invention.

[0088] According to the data processing device of the embodiment of the present invention, the radar coordinates can be effectively converted into world coordinates by performing coordinate conversion based on the radar deflection angle and the radar height.

[0089] An embodiment of the present invention provides a computer readable program which, when executed in a data processing apparatus, causes the data processing apparatus to perform the method according to embodiment 1.

[0090] An embodiment of the present invention further provides a storage medium having stored thereon a computer readable program for causing a data processing apparatus to perform the method according to the first embodiment.

[0091] The above-mentioned apparatus and method of the present invention may be realized by hardware or a combination of hardware and software. The present invention relates to a computer-readable program, which, when executed by a logic unit, causes the logic unit to realize the above-mentioned apparatus or components, or to realize the above-mentioned various methods or steps. The present invention relates to a storage medium for storing the above-mentioned program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, etc.

[0092] The methods / apparatuses described with reference to the embodiments of the present invention may be implemented in hardware, software modules executed by a processor, or a combination of both. For example, one or more of the functional block diagrams shown in the drawings, or one or more combinations of the functional block diagrams, may correspond to each software module in a computer program flow or each hardware module. These software modules may correspond to each step shown in the drawings. These hardware modules may be realized by implementing these software modules in hardware, for example, using a field programmable gate array (FPGA).

[0093] The software module may be located in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a mobile hard disk, a CD-ROM, or any other form of storage medium known to those skilled in the art. The storage medium may be connected to the processor so that the processor reads information from the storage medium and writes information to the storage medium, or the storage medium may be a component of the processor. The processor and the storage medium are located in an ASIC. The software module may be stored in the memory of the mobile terminal, or in a memory card inserted in the mobile terminal. For example, if the device (e.g., a mobile terminal) uses a MEGA-SIM card or a large capacity flash memory device with a relatively large capacity, the software module may be stored in the MEGA-SIM card or the large capacity flash memory device.

[0094] One or more of the functional blocks and / or one or more combinations of functional blocks depicted in the figures may be implemented in a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, or any suitable combination thereof to perform the functions described herein. One or more of the functional blocks and / or one or more combinations of functional blocks depicted in the figures may be implemented in, for example, a combination of computing devices, such as a combination of a DSP and a microprocessor, a combination of multiple microprocessors, one or more microprocessors in combination with a DSP communication, or any other configuration.

[0095] Although the present invention has been described above with reference to specific embodiments, the above description is merely illustrative and does not limit the scope of protection of the present invention. Various modifications and changes may be made to the present invention without departing from the spirit and principles of the present invention, and these modifications and changes also fall within the scope of the present invention.

[0096] Furthermore, the following supplementary notes are disclosed regarding the embodiments including the above-mentioned examples. (Appendix 1) A coordinate transformation method, comprising the steps of: determining a radar deflection angle; converting radar coordinates of an object detected by the radar into rotated coordinates based on the deflection angle; transforming the rotational coordinates of the object into horizontal coordinates based on the height of the radar; and transforming the horizontal coordinate of the object into world coordinates based on an orientation of the radar relative to a world coordinate system. (Appendix 2) The step of determining a radar deflection angle includes: acquiring radar data including radar coordinates of objects detected by the radar; selecting radar data in which an object's movement trajectory is within a range of a straight lane from the radar data; estimating a trajectory line based on the selected radar data; and calculating a deflection angle of the radar based on the trajectory line. (Appendix 3) The step of estimating a trajectory line based on the selected radar data includes: estimating the trajectory line by a least squares method; or 3. The method of claim 2, further comprising a step of estimating the trajectory line by a random sample consensus method. (Appendix 4) The function of the trajectory line is v=a+bu, where (u,v) represents an arbitrary point in the radar coordinate system, and u and v are the abscissa and ordinate values ​​of the object in the radar coordinate system, respectively; 3. The method of claim 2, wherein the radar deflection angle is α=arctan(-1 / b). (Appendix 5) The conversion equation for converting radar coordinates to rotating coordinates is the following:

number

[0097] The method described in Appendix 1, wherein (u,v) represents an arbitrary point in a radar coordinate system, u and v are the abscissa and ordinate values, respectively, of the object in the radar coordinate system, and (u',v') represents an arbitrary point in a rotating coordinate system, u' and v' are the abscissa and ordinate values, respectively, of the object in the rotating coordinate system. (Appendix 6) The conversion formula for converting the rotation coordinate to the horizontal coordinate is as follows:

number

[0098] The method described in Appendix 1, wherein (u',v') represents an arbitrary point in a rotating coordinate system, u' and v' are respectively the abscissa and ordinate values ​​in the rotating coordinate system of the object, h is the height of the radar, and (u",v") represents an arbitrary point in a horizontal coordinate system, u" and v" are respectively the abscissa and ordinate values ​​in the horizontal coordinate system of the object. (Appendix 7) When a horizontal axis of the horizontal coordinate system is parallel to an x-axis of the world coordinate system and a direction of the horizontal axis is the same as a direction of the x-axis of the world coordinate system, and a vertical axis of the horizontal coordinate system is parallel to a y-axis of the world coordinate system and a direction of the vertical axis is the same as a direction of the y-axis of the world coordinate system, the third conversion unit converts the horizontal coordinate of the object into world coordinates according to the following formula:

number

[0099] Here, (x 1 ,y 1 ) is the coordinate of the radar in the world coordinate system, (u”,v”) represents an arbitrary point in the horizontal coordinate system, and u” and v” are the abscissa and ordinate values ​​of the object in the horizontal coordinate system, respectively; When a horizontal axis of the horizontal coordinate system is parallel to a y axis of the world coordinate system and a direction of the horizontal axis is the same as a direction of the y axis of the world coordinate system, and a vertical axis of the horizontal coordinate system is parallel to an x ​​axis of the world coordinate system and a direction of the vertical axis is opposite to a direction of the x axis of the world coordinate system, the third conversion unit converts the horizontal coordinate of the object into world coordinates according to the following formula:

number

[0100] Here, (x 2 ,y 2) is the coordinate of the radar in the world coordinate system, (j”,k”) represents an arbitrary point in the horizontal coordinate system, and j” and k” are the abscissa and ordinate values ​​of the object in the horizontal coordinate system, respectively; When a horizontal axis of the horizontal coordinate system is parallel to an x-axis of the world coordinate system and a direction of the horizontal axis is opposite to a direction of the x-axis of the world coordinate system, and a vertical axis of the horizontal coordinate system is parallel to a y-axis of the world coordinate system and a direction of the vertical axis is opposite to a direction of the y-axis of the world coordinate system, the third conversion unit converts the horizontal coordinate of the object into world coordinates according to the following formula:

number

[0101] Here, (x 3 ,y 3 ) is the coordinate of the radar in the world coordinate system, (m”, n”) represents an arbitrary point in the horizontal coordinate system, and m” and n” are the abscissa and ordinate values ​​of the object in the horizontal coordinate system, respectively; When a horizontal axis of the horizontal coordinate system is parallel to a y axis of the world coordinate system and a direction of the horizontal axis is opposite to a direction of the y axis of the world coordinate system, and a vertical axis of the horizontal coordinate system is parallel to an x ​​axis of the world coordinate system and a direction of the vertical axis is the same as a direction of the x axis of the world coordinate system, the third conversion unit converts the horizontal coordinate of the object into world coordinates according to the following formula:

number

[0102] Here, (x 4 ,y 4 2. The method of claim 1, wherein (t”,s”) is a coordinate of the radar in the world coordinate system, (t”,s”) represents an arbitrary point in the horizontal coordinate system, and t” and s” are the abscissa and ordinate values, respectively, of the object in the horizontal coordinate system.

Claims

1. A coordinate conversion device, comprising: A determination unit that determines a deflection angle of the radar; a first conversion unit that converts radar coordinates of an object detected by the radar into rotated coordinates based on the deflection angle; a second conversion unit that converts the rotational coordinates of the object into horizontal coordinates based on the height of the radar; a third conversion unit that converts a horizontal coordinate of the object into a world coordinate based on an orientation of the radar with respect to a world coordinate system; the world coordinates are coordinates of the object in the world coordinate system for generating an electronic map; the radar coordinates are coordinate values ​​of the object in a radar coordinate system; The rotating coordinates are coordinate values ​​of the object in a rotating coordinate system, in which a vertical axis is parallel to a lane; the horizontal coordinate is a coordinate value of the object in a horizontal coordinate system, the horizontal coordinate system being a coordinate system obtained by projecting the rotating coordinate system onto the world coordinate system; The determination unit is an acquisition unit that acquires radar data including radar coordinates of an object detected by the radar; a filtering unit that selects radar data in which an object's movement trajectory is within a range of a straight lane from the radar data; an estimation unit that estimates a trajectory line based on the selected radar data; a calculation unit that calculates a deflection angle of the radar based on the trajectory line.

2. The estimation unit estimates the trajectory line by a least squares method, or The apparatus of claim 1 , wherein the estimation unit estimates the trajectory line by a random sample consensus method.

3. The trajectory function is v=a+bu, where (u,v) represents an arbitrary point in the radar coordinate system; 2. The apparatus of claim 1, wherein the radar deflection angle is α=arctan(−1 / b).

4. The first conversion unit converts the radar coordinates of the object into rotated coordinates according to the following formula: [0010] 2. The apparatus of claim 1, wherein (u,v) represents any point in the radar coordinate system and (u',v') represents any point in the rotating coordinate system.

5. The second conversion unit converts the rotation coordinates of the object into horizontal coordinates according to the following formula: [0025] 2. The apparatus of claim 1, wherein (u',v') represents any point in the rotating coordinate system, h is the height of the radar, and (u",v") represents any point in the horizontal coordinate system.

6. When a horizontal axis of the horizontal coordinate system is parallel to an x-axis of the world coordinate system and a direction of the horizontal axis is the same as a direction of the x-axis of the world coordinate system, and a vertical axis of the horizontal coordinate system is parallel to a y-axis of the world coordinate system and a direction of the vertical axis is the same as a direction of the y-axis of the world coordinate system, the third conversion unit converts the horizontal coordinate of the object into world coordinates according to the following formula: [0030] Here, (x 1 , y 1 ) are coordinates of the radar in the world coordinate system, and (u″, v″) represents an arbitrary point in the horizontal coordinate system, When a horizontal axis of the horizontal coordinate system is parallel to a y axis of the world coordinate system and a direction of the horizontal axis is the same as a direction of the y axis of the world coordinate system, and a vertical axis of the horizontal coordinate system is parallel to an x ​​axis of the world coordinate system and a direction of the vertical axis is opposite to a direction of the x axis of the world coordinate system, the third conversion unit converts the horizontal coordinate of the object into world coordinates according to the following formula: [0045] Here, (x 2, y 2 ) is the coordinate of the radar in the world coordinate system, (j″, k″) represents an arbitrary point in the horizontal coordinate system, When a horizontal axis of the horizontal coordinate system is parallel to an x-axis of the world coordinate system and a direction of the horizontal axis is opposite to a direction of the x-axis of the world coordinate system, and a vertical axis of the horizontal coordinate system is parallel to a y-axis of the world coordinate system and a direction of the vertical axis is opposite to a direction of the y-axis of the world coordinate system, the third conversion unit converts the horizontal coordinate of the object into world coordinates according to the following formula: [0050] Here, (x 3 , y 3 ) is the coordinate of the radar in the world coordinate system, and (m″, n″) represents an arbitrary point in the horizontal coordinate system, When a horizontal axis of the horizontal coordinate system is parallel to a y axis of the world coordinate system and a direction of the horizontal axis is opposite to a direction of the y axis of the world coordinate system, and a vertical axis of the horizontal coordinate system is parallel to an x ​​axis of the world coordinate system and a direction of the vertical axis is the same as a direction of the x axis of the world coordinate system, the third conversion unit converts the horizontal coordinate of the object into world coordinates according to the following formula: [006] Here, (x 4 , y 4 2. The apparatus of claim 1, wherein (t'', s'') are coordinates in the world coordinate system of the radar, and (t'', s'') represents an arbitrary point in the horizontal coordinate system.

7. A coordinate transformation method, comprising the steps of: determining a radar deflection angle; converting radar coordinates of an object detected by the radar into rotated coordinates based on the deflection angle; transforming the rotational coordinates of the object into horizontal coordinates based on the height of the radar; and converting the horizontal coordinate of the object into a world coordinate based on an orientation of the radar relative to a world coordinate system; the world coordinates are coordinates of the object in the world coordinate system for generating an electronic map; the radar coordinates are coordinate values ​​of the object in a radar coordinate system; The rotating coordinates are coordinate values ​​of the object in a rotating coordinate system, in which a vertical axis is parallel to a lane; the horizontal coordinate is a coordinate value of the object in a horizontal coordinate system, the horizontal coordinate system being a coordinate system obtained by projecting the rotating coordinate system onto the world coordinate system; The step of determining a deflection angle of the radar includes: acquiring radar data including radar coordinates of objects detected by the radar; selecting radar data in which an object's movement trajectory is within a range of a straight lane from the radar data; estimating a trajectory line based on the selected radar data; and calculating a deflection angle of the radar based on the trajectory line.

8. A data processing apparatus including a processor and a memory, The memory stores a computer program; When executing the computer program, the processor determining a radar deflection angle; converting radar coordinates of an object detected by the radar into rotated coordinates based on the deflection angle; transforming the rotational coordinates of the object into horizontal coordinates based on the height of the radar; and converting the horizontal coordinate of the object into a world coordinate based on an orientation of the radar relative to a world coordinate system; the world coordinates are coordinates of the object in the world coordinate system for generating an electronic map; the radar coordinates are coordinate values ​​of the object in a radar coordinate system; The rotating coordinates are coordinate values ​​of the object in a rotating coordinate system, in which a vertical axis is parallel to a lane; the horizontal coordinate is a coordinate value of the object in a horizontal coordinate system, the horizontal coordinate system being a coordinate system obtained by projecting the rotating coordinate system onto the world coordinate system; The step of determining a deflection angle of the radar includes: acquiring radar data including radar coordinates of objects detected by the radar; selecting radar data in which an object's movement trajectory is within a range of a straight lane from the radar data; estimating a trajectory line based on the selected radar data; and calculating a deflection angle of the radar based on the trajectory line.

Citation Information

Patent Citations

  • Field environment barrier detection method fusing distance and image information

    CN101975951A

  • Object detection apparatus and method

    CN105893931A

  • Running environment recognizing device

    JP1998187930A

  • Traffic flow measurement device and device using the measurement device

    JP1999086183A

  • Vehicle stream measurement device, method and program

    JP2015026127A