Radar device

The radar device corrects radiation direction deviations by analyzing image data and adjusting the antenna beam, addressing inaccuracies in radar systems when reflecting off complex objects, ensuring precise object detection and alignment.

JP2024164643AInactive Publication Date: 2024-11-27TOYOTA JIDOSHA KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023080272
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-15
Publication Date
2024-11-27
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 2024164643000001_ABST
    Figure 2024164643000001_ABST
Patent Text Reader

Abstract

To provide a radar device capable of accurately calculating an axis deviation amount of a reference straight line of a radar wave and correcting the radiation direction of the radar wave.SOLUTION: A radar device 7 includes a control unit which calculates a straight trajectory H in a state where a vehicle 1 travels straight during travel on a road, analyzes imaging data obtained by imaging an object P which is stationary on the road, extracts a reference point J at which the reflected wave with respect to the transmitted wave of the radar wave radiated from an antenna part 8 is obtained at a prescribed level in the object, calculates a movement trajectory Q on which the reference point moves on the basis of radar data obtained by detecting the reference point by the antenna part, and corrects the radiation direction of radiating the radar wave of the antenna part on the basis of a comparison result between the straight trajectory and the movement trajectory.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a radar device capable of correcting deviations in the radiation direction of radar waves. [Background technology]

[0002] Patent Document 1 describes a method for estimating an error in a reference line of radar waves of a radar device installed in a vehicle. According to this method, while the vehicle is moving straight, the reflected waves of radar waves reflected at the reflection points of a stationary object are measured, the reference line of the radar device is calculated based on the measured values, and the deviation amount of the reference line of the radar waves can be calculated based on the difference between the direction of the reference line and the straight trajectory of the vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2007 / 015288 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the method described in Patent Document 1, when radar waves reach an object with a complex shape, such as a tree, multiple reflected waves are reflected, making it impossible to accurately calculate the reference line of the radar device, and in some cases making it difficult to calculate the amount of deviation of the reference line of the radar waves.

[0005] An object of the present invention is to provide a radar device that can accurately calculate the amount of deviation of a reference line of a radar wave and correct the radiation direction of the radar wave. [Means for solving the problem]

[0006] One aspect of the present invention includes a control unit that calculates a straight-line trajectory of a vehicle traveling on a road when the vehicle is traveling straight, analyzes image data obtained by imaging an object that is stationary on the road, extracts a reference point at which a reflected wave of a radar wave radiated from an antenna unit is obtained at a predetermined level on the object, calculates a movement trajectory along which the reference point moves based on radar data obtained by detecting the reference point by the antenna unit, and corrects a radiation direction in which the antenna unit radiates the radar wave based on a comparison result between the straight-line trajectory and the movement trajectory. It is a radar device. Effect of the Invention

[0007] According to the present invention, it is possible to accurately calculate the amount of deviation of the reference line of the radar wave and correct the radiation direction of the radar wave. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of a radar device according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a plan view showing a state in which the vehicle is traveling straight. [Diagram 3] FIG. 11 is a plan view showing a state in which an error occurs in the radar axis. [Figure 4] FIG. 2 is a diagram showing the state of radar waves reflected by an object. [Diagram 5] FIG. 11 is a diagram showing a method of correcting a reference straight line of a radar wave. [Figure 6] 5 is a flowchart showing a process flow for executing a method for correcting a reference straight line of a radar wave. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] 1, the vehicle 1 includes a detection unit 2 for detecting information related to the traveling of the vehicle 1, and a radar device 7 for detecting surrounding objects. The detection unit 2 is composed of a plurality of sensor devices for acquiring various types of information.

[0010] The detection unit 2 includes a position sensor 3 that detects the position of the vehicle 1. The position sensor 3 is, for example, a GPS (Global Positioning System) sensor. The position sensor 3 measures three-dimensional position information of the vehicle itself on the earth, such as longitude, latitude, and altitude, based on information contained in signals transmitted from a plurality of artificial satellites. The position sensor 3 may be another sensor device as long as it is capable of measuring the position of the vehicle 1.

[0011] The detection unit 2 includes an attitude sensor 4 that detects the attitude of the vehicle 1. The attitude sensor 4 is, for example, a yaw rate sensor that detects at least the rotation of the vehicle 1 about the vertical axis. The attitude sensor 4 measures the change in angular velocity in the turning direction of the vehicle 1. The attitude sensor 4 may be another sensor device as long as it can measure the attitude of the vehicle 1.

[0012] The detection unit 2 includes a speed sensor 5 that detects the speed of the vehicle 1. The speed sensor 5 is configured with, for example, an encoder that detects the rotation of the wheels, and a solenoid or laser that converts the rotation of the wheels into an electric pulse signal. The speed sensor 5 may be any other sensor device as long as it can measure the speed of the vehicle 1.

[0013] The detection unit 2 includes at least one camera 6 that captures an image of the environment around the vehicle 1. The camera 6 acquires image data captured over time based on a predetermined frame rate. The camera 6 stores the image data in a storage unit 12 described below. The image data captured by the camera 6 is used to control the radar device 7.

[0014] The radar device 7 is a millimeter wave radar that detects objects existing around the vehicle 1. The radar device 7 includes an antenna unit 8 that transmits and receives radar waves, a circuit unit 9 that forms the radar waves, a control unit 11 that controls the circuit unit 9, and a storage unit 12 that stores data and programs used for control.

[0015] The antenna unit 8 is configured, for example, by a phased array antenna having a plurality of antenna elements. The antenna unit 8 includes a transmitting unit 8A that outputs a transmission wave based on a radar wave, and a receiving unit 8B that receives a received wave (reflected wave). The antenna unit 8 is configured to be capable of adjusting the direction of the beam of the transmission wave within an arbitrary scanning range.

[0016] The antenna unit 8 is set with the radiation direction when the scanning angle of the beam of the transmission wave is 0 degrees as the reference straight line of the radar wave. The antenna unit 8 is installed on the vehicle 1 so that the reference straight line of the radar wave is parallel to the central axis along the longitudinal direction of the vehicle 1. The reference straight line is set, for example, in the normal direction of the radiation surface of the antenna unit 8. The antenna unit 8 is attached, for example, inside an emblem provided in the center of the front edge of the vehicle 1. The emblem is formed, for example, from a resin material that transmits radar waves. The emblem functions as a radome that covers the antenna unit 8.

[0017] The transmitter 8A includes a plurality of transmitting antenna elements arranged in a matrix. The transmitting antenna elements are radio wave radiating elements that radiate a signal radio wave generated by the circuit unit 9. The transmitting antenna elements are formed of a radiating slot, a patch antenna, or the like. The signal radio wave is, for example, a radar wave in the millimeter wave band. Each transmitting antenna element radiates a signal radio wave (transmitting wave) whose radiation intensity, phase, and frequency have been individually adjusted.

[0018] A beam of transmission waves is generated from the transmitter 8A by emitting signal radio waves from each transmitting antenna element. The phase of the signal radio waves radiated from each transmitting antenna element is individually adjusted for the transmission waves radiated from the transmitter 8A, so that the direction of the beam of the transmission waves is adjusted in three dimensions. The transmission waves radiated from the transmitter 8A reach an object and are reflected. The reflected waves reflected by the object are received by the receiver 8B.

[0019] The receiving unit 8B has a plurality of receiving antenna elements arranged in a matrix. The receiving antenna elements are radio wave receiving elements that receive reflected waves of transmitted waves. The receiving antenna elements are formed of a radiation slot, a patch antenna, or the like. Each receiving antenna element individually receives the reflected wave and outputs it to the circuit unit 9.

[0020] The circuit unit 9 is connected to the transmitting unit 8A and the receiving unit 8B, and is configured with a circuit capable of transmitting and receiving radio waves. The circuit unit 9 is configured with a circuit used in a general radar device. The circuit unit 9 generates a transmission signal and transmits the transmission wave from the transmitting unit 8A. The circuit unit 9 is configured as a circuit capable of calculating the relative distance, relative speed, and relative angle with respect to an object based on the received reception signal and the transmission signal. The circuit configuration capable of calculating the relative distance, relative speed, and relative angle can utilize known technology.

[0021] The control unit 11 is composed of at least one hardware processor such as a CPU (Central Processing Unit). The storage unit 12 is composed of a non-transitory storage medium such as a hard disk drive (HDD) or a solid state disk (SSD). The storage unit 12 stores computer programs and data required for control. The control unit 11 and the storage unit 12 may be provided integrally with the radar device 7 or may be provided separately.

[0022] 2, in the radar device 7 in a state where there is no deviation in the reference line K of the radar waves, the direction of the reference line K of the radar waves coincides with the direction of the center line T of the vehicle 1. In this state, when the vehicle 1 moves straight along a lane L on the road, the direction of the reference line K coincides with the direction of the straight trajectory H of the vehicle 1. An object P is detected, for example, in a scanning range S of the radar waves of the radar device 7. When the vehicle 1 moves straight, a movement trajectory Q of the object P in the scanning range S is detected as being parallel to the reference line K and the straight trajectory H.

[0023] 3, in a state where there is a deviation in the reference line K of the radar wave, the direction of the reference line K of the radar wave does not match the direction of the center line T of the vehicle 1 in the radar device 7. In this state, when the vehicle 1 moves straight along the lane L on the road, the direction of the reference line K does not match the direction of the straight trajectory H of the vehicle 1. When the vehicle 1 moves straight, the movement trajectory Q of the object P detected by the radar device 7 in the scanning range S is not detected as being parallel to the reference line K. The object P is detected as moving in an oblique direction relative to the vehicle 1.

[0024] When an axis deviation occurs in the radar device 7, an error occurs in the object detection result. The control unit 11 executes correction control to correct the deviation of the reference line of the radar wave of the transmission wave radiated from the antenna unit 8 at a predetermined timing while the vehicle 1 is traveling.

[0025] Fig. 4 shows a reference point J of an object P used in correction control. Fig. 4(A) shows a state in which radar waves E1 from a radar device 7 reach a cylindrical object P1 having a circular cross-sectional shape. The object P1 is, for example, a columnar object such as a post for supporting a guardrail, which is provided along the boundary of a lane L. The post is, for example, made of a metal material and reflects radar waves. The object P1 may also be a columnar object present on a road, such as a utility pole, a sign, a street light, or a traffic light.

[0026] On the surface of the object P1, there is a portion where a reflected wave E2 that travels in the opposite direction to the radar wave is generated. This portion is a minimal surface that faces the radar wave E1 when viewed along the radar wave's direction of travel. In the case of the object P1, this portion is the apex of the circular cross section of the object P1 that faces the radar wave E1 when viewed along the radar wave's direction of travel.

[0027] This point is extracted as a reference point J to be used in correction control. The radar wave E1 that deviates from the reference point J and reaches the surface of the object P1 is reflected by the surface of the object P1. The reflected wave E2 travels in a direction different from the traveling direction of the radar wave.

[0028] FIG. 4(B) shows a state in which radar waves E1 from the radar device 7 reach an object P2 having a cross-sectional shape with a corner formed therein. The object P2 is, for example, a structural member of a vehicle body provided inside the bumper of a parked vehicle. The bumper is made of a resin material and transmits radar waves. The structural member is made of, for example, a metal material and reflects radar waves. The object P2 may be a structure such as a building having a corner.

[0029] At the corner of the object P2, a reflected wave E2 is generated that travels in a direction opposite to the radar wave. When viewed along the radar wave E1's direction of travel, the corner is a minimal surface that faces the radar wave E1's direction of travel. In the case of the object P2, the corner is extracted as a reference point J used in correction control. The radar wave E1 that deviates from the reference point J and reaches the surface of the object P1 is reflected by the surface of the object P2. The reflected wave E2 travels in a direction different from the radar wave's direction of travel.

[0030] 4(C) shows a state in which the radar wave E1 of the radar device 7 reaches an object P3 having a complex shape such as a plant. The object P3 has a number of protrusions such as branches and leaves, and generates a number of reflected waves E2 traveling in a direction opposite to the traveling direction of the radar wave. In the case of the object P3, it is difficult to set the reference point J used in the correction control, so it is desirable to exclude the object P3 from the target of the correction control.

[0031] In the correction control, the control unit 11 determines whether the vehicle 1 traveling on the road is moving straight or not. The control unit 11 determines the rotation in the yaw direction of the vehicle 1 and the traveling state of the vehicle 1 based on the detection values ​​of the attitude sensor 4 and the speed sensor 5, and determines that the vehicle 1 is moving straight when the rotation in the yaw direction of the vehicle 1 is zero and the vehicle 1 is moving. The control unit 11 may calculate the trajectory of the vehicle 1 based on the detection value of the position sensor 3 and the image data of the camera 6, and determine whether the vehicle 1 is moving straight or not based on whether the trajectory is a straight trajectory. The control unit 11 may use any data as long as it can determine that the vehicle 1 is moving straight.

[0032] As shown in FIG. 5, in the correction control, a first plane coordinate based on an xy plane coordinate for the vehicle 1 and a second plane coordinate based on an x′y′ plane coordinate based on the direction of a reference straight line of the radar wave are set. The origins of the first plane coordinate and the second plane coordinate are common and are set on the radiation plane of the radar wave of the antenna unit 8. The y-axis of the first plane coordinate coincides with the center line T of the vehicle 1. When the straight-line traveling state of the vehicle 1 is determined, the y-axis also coincides with the straight-line trajectory H of the vehicle 1. The y′-axis of the second plane coordinate coincides with the reference straight line K of the radar wave. In the example of FIG. 5, the reference straight line of the radar wave is shifted by a predetermined angle θ clockwise from the position of the reference straight line where no shift occurs.

[0033] When the control unit 11 determines that the vehicle 1 is moving straight, it calculates a straight trajectory H of the vehicle 1. The straight trajectory H is calculated at a predetermined sampling interval Δt. The control unit 11 analyzes imaging data of an object P that is stationary on the road and is detected by the radar device 7. Here, the control unit 11 performs supervised learning based on deep learning in advance to extract a reference point J of the object P.

[0034] The control unit 11 repeatedly executes a process of comparing imaging data of an object P stationary on the road based on the camera 6 in machine learning with radar data of the object P detected based on the radar device 7. The control unit 11 repeatedly executes a process of comparing a position on the object P where a reflected wave in response to a transmitted radar wave radiated from the radar device 7 is obtained at a predetermined level with a predetermined position in the area of ​​the object P in the imaging data, and extracts a reference point J in the imaging data.

[0035] The control unit 11 performs machine learning in advance so as to be able to extract reference points J such as the apex of a cylinder or the corners of an object based on the imaging data. The control unit 11 performs machine learning in advance so as to exclude objects such as plants from which reference points J cannot be extracted based on the imaging data.

[0036] The control unit 11 analyzes the imaging data obtained by the camera 6 in the correction control, and extracts the reference point J from the imaging data. The control unit 11 calculates a movement trajectory Q indicating the trajectory along which the reference point J moves at a predetermined sampling interval Δt, based on radar data obtained by detecting the reference point J by a radar device. For example, the control unit 11 calculates, in the second plane coordinate system, a first coordinate (x′1, y′1) of the first reference point J1 at the first time and a second coordinate (x′2, y′2) of the second reference point J2 at the second time advanced by Δt, and calculates the movement trajectory Q of the reference point J (see FIG. 5(A)). The movement trajectory Q has a length vΔt, where v is the speed of the vehicle 1.

[0037] The control unit 11 determines whether or not there is a deviation in the reference straight line K of the radar wave based on the comparison result between the straight trajectory H and the movement trajectory Q of the vehicle 1. When there is no deviation in the reference straight line K, the movement trajectory Q is parallel to the y'-axis which is parallel to the straight trajectory H. In this case, the second plane coordinates and the first plane coordinates coincide. When there is a deviation in the reference straight line K, the movement trajectory Q is not parallel to the y'-axis but forms a predetermined angle θ with respect to the y'-axis. In this case, the second plane coordinates and the first plane coordinates do not coincide, and the second plane coordinates are rotated at a rotation angle of the predetermined angle θ with respect to the first plane coordinates.

[0038] The control unit 11, for example, compares the value of x'1 in the first coordinate with the value of x'2 in the second coordinate, and if there is a difference between the value of x'1 and the value of x'2 in the second coordinate, determines that there is a deviation in the reference line K. If the control unit 11 determines that there is a deviation in the reference line K, it calculates a predetermined angle θ, which is the deviation of the radar wave. For example, the control unit 11 repeatedly samples the movement trajectory Q, and calculates the predetermined angle θ based on the average value of a large number of sampling data.

[0039] The control unit 11 corrects the radiation angle at which the radar device 7 radiates the radar wave. The control unit 11 calculates a rotation matrix that rotates the movement trajectory Q in the second plane coordinates so as to match the movement trajectory Q in the first plane coordinates (see FIG. 5B). The rotation matrix performs a rotation transformation that restores the deviation amount of a predetermined angle θ of the reference straight line K of the radar wave to the original coordinates. For example, in the first plane coordinates, the control unit 11 calculates a first transformation coordinate (x1, y1) of the first reference point J1 at the first time and a second transformation coordinate (x2, y2) of the second reference point J2 at the second time advanced by Δt, and calculates the movement trajectory Q of the reference point J (see FIG. 5B).

[0040] The corrected movement trajectory Q becomes parallel to the y-axis that is parallel to the straight movement trajectory H. The control unit 11 corrects the movement trajectory Q based on the calculated rotation matrix, and detects objects that exist around the vehicle 1.

[0041] The control unit 11 may physically adjust the radiation angle of the transmission wave radiated from the antenna unit 8 based on the calculated predetermined angle θ. The control unit 11 may control the circuit unit 9 to impart a phase difference to the transmission wave radiated from the multiple transmitting antenna elements provided in the transmitting unit 8A so as to compensate for the predetermined angle θ, thereby adjusting the radiation direction. In this way, the antenna unit 8 can physically match the direction of the reference straight line K of the radar wave with the direction of the center line T of the vehicle 1. The above-mentioned correction control is applicable not only to the scanning of the radar wave in the horizontal plane direction, but also to the scanning of the transmission wave in the vertical direction.

[0042] 6 shows a flow of the correction control process executed in the radar device 7. The correction control process is executed by a control unit 11 mounted on the radar device 7. A computer program stored in the storage unit 12 causes the control unit 11 to execute each process.

[0043] At a predetermined timing, the control unit 11 determines whether the vehicle 1 traveling on the road is moving straight or not (step S100). When the control unit 11 determines that the vehicle 1 is moving straight, it calculates the straight trajectory of the vehicle 1 (step S102). The control unit 11 analyzes image data of an object that is stationary on the road, and extracts a reference point J where a reflected wave of a radar wave radiated from the antenna unit at the object is obtained at a predetermined level (step S104).

[0044] The control unit 11 calculates a movement trajectory Q indicating the trajectory along which the reference point J moves, based on the radar data obtained by detecting the reference point J by the antenna unit 8 (step S106). The control unit 11 corrects the radiation direction in which the antenna unit 8 radiates the radar wave, based on the result of comparing the straight trajectory H with the movement trajectory Q (step S108).

[0045] As described above, the radar device 7 can extract the reference point J on the object by analyzing image data of the object that is stationary relative to the road in the correction control. The radar device 7 can accurately calculate the amount of axis deviation of the radiated radar wave by extracting the reference point J. The radar device 7 can accurately correct the amount of axis deviation of the reference straight line of the radar wave.

[0046] In the above-described embodiment, the computer program executed in each component of the radar device 7 may be provided in a form recorded on a computer-readable portable recording medium, such as a semiconductor memory, a magnetic recording medium, or an optical recording medium. [Explanation of symbols]

[0047] 1 vehicle, 2 detection unit, 3 position sensor, 4 attitude sensor, 5 speed sensor, 6 camera, 7 radar device, 8 antenna unit, 9 circuit unit, 11 control unit, 12 memory unit, E1 radar wave, E2 reflected wave, H straight trajectory, J reference point, K reference line, L lane, P object, Q movement trajectory, S scanning range, T center line

Claims

[Claim 1] Calculate the straight-line trajectory of a vehicle traveling on a road when it is moving straight, analyzing image data of an object that is stationary relative to the road surface, and extracting a reference point at which a reflected wave of a radar wave radiated from an antenna unit on the object is obtained at a predetermined level; Calculating a movement trajectory of the reference point based on radar data obtained by detecting the reference point by the antenna unit; a control unit that corrects a radiation direction in which the antenna unit radiates the radar wave based on a comparison result between the straight trajectory and the movement trajectory, Radar equipment.

Citation Information

Patent Citations

  • Misalignment estimation method, and misalignment estimation device

    WO2007015288A1