Hitch angle calculation system
The hitch angle detection system uses a towing vehicle's rearview camera to calculate hitch angles by identifying vehicle edges, addressing the limitations of specialized equipment and varying drawbar shapes, ensuring accurate detection.
Patent Information
- Application Number
- JP2023083260
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-19
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2043-05-19
AI Technical Summary
Existing hitch angle detection technologies are limited by the need for specialized equipment on the towing vehicle or trailer, and are not versatile enough to handle various drawbar shapes, such as straight and Y-shaped configurations.
A hitch angle detection system using a rearview camera on the towing vehicle to identify the left-right directions of the towing vehicle and trailer from their respective edges, calculating the hitch angle without requiring additional markers or specialized equipment, by employing image processing to determine the relative angle between the vehicles.
Enables accurate hitch angle detection regardless of drawbar shape, using standard rearview cameras, simplifying the setup and enhancing versatility.
Smart Images

Figure 2024166869000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a technique for detecting a hitch angle of a trailer. [Background technology]
[0002] One known technology for detecting the trailer hitch angle, which is the angle of rotation around the axis of the hitch ball of a trailer (towed vehicle) that is swingably connected to the hitch ball of a towing vehicle, is to recognize a straight line corresponding to the central axis of the trailer drawbar from an image of the connection point between the towing vehicle and the trailer taken with a camera, and detect the angle of the recognized straight line relative to the vehicle center axis in the left-right direction of the towing vehicle as the trailer hitch angle (for example, Patent Document 1).
[0003] Another known technology for detecting a trailer hitch angle is one that uses a laser range finder to measure the fore-and-aft distance from the towing vehicle to both the left and right ends of the trailer, and then calculates the trailer hitch angle from the distance between the left and right ends and the measured fore-and-aft distance of the towing vehicle (for example, Patent Document 2).
[0004] Another known technology for detecting a trailer hitch angle is one that detects the trailer hitch angle from the inclination of an image of a marker affixed to the top surface of the trailer drawbar captured by a camera (for example, Patent Document 3). Another known technology that utilizes the detected trailer hitch angle is one in which the relative positional relationship between the towing vehicle and the trailer is calculated from the detected hitch angle when the towing vehicle is reversing, and based on the calculated positional relationship, the predicted movement trajectory of the trailer if the towing vehicle were to be continued in reverse, and the calculated movement trajectory is displayed by superimposing it on an image of the rear of the trailer captured by a camera installed at the rear of the trailer (for example, Patent Document 4).
[0005] In addition, a technology that utilizes the detected trailer hitch angle is known in which a system combines images taken by three cameras mounted on the left and right sides and rear of the trailer to generate a panoramic view image that broadly shows the area around the towing vehicle, and displays a portion of the generated panoramic view image to the driver, switching the range of the panoramic view image that is displayed depending on the detected hitch angle (for example, Patent Document 5).
[0006] In addition, a technology that utilizes the detected trailer hitch angle is known in which, when the towing vehicle is reversing, a collision between the towing vehicle and the trailer is predicted from the detected hitch angle and the steering angle of the towing vehicle, and processing is performed to avoid the collision (for example, Patent Document 6). [Prior art documents] [Patent documents]
[0007] [Patent Document 1] JP 2020-1631 A [Patent Document 2] Patent Publication No. 2021-177145 [Patent Document 3] JP 2019-199150 A [Patent Document 4] JP 2016-137802 A [Patent Document 5] Special Publication No. 2022-547068 [Patent Document 6] JP 2016-81198 A Summary of the Invention [Problem to be solved by the invention]
[0008] Trailer drawbars come in a variety of shapes, including straight and Y-shaped, and depending on the shape of the drawbar, the technology described above for detecting the hitch angle from a straight line recognized from an image of the connection point may not be able to detect the hitch angle correctly. In addition, when applying technology to detect the hitch angle using a laser rangefinder, special equipment such as markers and laser rangefinders must be installed on the towing vehicle and trailer, and calibration must be performed individually, which makes the system less simple. In addition, the technology of detecting the hitch angle using a marker affixed to the top surface of the drawbar cannot be applied if the shape of the drawbar or the top surface of the drawbar is not suitable for affixing a marker. Therefore, an object of the present invention is to realize detection of a trailer hitch angle using a simpler and more versatile configuration. [Means for solving the problem]
[0009] In order to achieve the above-mentioned object, the present invention provides a hitch angle detection system for detecting the hitch angle of a trailer towed by a towing vehicle, which includes a camera mounted on the towing vehicle so as to include the front of the trailer in its shooting range regardless of the hitch angle of the trailer, a left-right direction calculation means for calculating the left-right direction of the trailer from images of the trailer members extending to the left and right of the trailer that appear in the image captured by the camera, and a hitch angle calculation means for calculating the relative angle of the calculated left-right direction of the trailer to the left-right direction of the towing vehicle as the trailer hitch angle.
[0010] Here, in this hitch angle detection system, the components of the trailer extending to the left and right of the trailer may be components that form the leading edge of the trailer, and the left-right direction calculation means may calculate the left-right direction of the trailer as the direction in which a straight line approximating the line of the leading edge of the trailer that appears in the image captured by the camera extends.
[0011] Furthermore, in the above hitch angle detection system, the camera may be provided on a towing vehicle so that the rear of the towing vehicle and the front of the trailer are included in the shooting range regardless of the hitch angle of the trailer, and the left / right direction calculation means may calculate the left / right direction of the towing vehicle from images of parts of the towing vehicle extending to the left and right of the towing vehicle that appear in the image captured by the camera, and the hitch angle calculation means may calculate, as the trailer hitch angle, the angle between the left / right direction of the trailer calculated by the left / right direction calculation means and the left / right direction of the towing vehicle calculated by the left / right direction calculation means.
[0012] In this case, the towing vehicle components extending to the left and right of the towing vehicle may be regarded as the rear bumper of the towing vehicle, and the left-right direction calculation means may calculate the direction in which a straight line approximating the line of the rear edge of the towing vehicle components appearing in the image captured by the camera extends as the left-right direction of the towing vehicle.
[0013] According to the hitch angle detection system described above, the trailer hitch angle can be detected correctly regardless of the shape of the trailer drawbar. Also, without providing special equipment to the towing vehicle or trailer, the trailer hitch angle can be detected by using a backup camera, which is widely used for checking the rear when reversing, as the camera for the hitch angle detection system.
[0014] In addition, in order to achieve the above-mentioned object, the present invention provides a hitch angle detection system for detecting the hitch angle of a trailer towed by a towing vehicle, which includes a camera mounted on the towing vehicle so as to include the front of the trailer in its shooting range regardless of the hitch angle of the trailer, a marker affixed to a position within the shooting range of the camera at the front of the trailer so as to indicate the left and right direction of the trailer, a left-right direction calculation means for calculating the left-right direction of the trailer represented by the image of the marker that appears in the image captured by the camera, and a hitch angle calculation means for calculating the relative angle of the calculated left-right direction of the trailer to the left-right direction of the towing vehicle as the trailer hitch angle.
[0015] By doing this, it becomes possible to detect the trailer hitch angle θ regardless of the shape or structure of the trailer by simply affixing a marker to the trailer itself, where it is easier to secure a good affixing space compared to the top surface of the drawbar, etc. Effect of the Invention
[0016] As described above, according to the present invention, detection of the trailer hitch angle can be achieved with a simpler and more versatile configuration. [Brief description of the drawings]
[0017] [Figure 1] 1 is a block diagram showing a configuration of a driving assistance system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a diagram showing a towing vehicle and a trailer according to an embodiment of the present invention. [Diagram 3] FIG. 4 is a diagram showing a hitch angle detected in an embodiment of the present invention. [Figure 4] FIG. 4 is a diagram illustrating an example of detection of a hitch angle according to an embodiment of the present invention. [Diagram 5] 11A and 11B are diagrams illustrating another example of detection of a hitch angle according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0018] Hereinafter, an embodiment of the present invention will be described. FIG. 1 shows the configuration of a driving assistance system according to this embodiment. The driving assistance system shown in FIG. 1 assists the driving of a towing vehicle 2 that tows a trailer 1 such as a camper trailer as shown in FIGS. 2a and 2b. Returning to FIG. 1, the driving assistance system comprises a trailer side system 11 mounted on the trailer 1 and a towing vehicle side system 21 mounted on the towing vehicle 2. The trailer side system 11 is equipped with three cameras: a trailer right camera 111, a trailer rear camera 112, and a trailer left camera 113, and a transmitter 114 that wirelessly transmits images taken by each of the above cameras to the towing vehicle side system 21. The towing vehicle side system 21 also includes an input device 211, a status sensor 212 that detects various states of the towing vehicle 2, such as the forward / reverse driving state of the towing vehicle 2 and the steering angle of the towing vehicle 2, a display device 213, a rear camera 214, a receiving device 215 that receives images wirelessly transmitted by the transmitting device 114 of the trailer side system 11, a hitch angle detection unit 216 that detects the hitch angle of the trailer 1 using the image taken by the rear camera 214, a support information generation unit 217 that generates various support information to support the driving of the towing vehicle 2 using the images of the trailer right camera 111, the trailer rear camera 112, and the trailer left camera 113 received by the receiving device 215, images taken by the rear camera 214, and the hitch angle detected by the hitch angle detection unit 216, and displays the support information on the display device 213, and a control unit 218 that controls each of the above units.
[0019] However, images from the trailer right camera 111, trailer rear camera 112, and trailer left camera 113 may be transmitted from the trailer side system 11 to the towing vehicle side system 21 by wired transmission. In this case, the transmitting device 114 and the receiving device 215 are not provided, and the images from the trailer right camera 111, trailer rear camera 112, and trailer left camera 113 are transmitted directly to the support information generating unit 217. Next, as shown in Figures 2a and 2b, the trailer right camera 111 of the trailer side system 11 takes images from the front end of the right side of the trailer 1 to the rear, the trailer rear camera 112 takes images from a central position in the left-right direction of the rear of the trailer 1, and the trailer left camera 113 takes images from the front end of the left side of the trailer 1 to the rear.
[0020] The rear camera 214 of the towing vehicle side system 21 captures wide-angle images from a central position in the left-right direction of the rear of the towing vehicle 2. The shooting range of the rear camera 214 is set so that the rear end portion of the towing vehicle 2, such as the rear bumper of the towing vehicle 2, and the front end portion of the trailer 1, such as the front bumper of the trailer 1 and the front end of the chassis and body, are included in the captured image.
[0021] A drawbar 12 that connects to the chassis extends forward from the lower front end of the trailer 1, and the trailer 1 is connected to the towing vehicle 2 by engaging a coupler provided at the front end of the drawbar 12 with a hitch ball provided at the rear end of a hitch member 22 that extends from the lower rear end of the towing vehicle 2 to the rear of the towing vehicle 2 so that the coupler and hitch ball can swing around the central axis of the coupler and hitch ball.
[0022] Therefore, as shown in Figures 3a and 3b, the trailer 1 can swing relative to the towing vehicle 2 around the central axis of the coupler and hitch ball, and the angle of this swing, shown as θ in the figures, is the hitch angle of the trailer 1. The detection of the hitch angle of the trailer 1 performed by the hitch angle detection unit 216 using the image captured by the rear camera 214 will be described below. The hitch angle detection unit 216 extracts a portion of the image captured by the rear camera 214 that includes an image of the rear end portion of the towing vehicle 2 and an image of the front end portion of the trailer 1, and by image recognition, identifies lines extending in the left-right direction of the towing vehicle 2, such as the line at the rear edge of the towing vehicle 2, that appear in the extracted image, and lines extending in the left-right direction of the trailer 1, such as the line at the front edge of the trailer 1. Then, a first straight line that is most similar to the identified line extending in the left-right direction of the towing vehicle 2 is calculated as a straight line parallel to the left-right direction of the towing vehicle 2, and a second straight line that is most similar to the identified line extending in the left-right direction of the trailer 1 is calculated as a straight line parallel to the left-right direction of the trailer 1. Then, the relative angle of the second straight line with respect to the first straight line is obtained as the hitch angle θ of the trailer 1. That is, the hitch angle is detected, for example, as follows. Now, when the directional relationship between the towing vehicle 2 with a rear bumper and the trailer 1 with a front bumper is as shown in Figure 4a1, the hitch angle detection unit 216 extracts the portion of the image captured by the rear camera 214 that includes an image 410 of the rear bumper of the towing vehicle 2 and an image 420 of the front bumper of the trailer 1, as shown in Figure 4a2.
[0023] Then, edge detection is performed on the extracted image of Figure 4a2, and from the detected edges, edge 411 corresponding to the rear edge of the rear bumper of the towing vehicle 2 and edge 421 corresponding to the front edge of the front bumper of the trailer 1 are extracted based on the position, orientation, etc. of the edges, as shown in Figure 4a3. Then, by using regression analysis or the like, as shown in FIG. 4a4, a straight line 412 that is closest to an edge 411 corresponding to the rear edge of the rear bumper is calculated as a straight line parallel to the left-right direction of the towing vehicle 2, and a straight line 422 that is closest to an edge 421 corresponding to the front edge of the front bumper of the trailer 1 is calculated as a straight line parallel to the left-right direction of the trailer 1.
[0024] As shown in the figure, when the angle of the straight line 412 is θ1 and the angle of the straight line 422 is θ2, the relative angle of the straight line 422 with respect to the straight line 412 expressed by θ2-θ1 is calculated as the hitch angle θ of the trailer 1. Similarly, when the directional relationship between the towing vehicle 2 with a rear bumper and the trailer 1 with a front bumper is as shown in Figure 4b1, the hitch angle detection unit 216 extracts the portion of the image captured by the rear camera 214 that includes an image 410 of the rear bumper of the towing vehicle 2 and an image 420 of the front bumper of the trailer 1, as shown in Figure 4b2.
[0025] Then, edge detection is performed on the extracted image of Figure 4b2, and from the detected edges, edge 411 corresponding to the rear edge of the rear bumper of the towing vehicle 2 and edge 421 corresponding to the front edge of the front bumper of the trailer 1 are extracted based on the position, orientation, etc. of the edges, as shown in Figure 4b3. Then, by using regression analysis or the like, as shown in FIG. 4b4, a straight line 412 that is closest to an edge 411 corresponding to the rear edge of the rear bumper is calculated as a straight line parallel to the left-right direction of the towing vehicle 2, and a straight line 422 that is closest to an edge 421 corresponding to the front edge of the front bumper of the trailer 1 is calculated as a straight line parallel to the left-right direction of the trailer 1.
[0026] As shown in the figure, when the angle of the straight line 412 is θ1 and the angle of the straight line 422 is θ2, the relative angle of the straight line 422 with respect to the straight line 412 expressed by θ2-θ1 is calculated as the hitch angle θ of the trailer 1. During the period in which the state (position, orientation, and angle of view) of rear camera 214 is fixed, the position of the image of the rear bumper appearing in the image captured by rear camera 214 does not change. Therefore, during this period, a straight line 412 that is most approximate to edge 411 corresponding to the rear edge of the rear bumper is calculated only the first time from the image captured by rear camera 214, and each time the hitch angle θ is calculated, the hitch angle θ may be calculated using the straight line 412 calculated the first time.
[0027] Alternatively, the left-right angle of the towing vehicle 2 in the image captured by the rear camera 214 may be obtained in advance and set as a fixed value, and each time the hitch angle θ is calculated, the set angle may be used in place of the angle θ1 of the straight line 412 to calculate the hitch angle θ. Returning to FIG. 1, the support information generating unit 217, under the control of the control unit 218, calculates the relative positional relationship between the towing vehicle 2 and the trailer 1 from the hitch angle θ detected by the hitch angle detecting unit 216 when the towing vehicle 2 is moving backward, and based on the calculated positional relationship, calculates the predicted movement trajectory of the trailer 1 if the towing vehicle 2 is moved backward as it is, and displays the calculated movement trajectory on the display device 213 by superimposing it on the images captured by the trailer right camera 111, the trailer rear camera 112, and the trailer left camera 113. The system performs processes such as predicting a collision between the towing vehicle 2 and the trailer 1 based on the hitch angle θ detected by the detection unit 216 and the steering angle of the towing vehicle 2 detected by the status sensor 212, and displaying guidance for avoiding the collision on the display device 213, and using the hitch angle θ detected by the hitch angle detection unit 216, synthesizing images taken by the rear camera 214, trailer right camera 111, trailer rear camera 112, and trailer left camera 113 into a single image that broadly observes the surroundings of the towing vehicle 2 from the viewpoint behind the towing vehicle 2, and displaying the image on the display device 213.
[0028] The embodiment of the present invention has been described above. According to this embodiment, the hitch angle of the trailer 1 can be correctly detected regardless of the shape of the drawbar 12 of the trailer 1. Also, without providing any special equipment to the towing vehicle 2 or the trailer 1, the hitch angle of the trailer 1 can be detected using the rear camera 214, which is widely used for checking the rear when reversing.
[0029] In the above embodiment, hitch angle detection unit 216 determines the left-right direction of trailer 1 from the line of the front edge of trailer 1 identified from the image captured by rear camera 214, and calculates the hitch angle. However, this may be achieved by attaching a marker to the position of trailer 1 captured by rear camera 214 to indicate the left-right direction of trailer 1, and hitch angle detection unit 216 identifying the marker from the image captured by rear camera 214 and determining the left-right direction of trailer 1 from the identified marker to calculate the hitch angle.
[0030] Similarly, in the above embodiment, the hitch angle detection unit 216 determines the left-right direction of the towing vehicle 2 from the line of the rear edge of the towing vehicle 2 identified from the image captured by the rear camera 214, and calculates the hitch angle. However, this may be achieved by attaching a marker to the position of the towing vehicle 2 captured by the rear camera 214 to indicate the left-right direction of the towing vehicle 2, and the hitch angle detection unit 216 may identify the marker from the image captured by the rear camera 214, and determine the left-right direction of the towing vehicle 2 from the identified marker to calculate the hitch angle.
[0031] For example, when the left-right direction of the towing vehicle 2 is determined in the same manner as in the above embodiment, and the left-right direction of the trailer 1 is determined using a marker affixed to the trailer 1 to calculate the hitch angle θ, a straight-line marker 43 is affixed to the front of the trailer 1 shown in Figure 5a so as to be parallel to the left-right direction of the trailer 1, as shown in Figure 5b1.
[0032] Then, as shown in FIG. 5b2, in the image captured by the rear camera 214, the edge 411 of the image of the rear bumper of the towing vehicle 2 and the area 431 of the image of the marker 43 are identified as shown in FIG. 5b3. Then, as shown in FIG. 5b4, a straight line 412 that is most approximate to the edge 411 of the image of the rear bumper and a straight line 432 that is parallel to the longitudinal direction of the area 431 of the image of the marker 43 are calculated. Then, the relative angle of the straight line 432 with respect to the straight line 412 is calculated as the hitch angle θ of the trailer 1. Alternatively, in this case, for example, a plurality of markers 43 are attached to the front surface of the trailer 1 shown in FIG. 5a so as to be aligned in the left-right direction of the trailer 1 as shown in FIG. 5c1. Then, from the image captured by the rear camera 214 as shown in FIG. 5c2, the edge 411 of the image of the rear bumper of the towing vehicle 2 and the area 431 of the image of the marker 43 are identified as shown in FIG. 5c3. Then, as shown in FIG. 5c4, a straight line 412 that is most approximate to the edge 411 of the image of the rear bumper and a straight line 432 that is parallel to the direction in which the areas 431 of the images of the multiple markers 43 are arranged are calculated. Then, the relative angle of the straight line 432 with respect to the straight line 412 is calculated as the hitch angle θ of the trailer 1. In addition, when determining the left-right direction of the towing vehicle 2 using a marker 43 affixed to the towing vehicle 2, the marker 43 is affixed to the rear bumper or the like of the towing vehicle 2, and the left-right direction of the towing vehicle 2 is determined in the same manner as in the case of the trailer 1 described above. By doing so, it becomes possible to detect the hitch angle θ of the trailer 1 simply by affixing the marker 43 to the towing vehicle 2 or the trailer 1 itself, where it is easier to secure a good affixing space compared to the top surface of the drawbar 12, regardless of the shape and structure of the rear end of the towing vehicle 2 or the shape and structure of the front end of the trailer 1. [Explanation of symbols]
[0033] 1...trailer, 2...towing vehicle, 11...trailer side system, 12...drawbar, 21...towing vehicle side system, 22...hitch member, 43...marker, 111...trailer right camera, 112...trailer rear camera, 113...trailer left camera, 114...transmitting device, 211...input device, 212...status sensor, 213...display device, 214...rear camera, 215...receiving device, 216...hitch angle detection unit, 217...support information generation unit, 218...control unit.
Claims
1. A hitch angle detection system for detecting a hitch angle of a trailer towed by a towing vehicle, comprising: A camera provided on a towing vehicle so as to include the front of the trailer in its photographing range regardless of the hitch angle of the trailer; a left-right direction calculation means for calculating a left-right direction of the trailer from an image of a member of the trailer extending to the left and right of the trailer that appears in the image captured by the camera; and a hitch angle calculation means for calculating a relative angle between the calculated left and right direction of the trailer and the left and right direction of the towing vehicle as a trailer hitch angle.
2. 2. The hitch angle detection system according to claim 1, The trailer member extending to the left and right of the trailer is a member forming a leading edge of the trailer, A hitch angle detection system characterized in that the left-right direction calculation means calculates the direction in which a straight line approximating the line of the front edge of the trailer shown in the image captured by the camera extends as the left-right direction of the trailer.
3. 3. The hitch angle detection system according to claim 1, the camera is provided on a towing vehicle so as to include a rear part of the towing vehicle and a front part of the trailer in an imaging range regardless of a hitch angle of the trailer, the left-right direction calculation means calculates a left-right direction of the towing vehicle from images of members of the towing vehicle extending to the left and right of the towing vehicle that appear in the image captured by the camera; The hitch angle calculation means calculates the relative angle of the left and right direction of the trailer calculated by the left and right direction calculation means to the left and right direction of the towing vehicle calculated by the left and right direction calculation means as the trailer hitch angle.
4. 4. The hitch angle detection system according to claim 3, the member of the towing vehicle extending to the left and right of the towing vehicle is a rear bumper of the towing vehicle, The hitch angle detection system is characterized in that the left-right direction calculation means calculates the direction in which a straight line approximating the line of the rear edge of the towing vehicle member appearing in the image captured by the camera extends as the left-right direction of the towing vehicle.
5. A hitch angle detection system for detecting a hitch angle of a trailer towed by a towing vehicle, comprising: A camera provided on a towing vehicle so as to include the front of the trailer in its photographing range regardless of the hitch angle of the trailer; A marker attached to a position within the photographing range of the camera at the front of the trailer so as to indicate the left and right directions of the trailer; a left-right direction calculation means for calculating a left-right direction of the trailer represented by an image of the marker that appears in an image captured by the camera; and a hitch angle calculation means for calculating a relative angle between the calculated left and right direction of the trailer and the left and right direction of the towing vehicle as a trailer hitch angle.
Citation Information
Patent Citations
Vehicle relative angle detection method and device, electronic equipment and storage medium
CN114545359A
Coupling angle detector
JP2003148938A
Detector of inclination angle of container vehicle
JP2008261632A
System and method for operating a vehicle-trailer unit while moving in reverse
JP2014502582A
Driving assist system
JP2016081198A
