Traction angle detection system
By calculating the relative angle between the trailer and the tractor through the camera, combined with the widely popular rear-view camera and marker, the problem of traction rod detection is solved, and the traction angle is realized is accurate and simple to detect. It is suitable for traction angle when the tractor is retreated. monitor.
Patent Information
- Application Number
- CN202410614605.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-19
- Filing Date
- 2024-05-17
- Publication Date
- 2024-11-22
AI Technical Summary
When detecting the traction angle of a trailer in the prior art, there are problems such as complex traction rods that are difficult to accurately detect, require special equipment calibration, and have poor simplicity.
The camera detection system is adopted to calculate the traction angle by calculating the relative angle of the left and right direction of the trailer relative to the tractor, and to use the widely popular rear-view camera and paste marker to achieve general detection of traction rods of various shapes.
The accuracy and simplicity of traction angle detection of various shapes of traction rods is achieved, and the installation of special equipment is avoided, and it is widely used in traction angle detection when tractors are retreated.
Smart Images

Figure CN118991309A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a technology for detecting a towing angle of a trailer. Background Art
[0002] As a technology for detecting the rotation angle of a trailer (towed vehicle) that is swingably connected to a towing ball of a tractor, that is, the towing angle of the trailer, there is known a technology that identifies a straight line corresponding to the central axis of the towing bar of the trailer based on an image of the connection portion between the tractor and the trailer captured by a camera, and detects the angle of the identified straight line relative to the central axis of the tractor in the left-right direction as the towing angle of the trailer (for example, Patent Document 1).
[0003] In addition, as a technology for detecting the towing angle of a trailer, the following technology is also known: using a laser rangefinder to measure the distance in the front-to-rear direction of the tractor from the tractor to the left and right ends of the trailer, and calculating the towing angle of the trailer based on the distance between the left and right ends and the measured distance in the front-to-rear direction of the tractor (for example, Patent Document 2).
[0004] Also known as a technology for detecting the towing angle of a trailer is a technology for detecting the towing angle of a trailer based on the inclination of an image of a marker attached to the upper surface of the towing bar of the trailer captured by a camera (for example, Patent Document 3).
[0005] In addition, as a technology that utilizes the detected towing angle of the trailer, the following technology is known: when the tractor is moving backward, the relative positional relationship between the tractor and the trailer is calculated based on the detected towing angle, and based on the calculated positional relationship, the movement trajectory of the trailer expected when the tractor is directly moving backward is calculated, and the calculated movement trajectory is displayed superimposed on the image of the rear of the trailer taken by a camera installed at the rear of the trailer (for example, Patent Document 4).
[0006] In addition, as a technology for utilizing the detected towing angle of the trailer, the following technology is known: in a system in which images captured by three cameras installed on the left and right sides and rear of the trailer are synthesized to generate a panoramic view image that widely represents the surrounding situation of the tractor, and a part of the generated panoramic view image is displayed to the driver, the range of the displayed panoramic view image is switched according to the detected towing angle (for example, Patent Document 5).
[0007] In addition, as a technology that utilizes the detected towing angle of the trailer, there is known a technology that predicts a collision between the tractor and the trailer based on the detected towing angle and the steering angle of the tractor when the tractor is moving backward, and performs processing to avoid the collision (for example, Patent Document 6).
[0008] [Prior art literature]
[0009] [Patent Document]
[0010] [Patent Document 1] Japanese Patent Application Publication No. 2020-1631
[0011] [Patent Document 2] Japanese Patent Application Publication No. 2021-177145
[0012] [Patent Document 3] Japanese Patent Application Publication No. 2019-199150
[0013] [Patent Document 4] Japanese Patent Application Publication No. 2016-137802
[0014] [Patent Document 5] Japanese Patent Publication No. 2022-547068
[0015] [Patent Document 6] Japanese Patent Application Publication No. 2016-81198 Summary of the invention
[0016] The drawbar of a trailer has various shapes such as a straight line and a Y-shape. Depending on the shape of the drawbar, the technology for detecting the draw angle based on the straight line recognized by the image of the connection portion described above may not be able to accurately detect the draw angle.
[0017] Furthermore, when a technique for detecting the towing angle using a laser rangefinder is applied, the tractor and trailer are equipped with special equipment such as a marker and a laser rangefinder, and calibration is required for each, which lacks simplicity.
[0018] Furthermore, the technique of detecting the traction angle using a marker attached to the upper surface of the traction bar cannot be applied when the traction bar or the shape of the upper surface of the traction bar is not suitable for attaching the marker.
[0019] Therefore, the technical problem of the present invention is to realize the detection of the towing angle of the trailer by means of a simpler and more universal structure.
[0020] In order to achieve the above technical problem, the present invention comprises, in a towing angle detection system for detecting the towing angle of a trailer towed by a tractor: a camera, which is installed on the tractor in such a manner that the front part of the trailer is included in a shooting range regardless of the towing angle of the trailer; a left-right direction calculation unit, which calculates the left-right direction of the trailer based on an image of a component of the trailer extending to the left and right of the trailer that appears in an image captured by the camera; and a towing angle calculation unit, which calculates a relative angle of the calculated left-right direction of the trailer with respect to the left-right direction of the tractor as the towing angle of the trailer.
[0021] Here, in the towing angle detection system, the component of the trailer extending left and right of the trailer may be set as a component forming a leading edge of the trailer, and the left-right direction calculation unit may calculate the direction of extension of a straight line approximating a line of the leading edge of the trailer appearing in the image captured by the camera as the left-right direction of the trailer.
[0022] In addition, in the above-mentioned towing angle detection system, the camera may be installed on the tractor in such a manner that the rear portion of the tractor and the front portion of the trailer are included in a photographing range regardless of the towing angle of the trailer, the left-right direction of the tractor is calculated based on an image of a component of the tractor extending to the left and right of the tractor that appears in an image photographed by the camera, and the towing angle calculation unit may calculate a relative angle between the left-right direction of the trailer calculated by the left-right direction calculation unit and the left-right direction of the tractor calculated by the left-right direction calculation unit as the towing angle of the trailer.
[0023] In this case, a member of the tractor extending to the left and right of the tractor may be used as a rear bumper of the tractor, and the left and right direction calculation unit may calculate a direction in which a straight line approximates a line of a rear edge of the member of the tractor appearing in the image captured by the camera extends as the left and right direction of the tractor.
[0024] According to the above-mentioned towing angle detection system, the towing angle of the trailer can be accurately detected regardless of the shape of the towing bar of the trailer. In addition, the towing angle of the trailer can be detected by using a rear view camera widely used for rear confirmation when backing up as a camera of the towing angle detection system without providing special equipment for the tractor and the trailer.
[0025] In addition, in order to achieve the above-mentioned technical problem, the present invention comprises, in a towing angle detection system for detecting the towing angle of a trailer towed by a tractor: a camera, which is arranged on the tractor in a manner that the front part of the trailer is included in the shooting range regardless of the towing angle of the trailer; a marker, which is attached to the front part of the trailer at a position within the shooting range of the camera in a manner that indicates the left-right direction of the trailer; a left-right direction calculation unit, which calculates the left-right direction of the trailer indicated by the image of the marker appearing in the image captured by the camera; and a towing angle calculation unit, which calculates the relative angle of the calculated left-right direction of the trailer with respect to the left-right direction of the tractor as the towing angle of the trailer.
[0026] Thus, the towing angle θ of the trailer can be detected regardless of the shape and structure of the trailer simply by attaching the marker to the trailer itself where a relatively good attachment space can be easily secured compared to the upper surface of the tow bar.
[0027] [Effects of the Invention]
[0028] As described above, according to the present invention, the towing angle of the trailer can be detected with a simpler and more versatile structure. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figure 1 It is a block diagram showing the configuration of a driving assistance system according to an embodiment of the present invention.
[0030] Figure 2 It is a figure which shows the tractor and trailer which concern on embodiment of this invention.
[0031] Figure 3 It is a diagram showing the pulling angle detected in the embodiment of the present invention.
[0032] Figure 4 It is a diagram showing an example of detection of a towing angle according to the embodiment of the present invention.
[0033] Figure 5 It is a diagram showing another detection example of the towing angle according to the embodiment of the present invention. DETAILED DESCRIPTION
[0034] Hereinafter, embodiments of the present invention will be described.
[0035] exist Figure 1 2 shows the configuration of the driving assistance system according to the present embodiment.
[0036] Here, Figure 1 The driver assistance systems shown are Figure 2 a, Figure 2 Assistance in driving a tractor 2 towing a trailer 1 such as a caravan as shown in b.
[0037] return Figure 1 The driving assistance system is composed of a trailer-side system 11 mounted on the trailer 1 and a tractor-side system 21 mounted on the tractor 2 .
[0038] The trailer-side system 11 includes three cameras: a trailer right camera 111 , a trailer rear camera 112 , and a trailer left camera 113 ; and a transmitter 114 that wirelessly transmits images captured by the cameras to the tractor-side system 21 .
[0039] The tractor-side system 21 includes: an input device 211; a state sensor 212 for detecting various states of the tractor 2, such as the forward / reverse driving state of the tractor 2 and the steering angle of the tractor 2; a receiving device 215 for receiving images wirelessly transmitted by the display device 213, the rear camera 214, and the transmitting device 114 of the trailer-side system 11; a towing angle detection unit 216 for detecting the towing angle of the trailer 1 using the image captured by the rear camera 214; an auxiliary information generation unit 217 for generating various auxiliary information for assisting the driving of the tractor 2 using the images of the trailer right camera 111, the trailer rear camera 112, and the trailer left camera 113 received by the receiving device 215, the images captured by the rear camera 214, the towing angle detected by the towing angle detection unit 216, and the like, and displaying the generated information on the display device 213; and a control unit 218 for controlling the above units.
[0040] However, the images of the trailer's right camera 111, the trailer's rear camera 112, and the trailer's left camera 113 can also be transmitted from the trailer-side system 11 to the tractor-side system 21 via wired transmission. In this case, the sending device 114 and the receiving device 215 are not provided, and the images of the trailer's right camera 111, the trailer's rear camera 112, and the trailer's left camera 113 are directly transmitted to the auxiliary information generating unit 217.
[0041] Then, if Figure 2 a, Figure 2 As shown in b, the trailer right camera 111 of the trailer side system 11 shoots the rear from the front end of the right side of the trailer 1, the trailer rear camera 112 shoots the rear from the center position of the left-right direction of the rear of the trailer 1, and the trailer left camera 113 shoots the rear from the front end of the left side of the trailer 1.
[0042] In addition, the rear camera 214 of the tractor-side system 21 captures the rear at a wide angle from a central position in the left-right direction of the rear portion of the tractor 2. Here, the capturing range of the rear camera 214 is set so that the rear end portion of the tractor 2, such as the rear bumper of the tractor 2, and the front end portion of the trailer 1, such as the front bumper, chassis, and front end of the vehicle body of the trailer 1, are included in the captured image.
[0043] The towing bar 12 connected to the chassis extends from the lower front end of the trailer 1 to the front of the trailer 1, and the trailer 1 is connected to the tractor 2 by engaging a coupling provided at the front end of the towing bar 12 with a towing ball provided at the rear end of a towing member 22 extending from the lower rear end of the tractor 2 to the rear of the tractor 2 in a manner that can swing around the central axis of the coupling and the towing ball.
[0044] Therefore, if Figure 3 a, Figure 3As shown in b, the trailer 1 can swing relative to the tractor 2 around the central axis of the coupling and the towing ball, and the angle of this swing shown in θ in the figure becomes the towing angle of the trailer 1.
[0045] Hereinafter, detection of the towing angle of the trailer 1 by the towing angle detection unit 216 using the image captured by the rear camera 214 will be described.
[0046] The towing angle detection unit 216 extracts a portion including the image of the rear end portion of the tractor 2 and the image of the front end portion of the trailer 1 from the image captured by the rear camera 214, and recognizes, through image recognition, lines extending in the left-right direction of the tractor 2, such as a line of the rear edge of the tractor 2, and lines extending in the left-right direction of the trailer 1, such as a line of the front edge of the trailer 1, which appear in the extracted image.
[0047] Then, the first straight line that is most approximate to the identified line extending in the left-right direction of the tractor 2 is calculated as a straight line parallel to the left-right direction of the tractor 2, and the second straight line that is most approximate to the identified line extending in the left-right direction of the trailer 1 is calculated as a straight line parallel to the left-right direction of the trailer 1.
[0048] Then, the relative angle of the second straight line with respect to the first straight line is obtained as the towing angle θ of the trailer 1 .
[0049] That is, the detection of the pulling angle is performed, for example, as follows.
[0050] Now, in the case where the orientation relationship between the tractor 2 having a rear bumper and the trailer 1 having a front bumper is as follows: Figure 4 In the case shown in a1, Figure 4 As shown in a2 , the towing angle detection unit 216 extracts a portion including an image 410 of the rear bumper of the tractor 2 and an image 420 of the front bumper of the trailer 1 from the image captured by the rear camera 214 .
[0051] Then, the extracted Figure 4 Edge detection is performed in the image a2, and from the detected edges, based on the position, orientation, etc. of the edges, such as Figure 4 As shown in a3 , an edge 411 corresponding to the rear edge of the rear bumper of the tractor 2 and an edge 421 corresponding to the front edge of the front bumper of the trailer 1 are extracted.
[0052] Then, through regression analysis, such as Figure 4 As shown in a4, the straight line 412 that is most approximate to the edge 411 corresponding to the rear edge of the rear bumper is calculated as a straight line parallel to the left-right direction of the tractor 2, and the straight line 422 that is most approximate to the edge 421 corresponding to the front edge of the front bumper of the trailer 1 is calculated as a straight line parallel to the left-right direction of the trailer 1.
[0053] As shown in the figure, when the angle of the straight line 412 is θ1 and the angle of the straight line 422 is θ2, the relative angle of the straight line 422 with respect to the straight line 412 expressed by θ2-θ1 is calculated as the towing angle θ of the trailer 1.
[0054] Similarly, in the case where the tractor 2 having a rear bumper and the trailer 1 having a front bumper have a direction relationship as shown in FIG. Figure 4 In the case shown in b1, Figure 4 As shown in b2 , the towing angle detection unit 216 extracts a portion including an image 410 of the rear bumper of the tractor 2 and an image 420 of the front bumper of the trailer 1 from the image captured by the rear camera 214 .
[0055] Then, the extracted Figure 4 Edge detection is performed in the image b2, and from the detected edges, based on the position, orientation, etc. of the edges, such as Figure 4 As shown in b3 , an edge 411 corresponding to the rear edge of the rear bumper of the tractor 2 and an edge 421 corresponding to the front edge of the front bumper of the trailer 1 are extracted.
[0056] Then, through regression analysis, such as Figure 4 As shown in b4, the straight line 412 that is most approximate to the edge 411 corresponding to the rear edge of the rear bumper is calculated as a straight line parallel to the left-right direction of the tractor 2, and the straight line 422 that is most approximate to the edge 421 corresponding to the front edge of the front bumper of the trailer 1 is calculated as a straight line parallel to the left-right direction of the trailer 1.
[0057] As shown in the figure, when the angle of the straight line 412 is θ1 and the angle of the straight line 422 is θ2, the relative angle of the straight line 422 with respect to the straight line 412 expressed by θ2-θ1 is calculated as the towing angle θ of the trailer 1.
[0058] Furthermore, during a period in which the state (position, orientation, and viewing angle) of the rear camera 214 is fixed, the position of the image of the rear bumper that appears in the image captured by the rear camera 214 does not change. Therefore, during this period, the straight line 412 that is most similar to the edge 411 corresponding to the rear edge of the rear bumper can be calculated only for the first time based on the image captured by the rear camera 214, and the straight line 412 calculated for the first time can be used to calculate the towing angle θ each time the towing angle θ is calculated.
[0059] Alternatively, the left-right angle of the tractor 2 in the image captured by the rear camera 214 may be determined in advance and fixedly set, and the set angle may be used instead of the angle θ1 of the straight line 412 each time the tractor angle θ is calculated.
[0060] Return to Figure 1The auxiliary information generating unit 217 performs the following processing under the control of the control unit 218: when the tractor 2 moves backward, the relative positional relationship between the tractor 2 and the trailer 1 is calculated based on the towing angle θ detected by the towing angle detecting unit 216, and the movement trajectory of the trailer 1 is calculated based on the calculated positional relationship when the tractor 2 moves backward as it is, and the calculated movement trajectory is overlapped with the images captured by the trailer right camera 111, the trailer rear camera 112, and the trailer left camera 113 and displayed on the display device 213; when the tractor 2 moves backward, the relative positional relationship between the tractor 2 and the trailer 1 is calculated based on the towing angle θ detected by the towing angle detecting unit 216, and the movement trajectory of the trailer 1 is calculated based on the calculated positional relationship, and the calculated movement trajectory is overlapped with the images captured by the trailer right camera 111, the trailer rear camera 112, and the trailer left camera 113 and displayed on the display device 213; The towing angle θ detected by the towing angle detection unit 216 and the steering angle of the tractor 2 detected by the state sensor 212 are used to predict the collision between the tractor 2 and the trailer 1, and a guidance for avoiding the collision is displayed on the display device 213; the towing angle θ detected by the towing angle detection unit 216 is used to synthesize the images captured by the rear camera 214, the trailer right camera 111, the trailer rear camera 112, and the trailer left camera 113 into an image obtained by widely observing the surroundings of the tractor 2 from the viewpoint of the rear of the tractor 2, and display the image on the display device 213.
[0061] The embodiments of the present invention have been described above.
[0062] According to this embodiment, the towing angle of the trailer 1 can be accurately detected regardless of the shape of the towing bar 12 of the trailer 1. In addition, the towing angle of the trailer 1 can be detected using the rear camera 214 widely used for rear confirmation when backing up, without providing special equipment for the tractor 2 and the trailer 1.
[0063] Here, in the above embodiment, in the towing angle detection unit 216, the left and right direction of the trailer 1 is obtained based on the line of the front edge of the trailer 1 recognized from the image captured by the rear camera 214 to calculate the towing angle, but it is also possible to paste a marker in a manner indicating the left and right direction of the trailer 1 at the position captured by the rear camera 214 of the trailer 1, and in the towing angle detection unit 216, the marker is recognized based on the image captured by the rear camera 214, and the left and right direction of the trailer 1 is calculated based on the recognized marker to calculate the towing angle.
[0064] Similarly, in the above embodiment, the towing angle detecting unit 216 calculates the towing angle by finding the left and right direction of the tractor 2 based on the line of the rear edge of the tractor 2 recognized from the image captured by the rear camera 214. However, a marker may be attached to the position captured by the rear camera 214 of the tractor 2 in such a manner as to indicate the left and right direction of the tractor 2, and the towing angle detecting unit 216 may recognize the marker based on the image captured by the rear camera 214, and calculate the towing angle by finding the left and right direction of the tractor 2 based on the recognized marker.
[0065] For example, the left and right direction of the tractor 2 is obtained in the same manner as in the above embodiment, and when the left and right direction of the trailer 1 is obtained using the marker attached to the trailer 1 to calculate the traction angle θ, Figure 5 The front surface of the trailer 1 shown in a Figure 5 As shown in b1 , a linear marker 43 is attached in parallel with the left-right direction of the trailer 1 .
[0066] Then, if Figure 5 As shown in b2, from the image captured by the rear camera 214, as Figure 5 As shown in b3 , the edge 411 of the image of the rear bumper of the tractor 2 and the area 431 of the image of the marker 43 are recognized.
[0067] Then, if Figure 5 As shown in b4, a straight line 412 that is most similar to the edge 411 of the image of the rear bumper and a straight line 432 that is parallel to the longitudinal direction of the region 431 of the image of the marker 43 are calculated.
[0068] Then, the relative angle of the straight line 432 with respect to the straight line 412 is calculated as the towing angle θ of the trailer 1 .
[0069] Or, in this case, for example, Figure 5 The front surface of the trailer 1 shown in a Figure 5 As shown in c1 , a plurality of markers 43 are attached to the trailer 1 in a row in the left-right direction.
[0070] Then, if Figure 5 As shown in c2, from the image captured by the rear camera 214, as Figure 5 As shown in c3 , the edge 411 of the image of the rear bumper of the tractor 2 and the area 431 of the image of the marker 43 are recognized.
[0071] Then, if Figure 5 As shown in c4, a straight line 412 that is most similar to the edge 411 of the image of the rear bumper and a straight line 432 that is parallel to the direction in which the regions 431 of the images of the plurality of markers 43 are arranged are calculated.
[0072] Then, the relative angle of the straight line 432 with respect to the straight line 412 is calculated as the towing angle θ of the trailer 1 .
[0073] When the left and right direction of the tractor 2 is determined using the marker 43 attached to the tractor 2 , the marker 43 is attached to the rear bumper of the tractor 2 , and the left and right direction of the tractor 2 is determined in the same manner as in the case of the trailer 1 described above.
[0074] Thus, it is easier to secure a relatively good pasting space than on the upper surface of the towing bar 12, and the towing angle θ of the trailer 1 can be detected regardless of the shape and structure of the rear end of the tractor 2 and the shape and structure of the front end of the trailer 1, simply by pasting the marker 43 on the tractor 2 and the trailer 1 themselves.
[0075] [Description of the accompanying drawings]
[0076] 1…trailer, 2…tractor, 11…trailer side system, 12…drawbar, 21…tractor side system, 22…drawing member, 43…marker, 111…trailer right camera, 112…trailer rear camera, 113…trailer left camera, 114…transmitting device, 211…input device, 212…status sensor, 213…display device, 214…rear camera, 215…receiving device, 216…drawing angle detection unit, 217…auxiliary information generation unit, 218…control unit.
Claims
1. A towing angle detection system for detecting the towing angle of a trailer towed by a tractor, characterized in that: have: a camera installed on the tractor so as to include the front part of the trailer in a photographing range regardless of the towing angle of the trailer; a left-right direction calculation unit that calculates the left-right direction of the trailer based on an image of a component of the trailer extending to the left and right of the trailer that appears in the image captured by the camera; as well as The traction angle calculation unit calculates a relative angle between the calculated left and right directions of the trailer and the left and right directions of the tractor as the traction angle of the trailer.
2. The traction angle detection system according to claim 1, characterized in that: The parts of the trailer extending to the left and right of the trailer are parts forming the front edge of the trailer, The left-right direction calculation unit calculates a direction in which a straight line obtained by approximating a line of the front edge of the trailer appearing in the image captured by the camera extends as the left-right direction of the trailer.
3. The traction angle detection system according to claim 1 or 2, characterized in that: The camera is installed on the tractor so as to include the rear part of the tractor and the front part of the trailer in a photographing range regardless of the towing angle of the trailer. The left-right direction calculation unit calculates the left-right direction of the tractor based on an image of a component of the tractor extending to the left and right of the tractor appearing in the image captured by the camera. The towing angle calculation unit calculates a relative angle of the left and right direction of the trailer calculated by the left and right direction calculation unit with respect to the left and right direction of the tractor calculated by the left and right direction calculation unit as the towing angle of the trailer.
4. The traction angle detection system according to claim 3, characterized in that: The part of the tractor extending to the left and right of the tractor is a part forming the rear edge of the tractor, The left-right direction calculation unit calculates a direction in which a straight line obtained by approximating a line of a rear edge of the tractor vehicle appearing in an image captured by the camera extends as the left-right direction of the tractor vehicle.
5. A towing angle detection system for detecting the towing angle of a trailer towed by a tractor, characterized in that: have: a camera installed on the tractor so as to include the front part of the trailer in a photographing range regardless of the towing angle of the trailer; A marker is attached to a position within the photographing range of the camera at the front of the trailer in a manner indicating the left and right directions of the trailer; a left-right direction calculation unit for calculating the left-right direction of the trailer indicated by the image of the marker appearing in the image captured by the camera; as well as The traction angle calculation unit calculates a relative angle between the calculated left and right directions of the trailer and the left and right directions of the tractor as the traction angle of the trailer.
