Camera wing system, vehicle equipped with the system and its operation method

By installing a camera wing system on the vehicle, combined with a ToF sensor, the problem of tracking the rear of the trailer is solved, enabling accurate monitoring and field of view updates of the rear of the trailer, adapting to different driving conditions.

CN116215382BActive Publication Date: 2026-11-10MOTHERSON INNOVATIONS CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202211508922.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-12-02
Filing Date
2022-11-29
Publication Date
2026-11-10
Estimated Expiration
2042-11-29

AI Technical Summary

Technical Problem

Existing trailer tracking systems struggle to accurately identify and monitor the rear end of trailers, resulting in an inability to effectively update the field of view to ensure that the trailer's end remains within the tracking system's field of view.

Method used

The system employs a camera wing system, including at least one camera and a time-of-flight (ToF) sensor, to update portions of the image by recording the field of view around the rear of the vehicle and by using geometric calculations based on the distance between cameras, the center of rotation, and the protrusion point, in order to maintain focus on the rear of the trailer and adapt to different driving conditions.

Benefits of technology

It enables effective tracking and monitoring of the rear of the trailer, ensuring that the trailer is always included in the image, thus improving the accuracy of field-of-view updates and the reliability of driver information acquisition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116215382B_ABST
    Figure CN116215382B_ABST
Patent Text Reader

Abstract

This disclosure relates to a camera wing system, a vehicle having the system, and a method of operating the system. A camera wing system (12) for a vehicle (20) includes at least one camera (14) for recording a field of view (FOV) in a scene surrounding at least the rear of the vehicle (20), wherein the presented view is provided to the driver of the vehicle (20) as part of the field of view. The camera wing system (12) is adapted to update an image portion (19) within the presented view provided to the driver from the presented view of at least one camera (14) to another presented view different from the previous presented view to maintain focus on the rear of the vehicle (20), preferably a trailer (300, 400) as the rear of the vehicle (20), regardless of the driving conditions of the vehicle (20), and to update the image portion (19) based on geometric calculations of the distance between at least one camera (14) and the triangle between the rotation center (312, 412), the protrusion point (24), and at least one camera (14) of the vehicle (20).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to tracking systems and more specifically to a time-of-flight (ToF) based tracking system for determining trailer angles to update portions of an image in a side-view camera. Background Technology

[0002] The statements in this section provide only background information in connection with this disclosure and may not constitute prior art.

[0003] Current trailer tracking systems struggle to identify the rear end of a trailer. Consequently, current tracking systems cannot accurately track and monitor the trailer's end to update the field of view and ensure the trailer's end remains within the tracking system's field of view. The purpose of this disclosure is to effectively track and monitor the rear end of a trailer or vehicle and update the image accordingly, overcoming at least some of the aforementioned problems. Summary of the Invention

[0004] The purpose of this invention is to provide a camera-wing system for vehicles that addresses at least some of the shortcomings of the prior art, particularly by providing a system for updating the image portion of a vehicle based on changes in the angle of a trailer / vehicle.

[0005] This problem is addressed by a camera wing system for a vehicle, comprising at least one camera for recording a field of view (FOV) of at least the area surrounding the rear of the vehicle, wherein a presented view is provided to the driver of the vehicle as part of the FOV. The camera wing system is adapted to update portions of the image from the presented view of at least one camera to another presented view different from the previous presented view within the presented view provided to the driver, in order to maintain focus on the rear of the vehicle, preferably a trailer, regardless of the vehicle's driving conditions, and to update portions of the image based on geometric calculations of the distance between at least one camera and the triangle between the rotation center, the salient point, and at least one camera of the vehicle.

[0006] The term "camera wing system" refers to a component positioned on the side of a vehicle to record at least the rear view from the vehicle. The location of the camera wing system may be the same as that of a conventional vehicle rearview mirror system. However, because the recorded scenery can be displayed on a monitor inside the vehicle, the camera wing system may be positioned outside the driver's field of vision. This wing system includes an arm or wing on which a camera is mounted, such that the camera is positioned above the wing, slightly away from the vehicle chassis, so that the vehicle chassis does not restrict the camera's field of view, or only partially restricts it.

[0007] The term "vehicle" refers to any motor-driven vehicle operated by a driver, where the driver needs information about people, other vehicles, or objects in the vicinity of the vehicle in order to drive safely. As an example, a motor vehicle is a car or truck, especially when towing a trailer. The term "driving situation" refers to the direction the vehicle is currently traveling. A common driving situation is driving straight, while cornering is another. Other driving situations include reversing, parking, or turning. Turning can be a special form of cornering. Depending on the driving situation, the requirements for the lighting system will vary due to changes in the scenery observed by the driver via the camera wing system.

[0008] The term "camera" refers to any device capable of recording or identifying the environment of a vehicle and displaying that identified or recorded environment in an image so that the driver can process the environment into driving information based on the image display. The camera may be an infrared (IR) camera. IR cameras increase the visibility of objects at night. In particular, CCD or CMOS cameras can detect near-infrared (NIR) wavelengths that are undetectable by the human eye. NIR refers to light in the spectral range between 700 nm and 1400 nm. NIR cameras can rely on the invisible infrared (IR) radiation of the sun during daytime operation. During nighttime operation, NIR light can be provided by an IR light source from a lighting system, illuminating the landscape in the field of view, where reflected light is recorded by the camera. For nighttime use, the camera must be sensitive to at least a portion of the spectrum of light emitted by the light source of the lighting system.

[0009] The term "field of view" refers to the extent of the observable world that a camera "sees" (records) at any given moment. The field of view involves angular views specified in degrees in both the vertical and horizontal directions. The recorded field of view can be displayed to the driver on a corresponding display connected to the camera wing system via a camera wing system. In some embodiments, the display may be part of the camera wing system. The field of view is directed towards the area of ​​interest for the driver to drive safely without endangering other people, objects, or vehicles within the field of view or damaging their own vehicle. The area of ​​interest can be the rear and sides of the vehicle, preferably on both sides, as well as the front view.

[0010] The term "landscape" refers to the observable world as seen by the pilot when using the camera wing system. A landscape may only be a portion of the observable world within the field of view. During daytime operation, overall brightness may be sufficient to observe the entire observable world within the camera's field of view. During nighttime operation, the scene may be limited to portions of the observable world illuminated by the lighting system. Unilevered objects may not be recorded by the camera due to the low level of light reflected from these "dark" objects.

[0011] In one embodiment, the camera wing system further includes a ToF sensor adapted to measure the distance, wherein the ToF sensor is configured outside the housing of at least one camera housing the camera wing system.

[0012] In one embodiment, a camera wing system having at least one camera and a ToF sensor is configured within the housing of the camera wing system. In another embodiment, the camera wing system having at least one camera is adapted to capture the field of view (FOV) and measure the distance.

[0013] In yet another embodiment, the camera wing system with the trailer protrusion is a point of interest as a prominent part of vehicle detection.

[0014] In yet another embodiment, the camera wing system with a point of interest is a significant part of vehicle detection.

[0015] In yet another embodiment, the camera wing system having a distinctive portion for vehicle detection is attached to at least one of the vehicle's markings and distinctive features.

[0016] In yet another embodiment, the distinctive camera wing system includes at least one of the vehicle's rear axle, a tag, and side lights.

[0017] In yet another embodiment, the camera wing system with protruding points is detected by suitable optical recognition software installed and executed on the electronic control unit of the camera wing system.

[0018] In yet another embodiment, the camera wing system with this system needs to be initialized after a straight-line situation.

[0019] In yet another embodiment, the camera wing system with this system needs to be initialized after a reboot or after attaching a new trailer.

[0020] In yet another embodiment, the camera wing system with this system only begins initialization when a straight-ahead situation is detected based on the vehicle's speed data and steering angle in a time frame.

[0021] In yet another embodiment, a camera wing system records information about any changes in the ignition state, and in this case, performs reinitialization to measure the distance to the protrusion.

[0022] In yet another embodiment, the camera wing system with the system detects a straight-ahead situation when the distance between the first camera and at least one protrusion on that side and the distance between the second camera and at least one protrusion on that side are at predefined distances calibrated for straight-ahead situations.

[0023] The present invention also relates to a vehicle comprising at least one camera wing system as described herein.

[0024] The present invention also relates to a method for operating a camera wing system mounted on a vehicle including at least one camera, comprising the steps of: recording a field of view in a scene at least around the rear of the vehicle by the at least one camera, wherein a presented view is provided to the driver of the vehicle as part of the field of view, adapting the camera wing system to update an image portion from the presented view of the at least one camera to another presented view different from the previous presented view within the presented view provided to the driver, to maintain the focus of attention on the rear of the vehicle, preferably a trailer as the rear of the vehicle, regardless of the driving conditions of the vehicle, and updating the image portion based on the distance between the at least one camera and the geometric calculation of a triangle between the rotation center, the protrusion point, and the at least one camera of the vehicle.

[0025] The present invention also relates to a method for operating a tracking system, including the method for operating a camera wing system as described above. For example, see reference... Figure 2 The details of the tracking system and its operation are described.

[0026] It should be noted that the features listed individually in the following description can be combined with each other in any technically advantageous manner, as well as other forms of this disclosure. The description further characterizes and illustrates this disclosure, particularly in conjunction with the accompanying drawings. Attached Figure Description

[0027] To facilitate a good understanding of this disclosure, its various forms will now be described, given by way of example and with reference to the accompanying drawings, wherein:

[0028] Figure 1a A schematic diagram depicting the trailer and camera wing system is shown.

[0029] Figure 1b Another schematic diagram depicting the trailer and camera wing system;

[0030] Figure 1c This is yet another schematic diagram depicting the trailer and camera wing system;

[0031] Figure 1d This is yet another schematic diagram depicting the trailer and camera wing system;

[0032] Figure 2 A method for tracking time-of-flight trailers to update image segments is described;

[0033] Figure 3 The subprocess described describes the steps for determining the protrusion of the trailer and the distance from the protrusion to the image capture device.

[0034] Figure 4a: A schematic diagram depicting the adjustment angle of the image capture equipment of the semi-trailer used to determine the front of the semi-trailer.

[0035] Figure 4b : An enlarged view of a diagram depicting the adjustment angle of an image capture device for determining the semi-trailer using the front of the semi-trailer.

[0036] Figure 5 A diagram depicting the adjustment angle of the image capture equipment on the semi-trailer is shown; and

[0037] Figure 6 A diagram depicting the adjustment angle of the image capture device used to determine the rigid trailer.

[0038] Unless otherwise specified, the accompanying drawings mentioned in this specification should not be construed as being drawn to scale, and such drawings are merely illustrative in nature. Detailed Implementation

[0039] The following description is exemplary in nature only and is not intended to limit this disclosure, its application, or its use. It should be understood that in all the drawings, corresponding reference numerals denote the same or corresponding parts and features.

[0040] Figure 1a , 1b Figures 1c and 1d depict schematic diagrams of the camera wing system 12 of the trailer 20 or vehicle 20. Figure 1a As shown, the camera wing system 12 includes at least one camera 14 disposed within a housing of the camera wing system 12 and a time-of-flight (TOF) sensor 16 located outside or attached to the housing. The at least one camera 14 is configured to capture the field of view (FOV), while the TOF sensor 16 is configured to measure the distance between the at least one camera 14 and a protruding point (e.g., ...). Figure 5 (Including those depicted in other figures).

[0041] In another embodiment, such as Figure 1b As shown, the camera wing system 12 includes at least one camera 14 and a ToF sensor 16, wherein the at least one camera 14 and the ToF sensor 16 are configured within the housing of the camera wing system 12. The at least one camera 14 is configured to capture the field of view (FOV), while the ToF sensor 16 is configured to measure the distance between the at least one camera 14 and a protruding point (e.g., ...). Figure 5 (Including those depicted in other figures).

[0042] In yet another embodiment, such as Figure 1cAs shown, the camera wing system 12 includes at least one camera 14 configured to capture the field of view (FOV). Furthermore, the at least one camera 14 is designed such that it is adapted to measure the distance between the at least one camera 14 and the protrusion point (e.g., ...). Figure 5 (Including those depicted in other figures). At least one camera 14 is configured within the housing of the camera wing system 12. In embodiments, the light sensor of at least one camera 14 may have specifications ranging from 0.1 megapixels to 100 megapixels.

[0043] In yet another embodiment, such as Figure 1d As shown, the camera wing system 12 includes a TOF sensor 16 to measure the distance between at least one camera 14 and the protrusion (e.g., ...). Figure 5 (Including those depicted in other figures). Furthermore, the TOF sensor 16 is adapted to capture the field of view (FOV). The TOF sensor 16 can be similar to an image sensor with more pixels to meet the need to capture both the light signal it projects and external light signals. In embodiments, the light sensor at the TOF sensor 16 can have specifications ranging from 5 pixels to 0.5 megapixels.

[0044] The camera wing system 12 also includes an electronic control unit (ECU) 18 and an image section 19. In a scenario where only camera 14 is part of the camera wing system 12, camera 14 is adapted to operate as a conventional image sensor, similar to the TOF sensor 16, for capturing the field of view (FOV) and measuring distance. Similarly, in a scenario where only the TOF sensor 16 is part of the camera wing system 12, the TOF sensor 16 is configured to have more pixels, making it suitable for operation as a conventional image sensor, similar to the TOF sensor 16, for capturing the FOV and measuring distance.

[0045] The protruding point 24 of the trailer is a point of interest, which is a salient portion detected by vehicle 20. The point of interest is a salient portion detected by vehicle 20. The unique portion detected by vehicle 20 is at least one of markings and distinctive features attached to vehicle 20. Furthermore, distinctive features include at least one of the last axle, label, and side lights of vehicle 20. The protruding point 24 is detected by suitable optical recognition software installed and executed on the ECU 18 of the camera wing system 12. System 12 needs to be initialized after a straight-ahead situation. System 12 needs to be initialized after a restart or after attaching a new trailer. According to any of the preceding claims, the camera wing system 12 only begins initialization when a straight-ahead situation is detected in a time frame based on the speed data and steering angle of vehicle 20. The straight-ahead situation described above refers to the situation where the cargo box and trailer are in a straight line.

[0046] The camera wing system 12 according to claim 12, wherein information about any changes in the ignition state is recorded, and in this case, reinitialization is performed to measure the distance to the protrusion.

[0047] The camera wing system 12 according to any one of the preceding claims, wherein the system 12 detects a straight-ahead situation when the distance between the first camera 12 and at least one protrusion 24 on that side and the distance between the second camera 12 and at least one protrusion 24 on that side are at a predefined distance calibrated for a straight-ahead situation.

[0048] In another embodiment, the camera wing system 12 for vehicle 20 includes at least one camera 14 for recording a field of view in the scene surrounding at least the rear of vehicle 20. The presented view is provided to the driver of vehicle 20 as part of the field of view, and the camera wing system 12 is adapted to update image portion 19 from the presented view of at least one camera 14 to another presented view different from the previous presented view within the presented view provided to the driver 60, to maintain focus on the rear of vehicle 20, preferably the trailer 300, 400 as the rear of vehicle 20, regardless of the driving conditions of vehicle 20. The image portion 19 is updated based on geometric calculations of the distance between at least one camera 14 and the triangle between the rotation center 312, the protrusion point 24, and at least one camera 14 of vehicle 20.

[0049] Trailer 20 can be a semi-trailer 300 or a rigid trailer 400, respectively as follows: Figure 5 and Figure 6 As shown in the diagram. Trailer 20 includes a marker point 22 and a protrusion point 24. Marker point 22 is located along the leading edge 305 of the semi-trailer 300, as shown in the diagram. Figure 3 As shown in the diagram. The protruding point 24 may include, but is not limited to, one or a combination of the marking point 22, the rear wheel on the trailer 20, a label affixed near the rear end of the trailer 20, and the side lights located near the rear of the trailer 20.

[0050] The camera wing system 12 or a ToF array without MEM technology can be used as a solid-state sensor to detect the position of the trailer 20 of the semi-trailer 300 or the rigid trailer 400 to update the image portion 19. Having multiple pixels, at least one camera 14 is capable of identifying the trailer 20 based on unique points via software executing the algorithms described in this disclosure. The angle of the trailer 20 can be determined based on the distance from at least one camera 14 or ToF sensor 16 to a protruding point 24. The protruding point 24 can be one or a combination of the rear wheels on the trailer 20, a label affixed near the rear of the trailer 20, or a side lamp located near the rear of the trailer 20. The angle of the trailer 20 can also be determined based on the distance from at least one camera 14 or ToF sensor 16 to a marker point 22 located along the leading edge of the trailer 20.

[0051] Active illumination can be used, enabling the camera wing system 12 to identify the trailer 20 in dark places with minimal or no external lighting, or at night. Furthermore, the camera wing system 12 can scan blind spots, rear views, objects and their distances, and approach speeds. Before determining the angle of the trailer 20, a distance measurement to the protrusion 24 is calculated at least once at an angle of approximately zero degrees. When the trailer 20 has an angular offset of approximately ten degrees or greater, the protrusion 24 is sufficiently visible and identifiable for distance measurement. If the protrusion 24 can be sufficiently identified, measurements can be performed when the angular offset is less than ten degrees.

[0052] The camera wing system 12 is also capable of performing dual measurements on the protrusion 24 and the marker 22 on the semi-trailer 300 to determine the angle. By measuring simultaneously from both sides, the distances between the protrusion 24 and the marker 22 can be compared to determine the angle. This allows the camera wing system 12 to accurately determine when the trailer 20 is straight and the length of the vehicle or its distance to the protrusion 24.

[0053] Figure 2 A method 90 for time-of-flight (ToF) trailer tracking to update image portions 19 is described. Method 90 uses method 100 to operate a camera wing system 12 for trailer 20 to update image portions 19, such as... Figure 1a , 1b As shown in 1c. Method 100 includes the following steps: recording a field of view in a scene surrounding at least the rear of a vehicle 20 by at least one camera 14; providing the presented view to a driver of the vehicle 20 as part of the field of view; adapting a camera wing system 12 to update an image portion 19 from the presented view of at least one camera 14 to another presented view different from the previous presented view, within the presented view provided to the driver 60, to maintain the focus on the rear of the vehicle 20, preferably the trailers 300, 400 as the rear of the vehicle 20, regardless of the driving conditions of the vehicle 20; and performing the image portion update based on geometric calculations of the distance between at least one camera 14 and the triangle between the rotation center 312, the protrusion point 24, and at least one camera 14 of the vehicle 20.

[0054] In step 101 of method 90, the steering angle and velocity are measured. In step 102, if the steering angle is greater than five degrees or if the velocity is zero, then the camera wing system 12 returns to step 101 to measure the steering angle and velocity. If the steering angle is less than five degrees and the velocity is greater than zero for five seconds, then the camera wing system 12 proceeds to subprocessing step 104. Subprocessing 104 is used to determine the protrusion point 24 and will... Figure 3Further discussion follows. In step 106, the distance from step 104 is recorded into the memory within EDU 18. Then, in step 108, the camera wing system 12 checks if the ignition is off. If the ignition is off, the camera wing system 12 returns to step 101 to measure the steering angle and speed. Alternatively, if the ignition is on, the camera wing system 12 proceeds to step 110. In step 110, the camera wing system 12 checks if the signal from trailer 20 is interrupted. If the trailer 20 signal is interrupted, the camera wing system 12 returns to step 101 to measure the steering angle and speed. If the trailer 20 signal is not interrupted, the camera wing system 12 proceeds to step 112, in which the distance to the protruding point 24 is measured. Once the distance is measured, the trailer angle α is calculated in step 114. Furthermore, as... Figure 4b As shown, the helix angle β can be calculated for a specific type of trailer / vehicle. There are two different methods for determining the angle in section 114. The method described is the determination of angle α. However, the determination of angle β can also be used. To choose between α and β, an OR or AND / OR operation can be used. The advantage of the method for determining β is that it is closer to the target angle and therefore has an advantage in adverse weather conditions, but it is not possible for all vehicle types except semi-trailers. Furthermore, these two methods for determining α or β can be cross-checked.

[0055] In step 116, if the trailer angle α is less than ten degrees, the camera wing system 12 returns to step 101 to measure the steering angle and speed. If the trailer angle α is greater than ten degrees, the camera wing system 12 proceeds to step 118. In step 118, the camera wing system 12 updates the image portion 19 accordingly to ensure that the protrusion 24 is visible within the image portion 19.

[0056] Figure 3 Describes the methods used to determine such Figure 5 and Figure 6 The subprocess 104 of the highlighted point 24 shown. In step 202, the camera wing system 12 determines whether the vehicle is a semi-trailer 300 or a rigid trailer 400. If the vehicle is a semi-trailer 300, then the camera wing system 12 proceeds to step 204, where the camera wing system 12 determines the marker point 22 of the semi-trailer 300. Once the marker point 22 is determined, the camera wing system 12 determines whether it is possible to detect, in step 206, on the semi-trailer 300 as shown in the subprocess 104. Figure 4aThe leading edge 305 is shown in step 206. If the leading edge 305 is detected, the helix angle β is calculated in step 208. Once the helix angle β is calculated, or if the leading edge 305 is not detected in step 206, the camera wing system 12 proceeds to step 212. In step 212, the camera wing system 12 determines whether a tag is located at the protrusion point 24. The tag is optimized to reflect the wavelength of illumination from the camera wing system 12, preferably in the near-infrared (NIR) range. The tag reflects the infrared light emitted by the camera wing system 12. If a tag is present, the camera wing system 12 proceeds to step 218, where the distance from at least one camera 14 to the protrusion point 24 is calculated. This distance is then sent in step 220 for initialization. If no tag is detected in step 212, the camera wing system 12 checks the sidelight at the protrusion point 24 in step 214. If a sidelight is present, the camera wing system 12 proceeds to step 218, where the distance from at least one camera 14 to the protrusion point 24 is calculated. This distance is then sent in step 220 for initialization. If no side light is detected, then the camera wing system 12 detects the axle at the rear of the wheel at the protrusion point 24 in step 216. The camera wing system 12 then proceeds to step 218, where the distance from at least one camera 14 to the protrusion point 24 is measured. This distance is then sent in step 220 for initialization.

[0057] If the vehicle is a rigid trailer system 400, the ToF tracking system proceeds to step 212. In step 212, the camera wing system 12 determines if a tag is located at the protrusion point 24. If a tag is present, the camera wing system 12 proceeds to step 218, where the distance from at least one camera 14 to the protrusion point 24 is measured. This distance is then sent in step 220 for initialization. If no tag is detected in step 212, the camera wing system 12 checks the side lights at the protrusion point 24 in step 214. If a side light is present, the camera wing system 12 proceeds to step 218, where the distance from at least one camera 14 to the protrusion point 24 is measured. This distance is then sent in step 220 for initialization. If no side light is detected, the camera wing system 12 detects the axle at the rearmost wheel at the protrusion point 24 in step 216. The camera wing system 12 then proceeds to step 218, where the distance from at least one camera 14 to the protrusion point 24 is measured. This distance is then sent in step 220 for initialization.

[0058] Figure 4aA diagram depicts the modulation angle β (helix angle) for determining at least one camera 14 for the semi-trailer 300 using the leading edge 305 of the semi-trailer 300. The semi-trailer cab 302 supports at least one camera 14. In this configuration, at least one camera 14 is visible only on one side of the semi-trailer cab 302, but it can be located on either side or both sides of the semi-trailer cab 302. The semi-trailer 300 is capable of being positioned in either a first position 304a or a second position 304b. The semi-trailer 300 is in the first position 304a when the trailer angle θ is less than five degrees. When the semi-trailer 300 is in the first position 304a, the image capture device 306 cannot detect the leading edge 305. When the semi-trailer is in the second position 304b, the trailer angle θ is greater than five degrees and at least one camera 14 can detect the leading edge 305.

[0059] Figure 4b An enlarged view depicting an adjustment angle β for at least one camera 14 used to determine the semi-trailer 300 using its leading edge 305 is shown. At least one camera 14 and a camera wing system 12 embedded therein measure a first distance A. The first distance A corresponds to the distance from at least one camera 14 to a marker point 22 along the leading edge 305 of the semi-trailer 300 in a second position 304b. Then, the distance H from at least one camera 14 to a second point along the leading edge 305 of the semi-trailer 300 in the second position 304b is measured. The second point along the leading edge 305 is preferably a point at the edge of the semi-trailer 300. At least one camera 14 is able to distinguish pixels at the end of the leading edge 305 of the trailer 20 and uses that point to determine the distance H. At least one camera 14 uses the marker point 22 to determine an angle θ. The distance H1 is then calculated using the equation H1 = A cos θ. The distance H1 corresponds to the distance from at least one camera 14 to a point where distance L intersects perpendicularly with distance H. Distance L extends from marker point 22 to distance H. Distance H2 extends from the point where distance L intersects perpendicularly with distance H along the leading edge 305 to the second point. Distance H2 is calculated using the equation H2 = H - H1. Distance L is determined using L = Asin θ. Then, the equation... Determine the helix angle β.

[0060] Figure 5A diagram depicts the trailer angle α of at least one camera 14 used to determine the semi-trailer 300 using protrusion point 24. A ToF camera 12 is coupled to the semi-trailer cab 302. Distance bg measures the distance from the image capture device 12 to the rearmost end of the semi-trailer 300 in a first position 304a. Distance bg is a known value. The semi-trailer 300 includes a rotation center 312. The semi-trailer 300 pivots about the rotation center 312, and protrusion point 24 follows a theoretical curve of the rotation circle 310. The rotation center 312 is located at a vertical distance d from the central vehicle axis va to the central front end 309 of the semi-trailer 300 and a horizontal distance e (perpendicular to distance d) between at least one camera 14 and the central front end 309. The vertical distance d and the horizontal distance e are known values. Distance a′ is the distance from the rotation center 312 to the rearmost end of the semi-trailer 300 and is determined using the equation a′ = bg - d. The equation below... Distance a is determined using distance a′ and horizontal distance e. Distance a measures the distance from the rotation center 312 to the protruding point 24 on the semi-trailer 300 located at the second position 304b. Distance c is the distance from at least one camera 14 to the rotation center 312. Distance c can be determined using the equation... This is determined by [the following formula]. Distance b is the distance from at least one camera 14 to the protrusion 24, and is a measurement from at least one camera 14. The angle between distance b and distance a is γ. Angle γ is determined using the equation [equation missing]. To determine this, the trailer angle α is the angle between distance b and distance c, and can be expressed using the equation... To determine this, angle α2 is the angle between distance c and the edge of the semi-trailer cab 302, and can be determined using the equation. The angle α1 is a measurement between distance b and the edge of the semi-trailer cab 302. Angle α1 is determined using the equation ∝1=∝-∝2. Angle α1 is the adjustment angle of at least one camera 14. Distance s represents the distance by which the trailer 300 deviates from its track perpendicular to the central vehicle axis va in the second position 304b compared to the first position 304a.

[0061] Figure 6A diagram depicts the trailer angle α used to determine at least one camera 14 of the rigid trailer 400 using a protrusion 24. The rigid trailer 400 includes a rigid trailer cab 402 supporting at least one camera 14. The rigid trailer 400 is capable of being positioned in a first position 404a or a second position 404b. Distance bg measures the distance from the image capturing device 12 to the rearmost end of the rigid trailer 400 in the first position 404a. Distance bg is a known value. The rigid trailer 400 includes a rotation center 412. The rigid trailer 400 pivots about the rotation center 412, and the protrusion 24 follows a theoretical curve of the rotation circle 410. The rotation center 412 is located at a vertical distance d along the central vehicle axis va to the central front end 409 of the rigid trailer 400 and a horizontal distance e between at least one camera 14 and the central front end 409. The vertical distance d and the horizontal distance e are known values. Distance a′ is the distance from the rotation center 412 to the rearmost end of the rigid trailer 400 and is determined using the equation a′ = bg - d. In the equation below... Distance a is determined using distance a′ and horizontal distance e. Distance a measures the distance from the rotation center 412 to the protrusion 24 on the rigid trailer 400 located at the second position 404b. Distance c is the distance from at least one camera 14 to the rotation center 412. Distance c can be determined using the equation... The distance b is the distance from at least one camera 14 to the protrusion 24, and is a measurement from at least one camera 14. The angle between distance b and distance c is γ. The angle γ is determined using the equation... To determine this, the trailer angle α is the angle between distance b and distance c, and can be expressed using the equation... To determine this, angle α2 is the angle between distance c and the edge of the rigid trailer cab 402, and can be determined using the equation. The angle α1 is a measurement between distance b and the edge of the semi-trailer cab 302. Angle α1 is determined using the equation ∝1=∝-∝2. Angle α1 is the modulation angle of at least one camera 14. Distance s represents the distance by which the trailer 400 deviates from its track perpendicular to the central vehicle axis va in the second position 404b compared to the first position 404a.

[0062] For purposes of illustration and description, the foregoing description of various preferred embodiments has been presented. It is not intended to be exhaustive or to limit this disclosure to the precise forms disclosed; many modifications and variations will be apparent from the foregoing teachings. As stated above, the exemplary embodiments were chosen and described in order to best explain the principles of this disclosure and its practical application, thereby enabling others skilled in the art to best utilize this disclosure in various embodiments and with various modifications suitable for the particular intended use. The features of the invention disclosed in the foregoing description, drawings, and claims are important, either individually or in any combination, for implementation of the invention in its various embodiments.

[0063] List of reference numerals

[0064] 10-Vehicles

[0065] 12-Camera Wing System

[0066] 14 - At least one camera

[0067] 16-Time-of-Flight (TOF) Sensor

[0068] 18-Electronic Control Unit (ECU)

[0069] 19-Image Section

[0070] 20-Trailer / Semi-trailer / Vehicle

[0071] 22-Marker Points

[0072] 24-Highlights

[0073] 90-Tracking System Method

[0074] 100-Methods for operating the camera wing system

[0075] 101-Steering Angle and Speed ​​Measurement

[0076] 102-Determination of steering angle and speed

[0077] 104 – Subprocessing

[0078] 106 – Distance recorded in memory

[0079] 108 – Check if the ignition is on.

[0080] 110 – Check if the trailer signal is interrupted.

[0081] 112 – Measure the distance to the protrusion.

[0082] 114 – Calculated trailer angle

[0083] 116 – Trailer Angle Comparison

[0084] 118 – Image Partial Update

[0085] 202 – Trailer type determined

[0086] 204 – Determine the marker point for the semi-trailer

[0087] 206 – Determine if there is a frontier

[0088] 208 – Calculated helix angle

[0089] 212 – Determine if there is a label

[0090] 214 – Determine if there are side lights

[0091] 216 – Inspecting Wheel Axles

[0092] 218 – Measure the distance to the protrusion.

[0093] 220 – Initialization

[0094] 300 – Semi-trailer

[0095] 302 – Semi-trailer cab

[0096] 304a – Semi-trailer in first position

[0097] 304b – Semi-trailer in second position

[0098] 305 – Leading Edge

[0099] 306 – Image Capture Device

[0100] 308 – Highlight

[0101] 309 – Central front end of a semi-trailer

[0102] 310 – Semi-trailer Rotating Circle

[0103] 312 – Semi-trailer rotation center

[0104] 400 – Rigid Trailer

[0105] 402 – Rigid Trailer Cab

[0106] 404a – Rigid trailer in first position

[0107] 404b – Rigid trailer in second position

[0108] 406 – Image Capture Devices

[0109] 408 – Highlight

[0110] 409 – Central front end of rigid trailer

[0111] 410 – Rigid Trailer Rotating Circle

[0112] 412 – Rigid Trailer Rotation Center

[0113] α – Trailer angle between distances b and c

[0114] α1 – Angle between distance b and the edge of the semi-trailer cab

[0115] α2 – Angle between distance c and the edge of the semi-trailer cab

[0116] β – by The resulting adjustment angle or helix angle.

[0117] γ – Trailer angle between distance b and distance a

[0118] θ – Trailer angle

[0119] a' – Distance from the center of rotation to the rearmost part of the semi-trailer / rigid semi-trailer

[0120] a – Distance from the center of rotation to the protrusion on the semi-trailer / rigid trailer in the second position

[0121] b – Distance from at least one camera to the protrusion point

[0122] c – Distance from at least one camera to the center of rotation

[0123] d – Distance between the center of rotation and the central front end of the semi-trailer / rigid semi-trailer

[0124] e – the distance between at least one camera and the central front end

[0125] s

[0126] bg – Distance from the image capture device to the rearmost part of the semi-trailer / rigid trailer in the first position

[0127] va – Center vehicle axis

[0128] A – First Distance

[0129] L – the distance perpendicular to distance H, where distance L extends from marker 22 to distance H such that L = A sinθ

[0130] H – The distance from camera 14 to the second point along the leading edge 305 of the semi-trailer 300 at the second position.

[0131] H1 - the calculated distance, where H1 = A cosθ

[0132] H2 is the calculated distance, where the equation H2 = H - H1 is used.

Claims

1. A camera wing system (12) for a vehicle (20), comprising At least one camera (14) is used to record the field of view (FOV) of the scene at least around the rear of the vehicle (20), wherein The presented view is provided to the driver of the vehicle (20) as part of the field of view. The camera wing system (12) is adapted to update the image portion (19) from the presentation view of the at least one camera (14) to another presentation view different from the previous presentation view within the presentation view provided to the driver, so as to maintain the focus on the rear of the vehicle (20) regardless of the driving conditions of the vehicle (20), and The image portion (19) is updated based on the first distance (b) between the at least one camera (14) and the geometric calculation of the triangle between the at least one camera (14) of the rotation center (312, 412), the protrusion point (24) and the vehicle (20). The camera wing system (12) only initializes when it detects a straight-ahead situation based on the vehicle's (20) speed data and steering angle in a time frame. in, The second distance (a) between the rotation center (312, 412) and the protrusion (24), and the third distance (c) between the rotation center (312, 412) and the at least one camera (14) are known values ​​that do not depend on the driving conditions of the vehicle (20).

2. The camera wing system (12) for a vehicle (20) according to claim 1 further includes a time-of-flight (ToF) sensor (16) adapted to measure the first distance, wherein the ToF sensor (16) is configured outside the housing of the at least one camera (14) housing the camera wing system (12).

3. The camera wing system (12) for a vehicle (20) according to claim 1, wherein at least one camera (14) and a ToF sensor (16) are configured within the housing of the camera wing system (12).

4. The camera wing system (12) for a vehicle (20) according to claim 1, wherein the at least one camera (14) is adapted to capture FOV and measure the first distance.

5. The camera wing system (12) for a vehicle (20) according to any one of claims 1 to 4, wherein the protrusion (24) of the trailer is a point of interest as a significant part of the vehicle (20) being detected.

6. The camera wing system (12) according to any one of claims 1 to 4, wherein the point of interest is a significant portion of the vehicle (20) that is detected.

7. The camera wing system (12) according to claim 6, wherein the unique portion detected by the vehicle (20) is at least one of the unique features and markings attached to the vehicle (20).

8. The camera wing system (12) according to claim 7, wherein the distinctive features include at least one of the vehicle's (20) final axle, label, and side lights.

9. The camera wing system (12) according to any one of claims 1 to 4, wherein the protrusion (24) is detected by means of suitable optical recognition software installed and executed on the control unit (18) of the camera wing system (12).

10. The camera wing system (12) according to any one of claims 1 to 4, wherein the system (12) needs to be initialized after the straight-line condition.

11. The camera wing system (12) according to any one of claims 1 to 4, wherein the system (12) requires initialization after a restart or after attaching a new trailer.

12. The camera wing system (12) according to claim 1, wherein information about any changes in the ignition state is recorded, and in this case, reinitialization is performed to measure the distance to the protrusion.

13. The camera wing system (12) according to any one of claims 1 to 4, wherein the system (12) detects a straight-line situation when the distance between the first camera (12) and at least one protrusion (24) on the first side and the distance between the second camera (12) and at least one protrusion (24) on the second side are at a predefined distance calibrated for a straight-line situation.

14. A vehicle (20) comprising a camera wing system (12) as described in any of the preceding claims.

15. A method (100) for operating a camera wing system (12) mounted on a vehicle (20) including at least one camera (14), comprising the following steps: The field of view (FOV) is recorded by at least one camera (14) in the scene surrounding at least the rear of the vehicle (20), wherein Provide the driver of the vehicle (20) with a view presented as part of the field of view (FOV). The camera wing system (12) is adapted to update the image portion (19) from the presentation view of the at least one camera (14) to another presentation view different from the previous presentation view within the presentation view provided to the driver, so as to maintain the focus on the rear of the vehicle (20) regardless of the driving conditions of the vehicle (20), and Image partial updates are performed based on the first distance (b) between the at least one camera (14) and the geometric calculation of the triangle between the rotation center (312), the protrusion point (24), and the vehicle (20) of the at least one camera (14). The camera wing system initialization begins only when a straight-ahead situation is detected based on the vehicle's (20) speed data and steering angle in a time frame. The second distance (a) between the rotation center (312, 412) and the protrusion (24), and the third distance (c) between the rotation center (312, 412) and the at least one camera (14) are known values ​​that do not depend on the driving conditions of the vehicle (20).

16. A method of operating a tracking system, comprising the method of claim 15.

Citation Information

Patent Citations

  • Systems and methods for towing vehicle and trailer with surround view imaging devices

    US20170341583A1