Camera-based system and method for determining and verifying trailer location

Abstract

To provide a camera-based system and method that are suitable for commercial vehicles having a semi-trailer, a trailer, or another unit, which is rotatable and extends rearward, relative to a driver's cab or tractor unit.SOLUTION: A camera-based system for a vehicle having a towing unit and a trailer (5) extending rearward and rotatable includes: at least one image capture means located in the towing unit and having an image sensor for capturing time-successive camera images (6) of the trailer (5); at least one display means for displaying the camera images (6) captured by the at least one image capture means; and at least one processing means for executing a method for verifying information regarding a position of a trailer end received from an external method, to determine and verify the trailer end.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to a camera-based system (viewing system or mirror replacement system) and method for determining and verifying the position of a trailer edge that extends rearward from the vehicle and is pivotable relative to the vehicle, the camera-based system and method being suitable for commercial vehicles having semi-trailers, trailers, or other units that are pivotable and extend rearward relative to the cab or tractor unit. [Background technology]

[0002] Drivers of vehicles equipped with tractor units or towing units with trailers extending rearward and pivotable relative to the units typically rely on side mirrors mounted on the sides of the towing units to view traffic behind them. These side mirrors are increasingly being replaced by camera systems, such as camera monitor systems, or by mirror replacement systems mounted on the sides or rear of the vehicle. These side mirrors replace or supplement traditional mirror systems provided for motor vehicles, such as exterior and rearview mirrors on automobiles and wide-angle and front mirrors on commercial vehicles.

[0003] In the above-described system, for example, the corresponding field of view, which was conventionally viewed through a mirror, is always displayed in real time to the vehicle driver, for example, on an in-vehicle monitor or other display device, so that the vehicle driver does not directly view the corresponding field of view and can always view the corresponding field of view even without having a mirror.

[0004] A trailer in the sense of the present teaching includes a trailer that is connected to a vehicle (tractor or towing unit) by a trailer coupling, for example a semi-trailer (so-called trailer), that is located in the lowered area at the rear of the tractor unit and that is connected so as to be rotatable about at least one vertical axis. Alternatively, such a trailer may be a trailer attached to a passenger car, in which case the passenger car corresponds to the tractor unit. In general, a trailer is a rear extension of a vehicle that is located rearward relative to the cab, that is movable (rotatable) laterally relative to the cab, and that rotates about an axis perpendicular to the cab when cornering. Articulated trucks and articulated trains are also trailers in the sense of the present invention.

[0005] However, when using such a mirror replacement system, the greater the buckling angle (kink angle or bending angle) between the towing unit and the trailer when the vehicle equipped with the towing unit and trailer is cornering, the more rear traffic will be hidden in the image of the mirror replacement system for field of view class II of the ECE R46 regulation. Furthermore, the rear of the trailer may be lost (disappear) near the rear axle, which may cause the end of the trailer to disappear from the monitor image displayed to the driver.

[0006] To solve this problem, several methods already exist for tracking the trailer edge and shifting the image portion displayed on the monitor so that the trailer edge is displayed as centered as possible in the monitor image. According to EP 16 198 485, this tracking of the trailer edge is currently performed, for example, by vehicle sensors that acquire information about the rotational movement of the wheels. This information is analyzed by a control unit to determine the area behind the rear extension and track it appropriately based on the acquired information about the rotational movement of the wheels. However, since these sensors can only provide reliable signals above a certain speed, e.g., approximately 2 km / h, such tracking of the trailer edge can only be performed when driving forward at high speeds. These sensors cannot be used when driving backward or at low speeds, because they cannot detect the trailer edge with sufficient accuracy to track (update) the trailer edge in the monitor image. Furthermore, the accuracy of known methods for tracking the trailer edge requires corrections. Summary of the Invention [Problem to be solved by the invention]

[0007] A first object of the present invention is to validate the method for tracking the trailer ends, i.e., to perform a plausibility check to see whether the trailer ends obtained or determined for tracking are acceptable.

[0008] A second object of the present invention is to overcome the above-mentioned problems and to detect the position of the trailer end with sufficient accuracy during driving operations, such as reversing or at low speeds, in order to track (update) it in the monitor image independently of the type of trailer and the information acquired by the installed sensors. [Means for solving the problem]

[0009] The above mentioned object is solved by a method having the features of claims 1 and 13 and by a system having the features of claims 10 and 19. Advantageous further developments of the invention are set out in the dependent claims.

[0010] A method for validating a trailer end tracking method according to the present invention receives information about the position of the trailer end of a trailer extending rearward from a towing unit of a vehicle and rotatable relative to the towing unit from the trailer end tracking method, but the tracking method needs to be validated. The method according to the present invention involves capturing camera images of the side area of ​​the trailer by an image sensor of at least one image capture device mounted on the vehicle, preferably the towing unit, and determining so-called feature points in the captured camera images based on one or more image parameters, where one feature point corresponds to at least one pixel or pixel cluster in the camera image. A pixel in the camera image can be determined as a feature point, for example, if the value of the image parameter of this pixel differs by a predetermined value from the value of the corresponding image parameter of one or more neighboring pixels.

[0011] For example, adjacent pixels forming a pixel cluster may be compared with adjacent or nearby pixel clusters with respect to at least one image parameter to determine feature points. The pixels or pixel clusters do not need to be directly adjacent, but only need to be spatially close.

[0012] The feature points are determined based on, for example, one or more image parameters, at least calculated amounts of the one or more image parameters, and / or their gradients, where one feature point corresponds to at least one pixel in the camera image. A pixel in the camera image can be determined as a feature point if, for example, the value of the image parameter of this pixel differs from the value of the corresponding image parameter of one or more neighboring pixels by a predetermined value.

[0013] For example, further nearby pixels forming a pixel cluster can be compared with adjacent or nearby pixel clusters with respect to at least one image parameter to determine feature points. The pixels or pixel clusters do not need to be directly adjacent, they just need to be spatially close.

[0014] The method then generates a block grid over at least a portion of the captured camera image, the block grid having a plurality of columns and rows defining cells. By creating the block grid over the camera image that includes the determined feature points, a distribution of a plurality of feature points is defined across a plurality of cells of the block grid.

[0015] The method according to the present invention then compares the generated block grid having the distribution of feature points with the distributions of feature points of a plurality of corresponding stored block grids, each of which defines a different distribution of feature points along with the location of the actual trailer end. Based on the correlation between the distribution of feature points of the generated block grid and the distribution of feature points of the stored block grids, one of the stored block grids having information about the actual trailer end is selected and used to verify the received information about the trailer end.

[0016] According to an advantageous embodiment of the method according to the invention, the generated block grid feature points are weighted, for example based on the contrast difference between a pixel or pixel cluster and an adjacent pixel or pixel cluster or a neighboring pixel or pixel cluster, and based on one or more known image parameters.

[0017] According to a further advantageous embodiment of the method according to the invention, the received information about the trailer end can be corrected on the basis of the above-mentioned verification, for example if the deviation exceeds a preset threshold value.

[0018] According to a further advantageous embodiment of the method according to the invention, the distribution of feature points and the corresponding trailer end positions within the stored block grid can be stored in advance or can be generated and stored in real time, for example during forward travel, at fixed or dynamically adjustable time intervals.

[0019] According to a further advantageous embodiment of the method according to the invention, the different distributions of the feature points in the stored block grid depend on the buckling angle or on the relative position of the trailer and the towing unit, which are stored together with the block grid and are part of the block grid. Such buckling angle or relative position can be determined independently from camera images taken, for example by a buckling angle sensor mounted on the vehicle, or can be estimated from data received from a steering angle sensor. The corresponding buckling angle can be stored together with the block grid.

[0020] According to an advantageous embodiment of the method, the image parameters are for example brightness values, color values, gray tones or at least one of these gradients, and before determining the feature points in the camera image, the camera image is left unprocessed or is suitably processed to make contrast differences, brightness differences, etc. more visible. Other image parameters not explicitly mentioned here are also conceivable.

[0021] According to a further advantageous embodiment of the method according to the invention, the tracking method for the position of the trailer end that needs to be verified may be a radar-based method, an ultrasound-based method, a LiDAR-based method, a CAN-based method and / or an optical method.

[0022] A method for determining the trailer end of a trailer extending rearward from a towing unit of a vehicle and rotatable relative to the towing unit includes acquiring a camera image of the trailer and determining a plurality of feature points in the camera image based on at least one image parameter, with one feature point corresponding to at least one pixel in the camera image. Similar to the above-described verification method of the present invention, the method further includes creating a block grid on at least a portion of the captured camera image, the block grid defining a plurality of cells, and determining a distribution of the plurality of feature points across the plurality of cells of the block grid. By comparing the distribution of feature points of the created block grid with the distributions of feature points of a plurality of corresponding stored block grids, each of the stored block grids defines a different distribution of feature points with the actual trailer end, and from the stored block grids, the block grid that most closely correlates with the created block grid can be selected. Information about the trailer end stored with or associated with the selected block grid is determined as the trailer end in accordance with the present invention.

[0023] According to a further advantageous embodiment of the method according to the invention, the distribution of feature points and the corresponding trailer edges in the block grid can be stored in advance or can be generated and stored in real time at fixed or dynamically adjustable time intervals. For example, this can be done while driving forward. The stored block grid can then be used when driving slowly backward to determine the trailer edges.

[0024] According to a further advantageous embodiment of the method according to the invention, the different distribution of the feature points in the block grids stored together with the corresponding trailer end depends on the buckling angle between the trailer and the towing unit or on the relative position of the trailer and the towing unit. Information about the buckling angle and / or the relative position can be stored, for example, with each block grid. That is, if the current buckling angle, e.g., acquired by a sensor on the vehicle, is known, the stored block grid corresponding to this buckling angle can be found directly, and the trailer end defined in this stored block grid can be determined as the position of the trailer end.

[0025] According to a further advantageous embodiment of the method according to the invention, the determination of the trailer edge can be applied to successive camera images in time, and the tracking of the trailer edge can be carried out in such a way that when cornering the position of the trailer edge is displayed to the driver in a preferred position in the monitor image, for example in the center of the monitor image or at a position offset to the left or right of the center by ±10% to ±25%.

[0026] According to a further advantageous embodiment of the method according to the invention, the trailer end determined in this way can be verified by the verification method described above.

[0027] The system according to the present invention for verifying and determining the trailer end is a camera-based system for a vehicle having a towing unit and a rotatable trailer extending to the rear, comprising at least one image capturing means having an image sensor for acquiring time-sequential camera images of the trailer, and at least one processing means configured to carry out the above-mentioned method according to the present invention for verifying and determining the trailer end.

[0028] The system according to the invention optionally comprises display means by which the position of the trailer end is displayed on a monitor image.

[0029] According to an advantageous embodiment, the camera-based system according to the invention is a mirror replacement system approved according to UN ECE R46, preferably for commercial vehicles.

[0030] It may be provided in the following manner. [Aspect 1] 1. A method for validating a trailer end tracking method, comprising: receiving information from said trailer end tracking method relating to the position of at least a trailer end (12) of a trailer (5) extending rearward from a towing unit (4) of a vehicle and rotatable relative to said towing unit (4); capturing a camera image (6) of at least a side area of ​​the trailer by an image sensor of at least one image capturing means (2); determining a plurality of feature points (8) in the camera image (6) based on at least one image parameter, each feature point (8) corresponding to at least one pixel in the camera image (6); generating a block grid (10) defining a plurality of cells (11) in at least a portion of the captured camera image (6), and determining a distribution of the plurality of feature points (8) on the plurality of cells (11) of the block grid (10) as part of the generated block grid (10); comparing the distribution of feature points (8) within the generated block grid (10) with distributions of feature points in a plurality of corresponding stored block grids, each of the stored block grids defining a different distribution of feature points along with an actual trailer end; selecting one of the stored block grids based on a correlation between the distribution of feature points (8) in the generated block grid (10) and the distribution of feature points in the stored block grids; and verifying the received information regarding the position of the trailer end (12) by comparing the actual position of the trailer end (12) defined by the selected block grid with the received information regarding the position of the trailer end. [Aspect 2] In the method of embodiment 1, The method further includes modifying the received information regarding the position of the trailer end (12) based on the verification. [Aspect 3] In the method of embodiment 1 or 2, The method wherein the distribution of the feature points and the corresponding trailer ends within the stored block grid are pre-stored or are generated and stored in real time at fixed or dynamically adjustable time intervals. [Aspect 4] 2. The method according to any one of the preceding aspects, wherein the distribution of feature points in one of the stored block grids differs from the distribution of feature points in other of the stored block grids depending on the relative positions of the trailer (5) and the towing unit (4). [Aspect 5] 2. The method according to any one of the preceding aspects, The method, wherein the at least one image parameter is at least one of a luminance value, a color value, a gray tone, a contrast value, and / or a calculation from one of these values ​​and / or a gradient thereof for pixels and / or pixel clusters in the camera image (6). [Aspect 6] 2. The method according to any one of the preceding aspects, The method, wherein the method of tracking (updating) the position of the trailer end is a radar-based method, an ultrasound-based method, a LiDAR-based method, a CAN-based method, and / or an optical method. [Aspect 7] 2. The method according to any one of the preceding aspects, The method, wherein the feature points (8) correspond to a single pixel, a small number of directly adjacent pixel clusters, or pixel clusters that are close to each other. [Aspect 8] 2. The method according to any one of the preceding aspects, The method wherein the corresponding actual trailer end defined within the stored block grid is obtained from another method. [Aspect 9] 2. The method according to any one of the preceding aspects, A method comprising the step of tracking (updating) the position of the trailer end so that the trailer end appears in a preferred position within a monitor image of at least one display means (1) of a camera-based system. [Aspect 10] 1. A camera-based system for a vehicle having a towing unit (4) and a trailer (5) extending rearward from the towing unit (4) and rotatable relative to the towing unit (4), at least one image capture means (2) mounted on the towing unit (4) and having at least one image sensor for capturing time-sequential camera images (6) of the trailer (5); and at least one processing means configured to perform the method according to any one of aspects 1 to 8. [Aspect 11] 12. The camera-based system of claim 10, Further comprising at least one display means (1), The at least one display means (1) displays camera images (6) taken by the at least one image capture means (2) so that the trailer end appears in a preferred position in the monitor image of the display means (1), and tracks the position of the trailer end in successive camera images (6) over time depending on the position of the trailer (5) relative to the image sensor that acquires the camera images (6). [Aspect 12] 12. The camera-based system according to claim 10 or 11, Camera-based system approved according to UN ECE R46. [Aspect 13] 1. A method for determining a trailer end of a trailer (5) extending rearward from a towing unit (4) of a vehicle and rotatable relative to the towing unit (4), comprising: capturing a camera image (6) of said trailer (5) by an image sensor of at least one image capturing means (2); determining a plurality of feature points (8) in the camera image (6) based on at least one image parameter, each feature point (8) corresponding to at least one pixel in the camera image (6); creating a block grid (10) defining a plurality of cells (11) in at least a portion of the captured camera image (6), and determining a distribution of the plurality of feature points (8) on the plurality of cells (11) of the block grid (10) as part of the created block grid (10); comparing the distribution of the feature points (8) within the created block grid (10) with distributions of feature points in a plurality of corresponding stored block grids, each of the stored block grids defining a different distribution of feature points along with the actual location of the trailer end; selecting one of the stored block grids based on a correlation between feature points (8) in the created block grid (10) and the feature points of the stored block grids; determining the location of the trailer end defined as the end of the trailer (5) within the selected block grid. [Aspect 14] 14. The method of claim 13, The method wherein the distribution of the feature points and the corresponding trailer ends within the stored block grid is pre-stored or is generated and stored in real time at fixed or dynamically adjustable time intervals. [Aspect 15] 15. The method of claim 13 or 14, The method, wherein the at least one image parameter is at least one of a luminance value, a color value, a gray tone, a contrast value, and / or a calculation from one of these values ​​and / or a gradient thereof for pixels and / or pixel clusters in the camera image (6). [Aspect 16] The method according to any one of aspects 13 to 15, wherein the determined trailer end is verified by the method according to any one of aspects 1 to 9. [Aspect 17] 17. The method according to any one of aspects 13 to 16, A method wherein the corresponding actual positions of trailer ends defined within the stored block grid are obtained from another method. [Aspect 18] 18. The method according to any one of aspects 13 to 17, The method further comprises a step of tracking (updating) the position of the trailer end in successive camera images (6) over time depending on the position of the trailer (5) relative to an image sensor acquiring the camera images (6) so that the trailer end appears in a preferred position in a monitor image on a display means (1) of a camera-based system. [Aspect 19] 1. A camera-based system for a vehicle having a towing unit (4) and a trailer (5) extending rearwardly from the towing unit (4) and rotatable relative to the towing unit (4), comprising: at least one image capture means (2) located on the towing unit (4) and having an image sensor for acquiring time-sequential camera images (6) of the trailer (5); and at least one processing means (3) configured to perform the method according to any one of aspects 13 to 18. [Aspect 20] A camera-based system, at least one display means; A camera-based system, wherein the at least one display means (1) displays camera images (6) taken by the at least one image capture means (2) so that the trailer end appears in a preferred position in the monitor image of the display means (1), and tracks (updates) the position of the trailer end in successive camera images (6) over time depending on the position of the trailer (5) relative to the image sensor that acquires the camera images (6). [Aspect 21] 21. A camera-based system according to claim 19 or 20, Camera-based system approved according to UN ECE R46. [Brief explanation of the drawings]

[0031] The present invention will now be described, by way of example only, with reference to the accompanying drawings in which like reference numerals indicate the same or similar elements, in which:

[0032] [Figure 1] FIG. 1 is a schematic diagram of a camera-based system according to a preferred embodiment of the present invention.

[0033] [Figure 2] FIG. 2 is a top view of a vehicle using the camera-based system of FIG.

[0034] [Figure 3] FIG. 3 shows a camera image captured by the camera system of FIG.

[0035] [Figure 4] FIG. 4 shows a camera image according to FIG. 3 to illustrate the determination of feature points.

[0036] [Figure 5] FIG. 5 shows the camera image of FIG. 4 with a block grid according to a preferred embodiment of the present invention.

[0037] [Figure 6] FIG. 6 shows cells of the block grid of FIG. 3 with feature points according to a preferred embodiment of the present invention.

[0038] [Figure 7] FIG. 7 shows the camera image according to FIG. 3 displayed on a monitor as a monitor image with the position of the trailer end tracked (updated). DETAILED DESCRIPTION OF THE INVENTION

[0039] FIG. 1 shows a camera-based system according to a preferred embodiment of the present invention, comprising display means 1a, 1b, image capture means 2a, 2b and processing means 3a, 3b.

[0040] The image acquisition means 2a, 2b are preferably arranged on opposite sides of the vehicle and connected to the display means 1a, 1b via processing means 3a, 3b. The image acquisition means 2a, 2b are arranged on opposite sides of the vehicle, for example as shown in Figure 2. The processing means 3a, 3b according to a preferred embodiment comprise, for example, buckling angle determination means and image data processing means (not described in further detail) and are in particular able to execute the inventive method for determining the position of the trailer end and for tracking (updating) and correcting the trailer end on the display means 1a, 1b as will be described below.

[0041] For simplicity, only the display means 1a, the image capture means 2a and the processing means 3a will be described. However, the following description equally applies to the display means 1b, the image capture means 2b and the processing means 3b on the opposite side of the vehicle. Furthermore, according to a preferred embodiment, only one processing unit may be provided which performs the functions of the processing means 3a and 3b.

[0042] As shown in Fig. 2, the vehicle includes, for example, a towing vehicle 4 and a trailer 5 rotatably attached to the towing vehicle 4. The image capturing means 2a has a recording area that covers a display area or field of view equivalent to "Main Mirror (Large) Group II" according to the ECE-R46 regulation. The image capturing means 2a may also cover other appropriately defined fields of view based on national regulations.

[0043] FIG. 2 shows a state in which there is no buckling angle between the towing vehicle 4 and the trailer 5 and the vehicle is traveling straight ahead. When cornering, a buckling angle occurs between the towing vehicle 4 and the trailer 5, and as the buckling angle increases, the rear end of the trailer 5 shifts (moves) into the field of view of the image capturing means 2a. FIG. 3 shows a camera image 6 captured by the image capturing means 2a, and as the buckling angle increases, the end of the trailer 5 becomes more likely to obscure rearward traffic. The image capturing means 2a can capture a series of images that are continuous in time.

[0044] Figure 3 shows a camera image 6 taken by the camera-based system of Figure 1 as a monitor image of a trailer 5 displayed on a monitor with traffic 7 behind it. Figure 4 serves to illustrate the determination of feature points 8 within this camera image 6.

[0045] According to a preferred embodiment of the method of the present invention for verifying a trailer end or trailer edge in a camera image 6, a plurality of feature points 8 are determined in a two-dimensional camera image 6 having coordinate axes x and y, as shown in FIG. 4. Each feature point 8 corresponds to one or more pixels in a pixel cluster. FIG. 4 shows a pixel field 9 in a close-up view of a portion of the camera image 6. According to a preferred embodiment, pixels adjacent to, for example, pixels 1-5, are determined to be feature points if they have a predetermined contrast difference with at least some of their neighboring pixels. Other image parameters for determining whether a pixel is a feature point may alternatively or additionally be used.

[0046] According to a preferred embodiment of the method of the present invention, the feature points 8 determined in Fig. 4 may be weighted to emphasize or better determine their contrast differences with neighboring or spatially nearby pixels. The weighting parameter may be, for example, the speed at which the feature points change (move) relative to the towing vehicle; i.e., points that do not change or only change slightly with respect to their position on the image sensor are weighted higher, for example, as they are assumed to be moving with the vehicle and therefore located on the trailer. For further processing by the method of the present invention, only feature points that meet or exceed a certain weighting are used, thereby eliminating the need to use all feature points and saving computational capacity.

[0047] According to a preferred embodiment of the method according to the invention, a block grid 10 is generated on at least a portion of the camera image 6, as shown in Figure 5. An initial block grid 10 may be generated, for example, using the starting point 0 shown in Figure 4. The block grid 10 includes a number of columns and rows that define a number of cells 11. In the block grid 10 of Figure 5, the number of columns differs from the number of rows. In principle, grid layouts other than rectangular cells can also be used. Figure 5 also shows the trailer edge to be verified, indicated by a vertical line 12, which may be obtained, for example, by an external method for determining the trailer edge.

[0048] According to a preferred embodiment of the method of the present invention, the distribution of the plurality of feature points 8 determined in the above-described manner is determined over a plurality of cells 11. For example, the cell 11 shown in FIG. 14 contains two feature points 8. The distribution of feature points over the cells of the generated block grid 10 is then compared with the distribution of feature points in a plurality of corresponding stored block grids (not shown). Each stored block grid defines a different distribution of feature points along with the position and buckling angle of the actual trailer end. According to a preferred embodiment of the method of the present invention, the corresponding stored block grid defining the actual trailer end is selected based on the buckling angle and the correlation between the distribution of feature points in the generated block grid and the stored block grid. This actual trailer end can be verified by comparing it with a previously determined (input) trailer end and, if necessary, rejected or corrected.

[0049] According to a preferred embodiment of the method of the present invention, during the implementation of the method, the distribution of feature points and the corresponding (actual) trailer ends within the stored block grid may be pre-stored or may be generated and stored in real time at fixed or dynamic time intervals.

[0050] According to a preferred embodiment of the method of the present invention for determining the position of the trailer edge, in addition to the distribution of feature points on the cells, a block grid is used in which information about the trailer edge positions is stored, so that the trailer edge can be determined even when there is no trailer edge position to verify when comparing the generated block grid with the stored block grid, and the trailer edge can also be used for tracking the center in the camera image as described above.

[0051] 7 shows the tracked (updated) position of the trailer edge in camera image 6 at a preferred position within the displayed monitor image. This preferred position may be, for example, the center of the monitor image or a position offset 0%-25% to the left or right of the center. The preferred position may also be offset 0%-25% from the left or right edge of the monitor image.

[0052] It is emphasized that all features disclosed in the specification and / or claims are understood to be separate and independent from one another, not only for the purposes of the original disclosure, but also for the purposes of limiting the claimed invention independently of any combination of features in the embodiments and / or claims. The designation of ranges or groups of units expressly includes any intermediate values ​​or subgroups of units, not only for the purposes of the original disclosure, but also for the purposes of limiting the claimed invention, and in particular for the purposes of limiting the range. [Explanation of symbols]

[0053] 0: starting point 1a, 1b: Display means 2a, 2b: image capturing means 3a, 3b: Processing means 4: Towing vehicle or towing unit 5: Trailer 6: Camera image 7: Rear traffic 8: Feature points 9: Pixel field 10: Block grid 11: Cell 12: Line indicating the trailer end to be verified

Claims

1. A method for validating a trailer end tracking method, performed by at least one processing means, comprising: receiving information from said trailer end tracking method relating to the position of at least a trailer end of a trailer extending rearwardly from a towing unit of a vehicle and rotatable relative to said towing unit; capturing a camera image of at least a side area of ​​the trailer by an image sensor of at least one image capturing means; determining a plurality of feature points in the camera image based on at least one image parameter, each feature point corresponding to at least one pixel in the camera image; generating a block grid defining a plurality of cells in at least a portion of the captured camera image, and determining a distribution of the plurality of feature points on the plurality of cells of the block grid as part of the generated block grid; comparing the distribution of feature points within the generated block grid with distributions of feature points in a plurality of corresponding stored block grids, each of the stored block grids defining a different distribution of feature points along with the actual location of the trailer end; selecting one of the stored block grids based on a correlation between the distribution of feature points in the generated block grid and the distribution of feature points in the stored block grid; and verifying the received information regarding the position of the trailer end by comparing the actual position of the trailer end defined by the selected block grid with the received information regarding the position of the trailer end.

2. 10. The method of claim 1, The method further includes modifying the received information regarding the position of the trailer end based on the verification.

3. 10. The method of claim 1, The distribution of the feature points and the corresponding locations of the trailer ends within the stored block grid are pre-stored or are generated and stored in real time at fixed or dynamically adjustable time intervals.

4. 10. The method of claim 1, wherein the distribution of feature points within one of the stored block grids differs from the distribution of feature points within other of the stored block grids depending on the relative positions of a trailer and a towing unit.

5. 10. The method of claim 1, 10. The method of claim 9, wherein the at least one image parameter is at least one of a luminance value, a color value, a gray tone, a contrast value, and / or a calculated quantity from one of these values ​​and / or a gradient thereof for a pixel and / or a pixel cluster in a camera image.

6. 10. The method of claim 1, The method, wherein the method of tracking (updating) the position of the trailer end is a radar-based method, an ultrasound-based method, a LiDAR-based method, a CAN-based method, and / or an optical method.

7. 10. The method of claim 1, A method in which an interest point corresponds to a single pixel, a small number of immediately adjacent pixel clusters, or pixel clusters that are close to each other.

8. 10. The method of claim 1, The method wherein the corresponding actual trailer end defined within the stored block grid is obtained from a method for determining the location of the trailer end.

9. 10. The method of claim 1, A method comprising the step of tracking or updating the position of the trailer end so that the trailer end appears in a preferred position within a monitor image of at least one display means of a camera-based system.

10. 1. A camera-based system for a vehicle having a towing unit and a trailer extending rearwardly from the towing unit and rotatable relative to the towing unit, comprising: at least one image capture means provided on the towing unit and having at least one image sensor for capturing time-sequential camera images of the trailer; and at least one processing means configured to perform the method of claim 1.

11. 11. The camera-based system of claim 10, further comprising at least one display means; A camera-based system in which the at least one display means displays camera images captured by the at least one image capturing means so that the trailer end appears in a preferred position within the monitor image of the display means, and tracks the position of the trailer end within successive camera images over time depending on the position of the trailer relative to the image sensor that captures the camera images.

12. 11. The camera-based system of claim 10, Camera-based system approved according to UN ECE R46.

13. A method for determining the position of a trailer end of a trailer extending rearwardly from a towing unit of a vehicle and rotatable relative to the towing unit, the method being carried out using at least one processing means, comprising: capturing a camera image of said trailer by an image sensor of at least one image capturing means; determining a plurality of feature points in the camera image based on at least one image parameter, each feature point corresponding to at least one pixel in the camera image; creating a block grid defining a plurality of cells in at least a portion of the captured camera image, and determining a distribution of the plurality of feature points on the plurality of cells of the block grid as part of the created block grid; comparing the distribution of feature points within the created block grid with distributions of feature points in a plurality of corresponding stored block grids, each of the stored block grids defining a different distribution of feature points along with the actual location of the trailer end; selecting one of the stored block grids based on a correlation between the distribution of the feature points in the created block grid and the distribution of the feature points of the stored block grids; determining the location of the trailer end defined as the end of the trailer within the selected block grid.

14. 14. The method of claim 13, The distribution of the feature points and the corresponding locations of the trailer ends within the stored block grid are either pre-stored or are generated and stored in real time at fixed or dynamically adjustable time intervals.

15. 14. The method of claim 13, 10. The method of claim 9, wherein the at least one image parameter is at least one of a luminance value, a color value, a gray tone, a contrast value, and / or a calculated quantity from one of these values ​​and / or a gradient thereof for a pixel and / or a pixel cluster in a camera image.

16. 14. The method of claim 13, The method of claim 1 , wherein the determined trailer end is verified by the method of claim 1 .

17. 14. The method of claim 13, The method, wherein the corresponding actual position of the trailer end defined within the stored block grid is obtained from a method for determining the position of the trailer end.

18. 14. The method of claim 13, The method further includes a step of tracking (updating) the position of the trailer end in successive camera images over time depending on the position of the trailer relative to an image sensor that acquires the camera images so that the trailer end appears in a desired position in the monitor image of a display means of a camera-based system.

19. 1. A camera-based system for a vehicle having a towing unit and a trailer extending rearwardly from the towing unit and rotatable relative to the towing unit, comprising: at least one image capture means located on the towing unit and having an image sensor for acquiring time-sequential camera images of the trailer; and at least one processing means configured to perform the method of claim 13.

20. The camera-based system of claim 19, at least one display means; A camera-based system in which the at least one display means displays camera images captured by at least one image capturing means so that the trailer end appears in a preferred position within the monitor image of the display means, and tracks (updates) the position of the trailer end within successive camera images over time depending on the position of the trailer relative to the image sensor that captures the camera images.

21. 20. The camera-based system of claim 19, Camera-based system approved according to UN ECE R46.

22. 21. The camera-based system of claim 20, Camera-based system approved according to UN ECE R46.

Images