METHOD FOR ENTERING A ROUTE FOR A VEHICLE AND TRAILER

The system uses imaging and GPS sensors to generate an aerial view for intuitive trailer path input, addressing visibility and maneuvering challenges by enhancing path planning and stability during reversing maneuvers.

DE102015215573B4Active Publication Date: 2026-11-19FORD GLOBAL TECH LLC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
DE102015215573
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2014-08-14
Filing Date
2015-08-14
Publication Date
2026-11-19
Estimated Expiration
2035-08-14

AI Technical Summary

Technical Problem

Operating a vehicle towing a trailer is challenging due to visibility and route planning difficulties, especially with large trailers where the field of vision behind the trailer is obstructed, and slight steering adjustments can cause the coupling angle to bend, making maneuvering difficult.

Method used

A system utilizing multiple imaging devices on the vehicle and trailer to capture comprehensive image data, combined with GPS and inertial sensors, generates an aerial view on a display for intuitive path input, allowing operators to trace a reversing path and adjust it to avoid obstacles and maintain a stable coupling angle.

Benefits of technology

Enhances trailer maneuverability by providing a clear, interactive display for path planning, reducing the risk of jackknife conditions and improving the accuracy of reversing maneuvers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for inputting a route, comprising the following steps: generating (176) an aerial view of a vehicle (10) and a trailer (12) based on at least one image data and satellite image data; displaying (178) the aerial view on a display (13) with a touchscreen (86); and registering (180) a touch event on the touchscreen (86) that inputs an intended route for the vehicle (10) and the trailer (12), wherein the intended route is tracked, and wherein the intended route has different tracked sections corresponding to unobstructed sections (162) and obstructed sections (164), and unobstructed sections (162) of the intended route are displayed in a first color and obstructed sections (164) of the intended route are displayed in a second color.
Need to check novelty before this filing date? Find Prior Art

Description

The present invention relates generally to driver assistance and active safety technologies for vehicles, and in particular to methods for inputting an intended path of a vehicle and a trailer using a display. Operating a vehicle towing a trailer is a significant challenge for many drivers. Therefore, there is a need for a system that allows users to input their intended route in a simple yet intuitive way. Prior art documents DE 10 2012 222 972 A1 and DE 10 2009 012 253 A1 describe a method for inputting a path, which comprises the following steps: generating an aerial view of a vehicle and a trailer based on at least one set of image data and satellite image data; displaying the aerial view on a touchscreen display; and registering a touch event on the touchscreen that inputs an intended path for the vehicle and the trailer. A procedure with the features of independent claims is provided. According to one aspect of the present invention, a method for inputting a reversing path is provided. The method comprises the steps of generating an aerial view of a vehicle and a trailer, based at least on image data and satellite image data, displaying the aerial view on a display with a touchscreen, and registering a touch event on the touchscreen that inputs an intended reversing path for the vehicle and the trailer. According to a further aspect of the present invention, a method for inputting a reversing path is provided. The method comprises the steps of generating an aerial view of a vehicle and a trailer, displaying the aerial view on a touchscreen, and registering a second touch event on the touchscreen that inputs a modification of the intended reversing path. According to yet another aspect of the invention, a method for inputting a reversing path is provided. The method comprises the steps of generating an aerial view of a vehicle and a trailer, displaying the aerial view on a touchscreen, and performing a first touch event on the touchscreen that inputs an intended reversing path for the vehicle and the trailer. These and other aspects, objects and features of the present invention will be understood and recognized by those skilled in the art when they carefully consider the following description, the following claims and the accompanying drawings. In the drawings: Fig. 1 is a schematic diagram representing the imaging devices arranged on a vehicle or a trailer attached to the vehicle; Fig. 2 represents an imaging device according to one embodiment; Fig. 3 is a top view of the vehicle connected to the trailer, showing a plurality of fields of view corresponding to the imaging devices; Fig. 4 is a block diagram of a controller communicating with the imaging device and other equipment; Fig. 5 is a diagram of an aerial view of the vehicle and trailer displayed on a screen located inside the vehicle; Fig. 6 represents a path input screen displayed on the screen; Fig. 7 represents a touch event registered on the path input screen to input an intended reverse path; Fig.Figure 8 represents an intended return path that passes through an obstacle; Figure 9 represents a contact event that modifies the intended return path; Figure 10 represents a path selection screen that displays suggested return paths; and Figure 11 is a flowchart for a procedure for inputting a return path. Where necessary, detailed embodiments of the present invention are disclosed herein. However, it should be understood that the disclosed embodiments are merely exemplary of the invention, which can be implemented in various and alternative forms. The drawings are not necessarily detailed, and some functional drawings may be exaggerated or simplified to show a functional overview. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for showing a person skilled in the art how the present invention can be used in different ways. As used here, the term "and / or," when used in a list of two or more elements, means that each of the listed elements can be used alone, or any combination of two or more of the listed elements can be used. For example, if an arrangement is described as containing components A, B, and / or C, the arrangement can contain A alone; B alone; C alone; A and B combined; A and C combined; B and C combined; or A, B, and C combined. Reversing and maneuvering with a trailer can be challenging due to visibility and route planning difficulties. These challenges can vary depending on vehicle dimensions and environmental conditions. With large trailers, the field of vision behind the trailer may be completely obstructed. With smaller trailers, even slight steering adjustments can quickly cause the coupling angle between the vehicle's drawbar and the trailer to bend. Addressing these and other concerns, the following improvements provide various implementations to enhance the functionality of a trailer reversing assistance system. As shown in Fig. 1, the imaging devices C1-C5 can be arranged in different locations such that each field of view of the imaging devices C1-C5 is configured to capture a significantly different area of ​​the operating environment 14. Each of the imaging devices C1-C5 can comprise any type of imaging device configured to acquire image data, such as, but not limited to, charge-coupled devices (CCDs) and complementary metal-oxide-semiconductor (CMOS) image sensors. Although five imaging devices C1-C5 are described with reference to Fig. 1, the number of imaging devices can vary based on the specific operating specifications of the imaging devices implemented and the proportions and / or external profiles of a particular vehicle and trailer.For example, large vehicle and trailer combinations may require additional imaging equipment to capture image data appropriate to a larger operating environment. The imaging equipment may also vary in terms of viewing angle and field of view, depending on the specific vehicle and trailer. Imaging devices C1, C3, C4, and C5 are arranged on the vehicle 10 and each is oriented to have a field of view directed toward a significantly different region of the operating environment 14. Imaging device C1 is centrally located on a rear section 16 (e.g., a tailgate) of the vehicle 10 and can employ object detection to monitor the position of a target object 18 located on the trailer 12, so that a coupling angle γ between the vehicle 10 and the trailer 12 can be determined. As used here, the coupling angle γ is defined as the angle between a longitudinal center axis 20 of the vehicle 10 and the longitudinal center axis 22 of the trailer 12. In addition to or alternatively to imaging device C1, an imaging device C1' can be centrally located on a rearward-facing section 24 of the vehicle 10 near a roof section 26. The imaging device C3 is centrally located on a forward-facing section 28 of the vehicle 10 near a radiator grille section 30. In addition to or alternatively to the imaging device C3, an imaging device C3' may be centrally located on a forward-facing section 32 of the vehicle near the roof section 26. The imaging devices C1 (and / or C1') and C3 (and / or C3') are oriented such that their respective fields of view substantially encompass the entire operating environment 14 in both the rearward and forward directions relative to the vehicle 10. Imaging devices C4 and C5 are located on a passenger side 34 and a driver side 36, respectively, and are configured to capture image data corresponding to the operating environment 14 to the side of the vehicle 10. In some implementations, imaging device C4 is located near a passenger side mirror 38, and imaging device C5 is located near a driver side mirror 40. Imaging devices C4 and C5, in combination with imaging devices C1 and C3, are configured to capture image data approximately corresponding to the entire operating environment 14 surrounding the vehicle 10. However, when the vehicle is towing the trailer 12, the trailer 12 may obscure a large portion of the rearward field of view from the vehicle 10. Imaging device C2 can be configured to operate in combination with imaging devices C1 and C3-C5 to provide a combined field of view of the operating environment 14 surrounding the vehicle 10 and the trailer 12. Imaging device C2 can be located on a rear structure 42 of the trailer 12. Alternatively, imaging device C2 can be located centrally in an upper section 44 of the trailer 12 and have a rearward-facing field of view relative to the trailer 12. The positioning of imaging device C2 can vary depending on the trailer type and geometry. In various implementations, imaging device C2 can have a substantially rearward-facing field of view configured to capture image data corresponding to the operating environment 14 that is obscured by the trailer 12 in front of imaging devices C1 and C3-C5. With reference to Fig. 2, the imaging device C2 is shown according to one implementation as a portable electronic device 46 with a built-in camera 48 and a corresponding image acquisition setting. The portable electronic device 46 can correspond to a smart device, such as, but not limited to, a smartphone or a tablet. As shown, the portable electronic device 46 is provided in a housing 50 that is coupled to the rear structure 42 of the trailer 12. The housing 50 can be constructed of a transparent, rigid material (e.g., plastic) to allow the portable electronic device 46 to accurately capture image data at the rear end of the trailer 12.The portable electronic device 46 can be supported within the housing by a frame 52 and / or another support mechanism and powered via a suitable charging cable 54, which is electrically coupled to an electrical system of the trailer 12. The portable electronic device 46 can have an integrated navigation system 56, which includes a GPS receiver 58 for GPS assistance functions and / or one or more integrated inertial sensors 60, which may include three-axis gyroscopes, three-axis accelerometers, three-axis magnetometers, barometers, and the like, or a combination thereof. Image data from the camera 48, together with data from the GPS receiver 58 and / or the inertial sensors 60, can be communicated to a vehicle system via wired or wireless (e.g., Bluetooth®) connections.While one implementation of the imaging device C2 has been described here as a portable electronic device 46, this should not be considered limiting. Furthermore, it should be noted that the imaging devices C1 and C3-C5 can also be implemented as portable electronic devices, but are not limited to this. With reference to Fig. 3, a top view of the vehicle 10 connected to the trailer 12 is shown, illustrating a plurality of fields of view of the imaging devices C1-C5. In the illustrated embodiment, imaging device C1 is shown with field of view 62, imaging device C2 with field of view 64, imaging device C3 with field of view 66, imaging device C4 with field of view 68, and imaging device C5 with field of view 70. In this implementation, each of the fields of view 62, 64, and 66 encompasses a horizontal viewing angle of approximately 170 degrees or more, and each of the corresponding imaging devices C1, C2, and C3 is configured to acquire image data corresponding to the forward and reverse directions relative to the vehicle 10 and the trailer 12.Imaging devices C4 and C5 are configured to acquire image data corresponding to the operating area on each side of the vehicle 10 and trailer 12, and have corresponding fields of view 68 and 70, which can encompass viewing angles of approximately 170 degrees or more. As shown, field of view 68 can form an overlapping section 72 with field of view 66 and an overlapping section 74 with field of view 62. Similarly, field of view 70 can also form an overlapping section 76 with field of view 66 and an overlapping section 78 with field of view 62. Although not shown, each of the fields of view 62, 68, and 70 can further form overlapping sections with field of view 64. The overlapping sections can be combined in some implementations to form an extended view or an aerial view of the vehicle 10 and trailer 12.The imaging devices C1-C5 are configured to capture image data corresponding to objects and terrain in the surrounding operating environment 14 of the vehicle 10 and the trailer 12. In the various implementations described here, each of the fields of view 62-70 can be combined in any combination to create different extended fields of view and corresponding viewing angles based on the operating states and relative orientations of the vehicle 10 and the trailer 12. The operating states and relative orientations of the vehicle 10 and the trailer 12 can be determined from the direction of travel of the vehicle 10, the speed of the vehicle 10, the steering angle δ, and the coupling angle γ between the vehicle 10 and the trailer 12. In some implementations, the fields of view 62-70 can also be combined to create a composite aerial or bird's-eye view of the vehicle 10 and the trailer 12.Information regarding the operating state and orientation of the vehicle 10 relative to the trailer 12 can also be used to generate a simulated aerial view of the vehicle 10 and the trailer 12, representing the coupling angle γ around point 80. The various views of the vehicle 10 and the trailer 12 described herein can be generated and displayed by a controller on the display 13, so that an operator of the vehicle 10 can see information relevant to the vehicle 10, the trailer 12, and the surrounding operating environment 14. The display 13 can be implemented in the vehicle 10 as a center console screen, a rearview mirror, an instrument cluster screen, a heads-up display, or any other device configured to present the processed image data from the imaging devices C1-C5. The image data from the imaging devices C1-C5 can be raw image data, data from a lens-corrected camera, composite image data, or any other form of image data acquired by the imaging devices C1-C5 or any other type of imaging device. With reference to Fig. 4, a block diagram of a controller 82 is shown. The controller 82 can be combined with or communicate with a trailer reversing assistance system. The controller 82 can receive and process image data from the imaging devices C1-C5 to generate a variety of views for display on the display 13. The display 13 can include a variety of user inputs 84 to allow the controller 82 to receive selection decisions from a user of the vehicle 10. The display 13 can also include a screen 86 to show one or more views that can be selected by the operator and / or generated automatically. According to one embodiment, the screen 86 can be configured as a touchscreen to register one or more touch events.The screen 86 can employ resistance sensing, capacitance sensing, surface acoustic wave sensing, or any other sensing means capable of registering a single event from one or many touches to enable an operator to input a variety of user commands relating to the trailer reversing assistance functions. The controller 82 can also communicate with a first navigation system 88, which comprises a GPS device 90, a compass 92, and one or more inertial sensors 94, each of which may already be on board the vehicle 10. The GPS device 90 may include a GPS receiver 91 and is operable to determine a global position and location of the vehicle 10 and to communicate the position and location to the controller 82. The compass 92 may be operable to determine the direction of travel of the vehicle 10 relative to a geographic compass direction and to communicate the direction of travel to the controller 82. The inertial sensors 94 may be operable to determine the motion and rotation of the vehicle 10. They may include one or more motion sensors 96 (e.g., an accelerometer) and rotation sensors 98 (e.g., a gyroscope). The controller 82 can also communicate with a second navigation system 100, which may include a GPS receiver 102 and one or more inertial sensors 104. According to one implementation, the GPS receiver 102 is integrated into the imaging device C2. Optionally, the inertial sensors 104 can also be integrated into the imaging device C2, which may be configured as the portable electronic device 46 shown in Fig. 2. However, it should be noted that the imaging device C2 may be implemented as a dedicated device attached to the trailer 12. Furthermore, the GPS receiver 102 and the inertial sensors 104 may be located elsewhere on the trailer 12 and may be integrated into other devices and / or structures on the trailer 12. The GPS receiver 102 can be operated to determine a global position and location of the trailer 12 and to communicate the position and location to the controller 82. Inertial sensors 104 can be operated to determine the movement and rotation of the trailer 12 and can include any sensor configurations described herein. By providing a navigation system 100 on the trailer 12, the coupling angle γ between the vehicle 10 and the trailer 12 can be determined without the need for image-based target recognition. This would also eliminate the need for an operator to attach a target object (e.g., target object 18) to the trailer 12 or to perform vehicle / trailer measurements for the purpose of setting up an image-based target recognition system. In one implementation, the controller 82 can calculate the coupling angle γ by comparing the vehicle position with the trailer position using the vehicle position data received from GPS receiver 91 and the trailer position data received from GPS receiver 102. In another implementation, the controller 82 can include a coupling angle detection module 106 configured to switch between receiving vehicle position data output by GPS receiver 91 and trailer position data output by GPS receiver 102. The coupling angle detection module 106 can include a Kalman filter 108 to smooth and extrapolate a vehicle position and a trailer position from the vehicle position data and the trailer position data, and then calculate a coupling angle γ based on the extrapolated vehicle position and the extrapolated trailer position.In yet another implementation, the controller 82 can calculate the coupling angle γ based on data received from the inertial sensors 94 assigned to the vehicle 10 and the inertial sensors 104 assigned to the trailer 12. For example, the inertial sensors 94 and 104 can provide the controller 82 with data regarding the instantaneous direction of the vehicle and trailer, respectively, which the controller 82 can use to calculate the coupling angle γ. In yet another implementation, the controller 82 can use position data for the vehicle 10 as a reference to calculate differential position deviations for the trailer 12, and vice versa. This can lead to more accurate calculations of the relative position between the vehicle 10 and the trailer 12, which in turn leads to more accurate calculations of the coupling angle γ.It should be noted that each of the above-mentioned implementations can be combined or carried out separately. As further shown in Fig. 4, the controller 82 can be configured to communicate with one or more vehicle systems, shown as the powertrain system 110, steering system 112, braking system 114, and gearshift device (PRDNL) 116. Together, the powertrain system 110, steering system 112, braking system 114, and gearshift device 116 can work together to control the vehicle 10 and trailer 12 during a reversing maneuver. According to one implementation, the controller 82 can send commands to any of the powertrain system 110, steering system 112, braking system 114, and gearshift device 116 based on inputs received from a steering input device 118, which may include information defining the travel path of the vehicle 10 and trailer 12. The steering input device 118 can be a rotatable device (e.g.,button, steering wheel) configured to allow an operator of vehicle 10 to steer vehicle 10 during a reversing maneuver. The controller 82 can include a memory 120 coupled to one or more processors 122, which execute instructions 124 stored in the memory 120. The memory 120 and the instructions 124 together define an example of a non-volatile, processor-readable medium. The controller 82 can further include a variety of modules for combining the image data received from the imaging devices C1-C5 with satellite image data (e.g., from the GPS device 90) to form various composite views of the operating environment 14 surrounding the vehicle 10 and the trailer 12. The variety of modules can include a distortion correction module 126, a view conversion module 128, an image cropping / resizing module 130, an image reference identification module 132, and an image assembler 134. To create a composite view that combines image data corresponding to two or more of the imaging devices C1-C5, the controller 82 can receive image data from the imaging devices C1-C5 and correct any distortion in the image data using the distortion correction module 126. Distortion in the image data can result from lens distortion, view correction, or any other form of distortion common in imaging devices. The view conversion module 128 can then convert a view of the image data. A view correction can correspond to changing the orientation of a perspective of the image data corresponding to a field of view of an imaging device. For example, the image data can be adjusted from a side view to an aerial view.The image data from each of the two or more imaging devices can then be cropped and resized by the image cropping / resizing module 130 and combined in the image assembler 134. The composite image data output by the assembler 134 can form an extended field of view, an aerial view, or any combination of the image data received from the imaging devices C1-C5. In some implementations, the relative location of the image data received by the two or more imaging devices can also be aligned by the image reference identification module 132. The image reference identification module 132 can be operated to detect and identify objects in the image data received by each of the imaging devices C1-C5 and to use objects in different fields of view to align and accurately combine the image data. The image assembler 134 can also be capable of identifying obscured and / or missing image data and requesting satellite imagery or other feature data from the GPS device 90 to further augment and enhance the composite image data. The resulting enhanced image data can be output on the screen 86 for display to the operator of the vehicle 10. Referring to Fig. 5, an aerial view of the vehicle 10 and the trailer 12 is displayed on screen 86 of the display 13. A vehicle model 136 of the vehicle 10 and a trailer model 138 of the trailer 12 can be included in the aerial view by the controller 82 as sample image data and / or rendered graphics. The sample image data can include archive images of the vehicle 10 and a library of trailer images, which can be included in the aerial view to represent the proportions and position of the vehicle 10 relative to the trailer 12. In some implementations, the vehicle operator can input the dimensions of the trailer 12 via the user inputs 84 of the display 13. The controller 82 can also be operated to estimate the dimensions of the trailer 12 based on known ratios of the positions of each of the imaging devices C1-C5.For example, the controller 82 can be operated to recognize the trailer 12 in the image data using the image reference identification module 132. Based on the known ratios of the positions of the imaging devices C1-C5 and the corresponding fields of view 62-70, the controller 82 can be operated to determine the proportions, approximate dimensions, and shape of the trailer 12 in order to generate the trailer model 138. The controller 82 can further use the coupling angle γ to process and compare image data of the trailer 12 in different positions relative to the vehicle 10 in order to obtain additional image data for determining the proportions, approximate dimensions, and shape of the trailer 12. The coupling angle γ can also be used by the controller 82 to display the trailer model 138 at the corresponding coupling angle γ relative to the vehicle model 136. By displaying the vehicle model 136 and the trailer model 138, the controller 82 can provide the operator of the vehicle 10 with useful information. In some implementations, a graphic outline simulating the trailer 12 can also be included in the image data displayed on the screen 86 as a reference for the operator of the vehicle 10, to represent the position of the trailer model 138 relative to the vehicle model 136, as well as an operating environment model 140.Based on the specific proportions, approximate dimensions and shape of the trailer 12, the control 82 can automatically select a trailer graphic or archive image of a trailer model 138 from a library of trailer images or graphics via the memory 120. A variety of environmental features 142 can also be displayed by the controller 82 on the screen 86. The environmental features 142 can be integrated into the image data displayed on the screen 86 to represent a location of the environmental features 142 relative to the vehicle model 136 and the trailer model 138. The locations of the environmental features 142 can be extrapolated by the image reference identification module 132 of the controller 82 from the composite image data acquired by the imaging devices C1-C5. Each of the environmental features 142 can be identified based on one or more feature identification algorithms configured to identify various natural and man-made features that may obstruct the path of the vehicle 10 and the trailer 12.Additionally or alternatively, sensors and / or radars can be used to identify environmental features that may be in the path of the vehicle 10 and the trailer 12. The environmental features 142 can be identified and integrated into the aerial view based on image data, satellite image data, and any other data corresponding to the position and direction of travel of the vehicle 10. Based on the position and direction of travel of the vehicle 10, environmental features 142 can be added to the composite image data and, using global positions of each environmental feature 142, arranged on the screen 86 relative to the vehicle model 136 and the trailer model 138. The location of the environmental features 142 can be determined by the controller 82 using the GPS device 90 and the compass 92. By enhancing the aerial view with satellite image data, the controller 82 can provide additional information that can be used in addition to the information identified from the imaging devices C1-C5.In some implementations, satellite image data can also be used by the controller 82 to provide information corresponding to a region hidden from the fields of view 62-70 of the imaging devices C1-C5. The screen 86 of the display 13 can be configured as a touchscreen of any type, such as resistive, capacitive, surface acoustic, infrared, or optical. The multiple user inputs 84 can be implemented as screen buttons, providing the vehicle operator 10 with options to modify a view displayed by the controller 82. The screen buttons can allow the vehicle operator 10 to view the operating environment 140 and select a view corresponding to any of the imaging devices C1-C5, a combination of the imaging devices C1-C5, or the composite aerial view. The screen buttons can also provide an option for a manual mode to manually control the view displayed on the screen 86, or for an automatic mode to automatically control the view displayed on the screen 86. While the composite aerial view is selected, an operator of the vehicle 10 can touch the screen button 144 to enter a path input mode. When the path input mode is activated, the controller 82 can cause the display 13 to show a path input screen 145 as shown in Fig. 6. The path input screen 145 can be a "zoomed out" aerial view of the aerial view shown in Fig. 5. In addition, the zoomed-out aerial view can show other environmental features 142 that were not shown in the previous aerial view. By providing a zoom feature, the operator of the vehicle 10 can be given a larger view of the operating environment. However, it is provided that the operator can reduce the zoom level if they require a magnified view. The zoom level can be adjusted automatically or manually using the zoom-out button 146 and the zoom-in button 148.It is also intended that the vehicle model 136 and the trailer model 138 can initially be positioned in the center of the screen 86 by default. An operator can later adjust the screen center by touching the "Change Center" screen button 150 and then dragging the aerial view in the desired direction. Once the aerial view is positioned as desired, the operator can touch the "Change Center" screen button 150 to lock the new aerial view. The controller 82 can then adjust the new aerial view to the screen 86 and analyze image data and / or satellite imagery to display any new environmental features 142 that arise from it. According to one implementation, screen 86 is configured to register a touch event that enters an intended reverse path for vehicle 10 and trailer 12. Certain preconditions may be required before the intended reverse path can be entered. For example, vehicle 10's gearshift device 116 may need to be in either a park or reverse position, and vehicle 10 and trailer 12 may need to be aligned. To enter an intended reverse path, the operator of vehicle 10 can touch the "New Path" screen button 151 and then follow the intended reverse path on screen 86. The operator can touch the "End" screen button 153 at any time to exit path entry mode. An intended return path 152 is shown by way of example in Fig. 7. The intended return path 152 can be traced (e.g., using a finger) from the rear of the trailer model 138 and terminates at an end position 154 selected by the operator. Once traced, the intended return path 152 is displayed as an overlay on the screen 86. The intended return path 152 can be curved, straight, or a combination thereof. Preferably, the intended return path 152 is traced in such a way as to avoid obstacles displayed on the screen 86, which include environmental features 142 as well as any objects that would prevent the vehicle 10 and the trailer 12 from reversing along the intended return path 152.The obstacles can be natural and / or man-made and can be detected by using one or a combination of the C1-C5 imaging devices in addition to satellite imagery. It is also envisaged that sensors and / or radars can be used for object detection. Once the intended return path 152 has been tracked, the operator can touch screen button 156 to accept the intended return path 152, or otherwise touch screen button 158 to track a new path. While the intended return path 152 is being tracked, or afterward, the controller 82 can determine whether any unacceptable path conditions exist. An unacceptable path condition may occur if any tracked segments of the intended return path 152 would result in a coupling angle γ between the vehicle 10 and the trailer 12 that exceeds a maximum coupling angle γ, thereby creating a potential jackknife condition. Another unacceptable path condition may occur if one or more obstacles block the intended return path 152.If one or more unacceptable path conditions occur, the controller 82 can generate a warning for the operator indicating that the intended return path 152 requires revision or that a new intended return path must be entered. The warning can be of any type that stimulates an operator's senses and can include visual, audible, and tactile warnings, or a combination thereof. Figure 8 shows an example of an intended return path 152 passing through an obstacle 160. As shown, the intended return path 152 has several tracked sections, corresponding to unobstructed sections 162 and an obstructed section 164. To alert the operator to the unacceptable path condition, the controller 82 can display the unobstructed sections 162 of the intended return path 152 in a first color (e.g., green) and the obstructed section 164 in a second color (e.g., red), which is visually distinguishable from the first color. In response to the unacceptable path condition, a further touch event can be performed to modify the intended return path 152. According to an implementation shown in Fig. 9, the operator can modify the obstructed section 164 of the intended return path 152 by moving the obstructed section 164 away from the obstacle 160. The operator is able to move any portion of the obstructed section 164 in any direction. While this is being done, the controller 82 can automatically adjust the curvature of the modified intended return path 166 as needed to ensure permissible coupling angles γ and / or avoid any other potential obstacles. If no unacceptable return conditions arise from the modified intended return path 166, the screen button 168 can become available to allow the user to accept the modified intended return path 166. Otherwise, the operator can touch the screen button 170 to return to the path input screen 145.Additionally or alternatively, the controller 82 can automatically generate one or more possible return routes A, B, as shown in Fig. 10, and the operator can be given the option to select one of the proposed return routes A, B via a corresponding screen button 172, 174. Once a reversing route has been entered via screen button 168, the controller 82 can extrapolate GPS coordinates for all points along the reversing route. The controller 82 can work in conjunction with the GPS device 90 and send commands to the powertrain system 110, the steering system 112, and / or the braking system 114 to reverse the vehicle 10 and trailer 12 along the entered reversing route. Depending on which systems 110, 112, and 114 are used, the reversing maneuver can be fully automatic or require some action from the operator of the vehicle 10. While the vehicle 10 and trailer 12 are reversing along the route, the operator can adjust the path curvature by using the steering input device 118 and / or by performing another touch event (e.g., dragging a tracked section of the reversing route) on screen 86.The resulting return route can be saved either manually or automatically on GPS device 90 and / or at another location. Additionally, the GPS coordinates, along with the orientation of vehicle 10 and trailer 12, can also be saved on GPS device 90 and / or at another location. This allows an operator performing repeated reversing maneuvers to easily retrieve and request a saved return route instead of having to enter it manually each time. Similarly, when an operator exits a parking space, the corresponding exit route can also be saved and displayed later or simultaneously as an overlay on screen 86.It should be noted that an operator can enter an exit route in a similar manner to entering a return route, using one or more touch events as described here. Furthermore, saved return or exit routes can be offered as suggested routes where appropriate. With reference to Fig. 11, a method 175 for inputting a reverse path is shown. The method can be implemented using the controller 82 and other devices described herein and shown in Figs. 4-10. More precisely, the method can be carried out as instructions 124, which are stored in memory 120 and executed by the processor 122. The method 175 can begin at step 176, which includes generating an aerial view of a vehicle 10 and a trailer 12 based on at least one image and satellite image data. Step 178 includes displaying the aerial view on a display 13, which has a touchscreen 86. Step 180 includes registering a touch event on the touchscreen 86, which inputs an intended reverse path for the vehicle 10 and the trailer 12. Step 182 includes determining whether an unacceptable path condition exists.If an unacceptable path condition exists, step 184 involves modifying the intended return path to overcome the unacceptable path condition or selecting from one or more suggested return paths to overcome the unacceptable path condition. Step 186 involves reversing the vehicle 10 and the trailer 12 either along the intended return path or along the return path selected in step 184. The systems and methods described here can offer improvements to the functionality of a trailer reversing assistance system. Although the systems and methods are described and presented here as being implemented on a specific vehicle and trailer, it should be noted that the systems and methods described here can be used with any vehicle and trailer combination as disclosed. It is understood that variations and modifications to the aforementioned structure can be made without deviating from the concepts of the present invention, and it is further understood that such concepts are to be encompassed by the following claims, unless these claims expressly state otherwise by means of their language.

Claims

Method for inputting a route, comprising the following steps: generating (176) an aerial view of a vehicle (10) and a trailer (12) based on at least one image data and satellite image data; displaying (178) the aerial view on a display (13) with a touchscreen (86); and registering (180) a touch event on the touchscreen (86) that inputs an intended route for the vehicle (10) and the trailer (12), wherein the intended route is tracked, and wherein the intended route has various tracked sections corresponding to unobstructed sections (162) and obstructed sections (164), and unobstructed sections (162) of the intended route are displayed in a first color and obstructed sections (164) of the intended route are displayed in a second color. Method according to claim 1, wherein the generation step comprises mapping an operating environment (14) surrounding the vehicle (10) and the trailer (12) in order to obtain the image data. Method according to one of claims 1 and 2, wherein the generation step comprises using a GPS device (90) to obtain the satellite image data. Method according to claim 1, wherein the implementation step further comprises tracing a tracked section of the intended return path in order to modify a path curvature of the intended path. Method according to claim 4, wherein the intended path comprises a return path and an exit path. A method for inputting a path, comprising the following steps: generating (176) an aerial view of a vehicle (10) and a trailer (12); displaying (178) the aerial view on a touchscreen (86); registering (180) a first touch event on the touchscreen (86) which inputs an intended path for the vehicle (10) and the trailer (12); and wherein the intended path is tracked, and wherein the intended path has various tracked sections corresponding to unobstructed sections (162) and obstructed sections (164), and unobstructed sections (162) of the intended path are displayed in a first color and obstructed sections (164) of the intended path are displayed in a second color; and registering a second touch event on the touchscreen (86) which inputs a modification of the intended path, with the obstructed section (164) being drawn. Method according to claim 6, which further comprises the step of mapping an operating environment (14) of the vehicle (10) and the trailer (12) in order to obtain image data. Method according to claim 7, which further comprises the step of obtaining satellite image data, wherein the satellite image data relate to a position and location of the vehicle (10) and the trailer (12). Method according to claim 8, wherein the aerial view is generated based on the image data and the satellite image data. Method according to any one of claims 6 to 9, wherein the first contact event comprises tracking the intended path. Method according to claim 10, wherein the second contact event comprises tracing a tracked section of the intended path in order to modify a path curvature of the intended path. Method according to claim 11, wherein the intended path consists of a return path and an exit path.

Citation Information

Patent Citations

  • Method for assisting driver during reverse driving of locomotive set from drawing vehicle with trailer, involves fading trajectory in display of video image, so that locomotive set is moved along trajectory during reverse driving of set

    DE102009012253A1

  • Method for determining trajectory of driving maneuver, involves inputting symbol on touch-sensitive display device by user, where target pose is recognized depending on input symbol

    DE102012222972A1