360 degree trailer camera view system
By using a single auxiliary camera input channel to transmit bird's-eye view video between the trailer and the vehicle, the complexity and high cost of video signal transmission in existing trailer reversing auxiliary systems are solved, thus simplifying and improving the safety of trailer reversing operations.
Patent Information
- Application Number
- CN202110022132.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-01-13
- Filing Date
- 2021-01-08
- Publication Date
- 2025-11-25
- Estimated Expiration
- 2041-01-08
AI Technical Summary
In the prior art, trailer reversing assist systems lack a simple and economical way of transmitting video signals, resulting in high connection and maintenance costs, and failing to make effective use of the vehicle's existing wiring hardware.
By setting up a first control module on the trailer to generate and transmit the trailer's bird's-eye view video feed, and using a single auxiliary camera input channel in the trailer harness to transmit the video signal to the vehicle's second control module, integrating it into the vehicle's existing display system, the integrated display of the trailer's bird's-eye view and the vehicle's rear view is achieved.
The system integrates the aerial view of the trailer with the rear view of the vehicle without requiring additional wiring connections, improving visibility and safety during trailer reversing operations while reducing system complexity and maintenance costs.
Smart Images

Figure CN113103956B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to a vehicle interface system for a vehicle, and more particularly to an auxiliary trailer maneuvering system for improving visibility when maneuvering a trailer. BACKGROUND
[0002] Operating a vehicle with a trailer attached can be challenging for many drivers. This is especially true for drivers who are not proficient at reversing a vehicle with a trailer attached, which can include those drivers who do not drive frequently with a trailer attached (e.g., drivers who rent trailers, drivers who do not use a personal trailer frequently, etc.). A trailer reverse assist system for a vehicle can include an in-vehicle user interface that allows a user to steer a trailer being towed by a vehicle through an automatic steering controller that provides steering motion to move the trailer along a user-defined path curvature.
[0003] Some vehicles include a 360-degree camera system with processing capability to combine multiple camera angles into an aggregated bird’s-eye view of the vehicle. Although a bird’s-eye view of the trailer is not currently provided for a trailer reverse assist system, the bird’s-eye view of the trailer can further assist a vehicle driver in performing a trailer reverse operation.
[0004] Conventional reverse assist systems that do not provide a simplified way to transmit video signals from cameras on a trailer to a vehicle towing the trailer can be impractical because, in addition to the time and effort required for multiple connections for video feeds each time a trailer is hitched to and unhitched from a vehicle, the required video channel connectors can be expensive and wear out quickly. SUMMARY
[0005] Systems and methods are described for receiving a video feed from a trailer control module disposed in a vehicle trailer. For example, a first control module disposed on the trailer can aggregate a trailer forward view, a trailer rear view, a trailer left view, and a trailer right view into a bird’s-eye view. The trailer broadcasts the aggregated bird’s-eye view of the trailer to a vehicle towing the trailer via a single auxiliary video input channel integrated into a trailer hitch wiring harness of the towed trailer. The trailer harness connects the trailer with the vehicle to extend control over standard driving functions such as trailer brakes and turn signals, and includes the video input channel.
[0006] The bird’s-eye view of the trailer can be received via a second control module in the vehicle, and the trailer bird’s-eye view video feed can be output at an output display disposed in a cabin of the towing vehicle. The bird’s-eye view can be displayed in various ways, such as a split screen that depicts the trailer bird’s-eye view in conjunction with a rear view of the vehicle or other views obtained from the vehicle camera system.
[0007] The embodiments described herein can provide a way to integrate a trailer bird's eye view video feed with a tow vehicle's rear view using the existing on-board wiring hardware and control modules of the tow vehicle without adding additional wiring connections. The disclosed methods and systems can be useful in a trailer backing system that can assist a driver in operating a vehicle to tow a trailer, such as a box trailer or a recreational vehicle (RV), without observer assistance while in reverse, and without adding additional wiring connections or upgrading the on-board control modules of the tow vehicle.
[0008] These and other advantages of the disclosure are provided in greater detail herein. BRIEF DESCRIPTION OF DRAWINGS
[0009] A detailed description should be taken in conjunction with the drawings, in which like features are referred to by like numerals. Various embodiments can utilize elements and / or components other than those illustrated in the drawings, and some elements and / or components can be absent from various embodiments. The elements and / or components in the drawings are not necessarily to scale. Throughout the disclosure, singular and plural terminologies can be used interchangeably according to context.
[0010] Figure 1 An exemplary trailer backing assist system according to embodiments of the disclosure is depicted.
[0011] Figure 2 An exemplary computing environment in which techniques and structures for providing the systems and methods disclosed herein can be implemented is depicted.
[0012] Figure 3 An exemplary camera output display user interface in a vehicle according to embodiments of the disclosure.
[0013] Figure 4 Another view of an exemplary output display of Figure 3
[0014] Figure 5 A flowchart according to embodiments of the disclosure is depicted. DETAILED DESCRIPTION
[0015] The disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which example embodiments of the disclosure are shown, and in which like numerals refer to like elements throughout. The disclosure may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein.
[0016] Figure 1 An exemplary trailer reverse assist system 100 according to embodiments of the present disclosure is depicted. The reverse assist system 100 can be used to control a backing path of a trailer 104 attached to a vehicle 102 by allowing a driver of the vehicle 102 to specify a desired curvature of a backing path of the trailer 104. The trailer assist system 100 can include a first control module 110 and a second control module 112. The first control module 110 can be rigidly disposed on the trailer 104 and the second control module 112 can be disposed on the vehicle 102. The first control module 110 and the second control module 112 are depicted in Figure 1 FIG. 1 as controllers running an Intelligent Platform Management Bus (IPMB) communication protocol. Other protocols are possible and are contemplated.
[0017] The reverse assist system 100 can also include an output display device 114 disposed in communication with the second control module 112 on the vehicle. The first control module 110 on the trailer can be disposed in communication with the second control module 112 via an auxiliary camera input channel 116 through a trailer wiring harness 118. The first control module 110 can generate an overhead view video feed 184 through a single auxiliary input channel 148 connected via the trailer wiring harness 118. More specifically, the trailer wiring harness 118 connects a vehicle portion 116A of the single auxiliary camera input channel 148 and a trailer portion 116B of the single auxiliary camera input channel 116. The vehicle portion 116A can be connected with the trailer portion 116B through the trailer wiring harness 118 (and vice versa). The single auxiliary camera input channel 148 is described as “single” in that it utilizes a single channel connector disposed in the wiring harness 118.
[0018] The trailer assist system 100 can also include a plurality of trailer cameras 120, which can include a trailer front-facing camera 140, a trailer rear-facing camera 142, a trailer left-facing camera 146, and a trailer right-facing camera 144 disposed in communication with the first control module 110. The first control module 110 can receive respective video feeds from the trailer cameras 140-146, generate a trailer overhead view video feed 184 based on the video feeds from the respective cameras 140-146, and transmit a single video signal via the single auxiliary camera input channel 148.
[0019] The trailer assist system 100 can also include one or more 360-degree view cameras of a plurality of possible vehicle cameras 132-138. The plurality of trailer cameras 140-146 can be disposed on a trailer front portion 156, a trailer rear portion 158, a trailer left portion 160, and a trailer right portion 162, respectively, among other possible locations.
[0020] While some embodiments can include only the vehicle rear-facing camera 134, in one embodiment, the plurality of vehicle cameras 132-138 can include a front-facing camera 132 that provides a forward view of the vehicle 102, the vehicle rear-facing camera 134 can provide a rear view of the vehicle (including, for example, the trailer 104), the left-facing camera 138 can provide a left view of the vehicle 102, and the right-facing camera 136 can provide a right view of the vehicle 102. The cameras 132-138 can be configured to communicate with the second control module 112 of the vehicle via a plurality of camera connectors that connect the vehicle cameras 132-138 via the connection line 159.
[0021] Similarly, the plurality of trailer cameras 140-146 can include a trailer front-facing camera 140 that provides a forward view of the trailer 104 (and, thus, a view of the rear of the vehicle 102 from the perspective of the trailer), a rear-facing camera 142 that provides a rear view of the trailer 104, a trailer right-facing camera 144 that provides a right view of the trailer 104, and a trailer left-facing camera 146 that provides a left view of the trailer 104.
[0022] The second control module 112 disposed on the vehicle 102 can include a processor 164 and a computer-readable memory 166. Details regarding the processor 164 and the memory 166 are discussed below with respect to the automotive computer 245 in Figure 2 Further, the automotive computer 245 is an exemplary computing platform that can include or represent the second control module 112. It will be appreciated that the first control module 110 can include similar features as the second control module 112, and, in fact, can be substantially similar or identical to the second control module 112. The first control module 110 can include, for example, a processor 168 and a computer-readable memory 170, and can be connected to a power bus (not shown in Figure 1 ) that can be available via the wiring harness 182.
[0023] The trailer backup assist system 100 can be configured to automatically or manually manipulate the vehicle 102 to guide the trailer 104 over a desired curvature or backup path as a driver uses the accelerator and brake pedals (not shown in Figure 1 ) to control the speed of the vehicle 102 while backing up. To monitor the position of the trailer 104 behind the vehicle 102, the trailer backup assist system 100 can include a sensor system that senses or otherwise determines a hitch angle between the trailer 104 and the vehicle 102. In one embodiment, the sensor system 106 can include a trailer sensor module (not shown in Figure 1(Not shown in the image), the trailer sensor module monitors the dynamics of the trailer 104 (such as yaw rate) and communicates with a first control module 110 disposed on the trailer. The trailer reversing assist system 100 according to this embodiment may further include a vehicle sensor system that generates information for navigation, such as, for example, vehicle yaw rate and vehicle speed.
[0024] refer to Figure 1 In the illustrated embodiment, vehicle 102 is a pickup truck equipped with a trailer reversing assist system 100 for controlling the reversing path of a trailer 104 attached to vehicle 102. Specifically, vehicle 102 can be pivotally attached to trailer 104 via a tongue 172 that extends longitudinally from or adjacent to the rear bumper of the vehicle. The illustrated trailer 104 is... Figure 1 The vehicle is depicted as being attached to vehicle 102 via trailer hitch 178, which may include a hitch ball ( Figure 1 A connector assembly (not shown). The connector assembly may be latchable to a hook ball to provide a pivot ball joint connection, which allows for hinged hook angles. It should be understood that additional embodiments of trailer 104 may alternatively be coupled to vehicle 102 to provide a pivot connection, such as by connection to a fifth wheel connector (referred to herein as harness 182). It is also contemplated that additional embodiments of the trailer may include more than one axle and may have various shapes and sizes configured for different loads and items, such as tugboats or flatbed trailers.
[0025] The first control module 110 can receive a set of video feeds, which may include a front view of the trailer received from the front-mounted camera 140, a rear view of the trailer received from the rear-mounted camera 142, a right view of the trailer received from the right-mounted camera 144, and a left view of the trailer received from the left-mounted camera 146. Additional or fewer cameras can be used to capture various views. For example, two cameras may be able to see all sides of the trailer. The first control module 110 can generate a trailer bird's-eye view video feed 184 based on the set of video feeds received from the multiple cameras 140 to 146. The first control module 110 can send the trailer bird's-eye view video feed 184 to a second control module 112 located on the vehicle 102 via an auxiliary camera input channel associated with the trailer wiring harness 182. This image video data can be sent as a video feed via a single channel to any device listening for this signal via the wiring harness. In other words, the first control module 110 can generate a bird's-eye view video feed and broadcast it on the trailer section of the vehicle section of the auxiliary input channel 116A. When configured to communicate with the trailer 104, the second control module 112 can receive the trailer bird's-eye view video feed 184 via the vehicle section of the auxiliary camera input channel 116A and display it on the output display. Figure 1 The feed is shown on (not shown in the image). The bird's-eye view video feed 184 can be received and displayed by the vehicle 102 without requiring an additional video feed connection between the vehicle 102 and the trailer 104. The vehicle 102 can display the bird's-eye view video feed 184 when triggered on the vehicle's infotainment system or other output device.
[0026] Figure 2 An exemplary computing environment 200 is depicted, which may include a vehicle 205, the vehicle including: an automotive computer 245; and a vehicle control unit (VCU) 265, the VCU typically including a plurality of electronic control units (ECUs) 217, the plurality of ECUs being configured to interact with the automotive computer 245 and, for example... Figure 1 The reverse assist system 100 shown communicates with the vehicle. A mobile device 220, which can be associated with the user 240 and the vehicle 205, can connect to the vehicle computer 245 using wired and / or wireless communication protocols and transceivers. The mobile device 220 can be communicatively coupled to the vehicle 205 via one or more networks 225, which can communicate via one or more wireless channels 230, and / or the mobile device can use near field communication (NFC) protocols. Protocols, Wi-Fi, Ultra-Wideband (UWB), and other possible data connectivity and sharing technologies can be used to directly connect to vehicle 205. Vehicle 205 can also receive and / or communicate with a Global Positioning System (GPS) 275. In one embodiment, mobile device 220 can be used as an output display, the function of which is similar to that discussed below. Figure 3 and Figure 4 The output display is depicted in the image.
[0027] The vehicle computer 245 may be or include an electronic vehicle controller having one or more processors 250 and memory 255. The second control module 112 may be one such example. In some example embodiments, the vehicle computer 245 may be configured to communicate with the mobile device 220 and one or more servers 270. The server 270 may be part of a cloud-based computing infrastructure and may be associated with and / or include a telematics service delivery network (SDN) that delivers data to vehicle 205 and other vehicles that may be part of a vehicle fleet. Figure 2 (Not shown in the image) provides digital data services.
[0028] Although shown as a pickup truck, vehicle 205 can take the form of another passenger or commercial vehicle, such as, for example, an automobile, crossover, SUV, van, minivan, taxi, bus, etc., and can be configured to include various types of vehicle drive systems. Exemplary drive systems may include various types of internal combustion engine (ICE) powertrains with gasoline, diesel, or natural gas-powered combustion engines, having conventional drive components such as transmissions, drive shafts, differentials, etc. In another configuration, vehicle 205 may be configured as an electric vehicle (EV). More specifically, vehicle 205 may include a battery EV (BEV) drive system, or be configured as a hybrid EV (HEV) with an independent onboard power unit, a plug-in HEV (PHEV) including an HEV powertrain that can be connected to an external power source, and / or include a parallel or series hybrid powertrain with a combustion engine power unit and one or more EV drive systems. HEVs may also include battery and / or supercapacitor banks, flywheel energy storage systems, or other power generation and storage infrastructure for energy storage. Vehicle 205 can also be configured as a fuel cell vehicle (FCV) that uses fuel cells (e.g., hydrogen fuel cell vehicle (HFCV) powertrains, etc.) and / or any combination of these drive systems and components to convert liquid or solid fuels into usable power.
[0029] Furthermore, vehicle 205 may be a manually driven vehicle and / or configured to operate in fully autonomous (e.g., driverless) mode (e.g., Level 5 autonomy) or in one or more partially autonomous modes. Examples of partially autonomous modes are widely understood in the art to be Level 1 to Level 5 autonomy. An autonomous vehicle (AV) with Level 1 autonomy may typically include a single automated driver assistance feature, such as steering or acceleration assistance. Parking assistance systems may be included as one such Level 1 autonomous system. Adaptive cruise control is another example of a Level 1 autonomous system, which may include both acceleration and steering aspects. Level 2 autonomy in a vehicle may provide partial automation of steering and acceleration functions, where the automated system is supervised by a human driver performing non-automated operations, such as braking and other controls. Level 3 autonomy in a vehicle may typically provide conditional automation and control of driving features. For example, Level 3 vehicle autonomy typically includes “environmental detection” capabilities, where the vehicle can make informed decisions independently of the current driver, such as accelerating past slowly moving vehicles, while the current driver remains prepared to regain control of the vehicle if the system is unable to perform its task. Reversing assistance system 107 may also include Level 3 autonomous features. Level 4 autonomy includes vehicles with advanced autonomy, which can operate independently of a human driver but still include human controls for autonomous driving. Level 4 automation also allows the autonomous driving mode to intervene in response to predefined conditions, such as road hazards or system malfunctions. Level 5 autonomy is associated with autonomous vehicle systems that do not require human input and typically does not include human-operated driving controls.
[0030] According to embodiments of this disclosure, the reversing assistance system 107 can be configured to work with an autonomous vehicle controller having levels 1 to 4. Figure 2 (Not shown in the image) are operated together.
[0031] Mobile device 220 typically includes memory 223 for storing program instructions associated with application 235, which, when executed by mobile device processor 221, perform aspects of the disclosed embodiments. Application (or “application”) 235 may be part of back-down assist system 107, or may provide information to and / or receive information from back-down assist system 107.
[0032] In some aspects, mobile device 220 can communicate with vehicle 205 via one or more channels 230, said one or more channels being encrypted and established between mobile device 220 and telematics control unit (TCU) 260. Mobile device 220 can use a wireless transmitter associated with TCU 260 on vehicle 205. Figure 2(Not shown) communicates with TCU 260. The transmitter can use a wireless communication network such as, for example, one or more networks 225 to communicate with mobile device 220. Figure 2 The document describes one or more wireless channels 230 for communication via one or more networks 225 and via one or more direct connections 233. Connections 233 may include various low-power protocols, including, for example... BLE or other Near Field Communication (NFC) protocols.
[0033] Network 225 illustrates an example of an example communication infrastructure in which the connected devices discussed in the various embodiments of this disclosure can communicate. Network 225 may be and / or include the Internet, a private network, a public network, or other configurations operating using any one or more known communication protocols, such as, for example, Transmission Control Protocol / Internet Protocol (TCP / IP). Wi-Fi, Ultra Wideband (UWB), and cellular technologies based on the Institute of Electrical and Electronics Engineers (IEEE) standard 802.11, such as Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), High-Speed Packet Access (HSPDA), Long Term Evolution (LTE), Global System for Mobile Communications (GSM), and 5G, to name just a few.
[0034] According to this disclosure, the vehicle computer 245 may be installed in the engine compartment of the vehicle 205 (or elsewhere in the vehicle 205) and may operate as a functional part of the reversing assistance system 107. The vehicle computer 245 may include one or more processors 250 and computer-readable storage devices 255.
[0035] One or more processors 250 may be configured to communicate with one or more memory devices (e.g., memory 255 and / or memory 255) configured to communicate with a corresponding computing system. Figure 2 The processor 250 may communicate with one or more external databases (not shown). The processor 250 may utilize the memory 255 to store programs in code form and / or store data to execute aspects of this disclosure. The memory 255 may be a non-transitory computer-readable memory. The memory 255 may include any one or a combination of volatile memory elements (e.g., dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), etc.) and may include any one or more non-volatile memory elements (e.g., erasable programmable read-only memory (EPROM), flash memory, electronically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), etc.).
[0036] VCU 265 can share power bus 278 and can be configured to operate in vehicle 205 system, connected servers (e.g., one or more servers 270), and other vehicles operating as part of a vehicle fleet. Figure 2 Coordinating data between (not shown in the diagram). VCU 265 may include or communicate with any combination of ECU 217 (such as, for example, Body Control Module (BCM) 293, Engine Control Module (ECM) 285, Transmission Control Module (TCM) 290, TCU 260, Restraint Control Module (RCM) 287, etc.). In some aspects, VCU 265 may control various aspects of vehicle 205 and implement one or more sets of instructions received from application 235 operating on mobility device 220, one or more sets of instructions received from reverse assist system 107, and / or from AV controller ( Figure 2 (Not shown in the image) The received instructions.
[0037] TCU 260 can be configured to provide vehicle connectivity to wireless computing systems on and outside the vehicle 205, and may include a navigation (NAV) receiver 288 for receiving and processing GPS signals from GPS 275. Low-power (BLE) module (BLEM) 295, Wi-Fi transceiver, ultra-wideband (UWB) transceiver and / or other wireless transceivers that can be configured for wireless communication between vehicle 205 and other systems, computers and modules. Figure 2 (Not shown in the diagram). The TCU 260 can be configured to communicate with the ECU 217 via bus 180. In some respects, the TCU 260 can retrieve data and transmit data as a node in the CAN bus.
[0038] The BLEM 295 can be used by broadcasting and / or listening to the broadcast of small advertising packets and establishing a connection with a response device configured according to the embodiments described herein. and Bluetooth Low Communication protocols are used to establish wireless communication. For example, BLEM 295 may include a Universal Attribute Profile (GATT) device connectivity for client devices that respond to or initiate GATT commands and requests, and may be directly connected to mobile device 220.
[0039] Bus 180 can be configured as a Controller Area Network (CAN) bus organized in accordance with a multi-master serial bus standard for connecting two or more of the ECUs 217 as nodes using a message-based protocol, which can be configured and / or programmed to allow the ECUs 217 to communicate with each other. Bus 180 can be or include a high-speed CAN (which can have bit speeds of up to 1 Mb / s on CAN and up to 5 Mb / s on CAN Flexible Data Rate (CAN FD)) and can include a low-speed or fault-tolerant CAN (up to 125 Kbps), which, in some configurations, can be configured using a linear bus. In some respects, the ECUs 217 can communicate with a host computer (e.g., vehicle computer 245, reverse assist system 107, and / or server 270, etc.) and can also communicate with each other without requiring a host computer. Bus 180 can connect ECU 217 to vehicle computer 245, enabling vehicle computer 245 to retrieve information from ECU 217, send information to ECU 217, and otherwise interact with ECU 245 to perform the steps described according to embodiments of this disclosure. Bus 180 can connect CAN bus nodes (e.g., ECU 217) to each other via a two-wire bus, which can be a twisted pair with nominal characteristic impedance. Bus 180 can also be implemented using other communication protocol solutions, such as System Transmission to Media (MOST) or Ethernet. In other aspects, bus 180 can be a wireless in-vehicle bus.
[0040] VCU 265 can directly control various loads via bus 180 communication or implement such control in conjunction with BCM 293. The ECU 217 described with respect to VCU 265 is provided for illustrative purposes only and is not intended to be limiting or exclusive. Figure 2 Control and / or communication by other control modules not shown in the diagram are possible and such control may be considered.
[0041] In an exemplary embodiment, ECU 217 may use inputs from a human driver, inputs from an autonomous vehicle controller, the reverse assist system 107, and / or wireless signal inputs received via one or more wireless channels 233 from other connected devices (such as mobile device 220, etc.) to control various aspects of vehicle operation and communication. When configured as a node in bus 180, each ECU 217 may include a central processing unit (CPU), a CAN controller, and / or a transceiver. Figure 2 (Not shown in the image). For example, although Figure 2The mobile device 220 is depicted as being connected to the vehicle 205 via a BLEM 295, but it is also possible and contemplated, or alternatively, that a wireless connection 233 is established between the mobile device 220 and one or more of the ECU 217 via one or more corresponding transceivers associated with one or more modules.
[0042] The BCM 293 typically integrates sensors, vehicle performance indicators, and variable reactors associated with vehicle systems. It may also include processor-based power distribution circuitry that controls functions associated with the vehicle body (such as lights, windows, safety devices, door locks, and access controls) and various comfort controls. The BCM 293 can also operate as a gateway for bus and network interfaces to communicate with remote ECUs ( Figure 2 Interact with (not shown in the image).
[0043] The BCM 293 can coordinate one or more functions among various vehicle functionalities, including energy management systems, alarms, vehicle immobilizers, driver and passenger access authorization systems, mobile key-as-a-key (PaaK) systems, driver assistance systems, AV control systems, power windows, doors, actuators, and other functionalities. The BCM 293 can be configured for vehicle energy management, exterior lighting control, wiper functionality, power window and door functionality, heating, ventilation and air conditioning systems, and driver integration systems. In other aspects, the BCM 293 can control auxiliary equipment functionality and / or be responsible for integrating such functionality.
[0044] The computing system architecture of the automotive computer 245, VCU 265, and / or the reversing assistance system 107 may omit certain computing modules. This should be easily understood. Figure 3 The computing environment depicted is an example of a possible implementation according to this disclosure and should therefore not be considered limiting or exclusive.
[0045] Figure 3 A rear view 308 of the trailer 104 is depicted, as shown on the output display 304 of the vehicle infotainment system 300. Figure 1 The embodiments depicted may include vehicles according to embodiments of this disclosure (e.g., such as...). Figure 3 An exemplary output display 304 in the vehicle 102 shown. For example, it can be viewed via the vehicle infotainment system 300 or another output device that communicates securely with the vehicle trailer 104. Figure 3The rear view 308 is depicted. User 140 can select optional icons or menu items (e.g., optional menu item 302A "Trailer Bird's-eye View", optional menu item 302B "Rear View Only", etc.) on the output display 300 to switch from the rear view of vehicle 102 to a split screen displaying both the rear view 308 of trailer 104 and a bird's-eye view of trailer 104. Other optional icons may be displayed ( Figure 4 (Not shown in the image) is used for additional views, such as, for example, a bird's-eye view.
[0046] Figure 4 Another view of an exemplary output display according to embodiments of the present disclosure is depicted. More specifically, Figure 4 A vehicle infotainment system (or other output device) illustrating split-screen output 400 is depicted. Split-screen output 400 may include (in particular, other possible views) a bird's-eye view of trailer 104 in a first split-screen video portion 404 (in one embodiment, this may include the trailer itself, or in...). Figure 4 The second embodiment depicted includes a bird's-eye view of the trailer and vehicle, as well as a rear view of the trailer output in the second split-screen section 406.
[0047] Other views are also envisioned. For example, in one embodiment, vehicle 102 (and more specifically, second control module 112) may receive multiple video feeds, which may include a rear view 308, a left view of the trailer, a right view of the trailer, and a front view of the trailer. Therefore, second control module 112 may generate a second bird's-eye view of vehicle 102, which may be identifiable by icons (…). Figure 5 (Not shown in the image) Another available view to select.
[0048] Figure 5 This is a flowchart of an exemplary method 500 for generating a trailer bird's-eye view video feed using a single auxiliary input channel with a control module on a trailer towed by a trailer vehicle, according to the present disclosure. The following process is exemplary and is not limited to the steps described below. Furthermore, alternative embodiments may include more or fewer steps shown or described herein, and these steps may be included in an order different from that described in the following exemplary embodiments.
[0049] First refer to At step 505, method 500 may begin receiving a set of video feeds at a first control module located on the trailer, the set of video feeds including a front view, a rear view, a left view, and a right view of the trailer.
[0050] At step 510, the method may include the following steps: generating a trailer bird's-eye view video feed via a first control module based on a set of video feeds received from multiple cameras mounted on the trailer.
[0051] At step 515, the method may include the following steps: transmitting a trailer-mounted bird's-eye view video feed via a single auxiliary camera input channel to a second control module disposed in a trailer mechanically coupled to the trailer, wherein the trailer-mounted bird's-eye view video feed may be displayed via an output display associated with the trailer. A first control module may transmit the trailer-mounted bird's-eye view video feed to the second control module via an auxiliary camera input channel associated with the trailer wiring harness. In one embodiment, the single auxiliary camera input channel consists of a single-channel connection at the trailer wiring harness. At step 520, the second control module may receive a rear-view video feed depicting a rear view of the trailer via an output display, the trailer-mounted bird's-eye view video feed being displayed on a first split-screen portion and on a second split-screen portion.
[0052] In an exemplary embodiment, the step may further include combining a combined bird's-eye view video feed showing a bird's-eye view of the towing vehicle and the trailer via a second control module; and displaying the combined bird's-eye view video feed via an output display.
[0053] The embodiments described herein provide a way to integrate trailer-mounted bird's-eye view video feeds with existing wiring hardware and control modules on a trailer vehicle without the need for additional wiring connections. The disclosed methods and systems may be useful because they offer a better user experience, where users may want to view the trailer in a bird's-eye view similar to that found in a trailer vehicle, without the need for additional wiring connections or upgraded control modules on the trailer vehicle.
[0054] In the foregoing disclosure, reference has been made to the accompanying drawings, which form a part of the foregoing disclosure, illustrating specific embodiments in which the present disclosure may be practiced. It should be understood that other embodiments and structural modifications may be made without departing from the scope of the present disclosure. References to “an embodiment,” “embodiment,” “exemplary embodiment,” etc., in this specification indicate that the described embodiment may include specific features, structures, or characteristics, but each embodiment may not necessarily include said specific features, structures, or characteristics. Furthermore, such phrases do not necessarily refer to the same embodiment. Additionally, when features, structures, or characteristics are described in connection with embodiments, those skilled in the art will recognize such features, structures, or characteristics in conjunction with other embodiments, whether explicitly described or not.
[0055] Furthermore, where appropriate, the functions described herein may be performed by one or more of the following: hardware, software, firmware, digital components, or analog components. For example, one or more application-specific integrated circuits (ASICs) may be programmed to perform one or more of the systems and programs described herein. Certain terms are used throughout the specification and claims to refer to specific system components. As those skilled in the art will understand, components may be referred to by different names. This document is not intended to distinguish between components with different names but the same function.
[0056] It should also be understood that the word “example” as used herein is intended to be non-exclusive and non-restrictive in nature. More specifically, the word “exemplary” as used herein refers to one of several examples, and it should be understood that there is no excessive emphasis or preference for the particular example described.
[0057] Computer-readable media (also known as processor-readable media) include any non-transitory (e.g., tangible) medium that contributes to providing data (e.g., instructions) that can be read by a computer (e.g., by the computer's processor). Such media can take many forms, including but not limited to non-volatile and volatile media. A computing device may include computer-executable instructions, which can be executed by one or more computing devices (such as those listed above) and stored on a computer-readable medium.
[0058] Regarding the processes, systems, methods, heuristics, etc., described herein, it should be understood that although the steps of such processes, etc., have been described as occurring in a certain ordered order, such processes can be practiced with the described steps performed in a different order than that described herein. It should also be understood that some steps may be performed simultaneously, other steps may be added, or some steps described herein may be omitted. In other words, the description of processes herein is provided for the purpose of illustrating various embodiments and should in no way be construed as limiting the claims.
[0059] Therefore, it should be understood that the above description is intended to be illustrative rather than restrictive. Many embodiments and applications beyond the examples provided will become apparent upon reading the above description. The scope should not be determined by reference to the above description, but rather by reference to the appended claims and the full scope of their equivalents. It is anticipated and expected that the techniques discussed herein will evolve in the future, and the disclosed systems and methods will be incorporated into such future embodiments. In conclusion, it should be understood that modifications and variations are possible with this application.
[0060] All terms used in the claims are intended to be given their ordinary meaning as understood by one skilled in the art as described herein, unless expressly indicated otherwise herein. Specifically, unless the claims explicitly limit the recitation to the contrary, the use of singular articles such as “a,” “the,” or “the” should be interpreted as referring to one or more of the elements indicated. Unless otherwise specifically stated or understood in the context in which they are used, conditional language such as “can,” “may,” “possibly,” or “may” is generally intended to express that certain features, elements, and / or steps may be included in some embodiments but not in others. Therefore, such conditional language is generally not intended to imply that one or more embodiments require the stated features, elements, and / or steps in any way.
[0061] According to an embodiment, the invention is further characterized by a second non-transitory computer-readable storage medium in a second control module associated with a trailer vehicle, the second non-transitory computer-readable storage medium having instructions stored thereon that, when executed by a second processor,: receive the trailer bird's-eye view video feed via the single auxiliary camera input channel; and display the trailer bird's-eye view video feed at an output display.
[0062] According to an embodiment, the invention is further characterized in that the second processor feeds the trailer bird's-eye view video to the second control module via an auxiliary camera input channel associated with the trailer wiring harness.
[0063] According to an embodiment, the single auxiliary camera input channel is composed of a single-channel connection at the trailer wiring harness.
[0064] According to an embodiment, the invention is further characterized in that the second processor: receives a second video feed set associated with the trailer vehicle, wherein the second video feed set includes a front view of the trailer vehicle, a rear view of the trailer vehicle, a left view of the trailer vehicle, and a right view of the trailer vehicle; generates a bird's-eye view video feed showing a combination of bird's-eye views of the rear of the trailer vehicle and the trailer; and outputs the combination of bird's-eye view video feed via the output display.
[0065] According to an embodiment, the invention is further characterized in that the second processor: outputs the combined bird's-eye view video feed on the first split-screen portion via the output display; and outputs the vehicle rear view video feed on the second split-screen portion via the output display.
Claims
1. A method for a vehicle, comprising: The first control module installed on the trailer receives multiple video feeds from multiple cameras installed on the trailer, the multiple video feeds including a front view of the trailer, a rear view of the trailer, a left view of the trailer, and a right view of the trailer. The first control module generates a single trailer bird's-eye view video feed based on the multiple video feeds; as well as A single video signal, including the single trailer bird's-eye view video feed, is sent via a single auxiliary camera input channel to a second control module located in a trailer mechanically connected to the trailer, wherein the single trailer bird's-eye view video feed can be displayed in the trailer via an output display located in the trailer.
2. The method according to claim 1, further comprising: The second control module located in the trailer receives a trailer rear view video feed depicting the rear view of the trailer. The single trailer bird's-eye view video feed is displayed on the first split-screen portion via the output display; The rear view video feed of the trailer is displayed in the second split-screen section; as well as The output display shows the user optional icons or menu items to switch between the trailer rear view video feed and the single trailer bird's-eye view video feed.
3. The method of claim 2, further comprising feeding the trailer bird's-eye view video to the second control module via the single auxiliary camera input channel associated with the trailer wiring harness.
4. The method according to claim 3, wherein the single auxiliary camera input channel is composed of a single-channel connection at the trailer wiring harness.
5. The method according to claim 2, further comprising: The second control module receives multiple second video feeds associated with the trailer vehicle. The plurality of second video feeds include the rear view video feed, left view video feed, right view video feed, and front view video feed of the trailer vehicle.
6. The method of claim 5, further comprising: The second control module combines a bird's-eye view video feed showing a combination of bird's-eye views of the trailer and the tractor-trailer. The combined bird's-eye view video feed is displayed via the output display; as well as The output display shows the user optional icons or menu items to switch between the combined bird's-eye view video feed, the trailer rear view video feed, and the individual trailer bird's-eye view video feed.
7. A system for a vehicle, comprising: The first control module is installed in the trailer; as well as A first memory, disposed within the first control module, stores executable instructions that cause the first control module to execute the executable instructions to: Receive multiple video feeds, including a front view of the trailer, a rear view of the trailer, a left view of the trailer, and a right view of the trailer; A single aerial view video feed of the trailer is generated in the first control module based on the multiple video feeds received from multiple cameras mounted on the trailer. as well as A single video signal, including the bird's-eye view video feed from the single trailer, is sent to the trailer vehicle via a single auxiliary camera input channel.
8. The system of claim 7, further comprising: A second control module is disposed in the trailer vehicle mechanically connected to the trailer; as well as An output display, configured to communicate with the second control module, wherein the second control module is further configured to execute the executable instructions to: The second control module receives the single trailer bird's-eye view video feed via the single auxiliary camera input channel; as well as The single trailer bird's-eye view video feed is displayed on the output display.
9. The system of claim 8, further comprising a vehicle rear view video feed showing a rear view of the towed vehicle, wherein the second control module is further configured to execute the executable instructions to: The rear view video feed of the vehicle is received at the output display. The single trailer bird's-eye view video feed is output on the first split-screen portion via the output display; The rear view video feed of the vehicle is output on the second split-screen portion via the output display. as well as The output display provides the user with optional icons or menu items to switch between the vehicle rear view video feed and the single trailer bird's-eye view video feed.
10. The system of claim 9, wherein the first control module is further configured to execute the instructions to: The single trailer bird's-eye view video is fed to the second control module via the single auxiliary camera input channel associated with the trailer wiring harness.
11. The system of claim 10, wherein the single auxiliary camera input channel is composed of a single-channel connection at the trailer harness.
12. The system of claim 11, wherein the second control module is further configured to execute the executable instructions to: Receive multiple second video feeds associated with the trailer vehicle, wherein the multiple second video feeds include video feeds of a front view of the trailer vehicle, a rear view of the trailer vehicle, a left view of the trailer vehicle, and a right view of the trailer vehicle.
13. The system of claim 12, wherein the second control module is further configured to execute the executable instructions to: The video feed showing a bird's-eye view of the rear of the trailer and the tractor is combined via the second control module; The combined bird's-eye view video feed is output via the output display; and The output display shows the user optional icons or menu items to switch between the combined bird's-eye view video feed, the vehicle rear view video feed, and the single trailer bird's-eye view video feed.
14. The system of claim 13, wherein the second control module is further configured to execute the executable instructions to: The combined bird's-eye view video feed is output on the first split-screen portion via the output display; and The vehicle rear view video feed is displayed on the second split-screen portion via the output display.
15. A first non-transitory computer-readable storage medium in a first control module associated with a trailer, the first non-transitory computer-readable storage medium having instructions stored thereon, the instructions being executed by a first processor of the first control module: The first processor receives multiple video feeds, including a front view of the trailer, a rear view of the trailer, a left view of the trailer, and a right view of the trailer. The first processor generates a single aerial view video feed of the trailer based on the multiple video feeds received from multiple cameras mounted on the trailer; and A single video signal, including the bird's-eye view video feed from the single trailer, is transmitted to the trailer vehicle via a single auxiliary camera input channel.
Citation Information
Patent Citations
Display device for self-propelled industrial machine
CN104380724A
Tractor-trailer connections for image capture data
US20160052453A1
Vehicle and trailer maneuver assist system
US20190064831A1