Lighting for camera-based car trailer functions

Abstract

A method for controlling one or more lights of a vehicle based on image analysis during performance of a vehicle function is provided. The method includes receiving instructions to analyze one or more images captured by a camera supported by the vehicle. The method also includes sending instructions to a light system including one or more lights located near the camera. The instructions cause a current state of the one or more lights to change to a temporary state. During the temporary state, the method includes receiving one or more images from the camera and identifying one or more reference points within the one or more images.

Description

Technical Field

[0001] The present disclosure relates to a tractor configured to be attached to a trailer. The tractor provides rear lighting to observe the trailer. Background Art

[0002] A trailer is typically an unpowered vehicle towed by a powered tractor. A trailer may be a general-purpose trailer, a pop-up camper, a travel trailer, a livestock trailer, a flatbed trailer, an enclosed dispatcher, and a boat trailer, among others. The tractor may be a car, a crossover, a truck, a van, a sports utility vehicle (SUV), a recreational vehicle (RV), or any other vehicle configured to attach to and tow the trailer. The trailer may be attached to the powered vehicle using a trailer hitch. The recipient hitch is mounted on the tractor and connected to the trailer hitch to form a connection. The trailer hitch may be a ball-and-socket connector, a fifth wheel and gooseneck, or a trailer jack. Other attachment mechanisms may also be used. In addition to the mechanical connection between the trailer and the powered vehicle, in some examples, the trailer is electrically connected to the tractor. In this way, the electrical connection allows the trailer to obtain a feed from the taillight circuit of the powered vehicle, thereby allowing the trailer to have taillights, turn signals, and brake lights that are synchronized with the lights of the powered vehicle.

[0003] Some vehicles may be equipped with a trailer backup assist feature that helps the driver maneuver the trailer while driving the towing vehicle backwards. In some examples, the vehicle is equipped with a trailer knob that gives the driver the feeling that he / she is directly maneuvering the attached trailer when backing up, rather than maneuvering the vehicle backwards to cause the trailer to be pushed backwards. In this way, the trailer backup assist feature gives the driver an intuitive feeling as the driver drives in a rearward direction and turns the knob in one direction, which then turns the trailer in the same direction. This allows for a simpler and easier way to maneuver the trailer while backing up. When the vehicle is connected to the trailer, the driver typically manually enters the length of the trailer, in addition to several other trailer parameters, thereby allowing the towing vehicle to better maneuver the trailer in both the forward and rearward directions, and allowing the trailer backup assist feature to be activated. In some examples, the towing vehicle activates the trailer backup assist (or any other trailer backup feature). Once activated, the trailer backup assist requires knowledge of the trailer parameters, including the relative angle "α" of the trailer to the main / towing vehicle. T ”, and the length from the hitch to the central trailer axle L T .

[0004] The current state of the art methods of inputting these trailer parameters involve manually measuring the length and applying a specific sticker (or target) to the trailer that is designed for the sensor system to detect. Optionally, the trailer parameters can be learned through other image processing means. Current systems require a rear-view camera to detect the target sticker on the trailer, and other systems require the camera to track the trailer through reference / tracking points or edges. Therefore, these systems have problems when there is not enough light on the trailer for the system to detect the trailer or the sticker on the trailer. Summary of the invention

[0005] One aspect of the present disclosure provides a method for controlling one or more lights of a vehicle based on image analysis during the execution of a vehicle function. The vehicle function may include any function that includes image analysis, such as a trailer back-up assist function. In some examples, one or more lights face a rearward direction relative to the vehicle and are configured to illuminate a trailer attached to the vehicle. The method includes receiving an instruction at data processing hardware (i.e., a vehicle controller) to analyze one or more images captured by a camera that communicates with the data processing hardware. The received instruction is triggered by the start of the execution of the vehicle function. The method includes sending an instruction from the data processing hardware to a light system, the light system including one or more lights located near the camera, so that the one or more lights illuminate the captured image. The instruction causes the current state of the one or more lights to change to a temporary state. During the temporary state, the method includes receiving one or more images from the camera at the data processing hardware. In addition, during the temporary state, the method includes identifying one or more reference points within the one or more images at the data processing hardware.

[0006] Implementations of the present disclosure may include one or more of the following optional features. In some implementations, during a temporary state, the method includes sending instructions to a display that communicates with data processing hardware. The instructions cause the display to show one or more images. In some examples, the change in the current state of one or more lights includes a change from an off state to an on state, wherein the on state is a temporary state, or vice versa. During the temporary state, the intensity of the light can be modulated. The temporary state of one or more lights can include outputting light based on a pulse width modulation signal. The pulse width modulation signal can be synchronized with the acquisition timing of the camera image. When the execution of the vehicle function is completed, the method includes sending an instruction to the vehicle lighting system, which causes the temporary state of one or more lights to return to the current state.

[0007] Another aspect of the present disclosure provides a system for controlling one or more lights of a vehicle based on image analysis during the execution of a vehicle function. The system includes: a camera; a light system including one or more lights located near the camera; data processing hardware in communication with the camera and the light system; and memory hardware in communication with the data processing hardware. The memory hardware stores instructions that, when executed on the data processing hardware, cause the data processing hardware to perform operations including the above method.

[0008] The details of one or more implementations of the disclosure are set forth in the accompanying drawings and the description below. Other aspects, features, and advantages will be apparent from the description and drawings, and from the claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1A and 1B is a perspective view of an exemplary tractor vehicle hitched to a trailer;

[0010] Figure 2 is a schematic diagram of an exemplary tractor including a vehicle light system;

[0011] Figure 3 is a schematic diagram of an exemplary arrangement for regulating the operation of one or more lamps of a vehicle lighting system.

[0012] Like reference numbers in the various drawings represent like elements. DETAILED DESCRIPTION

[0013] A towing vehicle, such as, but not limited to, a car, a crossover, a truck, a van, a sport utility vehicle (SUV), and a recreational vehicle (RV), may be configured to tow a trailer. The towing vehicle is connected to the trailer via a trailer hitch. It is desirable for the towing vehicle to have a lighting system that provides rearward illumination for trailer back-up assist functions or other vehicle functions that require rearward vehicle illumination.

[0014] refer to Figure 1A-22, in some implementations, the vehicle-trailer system 100 includes a tractor 102 hitched to a trailer 104 via a hitch 106. The tractor 102 includes a driving system 110 associated with the tractor 102 that steers the tractor 102 and, therefore, the vehicle-trailer system 100 across a road surface based on, for example, driving maneuvers or commands having x, y, and z components. As shown, the driving system 110 includes a right front wheel 112, 112a, a left front wheel 112, 112b, a right rear wheel 112, 112c, and a left rear wheel 112, 112d. In addition, the driving system 110 may include wheels (not shown) associated with the trailer 104. The driving system 110 may also include other wheel configurations. The driving system 110 may include a motor or engine that converts a form of energy into mechanical energy that allows the vehicle 102 to move. The driving system 110 includes other components (not shown) that communicate and connect with the wheels 112 and the engine and allow the vehicle 102 to move, thereby also moving the trailer 104. The driving system 110 may also include a braking system 114 that includes a brake (not shown) associated with each wheel 112, 112a-d, wherein each brake is associated with a wheel 112a-d and is configured to slow down or stop the wheel 112a-n from rotating. In some examples, the braking system 114 is connected to one or more brakes supported by the trailer 104. The driving system 110 may also include an acceleration system configured to adjust the speed of the tractor 102 and thus the speed of the vehicle-trailer system 100, and a steering system configured to adjust the direction of the tractor 102 and thus the direction of the vehicle-trailer system 100. The vehicle-trailer system 100 may also include other systems.

[0015] The tractor 102 can move across the road surface by various combinations of motions about three mutually perpendicular axes defined by the tractor 102: a transverse axis X; V , front and rear axis Y V and the central vertical axis Z V . Transverse axis X V Extends between the right side R and the left side of the tractor 102. Along the front-rear axis Y V The forward driving direction is designated as F V , also called forward motion. In addition, along the front-to-back direction Y V The rearward or backward driving direction is designated as R V , also referred to as backward movement. In some examples, the tractor 102 includes a suspension system (not shown) that, when adjusted, enables the tractor 102 to rotate around the X V Axis and / or Y V Axis tilt, or along the central vertical axis Z VAs the tractor 102 moves, the trailer 104 follows the path of the tractor 102. Thus, when the tractor 102 moves in the forward direction F V When turning while moving, the trailer 104 follows. When turning, the tractor 102 and the trailer 104 form a trailer angle α T .

[0016] Additionally, the trailer 104 follows the tractor 102 across the road surface by various combinations of motions about three mutually perpendicular axes defined by the trailer 104: the trailer transverse axis X T 、Trailer front and rear axles Y T and the trailer center vertical axis Z T Trailer transverse axis X T Along the trailer wheel axle 105, it extends between the right side R and the left side of the trailer 104. Along the trailer front and rear axle Y T The forward driving direction is designated as F T , also known as forward motion. In addition, along the front-to-back direction Y T The trailer is driven rearward or backwards in the designated direction R T , also referred to as rearward movement. Thus, the movement of the vehicle-trailer system 100 includes the tractor 102 moving along its transverse axis X V , front and rear axis Y V and the central vertical axis Z V and the movement of the trailer 104 along its trailer transverse axis X T 、Trailer front and rear axles Y T and the trailer center vertical axis Z T Therefore, when the tractor 102 moves in the forward direction F V When turning while moving, the trailer 104 follows. When turning, the tractor 102 and the trailer 104 form a trailer angle α T , the angle is the vehicle's front and rear axis Y V and trailer front and rear axles Y T The angle between.

[0017] In some implementations, the vehicle 102 includes a sensor system 120 to provide sensor system data 122, which can be used to determine one or more measurements, such as the trailer axle length L T(which is the length from the hitch point 106 to the trailer axle 105). In some examples, the vehicle 102 may be autonomous or semi-autonomous, and therefore, the sensor system 120 may provide reliable and robust autonomous driving. The sensor system 120 provides sensor system data 122 and may include different types of sensors 124 that may be used alone or together to create a sense of the tractor's environment or a portion thereof, which is used by the vehicle-trailer system 100 to identify (one or more) objects in its environment and / or in some cases autonomously drive and make intelligent decisions based on objects and obstacles detected by the sensor system 120. In some examples, the sensor system 120 is supported by the rear of the tractor 102 and provides sensor system data 122 associated with the trailer 104 and (one or more) objects positioned behind the tractor 102. The tractor 102 may support the sensor system 120; while in other examples, the sensor system 120 may be supported by the vehicle 102 and the trailer 104. The sensor system 120 may include, but is not limited to, one or more imaging devices 124, 124a-n, such as (one or more) cameras, and sensors 126, 126a-n, such as, but not limited to, radar, sonar, LIDAR (light detection and ranging, optical remote sensing that may require measuring properties of scattered light to find the distance and / or other information of distant objects), LADAR (laser detection and ranging), ultrasonic sensors, etc. The sensor system 120 provides sensor system data 122 including images 122a from the one or more cameras 124 and sensor data 122b from the one or more sensors 126b, 126a-n. Thus, the sensor system 120 is particularly useful for receiving information of the vehicle's environment or portions of the environment, and for increasing the safety of the vehicle-trailer system 100 that may be operated by a driver or in semi-autonomous or autonomous conditions. In some implementations, the sensor system 120 includes a controller (not shown) that processes the sensor system data 122, while in other examples, the sensor system 120 sends received sensor system data 122 to the vehicle controller 150, which in turn processes the received data 122 (e.g., Figure 2 as shown).

[0018] The tractor 102 may include a user interface 130, such as a display. The user interface 130 is configured to display information to the driver. In some examples, the user interface 130 is configured to receive one or more user commands from the driver via one or more input mechanisms or a touch screen display and / or display one or more notifications to the driver. In some examples, the user interface 130 is a touch screen display. In other examples, the user interface 130 is not a touch screen, and the driver can use an input device such as, but not limited to, a rotary knob or a mouse to make selections. In some examples, the driver can interact with the user interface 130 to turn on or off a "rearward lights" feature (which is associated with the light system 140).

[0019] The tractor 102 includes a vehicle light system 140 including rear lights 142, 142a-d, such as but not limited to tail lights 142a, brake lights 142b, backup lights 142c, and center high mounted stop lights (CHMSL) 142d. In addition, the vehicle light system 140 includes other lights 142, 142e-n, such as forward lights and side lights.

[0020] The sensor system 120, the user interface 130, and the light system 140 communicate with a vehicle controller 150. The vehicle controller 150 includes a computing device (or data processing hardware) 152 (e.g., a central processing unit having one or more computing processors) in communication with a non-transitory memory or hardware memory 154 (e.g., a hard disk, flash memory, random access memory) capable of storing instructions executable on the computing processor(s). In some examples, the non-transitory memory 154 stores instructions that, when executed on the computing device 152, cause the vehicle controller 150 to provide a signal or command 156 to the light system 140, thereby causing the light system 140 to adjust one or more lights 142, 142a-n. As shown, the vehicle controller 170 is supported by the tractor 102; however, the vehicle controller 150 may be separate from the tractor 102 and communicate with the tractor 102 via a network (not shown).

[0021] In some implementations, vehicle functions related to visualization and detection of (one or more) objects based on received sensor system data 122 (such as camera image 122a) may not work in low-light conditions. In this case, the vehicle controller 150 instructs the vehicle lighting system 140 to illuminate one or more lights 142, 142a-n to improve the image 122a captured by the camera 124. For example, the camera 124 positioned on the rear of the vehicle 102 captures an image 122a of the trailer 104, and the controller 150 determines one or more trailer parameters based on the received image 122a. In addition or alternatively, the camera 124 can be positioned next to the center high-mounted stop lamp 142d, which captures the image 122a of the trailer 104, which is then processed by the controller 150 to determine one or more trailer parameters. The controller 150 may identify one or more reference points within each received image 122a associated with the trailer 104; however, in low-light conditions, the camera 124 may not be able to capture an image 122a that, when processed, identifies a reference point for tracking during movement of the tractor 102. In this case, the vehicle controller 150 instructs the vehicle lighting system 140 to illuminate one or more vehicle rear lights 142, 142a-d so that the camera 124 captures a better image 122a to be analyzed by the controller 150. The reference points within the image 122a identified and tracked by the sensor system 122 and controller 150 may be, but are not limited to, a target sticker, an icon, trailer edge(s), or any other markings already present on the trailer 104 or introduced by the customer. The vehicle controller 150 identifies the reference points within the image 122a by applying any image processing or machine vision technique, such as, but not limited to, a histogram.

[0022] In some implementations, a vehicle function associated with analyzing the received image 122a is calibrated by instructing a driver or the driving system 110 (for autonomous or semi-autonomous driving) to perform one or more driving maneuvers. During calibration, the vehicle controller 150 may instruct the vehicle light system 140 to continuously turn on a single light 142 or a plurality of lights 142, 142a-n to have uniform illumination through the maneuvers, wherein the single light 142 or a plurality of lights 142, 142a-n are positioned such that the camera(s) 124 captures an illuminated image 122a that can be processed due to the uniform illumination provided by the vehicle light system 140. For example, a trailer back-up assist function is calibrated by instructing a driver or the driving system 110 to perform one or more driving maneuvers. The vehicle controller 150 instructs the vehicle lighting system 140 to continuously turn on the single rear-facing light 142a-d or the plurality of rear-facing lights 142a-d to illuminate the trailer 104 by maneuvering to have uniform illumination, wherein the single rear-facing light 142a-d or the plurality of rear-facing lights 142a-d illuminates the trailer 104, thereby allowing the camera 124 to capture an illuminated image 122a that allows the controller 150 to identify one or more reference points within the captured image 122a.

[0023] In some examples, the controller 150 may process the image 122a without illumination, and then based on the received and processed image 122a, the controller 150 may instruct the vehicle lighting system 140 to illuminate one or more lights 142 located near the camera 124. In other examples, the controller may process the sensor system data 122 with minimal illumination (one or two lights 142 turned on), and then the controller 150 may adaptively increase the number of illumination sources or lights 142 used in order to successfully detect and track one or more objects (e.g., the trailer 104 attached to the tractor 102).

[0024] In some implementations, the controller 150 instructs the vehicle lighting system 140 to turn on the brake lights 142b to illuminate the trailer 104. In this case, the brake lights 142b will remain on even if the brakes are not applied. The trailer brake lights respond to the actual use of the brakes.

[0025] In some implementations, the controller 150 does not instruct the vehicle light system 140 to turn on the brake lights 142b, but instead instructs the vehicle light system 140 to turn on the other rear-facing lights 142a-d to illuminate the trailer 104. In this case, when the brakes are applied, the vehicle controller 150 prevents the brake system 114 from illuminating the vehicle brake lights 142b; however, the brake lights of the trailer 104 are turned on. In this way, the controller 150 provides consistent illumination of the trailer 104, which ensures that the target can be better tracked within the captured image 122a because the illumination provided does not change.

[0026] In some implementations, the controller 150 instructs the vehicle lighting system 140 to turn on the reverse lights 142c to illuminate the trailer 104. In this case, the reverse lights 142c will remain on even if the reverse gear is not engaged. Only the trailer reverse lights respond to the actual use of the reverse gear.

[0027] In some implementations, the controller 150 does not instruct the vehicle light system 140 to turn on the reverse lights 142c of the tractor 102, but instead instructs the vehicle light system 140 to turn on the other rear-facing lights 142a, 142b, 142d to illuminate the trailer 104. In this case, when the driver switches to reverse gear, the vehicle controller 150 prevents the reverse lights 142c from illuminating the trailer 104; however, when reverse gear is engaged, the reverse lights of the trailer 104 are turned on. In this way, the controller 150 provides consistent illumination with the trailer 104, which ensures better tracking of the target within the captured image 122a because the illumination provided does not change.

[0028] In some implementations, the controller 150 instructs the vehicle lighting system 140 to keep the light 142 continuously on, but the intensity is digitally pulse-width modulated. The image capture of the camera and the light illumination are synchronized so that all images 122a obtained by the camera 124 are evenly illuminated. In one example, if the camera frequency is 30 Hz, one of the lights 142, 142a-d (such as the brake light 142b) will also be pulse-width modulated at 30 Hz with a low duty cycle. The phase of the modulation is adjusted by the vehicle controller 150 based on the image acquisition of the camera. When the vehicle brakes are not applied, the light 142b is supplied with a high voltage when the camera aperture is open, and is supplied with a low voltage when the camera aperture is closed. This will enable all the images 122a collected to be illuminated at a high brightness, while a normal person perceives the light to be illuminated at a low brightness and understands that the taillights are on. When the vehicle brakes are applied, the brake light 142b will be continuously supplied with a high voltage. A normal person will perceive a brighter brake light and understand that the brakes are applied. Similar to the case where the brakes are not applied, all images 122a captured will also be illuminated at high brightness. Therefore, all images captured will have the same illumination regardless of whether the brakes are applied. Optionally, the vehicle controller 150 instructs the vehicle light system 140 to digitally pulse width modulate the lights 142 at the same frequency as the camera (e.g., briefly turn on or off - for as long as the camera's aperture speed dictates). In one example, if the camera frequency is 30 Hz, one of the lights (such as the reverse lights 142c) will also be pulse width modulated at 30 Hz with a high duty cycle when illumination is required. The phase of the modulation will be adjusted by the vehicle controller 150 based on the image capture of the camera. When the reverse gear is engaged, the lights 142c are not supplied with voltage when the camera aperture is open and are supplied with high voltage when the camera aperture is closed. This enables all images 122a captured to be illuminated at low brightness because the reverse lights 142c are turned off when the camera aperture is open. At the same time, a normal person perceives the lights to be turned on and understands that the reverse gear is engaged. When reverse gear is not engaged, the reverse lights will remain off. A normal person will understand that reverse gear is not engaged. All captured images will also be illuminated at a low brightness. Therefore, all captured images will have the same illumination regardless of whether reverse gear is engaged or not.

[0029] Alternatively, the various rear-facing lights 142a-d of the tractor 102 may be replaced by similar colored lights having wavelengths extending into the infrared spectrum. These similar colored lights may be used to illuminate the trailer 104 for trailer back-up assist functions, for calibration maneuvers, or any other functions associated with image analysis, and image processing may be performed only on the infrared spectrum. This would enable the driver to perceive the normal operation of all lights.

[0030] In some implementations, the light 142 return to normal operating function is not used, or the calibration maneuver for trailer maneuvers is not performed.

[0031] Figure 3 An exemplary arrangement of operations of method 300 is provided for using Figure 1A-2 The system described in the claims controls one or more lights 142, 142a-d of the vehicle 102 based on image analysis during the execution of a vehicle function. The vehicle function may include any function that includes image analysis, such as a trailer back-up assist function. In some examples, the one or more lights 142, 142a-d face a rearward direction relative to the vehicle 102 and are configured to illuminate the trailer 104 attached to the vehicle 102. At box 302, the method 300 includes receiving an instruction at the data processing hardware 152 (i.e., the vehicle controller 150) to analyze one or more images 122a captured by the camera 124 in communication with the data processing hardware 150. The received instruction is triggered by the start of the execution of the vehicle function. At box 304, the method 300 includes sending an instruction from the data processing hardware 150, 152 to the vehicle light system 140, the vehicle light system 140 including one or more lights 142, 142a-d located near the camera 124. The instructions cause the current state of one or more lights 142, 142a-d to change to a temporary state. During the temporary state, at block 306, the method 300 includes receiving one or more images 122a from the camera 124 at the data processing hardware 150, 152. Additionally, at block 308, during the temporary state, the method 300 includes identifying one or more reference points within the one or more images 122a at the data processing hardware 150, 152.

[0032] In some implementations, during the temporary state, the method includes sending instructions to a display 130 that communicates with the data processing hardware 150, 152. The instructions cause the display 130 to show one or more images 122a. In some examples, the change of the current state of one or more lights 142 includes a change from an off state to an on state, wherein the on state is a temporary state, or vice versa. During the temporary state, the intensity of the light 142 can be modulated. The temporary state of one or more lights can include outputting light based on a pulse width modulation signal. The pulse width modulation signal can be synchronized with the acquisition timing of the camera image. When the execution of the vehicle function is completed, the method 300 includes sending instructions to the vehicle lighting system 140 to change the temporary state of one or more lights back to the current state.

[0033] Various implementations of the systems and techniques described herein can be realized in digital electronic circuitry, integrated circuitry, specially designed ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include implementations in one or more computer programs executable and / or interpretable on a programmable system, the programmable system comprising at least one programmable processor, which may be special purpose or general purpose, coupled to receive data and instructions from a storage system, at least one input device, and at least one output device, and to send data and instructions to the storage system, at least one input device, and at least one output device.

[0034] These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for a programmable processor and may be implemented in high-level procedural and / or object-oriented programming languages ​​and / or in assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and / or device (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

[0035] The subject matter and implementation of the functional operations described in this specification may be implemented in digital electronic circuits, or in computer software, firmware or hardware (including the structures disclosed in this specification and their structural equivalents), or in a combination of one or more of them. In addition, the subject matter described in this specification may be implemented as one or more computer program products, that is, one or more modules of computer program instructions encoded on a computer-readable medium for execution by a data processing device or for controlling the operation of the data processing device. The computer-readable medium may be a machine-readable storage device, a machine-readable storage substrate, a memory device, a combination of substances that implement machine-readable propagation signals, or a combination of one or more of them. The terms "data processing device", "computing device" and "computing processor" cover all devices, devices and machines for processing data, including, for example, a programmable processor, a computer, or multiple processors or computers. In addition to hardware, the device may also include code that creates an execution environment for the computer program in question, for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them. A propagation signal is an artificially generated signal, for example, a machine-generated electrical, optical or electromagnetic signal, which is generated to encode information for transmission to a suitable recipient device.

[0036] Similarly, although operations are depicted in a particular order in the accompanying drawings, this should not be understood as requiring that such operations be performed in the particular order shown or in a sequential order or that all of the operations shown be performed to achieve the desired result. In some cases, multitasking and parallel processing may be advantageous. In addition, the separation of various system components in the above-described embodiments should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.

[0037] A variety of implementations have been described. However, it should be understood that various modifications can be made without departing from the spirit and scope of the present disclosure. Therefore, other implementations are within the scope of the appended claims.

Claims

1. A method for controlling one or more lights of a vehicle based on image analysis during performance of a vehicle function, the method comprising: receiving instructions at data processing hardware to analyze one or more images captured by a camera in communication with the data processing hardware; sending an instruction from the data processing hardware to a vehicle lighting system including one or more lights located near the camera, the instruction causing a current state of the one or more lights to be changed to a temporary state; During the temporary state: receiving, at the data processing hardware, one or more images from the camera; as well as identifying, at the data processing hardware, one or more reference points within the one or more images, Wherein the temporary state of the one or more lamps comprises outputting light based on a pulse width modulation signal, comprising: When the reverse gear is engaged, the lamp is not supplied with voltage when the camera is capturing images, and is supplied with high voltage when the camera is not capturing images; or When the vehicle brakes are not applied, the lamp is supplied with a high voltage when the camera is performing image acquisition, and is supplied with a low voltage when the camera is not performing image acquisition.

2. The method of claim 1 , further comprising, during the temporary state: Instructions are sent to a display in communication with the data processing hardware, the instructions causing the display to show the one or more images.

3. The method according to claim 1, wherein: The vehicle functions include a trailer back-up assist function.

4. The method according to claim 1, wherein: The one or more lights face in a rearward direction relative to the vehicle and are configured to illuminate a trailer attached to the vehicle.

5. The method according to claim 1, wherein: The change of the current state of the one or more lights comprises a change from an off state to an on state, the on state being the temporary state, or vice versa.

6. The method according to claim 1, wherein: During the temporary state, the intensity of the lamp is modulated. 7 . The method according to claim 1 , further comprising, when the execution of the vehicle function is completed, sending a command to the vehicle light system so that the temporary state of the one or more lights changes back to the current state.

8. A system for controlling one or more lights of a vehicle based on image analysis during performance of a vehicle function, the system comprising: Camera; a vehicle lighting system including one or more lights positioned proximate to the camera; data processing hardware in communication with the vehicle lighting system and the camera; as well as Memory hardware in communication with the data processing hardware, the vehicle light system, and the camera, the memory hardware storing instructions that, when executed on the data processing hardware, cause the data processing hardware to perform operations, the operations comprising: receiving instructions to analyze one or more images captured by the camera; Sending a command to the vehicle lighting system, the command causing the current state of the one or more lights to be changed to a temporary state; During the temporary state: receiving one or more images from the camera; and identifying one or more reference points within the one or more images, Wherein the temporary state of the one or more lamps comprises outputting light based on a pulse width modulation signal, comprising: When the reverse gear is engaged, the lamp is not supplied with voltage when the camera is capturing images, and is supplied with high voltage when the camera is not capturing images; or When the vehicle brakes are not applied, the lamp is supplied with a high voltage when the camera is performing image acquisition, and is supplied with a low voltage when the camera is not performing image acquisition.

9. The system according to claim 8, wherein: During the temporary state, the operations further include: Instructions are sent to a display in communication with the data processing hardware, the instructions causing the display to show the one or more images.

10. The system according to claim 8, wherein: The vehicle functions include a trailer back-up assist function.

11. The system according to claim 8, wherein: The one or more lights face in a rearward direction relative to the vehicle and are configured to illuminate a trailer attached to the vehicle.

12. The system according to claim 8, wherein: The change of the current state of the one or more lights comprises a change from an off state to an on state, the on state being the temporary state, or vice versa.

13. The system according to claim 8, wherein: During the temporary state, the intensity of the lamp is modulated.

14. The system according to claim 8, wherein: When the execution of the vehicle function is completed, the operation further includes: sending an instruction to the vehicle light system so that the temporary state of the one or more lights changes back to the current state.

Images