Method and system for vehicular lidar and communication utilizing vehicle head light and / or taillight

By employing vehicle LED light assemblies for LIDAR, the cost and safety issues of traditional laser-based systems are addressed, enabling accurate distance measurements through high-frequency modulation, thereby reducing power consumption and eliminating the need for lasers.

JP2024166145APending Publication Date: 2024-11-28WIRELESS PHOTONICS LLC
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
JP2024079087
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-16
Filing Date
2024-05-15
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Current laser-based LIDAR systems for autonomous driving are costly and pose eye safety issues, while existing flash LIDAR systems compromise optical power and sensitivity due to wide beam illumination.

Method used

Utilize existing vehicle LED light assemblies, such as headlights and taillights, for LIDAR by modulating light at high frequencies to calculate distance based on time-of-flight measurements, eliminating the need for lasers and laser scanning.

Benefits of technology

Reduces the cost of LIDAR systems and enhances safety by using existing vehicle components, providing accurate distance measurements without the need for powerful lasers, thus reducing power consumption and eye safety risks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024166145000001_ABST
    Figure 2024166145000001_ABST
Patent Text Reader

Abstract

To provide a method and system for vehicular LIDAR and communication utilizing vehicle head light and / or taillight.SOLUTION: A method of measuring a distance between a vehicle and objects includes: generating a modulation signal; generating a modulated light emitting diode (LED) transmission signal via a vehicle LED driver assembly; transmitting a plurality of light beams based at least in part on the generated modulated LED transmission signal; capturing reflections of the plurality of light beams off the objects by utilizing lens assemblies and a camera, the camera including an array of pixel sensors; communicating a series of measurements representing the captured plurality of light beam reflections; calculating, by utilizing a time-of-flight sensor module, time-of-flight measurements between a vehicle LED light assembly and the objects; and calculating distances, by utilizing a depth processor module, between the vehicle LED light assembly and the objects based on the time-of-flight measurements.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] CROSS REFERENCE / INCORPORATION BY REFERENCE TO RELATED APPLICATIONS none.

[0002] Technical Field Certain embodiments of the present disclosure relate to vehicular light detection and ranging (LIDAR) systems and other embodiments relate to vehicular communication systems. More particularly, certain embodiments of the present disclosure relate to vehicular lidar systems that utilize light emitting diode (LED) light assemblies and certain embodiments of the present disclosure relate to vehicular communication systems that utilize LED light assemblies in outdoor environments. [Background technology]

[0003] background Driver assistance and autonomous driving systems require three-dimensional ("3D") cameras, known as light detection and ranging ("lidar"), to sense the distance (range) to objects in front of the car. Most existing laser-based lidar techniques employ laser scanning of target objects and measure range through pulsed time-of-flight (TOF) measurements - i.e., the time it takes for each laser pulse to hit the target and return to the sensor. Autonomous driving systems may also use another technique that uses a frequency-swept (FMCW) laser to scan the target object, similar to radio frequency FMCW radar, followed by coherent detection. Currently, both of these techniques are too costly for the automotive or mobile vehicle industry.

[0004] Driver assistance and autonomous driving systems may also use an alternative 3D imaging technique named flash lidar. In flash lidar, the entire field of view is illuminated with a wide diverging light beam in a single pulse. This is in contrast to traditional scanning lidar, which uses a collimated laser beam that illuminates a single point at a time, and is raster scanned to illuminate the field of view point by point. In these environments, depth information is collected using the time of flight (TOF) of the laser pulse, which requires pulsing the laser and acquiring it with a camera, and the laser and camera must be synchronized. By measuring the time of flight at every pixel of the camera, a 3D image of the target object is formed. However, the light power and also the sensitivity are reduced because the energy of the laser is spread over the entire field of view. To compensate for this in flash lidar, the laser must be powerful, which increases the cost and also causes eye safety issues. Summary of the Invention [Problem to be solved by the invention]

[0005] Through comparison of such systems with certain aspects of the present disclosure as described in the remainder of this application with reference to the drawings, further limitations and disadvantages of conventional and traditional approaches will become apparent to those skilled in the art. A low-cost system is needed that utilizes existing vehicle components for both the LIDAR system and the communication system. [Means for solving the problem]

[0006] Summary of the Disclosure A light detection and ranging (lidar) system and method utilizing a vehicle's existing or native LED light assembly to determine a distance between the vehicle and one or more objects and provide the obtained information to an automated driving or driver assistance system of the vehicle, substantially as hereinbefore described and / or illustrated in at least one of the figures, and as hereinbefore described in the claims. A communication system and method for communicating between a first vehicle and a second vehicle without reliance on a cellular network, utilizing the vehicles' existing or native LED light assemblies, substantially as hereinbefore described and / or illustrated in at least one of the figures, and as hereinbefore described in the claims.

[0007] These and other advantages, aspects, and novel features of the present disclosure, as well as details of illustrated embodiments thereof, will become more fully understood from the following description and drawings. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram illustrating various components of an exemplary vehicular light detection and ranging (LIDAR) system, in accordance with an exemplary embodiment of the present disclosure. [Diagram 2] FIG. 2 is a block diagram illustrating calculation of time-of-flight measurements according to an exemplary embodiment of the present disclosure. [Diagram 3] FIG. 3 is a flow chart illustrating an exemplary method for calculating distance between a vehicle and one or more objects using a vehicle's LED light assembly based LIDAR system in accordance with one embodiment of the present disclosure. [Figure 4] FIG. 4 is a block diagram of a vehicle processor and multiple vehicle subsystems according to one embodiment of the disclosure. [Diagram 5] FIG. 5 is a block diagram illustrating various components of an exemplary LED light communication system, according to an exemplary embodiment of the present disclosure. [Figure 6]FIG. 6 is a flow chart illustrating an exemplary method for communicating between a first vehicle and a second vehicle utilizing an LED assembly according to one embodiment of the present disclosure. [Figure 7] FIG. 7 illustrates a communication system between a first vehicle, a second vehicle, and a third vehicle using a vehicle LED communication system according to some implementations. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Detailed Description of the Disclosure The following detailed description provides a better understanding of the features and advantages of the invention described in this disclosure in accordance with the embodiments disclosed herein. The following detailed description describes a method and system that utilizes a vehicle LED light assembly in a LIDAR system and for communicating between a first vehicle and a second vehicle.

[0010] The subject matter disclosed herein is a vehicular three-dimensional (3D) imaging system that utilizes the headlights or taillights of a vehicle to accomplish ranging, i.e., measuring the distance from the vehicle to an object. Applications that may utilize the subject matter described herein may include, but are not limited to, transportation and / or robotics. The subject matter described herein eliminates the need for lasers for illumination of the scene by utilizing many existing aspects and / or components of the vehicle, and reduces the cost of vehicular LIDAR systems by eliminating the need for laser scanning. The subject matter described herein leverages and utilizes in-vehicle LED light assemblies (e.g., LED headlights and taillights) that exist in modern vehicles. The present invention provides a 3D imaging system that is compatible with older gasoline engines and is compatible with older gasoline engines. The present invention takes advantage of the fact that LEDs can be modulated at high frequencies, unlike gas discharge headlights (e.g., halogen lights). This property of LEDs allows an LED light assembly to be used as the light source and a camera (with an array of pixel sensors) to be used as a detector for the reflected modulated light beams that can be used by a time-of-flight module to calculate the range or distance from the measured object(s) to the vehicle. It is understood that the fundamental maximum modulation speed of an LED is limited by the spontaneous emission lifetime in the semiconductor or the capacitance of the LED, including the capacitance of the electrodes and wiring. In these implementations, the wiring of the LED assembly can be modified to take advantage of modulating the LEDs at a higher frequency or speed.

[0011] The low coherence of the LED light assembly (compared to the high coherence of the laser assembly) is not an issue with the systems and methods described herein because the time-of-flight measurements are based on a direct measurement of the optical power in the reflected light beams, not the electric field of the light beam. Furthermore, tail lights may also be utilized as light sources with the subject matter disclosed herein, because the range or distance measurements are based on the time of arrival of the intensity of the reflected light beam, not the color of the light. Thus, the red color of the rear light does not affect the accuracy of the range measurement. Nevertheless, a color filter may be used in front of the detector in the receiver to filter out unwanted light from entering the receiver.

[0012] In the following description, references are made to the accompanying drawings, which form a part hereof, and in which are shown by way of illustration various embodiments of the present disclosure.

[0013] FIG. 1 is a block diagram illustrating various components of an exemplary vehicle light detection and ranging (LIDAR) system according to an exemplary embodiment of the present disclosure. Referring to FIG. 1, a vehicle LIDAR system 100 is shown in a vehicle 101, which may include one or more power sources 106, one or more signal modulators 105, one or more light emitting diode (LED) drivers 107, one or more LED light assemblies 109, a vehicle central processor 110, one or more lenses or lens assemblies 112, one or more cameras 113 including an array of pixel sensors, one or more time-of-flight (TOF) sensor modules 114, one or more depth processors 115, one or more additional vehicle processors (not shown), one or more software applications 116, one or more memory devices 122, and / or one or more vehicle subsystems (described in detail with reference to FIG. 4). In some implementations, the vehicle LIDAR system 100 may further include a synchronization module 140 and / or a filter module 145.

[0014] In an exemplary embodiment, the vehicle 101 may be a car, a truck, an agricultural vehicle (tractor) that includes a light assembly, an electric bicycle that includes a light assembly, an auto terrain vehicle (ATV) that includes a light assembly, a motorcycle that includes a light assembly, an airplane, a golf cart that includes a light assembly, a robot or autonomous delivery vehicle that includes a light assembly, or a moving vehicle that includes a light assembly. Any device that moves and includes a light assembly may also be referred to as a vehicle.

[0015] In an exemplary embodiment, the vehicle 101 may include one or more power sources 106. The one or more power sources 106 may be one or more batteries. In some embodiments, if the vehicle is fully electric, the one or more batteries may be charged via an electric vehicle charging system. In some embodiments, the one or more batteries may be powered using a gas combustion engine system. In some implementations, the one or more batteries may be powered using a hydrogen gas combustion system. In an exemplary embodiment, the one or more power sources 106 may be coupled or connected to the vehicle 101 and / or other electrical components in an electrical or electromechanical subsystem.

[0016] In an exemplary embodiment, the vehicle LIDAR system may include one or more signal modulators 105. In some implementations, the one or more signal modulators 105 may utilize pulse modulation, or alternatively, sinusoidal modulation. In some implementations, the one or more signal modulators 105 may generate a modulated signal having a frequency ranging from 100 megahertz to 300 megahertz. In alternative implementations, the one or more signal modulators 105 may generate a modulated signal having a frequency ranging from 75 megahertz to 600 megahertz. It is understood that the fundamental maximum modulation speed of an LED is limited by the spontaneous emission lifetime in the semiconductor. The maximum speed may be further constrained by the capacitance of the LED, including the capacitance of the electrodes and wiring. In this context, certain analog circuit techniques, such as pre-emphasis or RF peaking techniques, may be used to expand the LED bandwidth and thus increase its modulation speed.

[0017] In an exemplary embodiment, the one or more signal modulators 105 may be coupled or connected to one or more LED driver assemblies 107. The one or more LED driver assemblies 107 may generate a modulated LED transmit signal based at least in part on the modulation signal. In some implementations, the one or more LED driver assemblies 107 may be integrated circuits manufactured by Texas Instruments, ST, Infineon, and ON Semiconductor.

[0018] In an exemplary embodiment, the vehicle LED light assembly 109 may be communicatively coupled or connected to the LED driver assembly 107. In an exemplary embodiment, the LED light assembly 109 may transmit or generate multiple light beams. The multiple light beams may be based at least on the generated modulated LED transmit signal. The vehicle LED light assembly 109 may be a vehicle headlight, or alternatively, a vehicle taillight. In implementations, the vehicle LED light assembly 109 may include multiple LED lights. In some implementations, the vehicle LED light assembly may be an LED headlight, an LED taillight, an LED light assembly installed on a front portion of the vehicle, or an LED light assembly installed on a rear portion of the vehicle. Utilizing the existing vehicle LED light assembly 109 for the vehicle LIDAR system and eliminating laser scanning reduces the overall cost for the LIDAR system. In the subject matter described herein, eliminating lasers also reduces the amount of power the vehicle 101 may expend in determining a distance between the vehicle and / or one or more objects.

[0019] In an exemplary embodiment, one or more objects 130 may be located in an outdoor environment along with the vehicle 101, while in other exemplary embodiments, the vehicle 101 and one or more objects 130 may be located in an indoor environment, or alternatively, in an outdoor environment. The automotive lidar system 100 may be utilized to determine a distance between the one or more objects 130 and the vehicle 101. In some implementations, one or more of the light beams may reflect off the one or more objects 130 and generate multiple reflected light beams. In some implementations, the multiple reflected light beams may be captured or received by one or more cameras located or mounted on the vehicle. The one or more objects 130 may be people, animals, furniture, buildings, or parked vehicles. The generation of the multiple reflected light beams may occur continuously, and the one or more cameras may continuously receive and / or capture the multiple reflected light beams.

[0020] In an exemplary embodiment, the multiple reflected light beams may pass through one or more lens assemblies 112 installed in the vehicle. In some implementations, the one or more lens assemblies 112 may focus the multiple reflected light beams onto an array of pixel sensors in one or more cameras 113.

[0021] In an exemplary embodiment, the one or more lens assemblies 112 may be in front of and / or communicatively coupled or connected to one or more cameras 113 on the vehicle. In an exemplary embodiment, after passing through the one or more lens assemblies 112, the reflected light beams may be captured by one or more cameras 113 positioned on the vehicle. In some implementations, the one or more cameras 113 in the vehicle may include one or more arrays of pixel sensors. The array of pixel sensors of the camera 113 may capture the reflected light beams and generate a number of measurements representing the captured intensities of the reflected light beams. In some implementations, the camera including the array of sensor pixels may be an Analog Devices ADSD3100 integrated circuit. However, other cameras may be utilized. In some implementations, the camera including the array of sensor pixels may be a three-dimensional camera, or alternatively, a two-dimensional camera. In some implementations, multiple components, such as one or more lens assemblies 112, a camera 113 including one or more arrays of pixel sensors, a vehicle LED assembly 109, and / or a vehicle LED driver assembly 107, may be located on or part of a single chipset, which reduces size and space requirements within the vehicle.

[0022] In an exemplary embodiment, the one or more cameras 113 may be communicatively coupled or connected to a time-of-flight sensor module 114. In some implementations, the one or more cameras 113 may communicate generated measurements to the time-of-flight sensor module 114. The time-of-flight sensor module 114 may calculate time-of-flight (TOF) measurements between the vehicle 101 and one or more objects 130. Figure 2 illustrates the calculation of TOF measurements between a vehicle and two objects according to an exemplary embodiment.

[0023] 2 is a block diagram illustrating calculation of time-of-flight measurements according to an exemplary embodiment of the present disclosure. The TOF system 200 includes a vehicle LED transmitter or lighting assembly 205, an object (human) 210, a second object 215 (human), a vehicle camera 220, a vehicle timing subsystem 225, and / or software 230 for calculating distances between the vehicle LED transmitter or lighting assembly 205 and multiple objects 210 and 215 (people 210 and 215). In some implementations, the vehicle LED transmitter or lighting assembly 205 transmits multiple modulated light beams toward the first object 210 and the second object 215. Multiple reflected light beams may bounce off or be reflected from the first object 210 and the second object 215. In some implementations, a camera including an array of sensor pixels, or a receiver 220, may capture the reflected light beams and generate light intensity measurements based on the captured reflected light beams. A time-of-flight module including a timer 225 may receive the generated light intensity measurements and generate a time between pulses of the transmitted modulated light beams and the captured reflected light beams for the first object 210 and the second object 215. In some implementations, the time-of-flight module measures a time delay Δ between when the light is emitted or transmitted from the vehicle LED light assembly 205 and when the reflected light is received by the camera 220 including an array of sensor pixels. The time delay is proportional to twice the distance between the camera 220 and the first object 210 and the second object 215, and thus the distance may be estimated as depth=cΔ / 2, where c is the speed of light. As an illustrative example as shown in FIG. 2, the time-of-flight module including a timer 225 may generate a time between pulses of 16.67 nanoseconds for the first person (object) 210 or a time between pulses of 33.33 nanoseconds for the second person (object) 215. The depth processor module including the distance generation algorithm 230 may calculate a distance (reference number 235) between the first person (object) 210 and the vehicle LED light assembly 205 of 2.5 meters, and a distance (reference number 235) between the second person (object) 215 and the vehicle LED light assembly 205 of 5.0 meters.

[0024] In an exemplary embodiment, a depth processor or depth processor module 115 may be communicatively coupled or connected to the TOF sensor module 114. The depth processor or depth processor module 115 may receive TOF measurements from the TOF sensor module 114. The depth processor or depth processor module 115 may calculate distances between the vehicle and objects. In some implementations, the distances may be stored in one or more memory devices 122 within the vehicle. In other implementations, the distances may be color coded with an image shown on a monitor inside the vehicle.

[0025] In an exemplary embodiment, the vehicle central processor 110 may be communicatively coupled to one or more memory devices 122 and / or a depth processor or depth processor module 115. In some implementations, the vehicle central processor 110 may read the multiple distances from the one or more memory devices 122 and communicate the multiple distances to other vehicle subsystems (e.g., a vehicle navigation subsystem, a vehicle braking subsystem, a vehicle transmission subsystem, a vehicle steering system, a vehicle audio system, or a vehicle display subsystem, which are described in more detail below) for the other vehicle subsystems to utilize the multiple distances in the operation of those subsystems. In some implementations, the vehicle central processor 110 may communicate with the depth processor or depth processor module 115 and instruct the depth processor or depth processor module 115 to communicate the multiple distance measurements to one or more of the other vehicle subsystems.

[0026] The vehicle central processor 110 may include suitable logic, circuitry, and / or interfaces configured to control various components within the vehicle LIDAR system and / or the vehicle central processor 110 may execute instructions stored in one or more memory devices 122. Example implementations of the vehicle central processor 110 may include, but are not limited to, embedded processors, field-programmable gate arrays (FPGAs), microcontrollers, dedicated DSPs, application-specific integrated circuit (ASIC) processors, graphics processor units (GPUs), and / or other processors.

[0027] In an exemplary embodiment, the systems and / or devices described above will operate continuously while the vehicle is powered on in order to continuously monitor the distance between one or more objects and / or vehicles.

[0028] In an exemplary embodiment, one or more software application programming interfaces (APIs) 116 may be stored in one or more memory devices 122. In some implementations, the one or more software APIs 116 may be executable by the vehicle central processor 110 to communicate with one or more other vehicle subsystems.

[0029] The one or more memory devices 122 may include suitable logic, circuitry, and / or interfaces that may be configured to store computer-readable instructions executable by the vehicle central processor 110. Example implementations of the one or more memory devices 122 may include, but are not limited to, random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), processor cache, thyristor random access memory (T-RAM), zero-capacitor random access memory (Z-RAM), read only memory (ROM), hard disk drive (HDD), secure digital (SD) card, flash drive, cache memory, and / or other non-volatile memory. Those skilled in the art will appreciate that the memory controller may control the operation of one or more memory devices 122 and may further include one or more other components known in the art, such as an analog to digital converter (ADC), a digital to analog converter (DAC), a cellular modem, and the like, which have been omitted for simplicity.

[0030] In an exemplary embodiment, the various components (e.g., the depth processor 115, the TOF sensor 114, the camera 113, the signal modulator 105, the LED driver 107, and / or the LED assembly 109) may utilize a number of different communication protocols when communicating with the vehicle central processor 110. These communication protocols may include a Mobile Industry Protocol Interface (MIPI), a Serial Peripheral Interface (SPI), and / or an Inter-Integrated Circuit interface (I2C). In an exemplary embodiment, the vehicle central processor 110 described above may communicate with various other subsystems utilizing a Controller Area Network bus (CANbus). The communication may be via a Controller Area Network (CAN). Communication may be performed using the CAN (Automatic Communication Network) protocol. In some implementations, the vehicle may include a number of subsystems (e.g., as shown in FIG. 4 and described below), including, but not limited to, a vehicle braking subsystem 405, a vehicle transmission subsystem 430, a vehicle steering subsystem 410, a vehicle audio subsystem 425, and a vehicle display subsystem 435. In some implementations, the vehicle central processor 110 may communicate with the subsystems over a CANbus using a CAN protocol. The subsystems may also be referred to as electronic control units (ECUs). In some implementations, the ECUs may have hard-wired sensors and switches to detect variables such as temperature, pressure, voltage, acceleration at different angles, braking, vehicle yaw and roll, steering angle, and many other signals. When the ECU needs a signal from a sensor connected to the ECU elsewhere in the automobile, the ECU or the subsystem may communicate using a CANbus.

[0031] Current vehicle-to-vehicle technologies include Cellular V2X (C-V2X), a 3GPP standard for autonomous vehicles, and Dedicated Short Range Communication (DSRC), which alerts drivers of impending hazardous conditions or events in time to take corrective or evasive action. Both C-V2X and DSRC are wireless based and require a communication infrastructure or network to be in place. However, the subject matter described herein does not require a wireless network or communication interface and involves direct communication between vehicles. The subject matter described herein can operate in all environmental conditions. In addition, the subject matter described herein has low latency compared to current wireless vehicle-to-vehicle technologies due to the directness of the communication, in conjunction with the speed of optical transmission. This is a major advantage over current vehicle-to-vehicle technologies and is crucial for autonomous vehicles and / or automotive safety, where the speed of communication between vehicles is crucial. Another application of the subject matter described herein is the ability to have covert communication between two or more vehicles that other drivers cannot eavesdrop on and would not even be aware is happening.

[0032] In an exemplary embodiment, a braking software API may be executable by the vehicle central processor 110 to communicate with the vehicle braking subsystem 405. Depending on the implementation, the vehicle central processor 110 may utilize the vehicle braking subsystem 405 to command the vehicle braking subsystem 405 to activate or deactivate. As an example, the vehicle central processor 110 may determine that if any of the received distance measurements are too close to the vehicle, to command the braking subsystem 405 to activate to stop the vehicle or apply one or more brakes to slow the vehicle.

[0033] In an exemplary embodiment, a vehicle transmission system API may be executable by the vehicle central processor 110 to communicate with the vehicle transmission subsystem 430. In some implementations, the vehicle central processor 110 may utilize the vehicle transmission subsystem 430 to instruct the vehicle transmission subsystem 430 to shift or not shift into a particular gear (e.g., drive, reverse, neutral). As an illustrative example, the vehicle central processor 110 may determine that if any of the received distance measurements are too close to the vehicle, to instruct the vehicle transmission subsystem 430 to shift the transmission or gearing assembly into drive or reverse to prevent the vehicle from hitting another or approaching one or more objects.

[0034] In an exemplary embodiment, a steering API may be executable by the vehicle central processor 110 to communicate with the vehicle steering subsystem 410. In some implementations, the vehicle central processor 110 may utilize the steering API to instruct the vehicle steering subsystem 410 to turn the vehicle in a particular direction. As an example, the vehicle central processor 110 may determine that if a plurality of received distance measurements identify that one or more objects are to the right, to instruct the vehicle steering subsystem 410 to turn the vehicle to the left in order to move away from the detected one or more objects.

[0035] In an exemplary embodiment, an audio software API may be executable by the vehicle central processor 110 to communicate with the vehicle audio subsystem 425. In some implementations, the vehicle central processor 110 may utilize the audio software API to instruct the vehicle audio subsystem 425 to generate audio. As an example, the vehicle central processor 110 may determine that if any of the received distance measurements are too close to the vehicle, it instructs the vehicle audio subsystem 425 to speak a message to the driver or passenger to inform him or her that one or more objects are approaching and to adjust the victim's speed to stop or slow down.

[0036] In an exemplary embodiment, a display software API may be executable by the vehicle central processor 110 to communicate with the vehicle display subsystem 435. In some implementations, the vehicle central processor 110 may utilize the display software API to instruct the vehicle display subsystem 435 to display a message or an image. As an example, the vehicle central processor 110 may determine that if any of the received distance measurements are too close to the vehicle, to instruct the vehicle display subsystem 435 to display a message that one or more objects are too close and / or to display an image showing the location of one or more objects to bring the driver's attention to the one or objects.

[0037] In an exemplary embodiment, the vehicle LIDAR system 100 may include a synchronization module 140. The synchronization module 140 may be implemented in software, hardware, and / or a combination thereof. In some implementations, the synchronization module 140 may be configured to synchronize the camera 113 and the modulated signal from the signal modulator 105. In some implementations, the signal modulator 105 and / or the camera 113 may utilize a code division multiple access (CDMA) protocol. The signal modulator 105 may use the CDMA protocol to impart a specific code to the modulated signal. The camera module 113 (including an array of pixel sensors) may be configured to capture multiple reflected light beams that include the imparted specific code. Other reflected light beams that do not include the specific code may be discarded and not utilized. This would allow, for example, stray light from other light sources, such as other vehicles, street lights, natural light sources like the moon and sun, that may be picked up by the camera module 113, to not be utilized in determining the time-of-flight measurements. In other words, utilizing CDMA filtering and protocols allows the vehicle lidar system 101 to filter out and utilize only the multiple reflected light beams transmitted by the vehicle LED light assemblies, which improves the accuracy of the vehicle lidar system 100.

[0038] In an exemplary embodiment, the vehicle LIDAR system 100 may further include an optical filter module 145. The filter module 145 may be coupled or connected to one or more cameras 113 including an array of pixel sensors. In some implementations, the signal modulator 105 may utilize one single frequency or a certain number of single frequencies in generating the modulated signal. The filter module 145 may receive the multiple reflected light beams and filter out any of the multiple reflected light beams whose frequency is not a single frequency (or other number of single frequencies). This also allows the vehicle lidar system 101 to filter out and use only the multiple reflected light beams transmitted by the vehicle LED light assembly 109. This also improves the accuracy of the vehicle LIDAR system 100.

[0039] 3 is a flow chart illustrating an example method for operating a vehicle light emitting diode (LED) light assembly (e.g., LED headlights and taillights) for vehicular light detection and ranging (LIDAR) in accordance with one embodiment of the present disclosure. FIG. 3 will be described with reference to elements from FIG. 1 and FIG. 2. Referring to FIG. 3, a flow chart 300 is shown that includes example operations 305-340.

[0040] At 305, a modulated signal may be generated by the signal modulator 105. The LED driver assembly 107 may be configured to receive the modulated signal from the signal modulator 105.

[0041] At 310, a modulated LED transmit signal may be generated based at least in part on the modulated signal via the vehicle LED driver assembly 107. The vehicle LED assembly 109 may be configured to receive the modulated LED transmit signal.

[0042] At 315, a plurality of modulated light beams may be generated based at least in part on the modulated LED transmission signal via the vehicle LED light assembly 109. The multiple modulated light beams may impinge on and / or be reflected from a plurality of objects 130 located in the environment with the first vehicle 101.

[0043] At 320, the array of pixel sensors of the camera 113 may be utilized to capture multiple light beam reflections from one or more objects 130. In an exemplary embodiment, the multiple light beam reflections may pass through one or more lens assemblies 112 before being captured by the array of pixel sensors 113.

[0044] At 325, a series of measurements representative of the intensities of the multiple light beam reflections captured by the array of pixel sensors of the camera 113 may be generated. In an exemplary embodiment, the series of measurements may be communicated to the time-of-flight sensor module 114, which may be configured to receive the series of measurements.

[0045] At 330, a plurality of time-of-flight (TOF) measurements may be calculated based at least in part on a series of measurements received from an array of pixel sensors representing a plurality of captured light beam reflections utilizing the TOF sensor module. In an exemplary embodiment, the depth processor 115 may be configured to receive the plurality of TOF measurements from the TOF sensor module 114.

[0046] At 335, a depth processor module 115 may be utilized to calculate multiple distances between the vehicle LED light assembly 109 (and thus the vehicle 101) and the one or more objects 130 131 based on the generated time-of-flight measurements. In an exemplary embodiment, the vehicle central processor 110 may be configured to receive the multiple distances between the vehicle LED light assembly 109 and the one or more objects 130.

[0047] At 340, the vehicle central processor 110 may utilize the calculated distances with various different software applications within the vehicle and / or store the calculated distances in one or more memory devices 122 of the vehicle 100. In an exemplary embodiment, the vehicle central processor 110 may communicate the calculated distances to various other components and / or subsystems within the first vehicle 100.

[0048] In some implementations, the vehicle central processor 110 may communicate one or more distances to the vehicle navigation subsystem 415. As an illustrative example, one or more distances between one or more objects 130 relative to the vehicle LED light assembly 109 may be utilized to generate a three-dimensional (3D) map.

[0049] In some implementations, the vehicle central processor 110 may communicate the one or more distances to the vehicle braking subsystem 405. The vehicle braking subsystem 405 may analyze the distances, and if the distance between the vehicle LED light assembly 109 and the one or more objects 130 is too small, the vehicle braking subsystem 405 may activate one or more vehicle brakes.

[0050] Depending on the implementation, the vehicle central processor 110 may communicate one or more distances to the vehicle drive or transmission subsystem 430. The vehicle transmission subsystem may analyze the received distances, and if the distance between the vehicle LED light assembly 109 and the one or more objects 130 is too small, the vehicle transmission subsystem 430 may disengage the vehicle drive subsystem.

[0051] In some implementations, the vehicle central processor 110 may communicate one or more distance or ranging measurements to an automated driving subsystem 433. The automated driving subsystem controls the operation of the vehicle when the vehicle is unmanned and therefore operating autonomously. In some implementations, the automated driving subsystem 433 may receive the distance or ranging measurements, analyze the distance or ranging measurements, and communicate instructions to other subsystems (such as the vehicle navigation subsystem 415, the vehicle braking subsystem 405, the vehicle drive or transmission subsystem 430, the vehicle display system 435, or the vehicle audio system 425) to identify and control the operation of the unmanned vehicle. As an example, if the distance or ranging measurements to multiple objects are too small, the automated driving subsystem 433 may communicate to the braking subsystem 405 that the brakes should be applied and / or to the vehicle display system 435 to display a warning.

[0052] In some implementations, the vehicle central processor 110 may communicate one or more distances to the vehicle display system 435. The vehicle display system 435 may analyze the received distances and generate a display object identifying a particular distance between the vehicle LED light assembly 109 and one or more objects, or may generate an error message or error display object to alert the driver of the vehicle.

[0053] In some implementations, the vehicle central processor 110 may communicate the one or more distances to the vehicle audio system 425. The vehicle audio system 425 may analyze the received distances and generate an audible voice alert identifying that the one or more distances are too close and the driver of the first vehicle 100 must take evasive action to avoid the one or more objects.

[0054] FIG. 4 is a block diagram illustrating various components of an exemplary vehicle according to an exemplary embodiment of the present disclosure. FIG. 4 is described in conjunction with elements from FIGS. 1-3 and 4-6. Referring to FIG. 4, a block diagram 400 is shown of a vehicle main processor 420, one or more memory devices 421, computer readable instructions 422 stored within the one or more memory devices 421, a braking subsystem 405, a steering subsystem 410, a navigation subsystem 415, an audio subsystem 425, a transmission subsystem 430, and / or a display subsystem 435. In some implementations, the computer readable instructions stored within the one or more memory devices may be executable by one or more vehicle processor controllers 420 to communicate with other vehicle subsystems to transmit and / or receive data and / or instructions to the other vehicle subsystems. As described above with respect to FIGS. 1-3, multiple distance and / or direction measurements may be received from the depth processor module 115. In these implementations, the computer readable instructions may be executable by the vehicle processor controller 420 to communicate the distance and / or direction measurements to other vehicle subsystems. As described above with respect to Figures 4-6, the decoded message or messages may be received from the decoder assembly or module 545 or 517. In these implementations, the computer readable instructions may be executable by the vehicle processor controller 420 to communicate the decoded message or messages to other vehicle subsystems.

[0055] For the exemplary embodiment, the braking subsystem 405 may be communicatively coupled or connected to the vehicle processor controller 420. In some implementations, the braking subsystem 405 may be configured to control the brakes on all of the vehicle's wheels. The braking subsystem 405 may include memory devices, sensors, controllers, and / or computer readable instructions executable by the controller to receive instructions and perform actions identified by the instructions. In some implementations, the braking subsystem 405 may receive range and / or distance measurements or parameters from the vehicle lidar system 100 as shown in FIGS. 1-3 (and related description), or may communicate to or receive one or more communication messages from other vehicles as described with respect to the LED vehicle communication system as shown in FIGS. 5-7 (and related description).

[0056] For the exemplary embodiment, the steering subsystem 410 may be communicatively coupled or connected to the vehicle processor controller 420. In some implementations, the steering system may be configured to control the steering of the vehicle during operation. The steering subsystem 410 may include memory devices, controllers, sensors, and / or computer readable instructions executable by the controller to receive instructions and perform actions identified by the instructions. In some implementations, the steering subsystem 410 may receive range and / or distance measurements or parameters from the vehicle lidar system 100 as shown in FIGS. 1-3 (and related description), or may communicate to or receive one or more communication messages from other vehicles as described with respect to the LED vehicle communication system as shown in FIGS. 5-7 (and related description).

[0057] For the exemplary embodiment, the navigation subsystem 415 may be communicatively coupled or connected to the vehicle processor controller 420. In some implementations, the navigation subsystem 415 may be configured to provide directions to a place of interest for the vehicle or driver or to provide location information to the driver or vehicle. The navigation subsystem 415 may include memory devices, sensors, controllers, and / or computer readable instructions executable by the controller to receive instructions and perform actions identified by the instructions. In some implementations, the navigation subsystem 415 may receive range and / or distance measurements or parameters from the vehicle lidar system 100 as shown in FIGS. 1-3 (and related description), or may communicate to or receive one or more communication messages from other vehicles as described with respect to the LED vehicle communication system as shown in FIGS. 5-7 (and related description).

[0058] For the exemplary embodiment, audio subsystem 425 may be communicatively coupled or connected to vehicle processor controller 420. In some implementations, audio subsystem 425 may be configured to generate audible messages for the driver and / or passengers in the vehicle. Audio subsystem 425 may include memory devices, sensors, controllers, and / or computer readable instructions executable by a controller to receive instructions and perform actions identified by the instructions. In some implementations, audio subsystem 425 may receive range and / or distance measurements or parameters from vehicle lidar system 100 as shown in FIGS. 1-3 (and related description), or may communicate to or receive one or more communication messages from other vehicles as described with respect to the LED vehicle communication system as shown in FIGS. 5-7 (and related description).

[0059] For the exemplary embodiment, the autonomous driving subsystem 433 may be communicatively coupled or connected to the vehicle processor 420. In some implementations, the autonomous driving subsystem 433 may be configured to communicate and provide instructions to other subsystems for the vehicle to drive itself without human intervention. The autonomous driving subsystem 433 may include memory devices, sensors, controllers, and / or computer readable instructions executable by a controller to receive the instructions and perform actions identified by the instructions. In some implementations, the autonomous driving subsystem 433 may receive range and / or distance measurements or parameters from the vehicle lidar system 100 as shown in FIGS. 1-3 (and related description), or may communicate to or receive one or more communication messages from other vehicles as described with respect to the LED vehicle communication system as shown in FIGS. 5-7 (and related description).

[0060] For the exemplary embodiment, the transmission subsystem 430 may be communicatively coupled or connected to the vehicle processor controller 420. In some implementations, the transmission subsystem 430 may be configured to control a gearing mechanism within the vehicle to move the vehicle forward, reverse, etc. The transmission subsystem 430 may include memory devices, controllers, sensors, and / or computer readable instructions executable by the controller to receive instructions and perform actions identified by the instructions. In some implementations, the transmission subsystem 430 may receive range and / or distance measurements or parameters from the vehicle lidar system 100 as shown in FIGS. 1-3 (and related description), or may communicate to or receive one or more communication messages from other vehicles as described with respect to the LED vehicle communication system as shown in FIGS. 5-7 (and related description).

[0061] For the exemplary embodiment, the display subsystem 435 may be communicatively coupled or connected to the vehicle processor controller 420. In some implementations, the display subsystem 435 may be configured to provide a user with an indication of the vehicle's operating conditions (e.g., speed, RPM, interior vehicle temperature, climate control status) as well as generate and display messages to the driver or passengers in the vehicle. The display subsystem 435 may include memory devices, sensors, controllers, and / or computer readable instructions executable by the controller to receive instructions and perform actions identified by the instructions. In some implementations, the display subsystem 435 may receive range and / or distance measurements or parameters from the vehicle lidar system 100 as shown in FIGS. 1-3 (and related description), or may communicate to or receive one or more communication messages from other vehicles as described with respect to the LED vehicle communication system as shown in FIGS. 5-7 (and related description).

[0062] 5 is a block diagram illustrating different components of an exemplary LED vehicle communication system between a first vehicle and a second vehicle, according to one embodiment of the present disclosure. Referring to FIG. 5, a block diagram 500 of a first vehicle 510 communicating with a second vehicle 520 is shown. Referring to FIG. 5, the first vehicle 510 includes an encoder assembly 505, a signal modulator 507, a vehicle LED driver assembly 509, a vehicle LED assembly 511, a power source 506, one or more vehicle light sensors 513, a signal demodulator 515, a decoder assembly 517, a vehicle central controller / processor 519, and / or one or more vehicle subsystem software application programming interfaces (APIs) 523.

[0063] Referring to FIG. 5, the second vehicle 520 may include one or more vehicle light sensors 541, a signal demodulator 543, a decoder assembly 545, a vehicle LED driver assembly 549, a vehicle LED assembly 547, a power supply 548, a signal modulator 551, an encoder assembly 553, a vehicle central controller / processor 555, one or more memory devices 557, and / or one or more vehicle subsystem software application programming interfaces (APIs) 559.

[0064] In an exemplary embodiment, first vehicle main controller processor 519 may execute computer readable instructions stored in one or more memory devices 521 for controlling operation of the illustrated components within first vehicle 510. To initiate communication from first vehicle 510 to second vehicle 520, the computer readable instructions may communicate one or more messages to encoder assembly 505 in the first vehicle.

[0065] In an exemplary embodiment, the encoder assembly 505 may be communicatively coupled and connected to the vehicle controller / processor 519 and / or the signal modulator 507. Depending on the implementation, one or more messages may be encoded by the encoder assembly 505 and communicated to the signal modulator 507.

[0066] In an exemplary embodiment, the encoded one or more messages may be modulated by a signal modulator 507 to generate one or more coded modulated messages.

[0067] In an exemplary embodiment, the signal modulator 507 may be communicatively coupled to a vehicle LED driver assembly 509. In some implementations, the vehicle LED driver assembly 509 may generate a modulated LED data transmission signal based at least in part on the one or more coded modulation messages.

[0068] In an exemplary embodiment, the vehicle LED assembly 511 is communicatively coupled or connected to the vehicle LED driver assembly 509. In some implementations, the vehicle LED assembly 511 in the first vehicle 510 may be configured to generate a plurality of modulated light beams based on the received modulated LED data transmission signal. The plurality of modulated light beams may be transmitted outwardly from the first vehicle 510. In some implementations, the vehicle LED assembly 511 may be a vehicle LED headlight, and the plurality of modulated light beams may be transmitted outwardly from the front of the first vehicle 510. In an alternative implementation, the vehicle LED assembly 511 may be a vehicle LED taillight in the first vehicle 510, and the plurality of modulated light beams may be transmitted outwardly from the rear of the first vehicle 510.

[0069] In an exemplary embodiment, the second vehicle 520 may receive the multiple modulated light beams from the first vehicle LED assembly 511. In some implementations, one or more light sensors 541 in the second vehicle may detect the multiple modulated light beams. The one or more light sensors 541 may detect the intensity of the multiple modulated light beams.

[0070] In an exemplary embodiment, the one or more optical sensors 541 of the second vehicle may be configured to generate a modulated data transmission signal representative of the captured intensities of the multiple modulated light beams.

[0071] In an exemplary embodiment, a signal demodulator 543 in the second vehicle 520 may be communicatively coupled or connected to the one or more light sensors 541. In some implementations, the signal demodulator 543 in the second vehicle may be configured to receive the modulated data transmission signal from the one or more light sensors 541 and may generate a demodulated data transmission signal. The signal demodulator 543 may transmit the demodulated data transmission signal to a decoder assembly 545.

[0072] In an exemplary embodiment, the decoder assembly 545 in the second vehicle 520 may be communicatively coupled to the signal demodulator 543 and / or the second vehicle central processor 555. In some implementations, the decoder assembly 545 in the second vehicle 520 may receive the demodulated data transmission signal and generate a decoded data transmission signal. The decoded data transmission signal should be the same or similar to the original message or messages generated by the controller and / or processor 519 of the first vehicle.

[0073] In an exemplary embodiment, the decoder assembly 545 may be communicatively coupled to one or more memory devices 557 and / or a second vehicle central processor or controller 555. In some implementations, the decoder assembly 545 may be configured to communicate the decoded data transmission signal to be stored in one or more memory devices 521. In some implementations, the second vehicle central processor or controller 555 may be configured to communicate the decoded data transmission signal to other vehicle subassemblies (as illustrated in FIG. 4 ) of the second vehicle, so that the other vehicle subassemblies perform actions in response to the received decoded data transmission signal. As an illustrative example, the first vehicle 510 may be traveling in the opposite direction to the second vehicle 520 and may communicate, via the LED headlights 511, one or more messages identifying that an accident has occurred within an area recently traversed by the first vehicle 510. The second vehicle 520 may receive the decoded data transmission signal and may communicate the decoded data transmission signal to a vehicle display subsystem 435 within the second vehicle 520 for displaying a message identifying that there is an accident ahead, and / or to a vehicle audio subsystem 425 for generating an audible message or sound to alert the driver of the second vehicle 520 that an accident is occurring ahead.

[0074] In some implementations, communication may flow bidirectionally between the first vehicles 510 and 520. In some implementations, the first vehicle LED headlights 511 may communicate one or more modulated messages via multiple light beams that may be received as just described. As an illustrative example, the first vehicle LED headlights 511 may communicate a message from the vehicle braking subsystem 405 that a tire is flat or that the brakes are faulty to alert the second vehicle 520 (traveling behind the first vehicle 510 in the same direction) that the brakes or tires have failed. In some implementations, the second vehicle 520 may generate one or more messages indicating receipt of the error message and asking the first vehicle 510 whether the first vehicle 510 may need any assistance. This scenario may be described below with reference to FIG. 5.

[0075] In this example, computer readable instructions 559 may be accessed from one or more memory devices 557 and may be executable by the second vehicle central processor or controller 555 to receive one or more messages from one or more of the other vehicle subsystems, verify receipt, and inquire whether the first vehicle 510 needs further assistance. In some implementations, the encoder assembly 553 of the second vehicle 520 may encode one or more verification and / or assistance messages and communicate the one or more encoded verification and / or assistance messages to the signal modulator 551. In some implementations, the signal modulator 551 of the second vehicle 520 may modulate the one or more encoded verification and / or assistance messages to generate one or more coded modulated verification and / or assistance messages. The signal modulator 551 may be configured to communicate the coded modulated verification messages to the LED driver assembly 549 in the second vehicle 520. The LED driver assembly 549 may be configured to generate a modulated LED transmit response signal based at least in part on the received one or more coded modulated verification / assistance messages. The LED driver assembly 549 in the second vehicle may be configured to communicate the modulated LED transmitted response signal to the vehicle LED assembly 547. The vehicle LED assembly 547 in the second vehicle 520 may be configured to generate and transmit a plurality of response light beams based at least in part on the modulated LED transmitted response signal.

[0076] In an exemplary embodiment, the one or more light sensors 513 on the first vehicle 510 may be configured to detect intensities of the multiple response light beams transmitted from the second vehicle LED assembly 547. In some implementations, the one or more light sensors 513 in the first vehicle may be configured to generate a response data transmission signal representative of the detected intensities of the multiple response light beams. The one or more light sensors 513 in the first vehicle may communicate the response data transmission signal to a signal demodulator 515 in the first vehicle 510.

[0077] In an exemplary embodiment, the signal demodulator 515 in the first vehicle 510 may be configured to generate a demodulated response data transmission signal and communicate the demodulated response data transmission signal to a decoder assembly 517 in the first vehicle 510. The decoder assembly 517 may decode the demodulated response data transmission signal and generate one or more decoded response messages. In some implementations, the one or more decoded response messages may be stored in one or more memory devices 521 of the first vehicle 510. In some implementations, the computer readable instructions 523 may be executable by the vehicle controller / processor 519 to process the decoded response messages and communicate these decoded messages to appropriate vehicle subsystems for action.

[0078] In an exemplary embodiment, the vehicle communication system 500 may include a synchronization module in the encoder assembly 505 553. The synchronization module in the encoder assembly 505 553 may be implemented in the form of software, hardware, and / or a combination thereof. In some implementations, the synchronization module in the encoder assembly 505 553 may be configured to synchronize one or more optical sensors 513 and 541 and one or more encoded messages generated by the encoder assembly 505 553. In some implementations, the encoder assembly 505 553 may utilize a code division multiple access (CDMA) protocol for synchronization. As an example, the encoder assembly 505 553 may utilize a CDMA protocol to apply a specific code to one or more encoded messages. The one or more optical sensors 513 541 may be configured to capture multiple reflected light beams that include the applied specific code. Other reflected light beams may be discarded and not utilized. Stray light from other sources, such as other vehicles, street lights, and natural light sources such as the moon and sun, may be picked up, for example, by one or more of the light sensors 513-541. However, utilizing CDMA filtering and protocols allows the vehicle communication system to filter out and utilize only the multiple reflected light beams transmitted by the vehicle LED light assemblies 511 and 547. This technique improves the accuracy of the vehicle LED communication system 500.

[0079] In an exemplary embodiment, the vehicle communication system 500 may further include a filter module 560 561. The filter module 560 561 may be coupled or connected to one or more optical sensors 513 541. Depending on the implementation, the signal modulator 507 551 may utilize one single frequency or a certain number of single frequencies in generating the modulated signal. The filter module 560 561 may receive the multiple reflected light beams and filter out any of the multiple reflected light beams whose frequency is not the single frequency (or other number of single frequencies) generated by the signal modulator 507 551. This also allows the vehicle communication system to filter out and use only the multiple reflected light beams transmitted by the vehicle LED light assemblies 511 and 547. This also improves the accuracy of the vehicle LED communication system 500.

[0080] Figure 6 is a flow chart illustrating an example method for utilizing vehicle light emitting diode (LED) light assemblies (e.g., LED headlights and taillights) for communication between a first vehicle and a second vehicle according to one embodiment of the present disclosure. Figure 6 will be described with reference to elements from Figures 4 and 5. With reference to Figure 6, a flow chart 600 is shown that includes example operations 605-640.

[0081] In an exemplary embodiment, one vehicle (or its operator) may desire to communicate information and data to a second vehicle (or its operator). In some implementations, in situations where cellular and / or other wireless networks are inoperable due to breakdowns, maintenance, and / or weather, a vehicle may require additional methods and / or systems for automatic and / or timely communication of information and data. This is an important application of the LED light assembly vehicle communication system 500 during emergency situations where other communication methods are not available.

[0082] A vehicle or operator may generate one or more messages for communication to another vehicle. These messages may include vehicle speed information, vehicle operation information (e.g., a part is malfunctioning), and / or emergency alert information. At 605, one or more messages may be received and encoded at encoder assembly 505 to generate one or more encoded messages.

[0083] In an exemplary embodiment, the signal modulator 507 may receive the encoded one or more messages. At 610, the signal modulator 507 may generate a modulated encoded signal based on the encoded one or more messages. The signal modulator may communicate the modulated encoded signal to the LED driver module 509.

[0084] At 615, a modulated LED transmission signal may be generated by the LED driver module 509 based on the modulation encoded signal. The modulated LED transmission signal may represent one or more encoded messages. In some implementations, the modulated LED transmission signal may modulate the intensity of multiple light beams.

[0085] The vehicle LED light assembly 511 may receive the modulated LED transmission signal from the LED driver module 509. At step 620, in an exemplary embodiment, the vehicle LED light assembly 511 may be utilized to transmit a plurality of light beams based at least in part on the generated modulated LED data transmission signal.

[0086] In an exemplary embodiment, the second vehicle 520 may receive the multiple light beams transmitted by the first vehicle 510. In some implementations, the LED light assembly 511 of the first vehicle 510 may be an LED headlight. In this implementation, if the second vehicle 520 is traveling in the same direction as the first vehicle 510, the one or more receiving sensors 541 may be disposed on a rear portion of the vehicle (e.g., a vehicle rear bumper). In some implementations, if the second vehicle 520 is traveling in the opposite direction compared to the first vehicle 510, the one or more receiving sensors may be disposed on a front portion of the vehicle, (e.g., a vehicle front bumper). In some implementations, the LED light assembly 511 of the first vehicle may be an LED taillight. In this implementation, if the second vehicle 520 is traveling in the same direction as the first vehicle 510, the one or more receiving sensors 541 may be disposed on a front portion of the second vehicle 520 (e.g., a second vehicle front bumper). In this implementation, when the second vehicle 520 is traveling in the opposite direction to the first vehicle 510, one or more receiving sensors 541 may be positioned on a rear portion of the second vehicle 520 (e.g., the second vehicle rear bumper).

[0087] In step 625, the intensities of the transmitted light beams transmitted from the first vehicle 510 may be detected by the second vehicle 520 by one or more light sensors 541 positioned on the second vehicle 520. In some implementations, in step 630, the light sensors 541 may generate a data transmission signal representative of the detected light intensity measurements. In some implementations, the one or more light sensors 541 may communicate the data transmission signal to a demodulator 543.

[0088] In an exemplary embodiment, the demodulator 543 may receive a data transmission signal. In step 635, the data transmission signal may be demodulated by the demodulator 543 to generate a demodulated data transmission signal. In some implementations, the demodulator 543 may transmit the demodulated data transmission signal to a decoder assembly 545.

[0089] In an exemplary embodiment, the decoder assembly 545 may receive the demodulated data transmission signal. In step 640, the demodulated data transmission signal may be decoded by the decoder assembly 545 and one or more decoded messages may be generated. The one or more decoded messages should be the same as or closely resemble the one or more generated messages that were transmitted to the first vehicle's encoder 505 in step 605.

[0090] In some implementations, the one or more decoded messages may be stored in one or more memory devices 557 of the second vehicle 520. In some implementations, software instructions 559 stored in the one or more memory devices 557 may be executable by the second vehicle central processor 555 to communicate the one or more decoded messages to other vehicle subsystems of the second vehicle 520.

[0091] FIG. 7 illustrates a communication system between a first vehicle, a second vehicle, and a third vehicle using a vehicle LED communication system according to some implementations. In an exemplary embodiment, the communication system 700 may be utilized in an area where no other communication networks exist (e.g., due to remoteness or due to an inoperable communication network). The communication system 700 may include a first vehicle 710, a second vehicle 720, and a third vehicle 730. In some implementations, the first vehicle 710 may have one or more LED assemblies 712 and one or more light sensors 714. In some implementations, the second vehicle 720 may have one or more LED assemblies 722 and one or more light sensors 724. In some implementations, the third vehicle 730 may have one or more LED assemblies 732 and one or more light sensors 734. In some implementations, the second vehicle 720 may act as a communication intermediary between the first vehicle 710 and the third vehicle 730. However, in other embodiments, all three vehicles 710, 720, and 730 may be communicatively coupled. The encoding and modulation of one or more messages and the generation of the multiple modulated light beams for FIG. 7 follow the same methods and apparatus as described in FIG. 5 and FIG. 6. Similarly, the reception of the modulated light beams, the demodulation of the light beams, and the decoding for FIG. 7 follow the same methods and apparatus as described in FIG. 5 and FIG. 6. These operations are not repeated for FIG. 7 for the sake of brevity. As an illustrative example, in some implementations, the first vehicle 710 may communicate one or more encoded messages through multiple modulated light beams generated by one or more LED assemblies 712 of the first vehicle. In some implementations, one or more optical sensors 724 of the second vehicle 720 may receive the modulated light beams and decode one or more messages from the first vehicle 710. In some implementations, if the second vehicle 720 is utilized as an intermediated communication vehicle, then the second vehicle may encode the received one or more messages and transmit intermediated modulated light beams from one or more second vehicle LED light assemblies 722 based on the encoded messages. In some implementations, one or more optical sensors 734 of the third vehicle 730 may receive the intermediated modulated light beams transmitted from the second vehicle and decode the one or more messages.The third vehicle 730 may analyze the received decoded one or more messages and generate one or more response messages designated for the first vehicle 710. In some implementations, one or more LED assemblies 732 of the third vehicle 730 may generate and transmit multiple response modulation beams based on the one or more response messages. In these implementations, one or more light sensors 724 of the second vehicle 720 may receive the multiple response modulation beams and the second vehicle 720 may decode the one or more response messages. The second vehicle 720 may encode one or more response mediated messages. One or more vehicle LED assemblies 722 of the second vehicle 720 may generate and transmit multiple mediated response light beams. In some implementations, one or more light sensors 714 of the first vehicle may receive the multiple mediated response light beams and the first vehicle 710 may decode and analyze the one or more response mediated messages. In these embodiments, when the vehicle LED taillights are transmitting or communicating multiple modulated light beams (e.g., when the first vehicle LED assembly 712 is transmitting through the LED taillights), the receiving vehicle may include a filter module in front of the one or more light sensors. The filter module may accept and receive only the red multiple light beams and filter out other light beams (e.g., the second vehicle one or more light sensors 724 may include a filter module to accept only the red light from the first vehicle LED assembly 712 in the taillight and reject all other light beams, such as headlight beams from oncoming vehicles). The above-described method can be utilized in environments where communication network services are not present, for example, in emergency weather situations such as immediately after a hurricane or earthquake. The subject matter described herein allows vehicles to communicate with each other even if other communication networks are down. The method described herein also allows high-speed low-latency communication, which is important when an emergency occurs and immediate vehicle action needs to be taken. These methods also allow two or more vehicles to communicate covertly in a manner that appears to be normal vehicle operation, without another party or vehicle being aware that vehicle-to-vehicle communication is taking place.

[0092] The subject matter described herein with respect to utilizing a vehicle LED light assembly for vehicle light detection and ranging (LIDAR) in FIGS. 1-4 and utilizing a vehicle LED light assembly for communication between two or more vehicles in FIGS. 5-7 may be utilized together. In other words, a vehicle LED light assembly LIDAR system and a vehicle LED light assembly communication system may be combined within the same vehicle. The vehicle may utilize the methods described herein in FIGS. 1-4 (methods utilizing an LED light assembly for LIDAR) and FIGS. 5-7 (methods utilizing an LED light assembly for vehicle-to-vehicle communication) to assist in the operation of various subsystems of the vehicle, such as the automated driving subsystem described in FIG. 4, the navigation subsystem, the braking subsystem, or the steering subsystem, or other subsystems.

[0093] In some embodiments, a method of communicating between a first vehicle and a second vehicle utilizing a light emitting diode (LED) light assembly includes encoding a vehicle data transmission from the first vehicle, generating a modulated signal based on the encoded vehicle data transmission, generating, via a vehicle LED driver module, a modulated LED data transmission signal based at least in part on the modulated signal representative of the encoded vehicle data transmission, the modulated LED data transmission signal for modulating an intensity of a light beam, and transmitting, via a vehicle LED light assembly, a plurality of light beams based at least in part on the generated modulated LED data transmission signal. The method of communicating between the first vehicle and the second vehicle also includes detecting, via one or more light sensors positioned on the second vehicle, an intensity of the plurality of light beams transmitted from the LED light assembly on the first vehicle, generating, via the one or more light sensors, a data transmission signal representative of the captured intensities of the plurality of light beams, demodulating, via a demodulator module, the data transmission signal representative of the captured intensities of the plurality of light beams, and decoding the demodulated data transmission signal to obtain the original vehicle data transmission. The method of communicating between the first vehicle and the second vehicle further includes encoding a responsive vehicle data transmission from the second vehicle; generating a modulated signal based on the encoded responsive vehicle data transmission; generating, via the second LED driver module, a modulated LED data transmission response signal based at least in part on the modulated signal representing the encoded responsive vehicle data transmission, the modulated LED data transmission response signal being for modulating an intensity of a light beam; and utilizing the vehicle LED light assembly to transmit a plurality of responsive light beams based at least in part on the generated modulated LED data transmission response signal.Additionally, a method of communication between a first vehicle and a second vehicle includes detecting, via one or more optical sensors positioned on the first vehicle, intensities of a plurality of light beams transmitted from a vehicle LED light assembly on the first vehicle; generating, via the one or more optical sensors on the first vehicle, a response data transmission signal representative of the captured intensities of the plurality of response light beams; demodulating, via a demodulator module, the response data transmission signal representative of the captured intensities of the plurality of response light beams; and decoding the demodulated response data transmission signal to obtain an original response vehicle data transmission.

[0094] In some embodiments, a system for communicating between a first vehicle and a second vehicle utilizing a vehicle light emitting diode assembly includes an encoding assembly for encoding a vehicle data transmission from the first vehicle, a signal modulator for generating a modulated signal based on the encoded vehicle data transmission, a vehicle LED driver module for generating a modulated LED data transmission signal based at least in part on the modulated signal representing the encoded vehicle data transmission, the modulated LED data transmission signal for modulating intensity of a light beam, and a vehicle LED light assembly positioned on the first vehicle for transmitting a plurality of light beams based at least in part on the generated modulated LED data transmission signal. In some embodiments, a system for communicating between a first vehicle and a second vehicle utilizing a vehicle light emitting diode assembly includes one or more light sensors positioned on the second vehicle for detecting intensities of a plurality of light beams transmitted from a vehicle LED light assembly on the first vehicle and generating a data transmission signal representative of the captured intensities of the plurality of light beams, a demodulator module on the second vehicle for demodulating the data transmission signal representative of the captured intensities of the plurality of light beams, and a decoder assembly for decoded the demodulated data transmission signal to obtain the original vehicle data transmission.

[0095] In some embodiments, a method of communicating between a first vehicle, a second vehicle, and a third vehicle utilizing a vehicle light emitting diode (LED) light assembly includes detecting, via one or more light sensors positioned on the second vehicle, an intensity of a plurality of light beams transmitted from a vehicle LED light assembly on the first vehicle; generating, via one or more light sensors of the second vehicle, a data transmission signal representative of the detected intensities of the plurality of light beams; demodulating, via a demodulator module, the data transmission signal representative of the captured intensities of the plurality of light beams; decoding, via a demodulator module, the demodulated data transmission signal to obtain an original vehicle data transmission from the first vehicle; and encoding, at the second vehicle, the original vehicle data transmission. The method of communicating between a first vehicle, a second vehicle, and a third vehicle utilizing a vehicle LED light assembly also includes generating, at the second vehicle, an intermediary modulated signal based on the encoded original vehicle data transmission; generating, at the second vehicle, via a second vehicle LED driver module, a modulated intermediary LED data transmission signal based at least in part on the intermediary modulated signal representing the encoded original vehicle data transmission, where the intermediary modulated LED data transmission signal is for modulating an intensity of a light beam; and transmitting, using the second vehicle LED light assembly, a plurality of intermediary light beams to the third vehicle based at least in part on the generated intermediary modulated LED data transmission signal.

[0096] While various embodiments described in the present disclosure have been described above, it should be understood that they have been presented by way of example, not limitation. It should be understood that various changes in form and detail may be made therein without departing from the scope of the present disclosure. In addition to using hardware (e.g., in or coupled to a central processing unit ("CPU"), microprocessor, microcontroller, digital signal processor, processor core, system on chip ("SOC") or any other device), implementations may also be embodied in the form of software (e.g., computer readable code, program code, and / or instructions arranged in any format, such as source, object, or machine code) disposed, for example, in a non-transitory computer readable medium configured to store the software. Such software may, for example, enable the function, fabrication, modeling, simulation, description, and / or testing of the apparatus and methods described herein. For example, this may be accomplished through the use of general-purpose programming languages ​​(e.g., C, C++), including Verilog HDL, VHDL, etc., hardware description languages ​​(HDLs), or other available programs. Such software may be located in any known non-transitory computer-readable medium, such as a semiconductor, magnetic disk, or optical disk (e.g., CD-ROM, DVD-ROM, etc.). The software may also be located as computer data embodied in a non-transitory computer-readable transmission medium (e.g., any other non-transitory medium, including digital, optical, analog-based media, such as solid-state memory, removable storage media, etc.). Embodiments of the present disclosure may include methods of providing an apparatus described herein by providing software that describes the apparatus and then transmitting the software as a computer data signal over a communications network, including the Internet and intranets.

[0097] Although illustrated as separate elements, the method steps described and / or illustrated herein may represent parts of a single application. Additionally, in some embodiments, one or more of these steps may represent or correspond to one or more software applications or programs that, when executed by a computing device, may cause the computing device to perform one or more tasks, such as method steps.

[0098] In addition, one or more of the devices described herein may convert data, physical devices, and / or representations of physical devices from one form to another. For example, one or more of the devices described herein may receive image data of a sample to be converted, convert the image data, output a result of the conversion to determine a 3D process, use the result of the conversion to perform the 3D process, and store the result of the conversion to generate an output image of the sample. Additionally, or alternatively, one or more of the modules described herein may convert a processor, volatile memory, non-volatile memory, and / or any other portion of a physical computing device from one form of computing device to another form of computing device by executing on a computing device, storing data on a computing device, and / or otherwise interacting with a computing device.

[0099] Those skilled in the art will recognize that any process or method disclosed herein may be modified in many ways. The process parameters and sequences of steps described and / or illustrated herein are provided by way of example only and can be modified as desired. For example, although the steps illustrated and / or described herein may be shown or discussed in a particular order, these steps do not necessarily have to be performed in the order illustrated or discussed.

[0100] The various exemplary methods described and / or illustrated herein may also omit one or more of the steps described or illustrated herein, or include additional steps in addition to those disclosed. Furthermore, the steps of any method as disclosed herein may be combined with any one or more steps of any other method as disclosed herein.

[0101] Unless otherwise noted, the terms "connected to" and "coupled to" (and their derivatives) when used in this specification and claims should be interpreted as allowing for both direct and indirect (i.e., via other elements or components) connections. In addition, the terms "a" or "an" when used in this specification and claims should be interpreted as meaning "at least one of." Finally, for ease of use, the terms "including" and "having" (and their derivatives) are intended to be interchangeable and have the same meaning as the word "comprising" when used in this specification and claims.

[0102] A processor as disclosed herein may be configured with instructions to perform any one or more steps of any method as disclosed herein.

[0103] As used herein, the term "or" is used inclusively to refer to items in alternatives and in combination.

[0104] As used herein, letters such as numbers refer to similar elements.

[0105] The embodiments of the present disclosure, as shown and described herein, are provided by way of example only. Those skilled in the art will recognize numerous adaptations, modifications, variations, and substitutions that do not depart from the scope of the present disclosure. Several alternatives and combinations of the embodiments disclosed herein may be utilized without departing from the scope of the disclosure and invention disclosed herein. Thus, the scope of the invention of the present disclosure is to be defined only by the scope of the appended claims and their equivalents. [Explanation of symbols]

[0106] 100 Vehicle LIDAR Systems 101 vehicles 105, 507, 551 Signal Modulator 106, 506, 548 power supply 107 LED Driver Assembly 109 LED Light Assembly 110 Vehicle Central Processor 112 Lens Assembly 113 Camera 114 Time-of-Flight Sensor Module 115 Depth Processor Module 116 Software Applications 122, 421, 521, 557 Memory Devices 130 Object 140 Synchronization Module 145 Filter Module 200 TOF System 205 Vehicle LED transmitter or lighting assembly 210 First Object 215 Second Object 220 Vehicle Camera 225 Vehicle Timing Subsystem 230 Software 405 Vehicle Braking Subsystem 410 Vehicle Steering Subsystem 415 Navigation Subsystem 420 Vehicle Processor Controller 422, 523, 559 Computer Readable Instructions 425 Vehicle Audio Subsystem 430 Vehicle Transmission Subsystem 433 Autonomous Driving Subsystem 435 Vehicle Display Subsystem 500 Vehicle LED Communication System 505, 553 Encoder Assembly 509, 549 Vehicle LED Driver Assembly 510, 710 1st car 511, 547 Vehicle LED Assembly 513, 541 Vehicle light sensor 515, 543 Signal Demodulator 517, 545 Decoder Assembly 519, 555 Vehicle Central Controller / Processor 520, 720 2nd car 560, 561 Filter Module 700 Communication Systems 712, 722, 732 LED Assembly 714, 724, 734 Optical Sensor 730 Third Car

Claims

1. 1. A method for measuring distance between a vehicle and one or more objects, comprising: generating a modulated signal; generating, via a vehicle LED driver assembly, a modulated light emitting diode (LED) transmit signal based at least in part on the modulated signal; utilizing a vehicle LED light assembly to transmit a plurality of light beams based at least in part on the generated modulated LED transmit signal; capturing reflections of the plurality of light beams from the one or more objects utilizing one or more lens assemblies and a camera, the camera including an array of pixel sensors and positioned on the vehicle; communicating a series of measurements representative of the captured plurality of light beam reflections from the array of pixel sensors to a time-of-flight sensor module; utilizing the time-of-flight sensor module to calculate a time-of-flight measurement between the vehicle LED light assembly and the one or more objects based at least in part on the series of measurements by the array of pixels representing the captured plurality of light beam reflections; utilizing a depth processor module to calculate a distance between the vehicle LED light assembly and the one or more objects based on the time-of-flight measurements; generating a three-dimensional (3D) map of the one or more objects relative to the vehicle based on the calculated distances between the vehicle LED light assembly and the one or more objects; A method comprising:

2. The method of claim 1 , wherein the modulated signal utilizes pulse modulation.

3. The method of claim 1 , wherein the modulated signal utilizes sinusoidal modulation.

4. The method of claim 1 , wherein the modulated signal has a frequency ranging from 100 megahertz to 300 megahertz, or alternatively, from 75 megahertz to 600 megahertz.

5. The method of claim 1 , wherein the vehicle LED light assembly is a vehicle LED headlight assembly in the automobile.

6. The method of claim 1 , wherein the vehicle LED light assembly is a vehicle LED tail light assembly.

7. The method of claim 1 , further comprising filtering extraneous light from the multiple light beams to improve accuracy of the time-of-flight measurements.

8. The method of claim 1 , wherein the image sensor and the modulated signal are synchronized.

9. 10. The method of claim 8, wherein the synchronization of the image sensor and the modulated signal utilizes code division multiplexing (CDMA) technology to generate a specific code, and the camera including the array of pixel sensors captures the reflections of the multiple light beams from the one or more objects when the reflections of the multiple light beams include the specific code.

10. The method of claim 8 , wherein the synchronization of the image sensor and the modulated signal is performed at a single frequency or at multiple single frequencies.

11. 10. The method of claim 9, further comprising a filter module, the filter module for filtering out frequencies of the reflections of the plurality of light beams captured at the image sensor other than the single frequency or the plurality of single frequencies.

12. 1. A method of communicating between a first vehicle and a second vehicle utilizing a vehicle light emitting diode (LED) light assembly, comprising: encoding a vehicle data transmission from a first vehicle; generating a modulated signal based on the encoded vehicle data transmission; generating, via a vehicle LED driver module, a modulated LED data transmission signal based at least in part on the modulation signal representing the encoded vehicle data transmission, the modulated LED data transmission signal for modulating an intensity of the light beam; utilizing a vehicle LED light assembly to transmit a plurality of light beams based at least in part on the generated modulated LED data transmission signal; detecting, via one or more light sensors positioned on the second vehicle, an intensity of the plurality of light beams transmitted from an LED light assembly on the first vehicle; generating a data transmission signal representative of the captured intensities of the plurality of light beams via the one or more light sensors; demodulating, via a demodulator module, the data transmission signal representative of the captured intensities of the plurality of light beams; Decoding the demodulated data transmission signal to obtain the original vehicle data transmission; A method comprising:

13. 13. The system of claim 6, wherein the LED light assembly is a tail light assembly at the rear of the first vehicle and the light sensor is located at the front of the second vehicle.

14. 13. The method of claim 12, wherein the LED light assembly is a headlight assembly at the front of the second vehicle and the light sensor is located at the rear of the first vehicle.

15. The method of claim 12 , wherein the modulated signal utilizes binary modulation.

16. The method of claim 12 , wherein the modulated signal utilizes multi-level modulation.

17. The method of claim 12, wherein the modulated signal has a frequency ranging from 100 megahertz to 300 megahertz, or alternatively, from 75 megahertz to 600 megahertz.

18. The method of claim 12 , wherein the original data transmission includes information regarding a speed of the first vehicle.

19. The method of claim 12 , wherein the original data transmission includes information regarding operational capabilities of the first vehicle.

20. 1. A vehicle light detection and ranging (LIDAR) device for measuring distance between a vehicle and one or more objects, comprising: a signal modulator for generating a modulated signal; a vehicle LED driver assembly for generating a modulated light emitting diode (LED) transmit signal based at least in part on the modulated signal; a vehicle LED light assembly for transmitting a plurality of light beams based at least in part on the generated modulated LED transmit signal; one or more cameras for capturing reflections of the plurality of light beams from the one or more objects, the camera including an array of pixel sensors, positioned on the vehicle, and for communicating a series of measurements representative of the captured plurality of light beam reflections to a time-of-flight sensor module; a time-of-flight sensor module for calculating a time-of-flight measurement between the vehicle LED light assembly and the one or more objects based at least in part on the series of measurements produced by the array of pixels representing the captured plurality of light beam reflections; a depth processor module for calculating a distance between the vehicle LED light assembly and the one or more objects based on the time-of-flight measurements; A LIDAR device comprising:

Citation Information

Cited By

  • Multi-active mirror system for compact MEMS-structured high-resolution wide-angle lidar scanner

    WO2026150972A1