Automotive headlight communication system and method based on image frame interpolation

Abstract

This application relates to the field of optical communication technology, and in particular to an automotive headlight communication system and method based on image frame interpolation. The system includes a transmitter and a receiver. The transmitter's in-vehicle central control system receives input information to be transmitted. An ambient light detection module assesses external lighting conditions in response to the input information, sets image grayscale values ​​and frame interpolation frequency based on the light intensity, and an image encoding module encodes the information to be transmitted based on the set image grayscale values ​​to generate a projected image frame. A projection module inserts the projected image frame into the normal illumination frame sequence of the headlights based on the frame interpolation frequency and projects it onto the external environment. The receiver's image acquisition module acquires the projected image frame, and an image decoding module preprocesses the projected image frame and decodes it to restore the information to be transmitted and send it to the in-vehicle central control system. This application enables headlight communication over a certain distance in a traffic environment while ensuring normal headlight illumination.

Description

Technical Field

[0001] This application relates to the field of optical communication technology, and in particular to an automotive headlight communication system and method based on image frame interpolation. Background Technology

[0002] With the development of vehicle-to-everything (V2X) technology, automobiles are gradually evolving from simple transportation tools into multi-dimensional information interaction nodes, leading to a continuous increase in communication demands between vehicles and between vehicles and infrastructure. Against this backdrop, vehicle external devices are being continuously endowed with new functions, especially automotive headlights. Due to their all-weather operation and high-power, high-brightness optical output characteristics, headlights have become an ideal carrier for visible light communication technology. Visible light communication utilizes light signals in the visible light band, embedding data information into the illumination light through modulation to achieve short-range data transmission, and has broad application prospects in intelligent transportation, assisted driving, and other scenarios.

[0003] Existing visible light communication technologies mostly employ high-frequency flashing or direct intensity modulation of LED vehicle lights to transmit limited status or identification information over short distances; the receiving end then demodulates the signal using a photodetector or high-speed camera. However, in real-world road environments, solutions often require a trade-off between lighting and communication: on the one hand, overly obvious flashing or strong signal modulation can negatively impact the visual experience of drivers and pedestrians; on the other hand, ambient light, such as sunlight, streetlights, and other vehicle lights, significantly interferes with communication signals, and modulation artifacts are easily detectable by conventional cameras or the naked eye.

[0004] Therefore, how to achieve concealment and high reliability of vehicle light communication while maintaining normal lighting functions has become a key technical problem that needs to be solved by existing technologies. Summary of the Invention

[0005] This application provides an image frame interpolation-based automotive headlight communication system and method, which enables headlight communication over a certain distance in a traffic environment while ensuring normal headlight illumination. The technical solution provided in this application is as follows:

[0006] In a first aspect, this application provides an automotive headlight communication system based on image frame interpolation, including a transmitter and a receiver:

[0007] The transmitting end includes an in-vehicle central control system, an ambient light detection module, an image encoding module, a light source module, and a projection module. The in-vehicle central control system receives input information to be transmitted. The ambient light detection module evaluates external lighting conditions in response to the input information to be transmitted and sets the image grayscale value and frame interpolation frequency based on the light intensity. The image encoding module encodes the information to be transmitted based on the set image grayscale value to generate a projected image frame. The projection module inserts the projected image frame into the normal lighting frame sequence of the vehicle headlights based on the set frame interpolation frequency and projects it onto the external environment. The light source module provides the lighting resources required by the projection module.

[0008] The receiving end includes an image acquisition module, an image decoding module, and an in-vehicle central control system; the image acquisition module is used to acquire projected image frames, and the image decoding module preprocesses the projected image frames and performs decoding operations to restore the information to be transmitted and send it to the in-vehicle central control system of the receiving end.

[0009] In one specific implementation, the ambient light detection module is integrated inside the vehicle headlights. It uses a photoelectric sensor to measure the illuminance of ambient reflected light from the ground and direct incident light from around the vehicle in real time. When the illuminance exceeds 10,000 lux, the grayscale value of the projected image is set to 200; if the illuminance is between 3,000 and 10,000 lux, the grayscale value of the projected image is set to 210; if the illuminance is between 500 and 3,000 lux, the grayscale value of the projected image is set to 240; if the illuminance is less than 500 lux, the grayscale value of the projected image is set to 251. When the illuminance exceeds 3,000 lux, the frame interpolation frequency during image projection is set to one frame inserted every two frames; if the illuminance does not exceed 3,000 lux, the frame interpolation frequency during image projection is set to one frame inserted every three frames.

[0010] In one specific implementation, the image encoding module arranges the information to be transmitted according to the characters and error correction encoding method of the QR code to generate a QR code image; and converts the QR code image into a grayscale image according to the set image grayscale value to obtain a projected image frame.

[0011] In one specific implementation, the projection module uses DLP technology to perform image imaging through a DMD chip, and periodically inserts projected image frames into the normal lighting frame sequence of the vehicle headlights based on a set frame interpolation frequency. The light source module is used to provide the illumination resources required for modulation by the DMD chip.

[0012] In one specific implementation, the image acquisition module captures and samples the projected image of the ground using a camera positioned at the rear of the vehicle. During the capture process, the sampling frequency of the camera satisfies the Nyquist sampling theorem. An image feature recognition algorithm is used to automatically identify the projected image region. After identifying the region, the image is corrected to restore the captured image to a geometrically regular QR code image.

[0013] In one specific implementation, the image decoding module converts all acquired projected image frames into grayscale images and crops them to a fixed size to obtain a grayscale image sequence with a uniform structure; lock-in amplification technology is introduced to perform coherent filtering on the image sequence on the time axis to extract signal components consistent with the projection frequency;

[0014] Constructing time vectors as follows:

[0015] ;

[0016] in, This refers to the actual sampling frame rate of the camera. Indicates from 0 to sequence of integers, This indicates the number of image frames continuously acquired by the image acquisition module within one receiving cycle;

[0017] Set reference frequency Construct the corresponding sinusoidal signal With cosine signal as follows:

[0018] ;

[0019] ;

[0020] grayscale image sequence respectively with sinusoidal signals With cosine signal Perform frame-by-frame matrix multiplication to extract the two orthogonal components of the image signal at the reference frequency:

[0021] ;

[0022] ;

[0023] The amplitude response is calculated based on the two orthogonal components using the following formula. :

[0024] ;

[0025] The calculated amplitude results constitute a modulated image reconstructed in the frequency domain after filtering out asynchronous interference.

[0026] In one specific implementation, the image decoding module performs image enhancement processing on the modulated image, performs QR code image recognition and decoding operations, recovers the complete information to be transmitted, and sends it to the vehicle central control system at the receiving end.

[0027] Secondly, this application provides a car headlight communication method based on image frame interpolation, which adopts the following technical solution:

[0028] An image frame interpolation-based automotive headlight communication method, applied to the image frame interpolation-based automotive headlight communication system described in the first aspect, includes:

[0029] The vehicle-mounted central control system in the transmitter receives the input information to be transmitted; the ambient light detection module responds to the input information to be transmitted, evaluates the external lighting conditions, and sets the image grayscale value and frame interpolation frequency based on the light intensity;

[0030] The image encoding module encodes the information to be transmitted based on the set image grayscale value to generate a projected image frame; the projection module inserts the projected image frame into the normal lighting frame sequence of the vehicle headlights based on the set frame interpolation frequency and projects it onto the external environment; the light source module provides the lighting resources required by the projection module.

[0031] The image acquisition module in the receiving end acquires the projected image frame, and the image decoding module performs phase-locked amplification processing on the projected image frame and then performs decoding operation to restore the information to be transmitted and send it to the vehicle central control system in the receiving end.

[0032] Thirdly, this application provides an electronic device, the device including a processor and a memory; the memory stores a program, the program being loaded and executed by the processor to implement an image frame interpolation-based automotive headlight communication method as described in the second aspect.

[0033] Fourthly, this application provides a computer-readable storage medium storing a program that, when executed by a processor, is used to implement an image frame interpolation-based automotive headlight communication method as described in the second aspect.

[0034] In summary, the beneficial effects of this application include at least the following:

[0035] (1) The visible light communication technology and digital light processing projection technology are deeply integrated into the automotive headlight system, enabling short-range and efficient communication between vehicles and between vehicles and road infrastructure while ensuring the normal lighting function of the headlights. This integrated solution makes full use of the lighting hardware resources of the headlights, avoids the addition of additional communication equipment, improves the integration and practicality of the system, and effectively promotes the development of vehicle communication technology in the intelligent transportation environment.

[0036] (2) A special optical signal modulation method is adopted. By periodically inserting image frames carrying communication information into the vehicle headlight illumination frame sequence, the communication signal is highly concealed from conventional camera equipment and human eyes. Due to the combination of the frame insertion frequency and the persistence of vision effect of human eyes, and the reasonable design of the projection grayscale, it is difficult for external observers to directly perceive or capture the communication information, thereby realizing the concealed transmission of information and effectively ensuring communication security and the practicality of the system.

[0037] (3) By monitoring external lighting conditions in real time through the ambient light detection module, the system dynamically adjusts the image grayscale encoding method to adapt to complex noise environments such as strong sunlight, nighttime lights, and other vehicle lights, thereby significantly improving the stability and robustness of communication. The receiver combines multiple advanced techniques such as lock-in amplification, high-frequency pulse filtering, and neural network image recognition decoding to achieve efficient extraction and accurate decoding of periodic modulation signals, ensuring reliable recovery of communication information in changing environments.

[0038] By periodically inserting coded projected image frames into a normal lighting frame sequence, covert information transmission is achieved. The system dynamically adjusts image grayscale and frame interpolation frequency using ambient light detection to ensure good discernibility of the projected image under different lighting conditions. Simultaneously, digital light processing technology is used to precisely control the projection optical output, balancing lighting and communication functions. The receiving end acquires projected images through a high-sampling-rate camera, effectively extracts periodically interpolated frame signals using phase-locked amplification technology, and combines image enhancement and QR code decoding algorithms to significantly suppress environmental noise interference, ensuring highly reliable information recovery. This solution cleverly solves the key challenge of achieving both covertness and high reliability in vehicle headlight communication while maintaining normal lighting functionality, significantly improving the environmental adaptability and system robustness of visible light communication in vehicle headlights.

[0039] The above description is only an overview of the technical solution of this application. In order to better understand the technical means of this application and to implement it in accordance with the contents of the specification, the preferred embodiments of this application are described in detail below with reference to the accompanying drawings. Attached Figure Description

[0040] Figure 1 This is an application scenario diagram of the automotive headlight communication system based on image frame interpolation, according to an embodiment of this application.

[0041] Figure 2 This is a structural block diagram of the automotive headlight communication system based on image frame interpolation in the embodiments of this application.

[0042] Figure 3 This is a schematic diagram of the transmitter structure in an embodiment of this application.

[0043] Figure 4 This is a flowchart illustrating the transmitting end in an embodiment of this application.

[0044] Figure 5 This is a flowchart of the receiving end in an embodiment of this application.

[0045] Figure 6 This is a use case diagram of a specific embodiment in this application.

[0046] Figure 7 This is a block diagram of an electronic device for automotive headlight communication based on image frame interpolation, according to an embodiment of this application. Detailed Implementation

[0047] The specific embodiments of this application will be described in further detail below with reference to the accompanying drawings and examples. The following examples are used to illustrate this application, but are not intended to limit the scope of this application.

[0048] Reference Figure 1 This is an application scenario diagram of the automotive headlight communication system based on image frame interpolation in the embodiments of this application, combined with... Figure 2 , Figure 2 The diagram illustrates a structural block diagram of an automotive headlight communication system based on image frame interpolation according to an embodiment of this application. The system includes a transmitter and a receiver.

[0049] Reference Figure 3 The transmitter includes an in-vehicle central control system, an ambient light detection module, an image encoding module, a light source module, and a projection module.

[0050] The in-vehicle central control system is used to receive input information to be transmitted, including text, images, and command-type content.

[0051] The ambient light detection module is used to assess external lighting conditions in response to the input of the information to be transmitted, and sets the image grayscale value and interpolation frequency based on the light intensity. In implementation, the ambient light detection module is integrated inside the vehicle headlights and uses photoelectric sensors, such as silicon photodiodes or digital ambient light sensors, to measure the light intensity of ambient reflected light from the ground and direct incident light from around the vehicle in real time. This allows it to determine the current environment of the vehicle and set the image grayscale value and interpolation frequency for subsequent image projections accordingly.

[0052] Specifically, when the light intensity exceeds 10,000 lux, the external lighting conditions are considered strong sunlight, and the grayscale value of the projected image is set to 200 to ensure sufficient image contrast. If the light intensity is between 3,000 and 10,000 lux, the external lighting conditions are considered relatively strong, such as in sunny but indirect sunlight, and the grayscale value of the projected image is set to 210. If the light intensity is between 500 and 3,000 lux, the external lighting conditions are considered moderate, such as on a cloudy day, at dusk outdoors, or in a tunnel, and the grayscale value of the projected image is set to 240. If the light intensity is less than 500 lux, the external lighting conditions are considered dark at night or with a few streetlights, and the grayscale value of the projected image is set to 251 to maximize the image's visibility against the background.

[0053] Correspondingly, when the light intensity exceeds 3000 lux, in strong sunlight or relatively strong light environment, the frame interpolation frequency during image projection is set to insert one frame every two frames. If the light intensity does not exceed 3000 lux, in medium light or dark environment, the frame interpolation frequency during image projection is set to insert one frame every three frames.

[0054] It should be noted that lux is a unit of illuminance used to measure the intensity of visible light flux received per unit area. The illuminance unit range and image grayscale value set for each external lighting condition are derived from human experience combined with experiments. This application does not impose any restrictions on the illuminance unit range and image grayscale value set for each external lighting condition.

[0055] The image encoding module is used to encode the information to be transmitted based on the set image grayscale values ​​to generate a projected image frame. Specifically, refer to... Figure 4 The image encoding module first determines the encoding method of the image based on the information to be transmitted. It can choose a barcode, a QR code, or directly projected text image depending on the amount of information or external lighting conditions, but usually a QR code is selected. The image encoding module arranges the information to be transmitted according to the characters and error correction encoding method of the QR code to generate a QR code image. Then, it converts the QR code image into a grayscale image according to the previously set image grayscale values ​​to obtain the projected image frame.

[0056] It should be noted that the projected image frame can be one frame or multiple frames, depending on the amount of information to be transmitted. If the amount of information is small, it is usually one frame, and a single QR code image can transmit the complete information. If the amount of information is large, multiple QR code images are needed to transmit the complete information, in which case the projected image frame is multiple frames.

[0057] The projection module inserts projected image frames into the normal lighting frame sequence of the vehicle headlights based on a set interpolation frequency and projects them onto the external environment. The light source module provides the necessary illumination resources for the projection module. In implementation, the projection module uses Digital Light Processing (DLP) technology for image imaging, with the DMD chip as its core component. The generated projected image frames are transmitted to the DMD driver controller and mapped onto the micromirrors of the DMD chip. Each micromirror is tilted according to the position and grayscale value of each pixel in the projected image frame, thereby modulating the intensity of the reflected light emitted by the light source module to form a complete optical image output. For example, when the DMD chip projects at a frame rate of 120Hz, in strong sunlight or relatively strong light environments, the projection module inserts one effective projected image frame every two frames, forming an information output frequency of 40Hz. In medium light or dark environments, one effective projected image frame is inserted every three frames, corresponding to an information frame rate of 30Hz.

[0058] Furthermore, as a preferred embodiment, to complement the vehicle's lighting function and avoid interference with normal visual effects from information images, the projection module outputs images using a frame interpolation method. This involves periodically inserting projected image frames carrying valid information into the normal lighting frame sequence of the vehicle lights. With this interpolation method, the remaining frames are ordinary lighting frames without image information. Due to the persistence of vision and the projection grayscale design, external observers cannot visually distinguish the information content carried in these image frames, thus ensuring the concealment of the projected content.

[0059] The light source module provides the illumination resources required for DMD modulation. This module can use an LED matrix light source or a laser headlight source, such as a blue light chip exciting yellow phosphors to form white light. Structurally, the light source module can function as a standalone lamp assembly for projection, or it can be integrated with the vehicle's existing headlights, enabling the reuse of headlight illumination and visible light communication functions, effectively reducing system complexity.

[0060] In summary, the transmitter receives the information to be transmitted through the vehicle's central control system. Combined with the ambient light detection module, it dynamically assesses external lighting conditions and sets the image grayscale value and frame interpolation frequency. The image encoding module encodes the information into grayscale image frames, and the projection module uses DLP technology to covertly project this image into the normal vehicle headlight illumination sequence using frame interpolation. The light source module provides the necessary illumination support for image imaging. This transmission structure not only achieves adaptive encoding and projection control for different lighting environments but also achieves covert information projection without affecting the vehicle headlight illumination function, effectively improving the environmental adaptability, transmission stability, and system integration of vehicle headlight visible light communication.

[0061] The receiving end includes an image acquisition module, an image decoding module, and an in-vehicle central control system.

[0062] The image acquisition module is used to acquire projected image frames. Specifically, the image acquisition module captures and samples the projected image of the ground using a camera located at the rear of the vehicle. The camera is preferably a rear-view camera integrated into the vehicle itself. During the shooting process, the camera's sampling frequency must satisfy the Nyquist sampling theorem to ensure effective capture of the projected image frames generated by the transmitter's frame interpolation, avoiding aliasing or information loss. For example, when the projected image carrying valid information is projected at a frequency of 30Hz, the camera's sampling frequency should be no less than 60 frames per second (fps) to effectively avoid image aliasing or missed information.

[0063] Furthermore, as a preferred embodiment, considering potential interference factors such as vibration and changes in vehicle posture during operation, the image acquisition module further employs image feature recognition algorithms, such as template matching and edge detection, to automatically identify the projected image region. After identifying the region, the image is corrected for geometric distortions caused by shooting angle shifts or vehicle dynamics using matrix affine transformations or perspective transformations, thereby restoring the captured image to a geometrically regular QR code image.

[0064] It should be noted that the image feature recognition algorithms used are all existing methods, so they will not be described in detail.

[0065] The image decoding module is used to preprocess the projected image frame and then decode it to restore the information to be transmitted and send it to the vehicle central control system at the receiving end.

[0066] In implementation, refer to Figure 5 First, the image decoding module converts all acquired projected image frames into grayscale images and crops them to a fixed size to match the standard QR code template, resulting in a grayscale image sequence with a uniform structure. Because the transmitting end projects image frames periodically using frame interpolation, a specific frequency modulation component is implicitly present in the image sequence. To accurately extract these periodic image frames, the image decoding module further introduces lock-in amplification technology to enhance the information component at the corresponding frequency and suppress aperiodic interference signals. The basic idea is to perform coherent filtering on the image sequence along the time axis to extract the signal component consistent with the projection frequency.

[0067] Specifically, constructing time vectors as follows:

[0068] ;

[0069] in, This refers to the actual sampling frame rate of the camera. Indicates from 0 to sequence of integers, This represents the number of image frames continuously acquired by the image acquisition module within one receiving cycle. The numerator represents the index of each frame, and the time vector is used to represent the sampling time point corresponding to each frame.

[0070] Then set the reference frequency. That is, the periodic frequency of the inserted projected image frames, which is used to construct the corresponding sinusoidal signal. With cosine signal as follows:

[0071] ;

[0072] ;

[0073] Finally, the grayscale image sequence respectively with sinusoidal signals With cosine signal Perform frame-by-frame matrix multiplication to extract the two orthogonal components of the image signal at the reference frequency:

[0074] ;

[0075] ;

[0076] Through the above operations, the grayscale variation components in the image sequence at the reference frequency (i.e., the image interpolation frequency) are significantly enhanced, while other asynchronous variations (such as environmental noise, lighting fluctuations, or random disturbances) are canceled out during quadrature demodulation because they are orthogonal to the reference signal. Subsequently, the image decoding module calculates the amplitude response based on the two orthogonal components using the following formula. :

[0077] ;

[0078] The calculated amplitude results constitute a new two-dimensional image, whose pixel values ​​reflect the response amplitude of the original image sequence at the corresponding frequencies. Therefore, The image can be viewed as a reconstructed modulated image after filtering out asynchronous interference in the frequency domain. In the spatial domain, it directly represents the brightness distribution of the effective image frame and exhibits a clear QR code outline or text graphic structure. This modulated image provides a clear and clean image input foundation for subsequent QR code image enhancement and decoding operations.

[0079] It should be noted that in implementation, the amplitude response at the reference frequency is calculated for each pixel. This operation is performed at the pixel level, ultimately resulting in an amplitude value for each pixel location, thus forming a new two-dimensional matrix. This matrix is... An image, representing the response strength of the original image sequence at each pixel to the interpolation frequency, is equivalent to extracting image components synchronized with the interpolation frequency from the original sequence. Therefore, The image is essentially a frequency-selective response image, in which aperiodic noise has been significantly suppressed, while the effective image of the periodically interpolated frames has been enhanced and clearly displayed, and the brightness structure outline of the QR code or text can be identified in the image. This image exhibits a visual structure similar to the original projected image frame in the spatial domain, providing a high-quality basic input for subsequent image enhancement and decoding operations.

[0080] After obtaining the modulated image, the image decoding module further performs image enhancement processing to optimize image quality, suppress noise, and enhance edge sharpness. Specifically, this includes the following operations: linearly mapping the image grayscale values ​​to the [0,1] range, which helps to unify the brightness distribution of different frames and adapt to changes in lighting under different environments; applying spatial smoothing processing to remove high-frequency noise and maintain the image edge structure; optionally using an adaptive histogram equalization method to improve the brightness contrast of local areas of the image, making the QR code pattern clearer; and in high-noise environments, a lightweight deep neural network can be introduced to enhance the overall image sharpness and suppress artifacts.

[0081] After image enhancement, the image decoding module begins the QR code image recognition and decoding process. This process mainly includes the following operations: automatically locating the QR code image using methods such as corner detection and edge detection; identifying bright / dark units in the image based on the unit module structure of the QR code and converting them into corresponding binary bits; parsing data codewords and error correction codewords from each frame; extracting the original bit sequence containing the information; and using the error correction mechanism embedded in the QR code to correct any local defects, occlusions, or misjudgments in the image. Furthermore, if the information to be transmitted is large and distributed across multiple QR code image frames, the codewords in each frame are concatenated and combined according to the sequential markings in the image frames. Finally, reverse decoding is performed according to the QR code standard format to recover the complete information to be transmitted and send it to the receiving vehicle's central control system.

[0082] In summary, the receiving end captures and corrects projected image frames from behind the vehicle at high frequency through the image acquisition module. Combined with phase-locked amplification technology introduced in the image decoding module, it effectively extracts valid information images embedded in periodic frame interpolation, significantly suppressing environmental noise interference. Based on this, through image enhancement and QR code recognition decoding processes, the original data information can be accurately restored. This system not only possesses adaptive robustness to different lighting environments and vehicle dynamic states but also achieves stable data reception under visual concealment, providing a reliable and efficient reception mechanism for visible light communication of vehicle lights.

[0083] This application provides an automotive headlight communication system based on image frame interpolation. By periodically inserting coded projected image frames into a normal lighting frame sequence, it achieves covert information transmission. The system dynamically adjusts image grayscale using ambient light detection to ensure good discernibility of the projected image under different lighting conditions. Simultaneously, it utilizes digital light processing technology to precisely control the projection optical output, balancing lighting and communication functions. The receiving end acquires projected images through a high-sampling-rate camera, effectively extracts periodically interpolated frame signals using phase-locked amplification technology, and combines image enhancement and QR code decoding algorithms to significantly suppress environmental noise interference, ensuring highly reliable information recovery. This solution cleverly solves the key challenge of achieving both covertness and high reliability in automotive headlight communication while maintaining normal lighting functionality, significantly improving the environmental adaptability and system robustness of visible light communication in automotive headlights.

[0084] For example, refer to Figure 6 When a car carrying a pregnant woman encounters an emergency in a congested urban area, the driver can use the headlights to communicate with the vehicle in front, quickly alerting other vehicles to the situation and allowing them to give way. The specific process is as follows:

[0085] At the transmitting end, before vehicle headlight communication, the ambient light detection module first reports the ambient light intensity, and then pre-sets the image grayscale value and frame interpolation frequency for different environments. After confirming the communication message is "Pregnant woman urgently needs to go to the hospital, please make way," this message is created as a QR code image. Based on the ambient light and the preset image grayscale value, a corresponding scene projection image is generated. The projection image is then output to the projection module for image projection. The core component of the projection module is the DMD. Taking the DLP7000 DMD as an example, it sends data to the controller via the FPGA, enabling high-speed, low-latency signal transmission. The DLPA200 micromirror driver generates DMD micromirror clock pulses to control data and stores it in the SRAM unit below the micromirrors. This causes the 1024×768 micromirror array to flip +12º or -12º for spatial light modulation, generating an image that is output through the projection lens.

[0086] At the receiving end: The high frame rate camera in the image acquisition module of the preceding vehicle is aimed at the area illuminated by the taillights of the following vehicle, capturing images at a sampling frequency of 120 frames per second to ensure the timeliness and continuity of information extraction. First, the current ambient light conditions are assessed to determine the intensity of the ambient light, and then the corresponding reference signal frequencies are automatically switched: under sunlight (above 3000 lux)... The frequency setting strategy, using 40Hz for nighttime (below 3000 lux) and 30Hz for nighttime (below 3000 lux), considers both the confidentiality of the modulation signal and the anti-interference requirements during signal extraction. The image decoding module performs position correction, motion compensation, and target region extraction on the acquired images. Due to inevitable slight shaking or positional shifts during vehicle operation, image sequences captured by the vehicle-mounted camera often suffer from inter-frame misalignment, blurring, or rotation. To ensure accurate information extraction, the image sequence is first registered. This process estimates the geometric transformation relationships between images using edge detection, feature point extraction, and matching methods, aligning all images to a unified reference coordinate system. Then, lock-in amplification and image enhancement methods are used to extract the modulation signal from the projected image, effectively suppressing environmental interference. After image preprocessing, a lock-in amplification algorithm is applied to the extracted image sequence to extract specific frequency signals carried in the projected image. This method generates sine and cosine reference waveforms based on a set reference signal frequency, and performs orthogonal demodulation with the image sequence in the time dimension. It calculates the in-phase (I) and quadrature (Q) components for each pixel, and then reconstructs the amplitude image for the corresponding frequency. Phase-locked loop (PLL) processing effectively filters out light source interference at unmodulated frequencies, including sunlight reflection during the day, streetlights at night, and stray light from other vehicle headlights. The extracted amplitude image not only preserves the spatial structure of the modulated signal but also has a higher signal-to-noise ratio. To further improve image clarity and recognizability, the system also combines local contrast enhancement and edge enhancement algorithms to optimize the details of the output image, ensuring a more stable and reliable subsequent QR code or graphic recognition and decoding process. Finally, further image processing enhances image clarity. A geometric correction algorithm is applied to detect the positioning graphics of the QR code (the positioning squares at the three corners), calculate the projection transformation matrix between the actual image and the standard shape, thereby restoring the QR code to a standard square format and eliminating tilt, stretching, or perspective distortion. Finally, data decoding and extraction are completed according to the QR code encoding rules.

[0087] One embodiment of this application also provides a vehicle headlight communication method based on image frame interpolation, applied to the aforementioned vehicle headlight communication system based on image frame interpolation. This method includes at least the following steps:

[0088] The vehicle-mounted central control system in the transmitter receives the input information to be transmitted; the ambient light detection module responds to the input information to be transmitted, evaluates the external lighting conditions, and sets the image grayscale value and frame interpolation frequency based on the light intensity;

[0089] The image encoding module encodes the information to be transmitted based on the set image grayscale value to generate a projected image frame; the projection module inserts the projected image frame into the normal lighting frame sequence of the vehicle headlights based on the set frame interpolation frequency and projects it onto the external environment; the light source module provides the lighting resources required by the projection module.

[0090] The image acquisition module in the receiving end acquires the projected image frame, and the image decoding module performs phase-locked amplification processing on the projected image frame and then performs decoding operation to restore the information to be transmitted and send it to the vehicle central control system in the receiving end.

[0091] For relevant details, please refer to the above system implementation example.

[0092] Figure 7 This is a block diagram of an electronic device provided in one embodiment of this application. The device includes at least a processor 401 and a memory 402.

[0093] Processor 401 may include one or more processing cores, such as a quad-core processor or an octa-core processor. Processor 401 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 401 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 401 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 401 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0094] The memory 402 may include one or more computer-readable storage media, which may be non-transitory. The memory 402 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 402 are used to store at least one instruction, which is executed by the processor 401 to implement the image interpolation-based automotive headlight communication method provided in the method embodiments of this application.

[0095] In some embodiments, the electronic device may also optionally include: a peripheral device interface and at least one peripheral device. The processor 401, memory 402, and peripheral device interface can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface via a bus, signal line, or circuit board. Indicatively, peripheral devices include, but are not limited to: radio frequency circuits, touch displays, audio circuits, and power supplies.

[0096] Of course, electronic devices may also include fewer or more components, and this embodiment does not limit this.

[0097] Optionally, this application also provides a computer-readable storage medium storing a program that is loaded and executed by a processor to implement the image interpolation-based automotive headlight communication method of the above-described method embodiments.

[0098] Optionally, this application also provides a computer product including a computer-readable storage medium storing a program, which is loaded and executed by a processor to implement the image interpolation-based automotive headlight communication method of the above-described method embodiments.

[0099] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0100] The above embodiments merely illustrate several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A car headlight communication system based on image frame interpolation, comprising a transmitter and a receiver, characterized in that: The transmitting end includes an in-vehicle central control system, an ambient light detection module, an image encoding module, a light source module, and a projection module. The in-vehicle central control system receives input information to be transmitted. The ambient light detection module evaluates external lighting conditions in response to the input information to be transmitted, and sets the image grayscale value and frame interpolation frequency based on the light intensity. The image encoding module encodes the information to be transmitted based on the set image grayscale value to generate a projection image frame. The image encoding module arranges the information to be transmitted according to the characters and error correction encoding method of a QR code to generate a QR code image. It then converts the QR code image into a grayscale image based on the set image grayscale value to obtain the projection image frame. The projection module inserts the projection image frame into the normal lighting frame sequence of the vehicle headlights based on the set frame interpolation frequency and projects it onto the external environment. The light source module provides the lighting resources required by the projection module. The receiving end includes an image acquisition module, an image decoding module, and an in-vehicle central control system; the image acquisition module is used to acquire projected image frames, and the image decoding module preprocesses the projected image frames and performs decoding operations to restore the information to be transmitted and send it to the in-vehicle central control system of the receiving end.

2. The automotive headlight communication system based on image frame interpolation according to claim 1, characterized in that, The ambient light detection module is integrated inside the vehicle headlights. It uses a photoelectric sensor to measure the illuminance of ambient reflected light from the ground and direct incident light from around the vehicle in real time. When the illuminance exceeds 10,000 lux, the grayscale value of the projected image is set to 200; if the illuminance is between 3,000 and 10,000 lux, the grayscale value is set to 210; if the illuminance is between 500 and 3,000 lux, the grayscale value is set to 240; if the illuminance is less than 500 lux, the grayscale value is set to 251. When the illuminance exceeds 3,000 lux, the frame interpolation frequency during image projection is set to insert one frame every two frames; if the illuminance does not exceed 3,000 lux, the frame interpolation frequency during image projection is set to insert one frame every three frames.

3. The automotive headlight communication system based on image frame interpolation according to claim 1, characterized in that, The projection module uses DLP technology through the DMD chip to perform image imaging. Based on the set frame interpolation frequency, it periodically inserts projected image frames into the normal lighting frame sequence of the vehicle headlights. The light source module is used to provide the illumination resources required for the DMD chip to modulate.

4. The automotive headlight communication system based on image frame interpolation according to claim 1, characterized in that, The image acquisition module captures and samples the projected image of the ground using a camera positioned at the rear of the vehicle. During the capture process, the sampling frequency of the camera satisfies the Nyquist sampling theorem. An image feature recognition algorithm is used to automatically identify the projected image region. After identifying the region, the image is corrected to restore the captured image to a geometrically regular QR code image.

5. The automotive headlight communication system based on image frame interpolation according to claim 1, characterized in that, The image decoding module converts all acquired projected image frames into grayscale images and crops them to a fixed size to obtain a grayscale image sequence with a uniform structure; lock-in amplification technology is introduced to perform coherent filtering on the image sequence on the time axis to extract signal components consistent with the projection frequency; Constructing time vectors as follows: ； in, This refers to the actual sampling frame rate of the camera. Indicates from 0 to sequence of integers, This indicates the number of image frames continuously acquired by the image acquisition module within one receiving cycle; Set reference frequency Construct the corresponding sinusoidal signal With cosine signal as follows: ； ； grayscale image sequence respectively with sinusoidal signals With cosine signal Perform frame-by-frame matrix multiplication to extract the two orthogonal components of the image signal at the reference frequency: ； ； The amplitude response is calculated based on the two orthogonal components using the following formula. : ； The calculated amplitude results constitute a modulated image reconstructed in the frequency domain after filtering out asynchronous interference.

6. The automotive headlight communication system based on image frame interpolation according to claim 5, characterized in that, The image decoding module performs image enhancement processing on the modulated image, performs QR code image recognition and decoding operations, recovers the complete information to be transmitted, and sends it to the vehicle central control system at the receiving end.

7. A method for automotive headlight communication based on image frame interpolation, applied to an automotive headlight communication system based on image frame interpolation as described in any one of claims 1 to 6, characterized in that, include: The vehicle-mounted central control system in the transmitter receives the input information to be transmitted; The ambient light detection module assesses external lighting conditions in response to the input of the information to be transmitted, and sets the image grayscale value and frame interpolation frequency based on the light intensity. The image encoding module encodes the information to be transmitted based on the set image grayscale values ​​to generate a projection image frame. The image encoding module arranges the information to be transmitted according to the characters and error correction encoding method of the QR code to generate a QR code image. It then converts the QR code image into a grayscale image based on the set image grayscale values ​​to obtain the projection image frame. The projection module inserts the projection image frame into the normal lighting frame sequence of the vehicle headlights based on the set frame interpolation frequency and projects it onto the external environment. The light source module provides the lighting resources required by the projection module. The image acquisition module in the receiving end acquires the projected image frame, and the image decoding module performs phase-locked amplification processing on the projected image frame and then performs decoding operation to restore the information to be transmitted and send it to the vehicle central control system in the receiving end.

8. An electronic device, characterized in that, The device includes a processor and a memory; the memory stores a program that is loaded and executed by the processor to implement the image frame interpolation-based automotive headlight communication method as described in claim 7.

9. A computer-readable storage medium, characterized in that, The storage medium stores a program that, when executed by a processor, is used to implement the image frame interpolation-based automotive headlight communication method as described in claim 7.

Images