Automobile headlamp communication system and method based on image frame insertion

Abstract

The invention relates to the technical field of optical communication, in particular to an automobile headlamp communication system and method based on image frame interpolation, comprising a transmitting end and a receiving end, a vehicle-mounted central control system of the transmitting end is used for receiving input to-be-transmitted information, and an ambient light detection module evaluates an external illumination condition in response to the input of the to-be-transmitted information; an image gray value and frame insertion frequency are set based on the illumination intensity, the image coding module codes information to be transmitted based on the set image gray value to generate a projection image frame, and the projection module inserts the projection image frame into a normal illumination frame sequence of a vehicle lamp based on the frame insertion frequency and projects the projection image frame to an external environment; the image acquisition module of the receiving end is used for acquiring a projection image frame, the image decoding module preprocesses the projection image frame and then decodes the projection image frame, and the information to be transmitted is restored and sent to the vehicle-mounted central control system. According to the invention, vehicle lamp communication at a certain distance in a traffic environment can be realized on the premise of ensuring normal vehicle lamp illumination.

Description

Technical Field

[0001] The present application relates to the field of optical communication technology, and in particular to an automobile headlight communication system and method based on image interpolation. Background Art

[0002] With the development of connected vehicle technology, cars are gradually evolving from simple transportation tools to multi-dimensional information exchange nodes. The demand for communication between vehicles and between vehicles and infrastructure continues to grow. In this context, vehicle external devices are constantly being given new functions. Headlights, in particular, are ideal vehicles for visible light communication (VLC) technology due to their all-weather operation and high-power, high-brightness optical output. VLC utilizes optical signals in the visible light band, embedding data information into the illumination light through modulation, enabling short-distance data transmission. This holds broad application prospects in scenarios such as intelligent transportation and assisted driving.

[0003] Existing visible light communication technologies often use high-frequency flashing or direct intensity modulation of LED lights to transmit small amounts of status or identification information over short distances. The receiving end then uses photodetectors or high-speed cameras to demodulate the signal. However, in real-world road conditions, these solutions often face a trade-off between illumination and communication. On the one hand, overly noticeable flashes or strong signal modulation can affect the visual experience of drivers and pedestrians. On the other hand, ambient light, such as sunlight, streetlights, and other vehicle lights, can significantly interfere with communication signals, and modulation artifacts are easily detected by conventional cameras or the naked eye.

[0004] Therefore, how to achieve the concealment and high reliability of vehicle light communication while maintaining normal lighting function has become a key technical problem that needs to be solved urgently in existing technologies. Summary of the Invention

[0005] This application provides a vehicle headlight communication system and method based on image interpolation, which can achieve headlight communication within a certain distance in a traffic environment while ensuring normal headlight illumination. This application provides the following technical solutions: In a first aspect, the present application provides an automobile headlight communication system based on image interpolation, comprising a transmitting end and a receiving end: The transmitting end includes an on-board central control system, an ambient light detection module, an image encoding module, a light source module, and a projection module; the on-board central control system is used to receive input information to be transmitted; the ambient light detection module evaluates external lighting conditions in response to the input information to be transmitted, and sets the image grayscale value and interpolation frequency based on the light intensity; the image encoding module encodes the information to be transmitted based on the set image grayscale value to generate a projected image frame; the projection module inserts the projected image frame into the normal lighting frame sequence of the vehicle light based on the set interpolation frequency and projects it into the external environment; the light source module is used to provide the lighting resources required by the projection module; The receiving end includes an image acquisition module, an image decoding module and an on-board central control system; the image acquisition module is used to obtain the projected image frame, and the image decoding module pre-processes the projected image frame and performs a decoding operation to restore the information to be transmitted and send it to the on-board central control system of the receiving end.

[0006] In a specific feasible implementation plan, the ambient light detection module is integrated into the interior of the car lamp, and a photoelectric sensor is used to measure the light intensity of the ambient reflected light from the ground and the direct incident light around the car in real time. When the light intensity exceeds 10,000 lux, the grayscale value of the projected image is set to 200; if the light intensity is between 3,000 and 10,000 lux, the grayscale value of the projected image is set to 210; if the light intensity is between 500 and 3,000 lux, the grayscale value of the projected image is set to 240; if the light intensity is less than 500 lux, the grayscale value of the projected image is set to 251; when the light intensity exceeds 3,000 lux, the interpolation frequency of the image projection is set to one frame for every two frames, and if the light intensity does not exceed 3,000 lux, the interpolation frequency of the image projection is set to one frame for every three frames.

[0007] In a specific implementation scheme, the image encoding module arranges the information to be transmitted according to the characters and error correction coding method of the QR code to generate a QR code image; and converts the QR code image into a grayscale image according to the set image grayscale value to obtain a projection image frame.

[0008] In a specific possible implementation scheme, the projection module uses DLP technology through a DMD chip to perform image imaging, and periodically inserts projection image frames into the normal lighting frame sequence of the car lights in an interpolation manner based on a set interpolation frequency. The light source module is used to provide the lighting resources required for modulation of the DMD chip.

[0009] In a specific feasible implementation scheme, the image acquisition module captures and samples the projected image of the ground through a camera installed at the rear of the vehicle. During the shooting process, the sampling frequency of the camera satisfies the Nyquist sampling theorem; and an image feature recognition algorithm is used to automatically identify the projected image area. After the area is identified, the image is corrected and the captured image is restored to a geometrically regular QR code image.

[0010] In a specific embodiment, the image decoding module converts all acquired projection image frames into grayscale images and crops them to a fixed size to obtain a grayscale image sequence with a uniform structure; a lock-in amplification technique is introduced to perform coherent filtering on the image sequence on the time axis to extract signal components consistent with the projection frequency; Constructing a time vector as follows: ; in, is the actual sampling frame rate of the camera, Indicates from 0 to sequence of integers, Indicates the number of image frames continuously collected by the image acquisition module in one receiving cycle; Set reference frequency , construct the corresponding sinusoidal signal With cosine signal as follows: ; ; Grayscale image sequence With sinusoidal signals With cosine signal Perform frame-by-frame matrix multiplication to extract the two orthogonal components of the image signal at the reference frequency: ; ; The amplitude response is calculated based on the two orthogonal components as follows: : ; The calculated amplitude results constitute a modulation image reconstructed in the frequency domain after filtering out the asynchronous interference.

[0011] In a specific implementation scheme, the image decoding module performs image enhancement processing on the modulated image, performs recognition and decoding operations on the two-dimensional code image, restores the complete information to be transmitted and sends it to the receiving end's on-board central control system.

[0012] In a second aspect, the present application provides a vehicle headlight communication method based on image interpolation, which adopts the following technical solutions: A vehicle headlight communication method based on image interpolation, applied to the vehicle headlight communication system based on image interpolation described in the first aspect, comprises: The vehicle-mounted central control system in the transmitting end receives the input information to be transmitted; the ambient light detection module evaluates the external lighting conditions in response to the input information to be transmitted, and sets the image grayscale value and interpolation frequency based on the light intensity; The image encoding module encodes the information to be transmitted based on the set image grayscale value to generate a projection image frame; the projection module inserts the projection image frame into the normal lighting frame sequence of the headlight based on the set interpolation frequency and projects it into the external environment, and the light source module provides the lighting resources required by the projection module; The image acquisition module in the receiving end obtains the projected image frame, and the image decoding module performs phase-locked amplification processing on the projected image frame and then performs decoding operation to restore the information to be transmitted and send it to the vehicle-mounted central control system at the receiving end.

[0013] In a third aspect, the present application provides an electronic device comprising a processor and a memory; the memory stores a program, which is loaded and executed by the processor to implement a car headlight communication method based on image interpolation as described in the second aspect.

[0014] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the storage medium stores a program, and when the program is executed by a processor, it is used to implement a car headlight communication method based on image interpolation as described in the second aspect.

[0015] In summary, the beneficial effects of this application include at least: (1) By deeply integrating visible light communication technology and digital light processing projection technology into the automotive headlight system, we achieve short-distance and efficient communication between vehicles and between vehicles and road infrastructure while ensuring the normal lighting function of the headlights. This integrated solution fully utilizes the lighting hardware resources of the headlights, avoids the addition of additional communication equipment, improves the system's integration and practicality, and effectively promotes the development of vehicle-mounted communication technology in the intelligent transportation environment.

[0016] (2) A special optical signal modulation method is used to periodically insert image frames carrying communication information into the lighting frame sequence of the vehicle headlights, ensuring that the communication signal is highly concealed from both conventional camera equipment and the human eye. Due to the combination of the frame insertion frequency and the persistence of vision effect of the human eye, as well as the reasonable design of the projection grayscale, it is difficult for external observers to directly perceive or capture the communication information, thus achieving covert information transmission, effectively ensuring communication security and the practicality of the system.

[0017] (3) The ambient light detection module monitors external lighting conditions in real time, and the system dynamically adjusts the image grayscale encoding method to specifically adapt to complex noisy environments such as strong sunlight, night lights, and other vehicle lights, thereby significantly improving the stability and robustness of communications. The receiving end combines a variety of advanced methods such as phase-locked amplification technology, high-frequency pulse filtering, and neural network image recognition and decoding to achieve efficient extraction and accurate decoding of periodic modulated signals, ensuring reliable recovery of communication information in changing environments.

[0018] By periodically inserting coded projected image frames into a sequence of normal lighting frames, covert information transmission is achieved. The system dynamically adjusts the image grayscale and interpolation frequency in conjunction with ambient light detection to ensure that the projected image is well discernible under varying lighting conditions. At the same time, digital light processing technology is used to precisely control the projection optical output, balancing both lighting and communication functions. The receiving end captures the projected image through a high-sampling-rate camera and employs phase-locked amplification technology to effectively extract the periodic interpolation signal. Combined with image enhancement and QR code decoding algorithms, it significantly suppresses environmental noise interference and ensures highly reliable information recovery. This solution cleverly solves the critical challenge of achieving both concealment and high reliability in vehicle light communication while maintaining normal lighting functions, significantly improving the environmental adaptability and system robustness of visible light communication for vehicle lights.

[0019] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application and to implement it in accordance with the contents of the specification, the following is a detailed description of the preferred embodiments of the present application in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a diagram of an application scenario of an automobile headlight communication system based on image interpolation according to an embodiment of the present application.

[0021] Figure 2 This is a structural block diagram of an automobile headlight communication system based on image interpolation in an embodiment of the present application.

[0022] Figure 3 It is a structural diagram of the transmitting end in an embodiment of the present application.

[0023] Figure 4 It is a flow chart of the transmitting end in the embodiment of the present application.

[0024] Figure 5 It is a flow chart of the receiving end in the embodiment of the present application.

[0025] Figure 6 This is a use case diagram of a specific embodiment in the embodiments of this application.

[0026] Figure 7 This is a block diagram of an electronic device for automobile headlight communication based on image interpolation according to an embodiment of the present application. DETAILED DESCRIPTION

[0027] The following embodiments are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0028] Reference Figure 1 , is an application scenario diagram of the automobile headlight communication system based on image interpolation in the embodiment of the present application, combined with Figure 2 , Figure 2 A structural block diagram of an automobile headlight communication system based on image interpolation provided by an embodiment of the present application is shown. The system includes a transmitting end and a receiving end.

[0029] Reference Figure 3 The transmitting end includes the vehicle-mounted central control system, ambient light detection module, image encoding module, light source module and projection module.

[0030] The vehicle-mounted central control system is used to receive input information to be transmitted, including text, images, instructions, etc.

[0031] The ambient light detection module is used to evaluate external lighting conditions in response to input of the information to be transmitted, and to set the image grayscale value and interpolation frequency based on the light intensity. In practice, the ambient light detection module is integrated into the headlights and uses a photoelectric sensor, such as a silicon photodiode or a digital ambient light sensor, to measure the intensity of ambient light reflected from the ground and directly incident light around the vehicle in real time. This allows the module to determine the vehicle's current environment and set the image grayscale value and interpolation frequency for subsequent image projection based on this environment.

[0032] Specifically, when the light intensity exceeds 10,000 lux, the external lighting condition is considered to be a strong sunlight environment, and the grayscale value of the projected image is set to 200 to ensure that the image contrast is sufficiently recognizable. If the light intensity is between 3,000 and 10,000 lux, the external lighting condition is considered to be a strong lighting environment, such as is common on sunny days but not under direct sunlight, and the grayscale value of the projected image is set to 210. If the light intensity is between 500 and 3,000 lux, the external lighting condition is considered to be a medium lighting environment, such as a cloudy day, outdoor evening, or tunnel environment, and the grayscale value of the projected image is set to 240. If the light intensity is less than 500 lux, the external lighting condition is considered to be a dark night environment or with a few street lights, and the grayscale value of the projected image is set to 251 to maximize the visibility of the image against the background.

[0033] Correspondingly, when the light intensity exceeds 3000 lux, in strong sunlight or relatively strong lighting environments, the interpolation frequency during image projection is set to insert one frame every two frames. If the light intensity does not exceed 3000 lux, in medium lighting or dark environments, the interpolation frequency during image projection is set to insert one frame every three frames.

[0034] It should be noted that lux is a unit of illuminance used to measure the intensity of visible light flux received per unit area. The illuminance unit interval corresponding to each external lighting condition and the set image grayscale value are obtained through human experience and experiments. This application does not impose any restrictions on the illuminance unit interval corresponding to each external lighting condition and the set image grayscale value.

[0035] The image encoding module is used to encode the information to be transmitted based on the set image grayscale value to generate a projection image frame. Specifically, refer to Figure 4 The image encoding module first determines the image encoding method based on the information to be transmitted. It can choose a barcode, QR code, or directly project a text image based on the amount of information or external lighting conditions, with QR codes typically being the preferred method. The image encoding module then formats the information to be transmitted according to the QR code's characters and error correction encoding method to generate a QR code image. It then converts the QR code image into a grayscale image based on the previously set image grayscale value, resulting in a projected image frame.

[0036] It should be noted that the projected image frame can be one or multiple frames, depending on the amount of information to be transmitted. If the amount of information is small, it is usually one frame, and a single QR code image can transmit the entire information. If the amount of information is large, multiple QR code images are required to transmit the complete information, in which case the projected image frame is multiple frames.

[0037] The projection module is responsible for inserting projected image frames into the normal lighting frame sequence of the headlights based on a set interpolation frequency and projecting them into the external environment. The light source module is responsible for providing the illumination resources required by the projection module. In practice, the projection module utilizes digital light processing (DLP) technology for image formation, with the DMD chip as its core component. The generated projected image frames are transmitted to the DMD driver controller and mapped onto the DMD chip's micromirrors. Each micromirror is tilted and controlled based on the position and grayscale value of each pixel in the projected image frame, thereby modulating the intensity of the reflected light emitted by the light source module, thereby forming a complete optical output image. For example, when the DMD chip projects at a 120Hz frame rate, in strong sunlight or relatively bright lighting environments, the projection module inserts one valid projected image frame every two frames, resulting in a 40Hz information output frequency. In moderate lighting or dark environments, a valid projected image frame is inserted every three frames, corresponding to a 30Hz information frame rate.

[0038] Furthermore, to complement the vehicle's lighting functions and prevent information images from interfering with normal visual effects, the projection module preferably uses interpolation for image output. This means that projected image frames carrying valid information are periodically inserted into the normal lighting frame sequence of the vehicle's lights. In this interpolation mode, the remaining frames are ordinary lighting frames without image information. Due to the persistence of the human eye and the projection grayscale design, the information contained in these frames is not clearly discernible to external observers, thus ensuring the concealment of the projected content.

[0039] The light source module provides the illumination resources required for DMD modulation. This light source module can utilize an LED matrix light source or a laser headlight light source. For example, a blue light chip excites yellow phosphor to produce white light. In terms of structural design, the light source module can function as a standalone light unit for projection or integrate with the vehicle's existing headlights, enabling functional reuse of headlights and visible light communication, effectively reducing system complexity.

[0040] In summary, the transmitter receives the information to be transmitted through the vehicle's central control system. The ambient light detection module dynamically assesses external lighting conditions and sets the image grayscale value and interpolation frequency. The image encoding module encodes the information into grayscale image frames. The projection module uses DLP technology to covertly project this image as interpolated frames within the normal vehicle lighting sequence. The light source module provides the necessary lighting support for image formation. This transmitter structure not only enables adaptive encoding and projection control for varying lighting environments, but also enables covert projection of information without affecting the vehicle lighting function, effectively improving the environmental adaptability, transmission stability, and system integration of visible light communication for vehicle lights.

[0041] The receiving end includes an image acquisition module, an image decoding module and an on-board central control system.

[0042] The image acquisition module is used to acquire projected image frames. Specifically, the image acquisition module samples the projected image of the ground using a camera located at the rear of the vehicle. The camera is preferably a rearview camera integrated into the vehicle. During the capture process, the camera's sampling frequency must meet the Nyquist sampling theorem to ensure that the projected image frames generated by the transmitter's interpolation are effectively captured and to avoid sampling aliasing or information loss. For example, when an image carrying valid information is projected at a frequency of 30 Hz, the camera's sampling frequency should be at least 60 frames per second (fps) to effectively avoid image aliasing or information loss.

[0043] Furthermore, preferably, considering possible interference factors such as vibration and vehicle posture changes during driving, the image acquisition module further employs image feature recognition algorithms, such as template matching and edge detection, to automatically identify the projected image area. After identifying the area, geometric distortion caused by camera angle offset or vehicle body dynamics is corrected using matrix affine transformation or perspective transformation, thereby restoring the captured image to a geometrically regular QR code image.

[0044] It should be noted that the image feature recognition algorithms used are all existing methods, so they will not be described in detail.

[0045] The image decoding module is used to perform decoding operations on the projected image frames after pre-processing, restore the information to be transmitted and send it to the receiving vehicle central control system.

[0046] In implementation, refer to Figure 5 First, the image decoding module converts all the acquired projection image frames into grayscale images and crops them to a fixed size to match the standard QR code template, obtaining a grayscale image sequence with a unified structure. Because the transmitter periodically projects image frames using interpolation, a modulation component with a specific frequency is implicit in the image sequence. To accurately extract these periodic image frames, the image decoding module further incorporates lock-in amplification technology to enhance the information components at the corresponding frequency and suppress non-periodic interference signals. The basic idea is to perform coherent filtering on the image sequence along the time axis to extract the signal components consistent with the projection frequency.

[0047] Specifically, construct the time vector as follows: ; in, is the actual sampling frame rate of the camera, Indicates from 0 to sequence of integers, It represents the number of image frames continuously collected by the image acquisition module in one receiving cycle. The numerator represents the index of each frame, and the time vector is used to represent the sampling time point corresponding to each frame.

[0048] Then set the reference frequency , that is, the periodic frequency of the projected image frame insertion, constructing the corresponding sinusoidal signal With cosine signal as follows: ; ; Finally, the grayscale image sequence With sinusoidal signals With cosine signal Perform frame-by-frame matrix multiplication to extract the two orthogonal components of the image signal at the reference frequency: ; ; Through the above operation, the grayscale change components in the image sequence at the reference frequency (i.e., the image interpolation frequency) are significantly enhanced, while other asynchronous changes (such as environmental noise, lighting fluctuations, or random disturbances) are offset by each other during the orthogonal demodulation process because they are orthogonal to the reference signal. Subsequently, the image decoding module calculates the amplitude response based on the two orthogonal components as follows: : ; The calculated amplitude results form a new two-dimensional image, whose pixel values ​​reflect the response amplitude of the original image sequence at the corresponding frequency. The image can be viewed as a modulated image reconstructed in the frequency domain after filtering out asynchronous interference. In the spatial domain, it directly represents the brightness distribution of the valid image frame, showing a clear outline of the QR code or text graphic structure. This modulated image provides a clear and clean image input foundation for subsequent QR code image enhancement and decoding operations.

[0049] It should be noted that in the implementation, the amplitude response of each pixel at the reference frequency is calculated. This operation is performed at the pixel level, and finally each pixel position obtains an amplitude, thus forming a new two-dimensional matrix. This matrix is Image, which represents the response intensity of the original image sequence to the interpolation frequency at each pixel point, is equivalent to extracting the image component synchronized with the interpolation frequency from the original sequence. The image is essentially a frequency-selective response image, in which non-periodic noise is significantly suppressed, while the effective image of the periodic interpolated frames is enhanced and clearly displayed. The brightness structure of the QR code or text can be discerned in the image. In the spatial domain, this image exhibits a visual structure similar to the original projected image frame, providing a high-quality basic input for subsequent image enhancement and decoding operations.

[0050] After obtaining the modulated image, the image decoding module further performs image enhancement processing on it to optimize image quality, suppress noise and enhance edge clarity. Specifically, the following operations are performed: linearly mapping the image grayscale value to the range of [0,1] helps to unify the brightness distribution of different frames and adapt to lighting changes in different environments; applying spatial smoothing processing to remove high-frequency noise and maintain the image edge structure; optionally using an adaptive histogram equalization method to enhance the brightness contrast of local areas of the image to make the QR code pattern clearer; in high-noise environments, a lightweight deep neural network can also be introduced to enhance the overall clarity of the image and suppress artifacts.

[0051] After image enhancement, the image decoding module begins the QR code image recognition and decoding process. This process primarily involves the following operations: automatically locating the QR code image using methods such as corner detection and edge detection; identifying the bright and dark units in the image based on the unit module structure of the QR code, converting them into corresponding binary bits; parsing the data codewords and error correction codewords from each frame, extracting the original bit sequence containing the information, and utilizing the QR code's built-in error correction mechanism to correct for any local defects, occlusions, or misjudgments in the image. Furthermore, if the information to be transmitted is large and distributed across multiple QR code image frames, the codewords for each frame are concatenated and combined according to the sequential markings within the image frames. Finally, reverse decoding is performed according to the standard QR code format to restore the complete information to be transmitted and send it to the receiving vehicle's central control system.

[0052] In summary, the receiving end uses the image acquisition module to capture and correct projected image frames from behind the vehicle at a high frequency. Combined with the lock-in amplification technology introduced in the image decoding module, this effectively extracts the effective information image embedded in the periodic interpolated frames, significantly suppressing environmental noise interference. Furthermore, through image enhancement and QR code recognition and decoding processes, the original data information can be accurately restored. This system not only exhibits adaptive robustness to varying lighting environments and vehicle dynamics, but also achieves stable data reception under visual concealment, providing a reliable and efficient reception mechanism for visible light communication between headlights.

[0053] The present application provides a car headlight communication system based on image interpolation, which realizes the covert transmission of information by periodically inserting encoded projected image frames into the normal lighting frame sequence. The system dynamically adjusts the image grayscale in combination with ambient light detection to ensure that the projected image has good recognizability under different lighting conditions; at the same time, it uses digital light processing technology to accurately control the projection optical output, taking into account both lighting and communication functions. The receiving end collects the projected image through a high-sampling rate camera, and uses phase-locked amplification technology to effectively extract the periodic interpolation signal. Combined with image enhancement and QR code decoding algorithms, it significantly suppresses environmental noise interference and ensures highly reliable information recovery. This solution cleverly solves the key problem of achieving concealment and high reliability of car headlight communication while maintaining normal lighting function, and significantly improves the environmental adaptability and system robustness of visible light communication of car lights.

[0054] For example, see Figure 6 When a car carrying a pregnant woman encounters an emergency on a crowded urban road, the driver can use the headlights to communicate with the vehicle in front of them through visible light, quickly letting the vehicle in front know the situation and make an evasive move. The specific process is as follows: On the transmitter side, before the headlights communicate, the ambient light detection module first reports the ambient light intensity. It then pre-sets the image grayscale value and interpolation frequency for different environments. After determining that the communication message is "Pregnant woman urgently needs to go to the hospital, please give way," it converts this message into a QR code image. A projection image corresponding to the scene is generated based on the ambient light and the pre-set image grayscale value. The projected image is then output to the projection module for imaging. The core component of the projection module is the DMD. For example, the DLP7000 DMD sends data to the controller via the FPGA, enabling high-speed, low-latency signal transmission. The DLPA200 micromirror driver generates DMD micromirror clock pulse control data, which is stored in the SRAM cells below the micromirrors. This data flips the 1024×768 micromirror array by +12° or -12° for spatial light modulation, generating the image that is output through the projection lens.

[0055] At the receiving end: the high frame rate camera in the image acquisition module of the front vehicle is aimed at the lighting area of ​​the rear vehicle, and the shooting sampling frequency is 120 frames to ensure the timeliness and continuity of information extraction. First, the current ambient light conditions are evaluated to determine the intensity of the ambient light and automatically switch to the corresponding different reference signal frequencies: under sunlight (above 3000 lux) The frequency setting strategy considers the security of the modulation signal and the anti-interference requirement in the signal extraction process. The image decoding module performs position correction, motion compensation, and target region extraction on the collected images. Due to the slight shaking or position deviation of the vehicle during driving, the image sequence captured by the vehicle-mounted camera often has problems such as frame misalignment, blur, or rotation. To ensure accurate information extraction, the image sequence is first registered. This process estimates the geometric transformation relationship between images through edge detection, feature point extraction, and matching methods, and aligns all images to a unified reference coordinate system. Then, the phase-locked amplification and image enhancement method is used to extract the modulation signal in the projection image, effectively suppressing environmental interference. After completing the image preprocessing, the phase-locked amplification algorithm is applied to the extracted image sequence to extract the specific frequency signal carried in the projection image. This method generates sine and cosine reference waveforms based on the set reference signal frequency, and performs orthogonal demodulation with the image sequence in the time dimension to calculate the in-phase (I) and quadrature (Q) components of each pixel point, and then restores the amplitude image of the corresponding frequency. The phase-locked processing can effectively filter out light source interference at non-modulation frequencies, including sunlight reflection during the day, street light illumination at night, and stray light from other vehicle headlights. The extracted amplitude image not only retains the spatial structure of the modulation signal, but also has a higher signal-to-noise ratio. To further improve image clarity and recognizability, the system also combines local contrast enhancement and edge enhancement algorithms to optimize the output image details, ensuring that the subsequent two-dimensional code or pattern recognition and decoding process is more stable and reliable. Finally, further image processing is performed to improve image clarity. The geometric correction algorithm is applied to detect the positioning pattern of the two-dimensional code (the positioning square on the three corners), calculate the projection transformation matrix between the actual image and the standard form, and restore the two-dimensional code to the standard square format, eliminating tilt, stretch, or perspective distortion. Finally, the data decoding and extraction are completed according to the two-dimensional code encoding rules.

[0056] One embodiment of the present application also provides an image interpolation-based automobile headlight communication method, which is applied to the above-mentioned image interpolation-based automobile headlight communication system. The method comprises at least the following steps: The vehicle-mounted central control system in the transmitting end receives the inputted to-be-transmitted information. The ambient light detection module evaluates the external light conditions in response to the input of the to-be-transmitted information, and sets the image gray value and the interpolation frequency based on the light intensity; The image encoding module encodes the to-be-transmitted information based on the set image gray value to generate a projection image frame. The projection module inserts the projection image frame into the normal illumination frame sequence of the vehicle lamp based on the set interpolation frequency and projects it to the external environment. The light source module provides the light resources required by the projection module; The image acquisition module in the receiving end obtains the projected image frame, and the image decoding module performs phase-locked amplification processing on the projected image frame and then performs decoding operation to restore the information to be transmitted and send it to the vehicle-mounted central control system at the receiving end.

[0057] For relevant details, please refer to the above system embodiment.

[0058] Figure 7 4 is a block diagram of an electronic device provided in one embodiment of the present application. The device includes at least a processor 401 and a memory 402.

[0059] Processor 401 may include one or more processing cores, such as a quad-core processor or an octa-core processor. Processor 401 may be implemented in hardware using at least one of the following: a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), or a PLA (Programmable Logic Array). Processor 401 may also include a main processor and a coprocessor. The main processor is used to process data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 401 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing content displayed on the display screen. In some embodiments, processor 401 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0060] Memory 402 may include one or more computer-readable storage media, which may be non-transitory. Memory 402 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in memory 402 is used to store at least one instruction, which is executed by processor 401 to implement the image interpolation-based vehicle headlight communication method provided in the method embodiment of the present application.

[0061] In some embodiments, the electronic device may optionally include a peripheral device interface and at least one peripheral device. The processor 401, memory 402, and peripheral device interface may be connected via a bus or signal lines. Each peripheral device may be connected to the peripheral device interface via a bus, signal lines, or circuit boards. Illustratively, the peripheral devices include, but are not limited to, radio frequency circuitry, a touchscreen display, audio circuitry, and a power supply.

[0062] Of course, the electronic device may also include fewer or more components, which is not limited in this embodiment.

[0063] Optionally, the present application also provides a computer-readable storage medium, in which a program is stored. The program is loaded and executed by a processor to implement the automobile headlight communication method based on image interpolation of the above method embodiment.

[0064] Optionally, the present application also provides a computer product, which includes a computer-readable storage medium, in which a program is stored. The program is loaded and executed by a processor to implement the automobile headlight communication method based on image interpolation of the above-mentioned method embodiment.

[0065] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0066] The above embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art could make various modifications and improvements without departing from the spirit of the present application, all of which fall within the scope of protection of the present application. Therefore, the scope of protection of the present patent application shall be determined by the appended claims.

Claims

1. An automobile headlight communication system based on image interpolation, comprising a transmitter and a receiver, characterized in that: The transmitting end includes an on-board central control system, an ambient light detection module, an image encoding module, a light source module, and a projection module; the on-board central control system is used to receive input information to be transmitted; the ambient light detection module evaluates external lighting conditions in response to the input information to be transmitted, and sets the image grayscale value and interpolation frequency based on the light intensity; the image encoding module encodes the information to be transmitted based on the set image grayscale value to generate a projected image frame; the projection module inserts the projected image frame into the normal lighting frame sequence of the vehicle light based on the set interpolation frequency and projects it into the external environment; the light source module is used to provide the lighting resources required by the projection module; The receiving end includes an image acquisition module, an image decoding module and an on-board central control system; the image acquisition module is used to obtain the projected image frame, and the image decoding module pre-processes the projected image frame and performs a decoding operation to restore the information to be transmitted and send it to the on-board central control system of the receiving end.

2. The automobile headlight communication system based on image interpolation according to claim 1, characterized in that: The ambient light detection module is integrated into the headlights and uses a photoelectric sensor to measure the intensity of ambient reflected light from the ground and direct incident light from the vehicle's surroundings in real time. When the light intensity exceeds 10,000 lux, the grayscale value of the projected image is set to 200; if the light intensity is between 3,000 and 10,000 lux, the grayscale value of the projected image is set to 210; if the light intensity is between 500 and 3,000 lux, the grayscale value of the projected image is set to 240; if the light intensity is less than 500 lux, the grayscale value of the projected image is set to 251; when the light intensity exceeds 3,000 lux, the interpolation frequency during image projection is set to one frame for every two frames, and if the light intensity does not exceed 3,000 lux, the interpolation frequency during image projection is set to one frame for every three frames.

3. The automobile headlight communication system based on image interpolation according to claim 1, characterized in that: The image encoding module arranges the information to be transmitted according to the characters and error correction coding method of the QR code to generate a QR code image; and converts the QR code image into a grayscale image according to the set image grayscale value to obtain a projection image frame.

4. The automobile headlight communication system based on image interpolation according to claim 1, characterized in that: The projection module uses DLP technology to perform image formation through a DMD chip, and periodically inserts projection image frames into the normal lighting frame sequence of the headlights in an interpolation manner based on a set interpolation frequency. The light source module is used to provide the lighting resources required for modulation by the DMD chip.

5. The automobile headlight communication system based on image interpolation according to claim 1, characterized in that: The image acquisition module captures and samples the projected image of the ground through a camera installed at the rear of the vehicle. During the shooting process, the sampling frequency of the camera satisfies the Nyquist sampling theorem. The image feature recognition algorithm is used to automatically identify the projected image area. After the area is identified, the image is corrected and the captured image is restored to a geometrically regular QR code image.

6. The automobile headlight communication system based on image interpolation according to claim 1, characterized in that: The image decoding module converts all acquired projection image frames into grayscale images and crops them to a fixed size to obtain a grayscale image sequence with a unified structure; the phase-locked amplification technology is introduced to perform coherent filtering on the image sequence on the time axis to extract the signal component consistent with the projection frequency; Constructing a time vector as follows: ； in, is the actual sampling frame rate of the camera, Indicates from 0 to sequence of integers, Indicates the number of image frames continuously collected by the image acquisition module in one receiving cycle; Set reference frequency , construct the corresponding sinusoidal signal With cosine signal as follows: ； ； Grayscale image sequence With sinusoidal signals With cosine signal Perform frame-by-frame matrix multiplication to extract the two orthogonal components of the image signal at the reference frequency: ； ； The amplitude response is calculated based on the two orthogonal components as follows: : ； The calculated amplitude results constitute a modulation image reconstructed in the frequency domain after filtering out the asynchronous interference.

7. The automobile headlight communication system based on image interpolation according to claim 6, characterized in that: The image decoding module performs image enhancement processing on the modulated image, executes recognition and decoding operations of the two-dimensional code image, restores the complete information to be transmitted and sends it to the vehicle-mounted central control system at the receiving end.

8. A vehicle headlight communication method based on image interpolation, applied to a vehicle headlight communication system based on image interpolation as claimed in any one of claims 1 to 7, characterized in that: include: The vehicle-mounted central control system in the transmitting end receives the input information to be transmitted; The ambient light detection module evaluates external lighting conditions in response to input of information to be transmitted, and sets the image grayscale value and interpolation frequency based on the light intensity; The image encoding module encodes the information to be transmitted based on the set image grayscale value to generate a projection image frame; the projection module inserts the projection image frame into the normal lighting frame sequence of the headlight based on the set interpolation frequency and projects it into the external environment, and the light source module provides the lighting resources required by the projection module; The image acquisition module in the receiving end obtains the projected image frame, and the image decoding module performs phase-locked amplification processing on the projected image frame and then performs decoding operation to restore the information to be transmitted and send it to the vehicle-mounted central control system at the receiving end.

9. An electronic device, characterized in that: The device includes a processor and a memory; the memory stores a program, and the program is loaded and executed by the processor to implement the automobile headlight communication method based on image interpolation as claimed in claim 8.

10. A computer-readable storage medium, characterized in that The storage medium stores a program, which, when executed by the processor, is used to implement the automobile headlight communication method based on image interpolation as claimed in claim 8.

Images