Rearview mirror visual field adjusting method and system capable of resisting strong light interference

By collecting and analyzing the rearview mirror image data in real time, dynamically adjusting the lighting and polarization angles in the car, combined with anti-glare processing, the visual interference problem of traditional rearview mirrors in a strong light environment is solved, and the stability, clear and comfortable Rear view image, improving driving safety and comfort.

CN118977648APending Publication Date: 2024-11-19SHENZHEN ANGXING TECH CO LTD
View PDF 0 Cites 11 Cited by

Patent Information

Application Number
CN202411070307.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-06
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

Traditional rearview mirrors are difficult to effectively suppress visual interference in strong light environments, resulting in blurred rear scenes and reduced contrast, which seriously threatens driving safety. In addition, the lighting system in the car cannot achieve real-time dynamic adjustment under different lighting environments, resulting in driver visual fatigue and Discomfort.

Method used

Real-time acquisition of rearview mirror camera image data, calculate the ambient light intensity and dynamically adjust the interior lighting, analyze the interference level of the strong light area and dynamically adjust the rearview mirror polarization angle, adjust the image processing parameters to optimize the visual effect, and generate high dynamic range images And white balance correction is performed, and anti-glare treatment is integrated to reduce strong light reflection.

Benefits of technology

Under complex lighting conditions, precise identification and suppression of strong light is achieved, ensuring clear vision of the rearview mirror, harmonious interior lighting with the external environment, reducing the risk of traffic accidents caused by strong light, and improving driving comfort and safety sex.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118977648A_ABST
    Figure CN118977648A_ABST
Patent Text Reader

Abstract

The invention discloses a rearview mirror visual field adjusting method and system capable of resisting strong light interference, and the method achieves the intelligent adjustment of the illumination in a vehicle through collecting image data in real time and calculating the ambient light intensity E based on the brightness information L and the contrast information C, and avoids the visual discomfort caused by the incoordination of the illumination in the vehicle and the illumination outside the vehicle. Then, a unique hard light interference level D judgment method is utilized, a hard light area in the image is accurately recognized, then the polarization angle theta of the rearview mirror is dynamically adjusted, hard light is effectively filtered out, and direct visual impact on a driver is reduced. Through fine adjustment of the image processing parameters of the non-strong light area, the overall visual effect of the image is ensured, and the naturalness and color balance of the image are kept. The use effect of the electronic rearview mirror in the strong light environment is remarkably improved, the traffic accident risk caused by the strong light is reduced, the visual environment in a cab is optimized through intelligent in-vehicle illumination adjustment, and the driving comfort is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the technical field of automobiles, and in particular relates to a rearview mirror field of view adjustment method and system capable of resisting strong light interference. Background Art

[0002] In modern car driving environments, rearview mirrors are an important tool for drivers to obtain a view of the rear of the vehicle, and their clarity and reliability are directly related to driving safety. However, in extreme lighting conditions such as strong light during the day, direct high beam light at night, or entering a tunnel, traditional glass rearview mirrors or early electronic rearview mirrors often have difficulty effectively suppressing the visual interference caused by strong light, resulting in blurred rear views, reduced contrast, and even glare, which seriously threatens driving safety.

[0003] In addition, the fixed brightness setting of the interior lighting system may also increase the driver's visual fatigue or reduce driving comfort under different external lighting environments. Existing solutions are insufficient in dealing with strong light interference and environmental adaptability, especially the lack of in-depth analysis of image data and real-time dynamic adjustment capabilities. Summary of the invention

[0004] The purpose of the present invention is to provide a rearview mirror field of view adjustment method and system that can resist strong light interference, which can accurately identify and suppress strong light interference in real time under complex and changeable lighting conditions, while ensuring that details of other areas within the rearview mirror field of view are clearly visible, and that the interior lighting and the external lighting environment are harmoniously matched, ensuring that the driver can obtain a stable, clear and comfortable rearview image in various driving scenarios, so as to solve the problems in the prior art raised in the above background technology.

[0005] To achieve the above object, the present invention adopts the following technical solution: a method for adjusting the field of view of a rearview mirror capable of resisting strong light interference, the method being applied to an in-vehicle electronic rearview mirror, comprising: a) collecting image data captured by a rearview mirror camera in real time, wherein the image data includes brightness information L and contrast information C; b) Calculate the ambient light intensity E according to the formula E=α*L+β*C, where α and β are preset coefficients, and dynamically adjust the interior lighting brightness according to the ambient light intensity E; c) Analyze the strong light area in the image to determine the strong light interference level D according to the formula D=f(E,T), where T is the preset threshold and f is a function for determining the interference level based on the ambient light intensity and the threshold; d) According to the result of the strong light interference level D, the polarization angle θ of the rearview mirror is dynamically adjusted using the formula θ=g(D), where g is the polarization angle adjustment function; e) Adjust the image processing parameters to enhance the details of the non-light-intensive areas, using the formula P = h (L, C, θ), where h is the function that adjusts the image processing parameters according to the original brightness, contrast and polarization angle, and P is the adjusted image processing parameter set to optimize the overall visual effect of the image; f) Output the adjusted image data to the electronic rearview mirror display screen to achieve a visual field display that is resistant to strong light interference.

[0006] Preferably, in step a), the camera uses high dynamic range technology to collect image data captured by the rearview mirror camera in real time, including: Continuously capture multiple frames of images with different exposure times in the same scene, including at least one frame of short-exposure image to capture highlight details and one frame of long-exposure image to capture dark details; Align multiple frames of images to compensate for image displacement caused by vehicle movement and ensure pixel correspondence between each frame of images; The tone mapping algorithm is used to fuse the brightness information of multiple frames of images to generate an HDR image containing highlight details and dark details, and perform real-time brightness and contrast analysis.

[0007] Preferably, in step b), dynamically adjusting the interior lighting brightness according to the ambient light intensity E includes: Using the ambient light information after HDR image processing, calculate the overall brightness of the current environment and the light intensity distribution of each area; Compare the calculated light intensity with the preset comfortable light range to determine whether the lighting in specific areas of the vehicle needs to be increased or decreased; According to the comparison results, the brightness and color temperature of the LED light group in the car are adjusted.

[0008] Preferably, in step c), analyzing the strong light area in the image to determine the strong light interference level D includes: Calculation of ambient light intensity E: First, calculate the light intensity E of the current environment according to the method mentioned in step b); Determine the threshold value T: preset a light intensity threshold value T based on the ambient light intensity under normal lighting conditions and the known critical point of strong light interference; Calculate the strong light interference level D: Use the function f(D=max(0,ET)) to determine the strong light interference level; if the calculated ambient light intensity E is greater than the preset threshold T, then D takes the positive value of the difference between E and T, indicating that there is a certain degree of strong light interference; if the ambient light intensity E is not greater than the preset threshold T, then D is 0, indicating that the current lighting conditions do not meet the standard of strong light interference; Classification and response level setting: According to the specific value of D, the strong light interference level is divided into several levels, and each level corresponds to a different response strategy; Triggering subsequent processing: After determining the strong light interference level D, this information input is passed to the dynamic adjustment of the polarization angle in step d) and the optimization processing of the brightness L and contrast C in step e); Real-time monitoring and dynamic evaluation: Continuously monitor changes in ambient light intensity E and recalculate D based on the latest E value.

[0009] Preferably, in step d), dynamically adjusting the polarization angle θ of the rearview mirror according to the result of the strong light interference level D comprises: Define parameters: determine the slope coefficient k based on the sensitivity of the polarization angle to the strong light interference level D and select the polarization starting angle φ based on the optical characteristics of the electronic rearview mirror; Measuring the strong light interference level D: Real-time monitoring of the strong light interference level in the ambient light through the light intensity detector; Calculate the polarization angle θ: Use the function g(D)=θ=D*k+φ and calculate the polarization angle θ based on the currently measured strong light interference level D; Perform polarization angle adjustment: send the calculated polarization angle θ command to the polarization controller in the electronic rearview mirror, and dynamically adjust the angle of the polarizer according to the received command.

[0010] Preferably, in step e), optimizing the overall visual effect of the image is performed by dynamically adjusting the brightness L and the contrast C according to the strong light interference level D, including: Determine adjustment coefficients m and n: Determine the values ​​of coefficients m and n based on experiments. Coefficients m and n respectively control the response amplitude of brightness L and contrast C to strong light interference level D; Calculate the adjusted brightness L' and contrast C': According to the function h, use the current strong light interference level D to calculate the adjusted brightness L' and contrast C' respectively. The calculation formulas are L'=L*(1+mD) and C'=C*(1+nD), where the value of D determines the degree of adjustment, and m and n determine the rate and direction of adjustment; Apply adjustment parameters: apply the calculated brightness L' and contrast C' to the original image data; Polarization angle integration: Integrate the polarization angle θ together with the adjusted brightness L' and contrast C' into the final image processing parameter set P; Image rendering and output: Use the adjusted parameter set P to render the original image.

[0011] Preferably, in f), an anti-glare display is also included. The anti-glare display includes: A light sensor is integrated inside the electronic rearview mirror to monitor the light intensity and position of the vehicle coming from behind in real time. When the sensor detects that a high-intensity light source is directly irradiating or nearly irradiating the rearview mirror, the anti-glare processing unit is activated. The anti-glare processing unit dynamically adjusts the local brightness distribution of the electronic rearview mirror display screen according to the light source position information, and directly weakens or blocks the reflection of strong light sources on the screen through local dimming.

[0012] Preferably, in step b), it further includes: performing white balance correction before calculating the ambient light intensity E, including: Raw data acquisition: Get the RAW image data of the current scene from the electronic rearview mirror camera. The RAW data contains image information without any color processing. Color space conversion: convert RAW image data to a color space that can be white balanced; Determine the reference white point: Identify one or more areas in the image that should theoretically be neutral gray or white as reference points; Calculate color deviation: Compare the value of the reference white point in the current color space with the ideal white to obtain the color deviation value; Applying a white balance correction matrix: According to the color deviation value, a white balance correction matrix is ​​calculated, and the matrix is ​​used to adjust the color component of each pixel in the image to eliminate the color deviation caused by the color temperature of the light source; Color space conversion back to RGB: Apply the white balance correction matrix to the adjusted image data and then convert it back to RGB color space; Ambient light intensity calculation: After completing white balance correction, use the adjusted image data to calculate the ambient light intensity E according to the formula E=α*L+β*C.

[0013] On the other hand, the present invention also provides a rearview mirror field of view adjustment system capable of resisting strong light interference, comprising: An image data acquisition module, used for acquiring image data captured by a rearview mirror camera in real time, wherein the image data includes brightness information L and contrast information C; The light intensity calculation module is used to calculate the ambient light intensity E according to the formula E=α*L+β*C, where α and β are preset coefficients, and dynamically adjust the interior lighting brightness according to the ambient light intensity E; A strong light interference level calculation module is used to analyze the strong light area in the image to determine the strong light interference level D according to the formula D=f(E, T), where T is a preset threshold and f is a function for determining the interference level according to the ambient light intensity and the threshold; A rearview mirror adjustment module is used to dynamically adjust the polarization angle θ of the rearview mirror according to the result of the strong light interference level D, using the formula θ=g(D), where g is the polarization angle adjustment function; The image processing module is used to adjust the image processing parameters to enhance the details of the non-light-intensive areas, using the formula P=h(L, C, θ), where h is a function that adjusts the image processing parameters according to the original brightness, contrast, and polarization angle, and P is the adjusted image processing parameter set to optimize the overall visual effect of the image; The image display module is used to output the adjusted image data to the electronic rearview mirror display screen to achieve a field of view display that is resistant to strong light interference.

[0014] Technical effects and advantages of the present invention: Compared with the prior art, the present invention provides a rearview mirror field of view adjustment method and system that can resist strong light interference, which has the following advantages: The present invention collects image data in real time and calculates the ambient light intensity E based on the brightness information L and the contrast information C, thereby realizing intelligent adjustment of the interior lighting and avoiding visual discomfort caused by the incoordination of the lighting inside and outside the vehicle. Then, a unique method for judging the strong light interference level D is used to accurately identify the strong light area in the image, and then dynamically adjust the polarization angle θ of the rearview mirror to effectively filter out the strong light and reduce the direct visual impact on the driver. At the same time, by finely adjusting the image processing parameters of the non-strong light area, the overall visual effect of the image is ensured, and the details of other areas will not be sacrificed due to strong light suppression, while maintaining the naturalness and color balance of the image. Not only does it significantly improve the use effect of the electronic rearview mirror in a strong light environment and reduce the risk of traffic accidents caused by strong light, but it also optimizes the visual environment in the cab and improves driving comfort through intelligent adjustment of the interior lighting. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A flow chart of a rearview mirror field of view adjustment method capable of resisting strong light interference according to the present invention; Figure 2 The present invention is a module diagram of a rearview mirror field of view adjustment system capable of resisting strong light interference. DETAILED DESCRIPTION

[0016] The following will be combined with the accompanying drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. The specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0017] The present invention provides a rearview mirror field of view adjustment method that can resist strong light interference. The method is applied to the electronic rearview mirror in the car, and can accurately identify and suppress strong light interference in real time under complex and changeable lighting conditions, while ensuring that other area details in the rearview mirror field of view are clearly visible, and the interior lighting and the external lighting environment are harmoniously matched, ensuring that the driver can obtain a stable, clear and comfortable rearview image in various driving scenarios. The details are as follows.

[0018] like Figure 1 As shown, Figure 1 The present invention is a flow chart of a rearview mirror field of view adjustment method capable of resisting strong light interference.

[0019] Exemplarily, the above-mentioned method for adjusting the field of view of a rearview mirror capable of resisting strong light interference includes the following steps: a) collecting image data captured by a rearview mirror camera in real time, wherein the image data includes brightness information L and contrast information C; Furthermore, the camera uses high dynamic range technology to collect image data captured by the rearview mirror camera in real time, specifically including: continuously shooting multiple frames of images with different exposure times in the same scene, including at least one short exposure image to capture highlight details and one long exposure image to capture dark details; aligning multiple frames of images to compensate for image displacement caused by vehicle driving and ensure pixel correspondence between frames; using tone mapping algorithm to fuse brightness information of multiple frames of images to generate an HDR image containing highlight details and dark details, and perform real-time brightness and contrast analysis. Specific embodiments are as follows: (1) Camera module selection In order to achieve real-time HDR image acquisition, the stacked CMOS image sensor model "Sony IMX577" is selected as the core component. This sensor is known for its excellent low-light performance and high dynamic range characteristics. It supports multiple exposure functions and can meet the needs of continuous shooting at different exposure times. Specifically, IMX577 can capture short-exposure and long-exposure images at extremely short time intervals (such as 1 / 1000 second and 1 / 30 second). Short-exposure images are used to capture highlight details and avoid overexposure; long-exposure images ensure rich dark details and avoid underexposure.

[0020] (2) Image alignment processing mechanism Since the vehicle will inevitably vibrate or slightly move during driving, this will cause pixel offsets between multiple frames of images taken continuously. To solve this problem, image alignment algorithms based on feature point matching are introduced, such as ORB (Oriented FAST and Rotated BRIEF) or SIFT (Scale-Invariant Feature Transform). These algorithms can automatically identify and match feature points in images with different exposure times, perform precise image alignment by calculating the offset between feature points, and ensure that the pixel positions of each frame image are consistent before fusion. This process is completed by a dedicated hardware accelerator integrated in the ISP to achieve high-speed, low-latency processing.

[0021] (3) HDR image generation and brightness contrast analysis The aligned image sequence is sent to the tone mapping stage, where the "Reinhard global tone mapping algorithm" or other more advanced local tone mapping techniques such as "Ward's Method" are used. These algorithms can effectively fuse the brightness information of images with different exposures to generate HDR images that retain highlight details without losing dark information. During this process, the algorithm automatically analyzes and adjusts the brightness L and contrast C of the image to ensure that the visual effect of the final image is both natural and clear.

[0022] (4) Principle of collaborative working between hardware and software The workflow of the entire system is as follows: The IMX577 sensor continuously captures multiple frames of images according to the preset exposure strategy and transmits the raw data to the ISP. The ISP first performs basic image preprocessing, such as noise removal and preliminary alignment, and then uses the hardware-accelerated image processing unit to perform precise pixel-level alignment and tone mapping. After generating the HDR image, the system further uses the built-in image analysis algorithm to extract the brightness information L and contrast information C, providing basic data for subsequent ambient light intensity calculation, strong light interference level analysis, and polarization angle adjustment.

[0023] The above solution not only significantly improves the imaging quality of the rearview mirror camera under complex lighting conditions, but also provides accurate data support for intelligent adjustment of interior lighting and polarization angle, effectively solving the visual interference problem of traditional electronic rearview mirrors in strong light environments.

[0024] b) Calculate the ambient light intensity E according to the formula E=α*L+β*C, where α and β are preset coefficients, and dynamically adjust the interior lighting brightness according to the ambient light intensity E; Furthermore, the interior lighting brightness is dynamically adjusted according to the ambient light intensity E, including: using the ambient light information after HDR image processing to calculate the overall brightness of the current environment and the distribution of light intensity in each area; comparing the calculated light intensity with the preset comfortable light range to determine whether to increase or decrease the lighting in a specific area of ​​the vehicle; and adjusting the brightness and color temperature of the LED light group in the vehicle according to the comparison result. The specific embodiments are as follows: The ambient light intensity calculation method is based on the proposed formula E=α*L+β*C, where L represents the average brightness of the image, C represents the average contrast of the image, and α and β are pre-set weight coefficients, reflecting the relative importance of brightness and contrast in light intensity calculation. In specific implementation, the image data obtained by HDR image processing technology is first used to calculate the average brightness L of the entire scene and the contrast C through an image analysis algorithm. The latter measures the difference between the brightest and darkest areas in the image. The coefficients α and β are set based on the research results of the human eye's sensitivity to brightness and contrast. Generally, the α value is larger to emphasize the impact of brightness, while β is used for subtle adjustments to cope with high-contrast scenes.

[0025] After obtaining the ambient light intensity E, the system further analyzes the HDR image to identify the light intensity distribution of various areas in the car (such as the driver's seat, passenger area, instrument panel, etc.). This step involves image segmentation technology, which divides the interior of the car into multiple sub-areas and calculates the average brightness of each area separately, thereby obtaining more refined lighting control requirements.

[0026] Next, the system presets the "comfortable lighting range" for interior lighting based on human factors engineering and visual comfort standards. This range is usually set based on different time periods during the day, dusk, and night, as well as different driving environments (such as tunnels, city streets, and highways). For example, higher brightness and cool color temperature may be required during the day to reduce eye fatigue, while low brightness and warm color temperature may be preferred at night to promote relaxation.

[0027] The calculated light intensity is compared with the preset comfortable light range. If the light intensity in a certain area is found to be lower than or higher than the comfortable range, the brightness and color temperature of the LED light group in the car are adjusted to achieve the ideal state. Brightness adjustment depends on the PWM (pulse width modulation) controller of the LED light, which linearly controls the light brightness by changing the pulse width. Color temperature adjustment is achieved by mixing LED light sources with different color temperatures, for example, adjusting the ratio of cold white light (high color temperature) and warm yellow light (low color temperature) to match the external environment and improve visual comfort.

[0028] The key to realizing this system lies in high-precision image processing capabilities, fast-response control systems, and efficient hardware integration. The image processing algorithm must be real-time to ensure that the ambient light changes can be continuously and quickly analyzed while the vehicle is driving. In addition, the design of the control system must take into account stability and accuracy to ensure smooth and flicker-free lighting adjustment while reducing energy consumption. According to the interior layout of different models, the layout and design of the LED light group must also be flexibly adjusted to achieve the best lighting effect.

[0029] c) Analyze the strong light area in the image to determine the strong light interference level D according to the formula D=f(E,T), where T is the preset threshold and f is a function for determining the interference level based on the ambient light intensity and the threshold; Further, the strong light area in the image is analyzed to determine the strong light interference level D, including: Calculation of ambient light intensity E: First, according to the method mentioned in step b), the light intensity E of the current environment is calculated; Determination of threshold T: A light intensity threshold T is preset based on the ambient light intensity under normal lighting conditions and the known strong light interference critical point; Calculation of strong light interference level D: The strong light interference level is determined using the function f (D=max(0, ET)); If the calculated ambient light intensity E is greater than the preset threshold T, D takes the positive value of the difference between E and T, indicating that there is a certain degree of strong light interference; If the ambient light intensity E is not greater than the preset threshold T, D is 0, indicating that the current lighting conditions do not meet the standard for strong light interference; Classification and response level setting: According to the specific value of D, the strong light interference level is divided into several levels, and each level corresponds to a different response strategy; Triggering subsequent processing: After determining the strong light interference level D, the information input is passed to the dynamic adjustment of the polarization angle in step d), and the optimization processing of the brightness L and contrast C in step e); Real-time monitoring and dynamic evaluation: Continuously monitor changes in ambient light intensity E and recalculate D based on the latest E value.

[0030] Specifically, the strong light area in the image is accurately analyzed to determine the strong light interference level D, and then applied to the automatic process of adjusting the rearview mirror field of view. This process not only involves the precise calculation of the ambient light intensity E, but also includes the scientific setting of the threshold T and the dynamic adjustment strategy based on the interference level D, ensuring the efficient operation of the entire system and driving safety under various lighting conditions.

[0031] First, we use the previously mentioned method to obtain image data through HDR image processing technology to calculate the ambient light intensity E. Here, we use the image brightness information L and contrast information C, and use the formula E=α∗L+β∗C to ensure accurate evaluation of light intensity in complex lighting environments. This calculation process is efficiently completed at the hardware level by a high-performance image processing unit (GPU) or a dedicated ISP (image signal processor), ensuring real-time calculation.

[0032] Scientific setting of threshold T. Determining threshold T is a key step. It is based on extensive testing and data analysis, covering various typical lighting conditions, including sunny days, cloudy days, dusk, night, and different types of strong light sources (such as direct sunlight, high beams, etc.). The setting of threshold T needs to comprehensively consider the sensitivity of the human eye to light, driving safety standards, and the processing capabilities of the electronic rearview mirror. Usually, a threshold that can effectively identify strong light interference and avoid oversensitivity is found through statistical analysis of a large amount of actual driving data. Threshold T is not fixed, but can be fine-tuned according to different regions, seasons, and time periods to adapt to a wider range of application scenarios.

[0033] Calculation and classification of strong light interference level D. The strong light interference level D is determined by the function D=max(0,E−T). This simple and effective judgment method can clearly distinguish whether there is strong light interference. When E is greater than T, the positive value of D directly reflects the degree of interference; conversely, D is 0, which means that the current lighting conditions are good and no special treatment is required. Based on the size of D, the strong light interference level can be divided into several levels such as mild, moderate, and severe, and each level corresponds to a different response strategy. For example, mild interference may only require a slight adjustment of the polarization angle, while moderate or severe interference may require stronger polarization adjustment and image processing enhancement.

[0034] After triggering subsequent processing and real-time monitoring and determining the strong light interference level D, the system will automatically trigger corresponding countermeasures, such as dynamic adjustment of polarization angle in step d) and optimization of brightness L and contrast C in step e). These adjustment strategies are designed to minimize the interference of strong light on the driver's vision while maintaining the overall visual quality of the image. Importantly, this series of adjustments is not a one-time thing, but through real-time monitoring of changes in ambient light intensity E and continuous recalculation of D values, ensuring that the system can dynamically respond to changes in lighting conditions and maintain the optimal visual experience.

[0035] d) According to the result of the strong light interference level D, the polarization angle θ of the rearview mirror is dynamically adjusted using the formula θ=g(D), where g is the polarization angle adjustment function; Furthermore, when implementing the solution of dynamically adjusting the rearview mirror polarization angle θ to deal with strong light interference, we deeply explored every link from theoretical design to practical application to ensure that this intelligent adjustment mechanism can work efficiently and accurately, thereby greatly improving the driver's visual experience and driving safety under complex lighting conditions.

[0036] Definition parameters: slope coefficient k and polarization start angle φ First, the slope coefficient k is set according to the sensitivity of the polarization angle to the strong light interference level D. In theory, the larger the k value, the faster the polarization angle changes with the increase of the strong light interference level, and vice versa. The selection of the k value needs to be based on experimental data and simulation analysis to ensure that while reducing the strong light interference, the overall brightness and color saturation of the image are not excessively sacrificed. The selection of the polarization starting angle φ needs to consider the optical design characteristics of the electronic rearview mirror and the average lighting conditions of the normal use environment. It is usually set at an angle that can provide better all-weather visual effects.

[0037] Measuring strong light interference level D The process of measuring the strong light interference level D involves the comprehensive use of multiple sensors and technologies. In addition to directly using light intensity detectors, modern electronic rearview mirror systems also integrate high dynamic range (HDR) cameras to analyze the brightness distribution and contrast changes in the image through image processing algorithms to further accurately evaluate the degree of strong light interference. This requires the system to have an efficient image processing unit (GPU) and algorithm support to achieve fast and accurate strong light interference recognition.

[0038] Calculate the polarization angle θ Based on the measured strong light interference level D, the formula g(D)=θ=D*k+φ is used to dynamically calculate the polarization angle θ. This formula is concise and intuitive. It amplifies the influence of D through the k value, and with the fixed polarization starting angle φ, it ensures the flexibility and pertinence of polarization adjustment. The calculation process is completed in the electronic control unit (ECU), which quickly calculates θ based on the real-time D value and prepares to execute instructions.

[0039] Perform polarization angle adjustment The calculated polarization angle θ command is sent to the polarization controller in the electronic rearview mirror through the vehicle bus system. Modern polarization controllers usually use micro-motors to drive polarizers, which can accurately control the change of polarization angle, respond quickly, and accurately position. This adjustment process must be smooth and jitter-free to avoid causing visual discomfort to the driver. The adjustment of the polarization angle not only reduces the strong light reflected directly, but also optimizes the transmittance of light at a specific angle by adjusting the polarization direction, further improving the clarity and contrast of the rearview mirror image.

[0040] Real-time monitoring and adaptive adjustment The system also needs to have real-time monitoring capabilities, continuously track changes in ambient light intensity, and recalculate θ based on the new D value to achieve dynamic adaptive adjustment of the polarization angle. This requires the system to have strong data processing capabilities and a high level of intelligence to quickly respond to environmental changes and maintain the best visual effects. In addition, to optimize the user experience, the system can also integrate a user feedback mechanism, allowing the driver to adjust the k value or φ value according to personal preferences to achieve personalized settings.

[0041] e) Adjust the image processing parameters to enhance the details of the non-light-intensive areas, using the formula P = h (L, C, θ), where h is the function that adjusts the image processing parameters according to the original brightness, contrast and polarization angle, and P is the adjusted image processing parameter set to optimize the overall visual effect of the image; Furthermore, the overall visual effect of the image is optimized by dynamically adjusting the brightness L and contrast C according to the strong light interference level D, including: determining the adjustment coefficients m and n: determining the values ​​of the coefficients m and n based on experiments, the coefficients m and n respectively control the response amplitudes of the brightness L and contrast C to the strong light interference level D; calculating the adjusted brightness L' and contrast C': according to the function h, using the current strong light interference level D, respectively calculate the adjusted brightness L' and contrast C', the calculation formulas are L'=L*(1+mD) and C'=C*(1+nD), wherein the value of D determines the degree of adjustment, and m and n determine the rate and direction of adjustment; applying adjustment parameters: applying the calculated brightness L' and contrast C' to the original image data; polarization angle integration: integrating the polarization angle θ together with the adjusted brightness L' and contrast C' into the final image processing parameter set P; image rendering and output: using the adjusted parameter set P to render the original image.

[0042] f) Output the adjusted image data to the electronic rearview mirror display screen to achieve a visual field display that is resistant to strong light interference.

[0043] Furthermore, it also includes anti-glare display, including: integrating a light sensor inside the electronic rearview mirror to monitor the light source intensity and position of the rear vehicle in real time, and activating the anti-glare processing unit when the sensor detects that a high-intensity light source directly illuminates or nearly illuminates the rearview mirror; the anti-glare processing unit dynamically adjusts the local brightness distribution of the electronic rearview mirror display screen according to the light source position information, and directly weakens or shields the reflection of the strong light source on the screen by local dimming. The specific embodiments are as follows: On the basis of realizing the field of vision display that resists strong light interference, the anti-glare function is further integrated, which not only improves the visual comfort of the driver, but also ensures driving safety. This enhanced electronic rearview mirror system responds to strong light sources in the rear in real time through sophisticated sensor technology and intelligent image processing algorithms, ensuring a clear, glare-free rear view image under any lighting conditions.

[0044] The light sensor is a high-sensitivity digital light sensor of model "AMS TSL2591", which has a wide dynamic range and high precision, and can accurately detect light intensity from weak starlight to strong sunlight. It communicates with the main control unit of the electronic rearview mirror through the I²C interface, transmits light intensity data in real time, and provides basic information for anti-glare processing.

[0045] The anti-glare processing unit integrates a high-performance microprocessor, such as "NVIDIA Jetson Nano" or "RaspberryPi Compute Module", which has powerful computing capabilities and can quickly process light sensor data and image data, execute complex image processing algorithms, and achieve dynamic local dimming.

[0046] Implementation principles and steps Real-time monitoring and data collection: The light sensor is located at an appropriate position in the electronic rearview mirror to ensure that the light intensity and approximate position of the vehicle coming from behind can be accurately captured. The sensor continuously monitors and transmits the data to the anti-glare processing unit in real time.

[0047] Light source identification and analysis: After receiving the light data, the anti-glare processing unit uses algorithms to identify high-intensity light sources, especially those direct light sources that may cause visual glare. The algorithm determines whether anti-glare processing needs to be activated by analyzing the intensity and position of the light source.

[0048] Image processing and local dimming: Once it is confirmed that there is a strong light source, the image processing module will intervene to process the image data obtained from the camera. Using local dynamic range compression technology, only the area directly illuminated by the strong light source or with obvious influence is dimmed, while maintaining the normal brightness and contrast of other parts of the image, ensuring the overall visual effect is natural and avoiding the entire screen from being completely darkened due to local strong light.

[0049] Intelligent dynamic adjustment: The anti-glare processing unit dynamically adjusts the area and degree of local dimming according to the changes in the position of the light source, ensuring that the anti-glare effect is accurate and effective even when the vehicle moves quickly or the light source angle changes frequently. This process relies on high-precision image analysis and fast-response algorithm optimization.

[0050] Optimize visual comfort: While making local brightness adjustments, the system will also fine-tune the brightness and color balance of the entire screen according to the ambient light intensity and the driver's visual habits to further improve visual comfort. This may include automatically adjusting the screen backlight intensity and applying color management technology to ensure that the image color is not distorted.

[0051] User-adjustable settings: To meet the preferences of different drivers, the system provides a user interface that allows adjustment of parameters such as the sensitivity of the anti-glare function and the degree of local dimming to achieve personalized customization.

[0052] In some other embodiments, the above-mentioned method for adjusting the field of view of a rearview mirror that can resist strong light interference also includes: performing white balance correction before calculating the ambient light intensity E, including: raw data acquisition: obtaining RAW image data of the current scene from the electronic rearview mirror camera, the RAW data contains image information that has not undergone any color processing; color space conversion: converting the RAW image data to a color space that can be white balanced; determining the reference white point: identifying one or more areas that should theoretically be neutral gray or white in the image as reference points; calculating color deviation: comparing the value of the reference white point in the current color space with the ideal white to obtain a color deviation value; applying a white balance correction matrix: calculating a white balance correction matrix based on the color deviation value, the matrix is ​​used to adjust the color component of each pixel in the image to eliminate the color deviation caused by the color temperature of the light source; converting the color space back to RGB: applying the image data adjusted by the white balance correction matrix, and then converting it back to the RGB color space; ambient light intensity calculation: after completing the white balance correction, using the adjusted image data, calculate the ambient light intensity E according to the formula E=α*L+β*C.

[0053] Specifically, the camera is selected to use a high-performance CMOS image sensor model Sony IMX415, which supports RAW format output, has high dynamic range and low-light performance, and is very suitable for image capture under complex lighting conditions.

[0054] The processing unit uses an embedded system such as NVIDIA Xavier NX, equipped with a high-performance GPU and CPU, which provides sufficient computing power to achieve fast image processing and algorithm operations, ensuring the real-time performance of white balance correction and subsequent image processing.

[0055] The RAW image data captured by the Sony IMX415 camera contains the most original light information without any color processing, providing the purest input source for white balance correction.

[0056] The RAW image data is converted into a color space suitable for white balance adjustment, such as AdobeRGB or CIE XYZ space, through an image processing unit. These color spaces are more suitable for accurate adjustment of color balance.

[0057] Using image processing algorithms, neutral gray or white areas are automatically identified in the converted image or manually marked by the user as reference points. The algorithm may use methods based on color histogram analysis or machine learning, such as K-means clustering, to accurately identify neutral areas in the scene.

[0058] Compare the color value of the reference point in the current color space with the ideal white value (such as the D65 light source standard white point in the CIE XYZ space) to calculate the color deviation value. The deviation value reflects the degree of image color deviation and is the basis for the correction matrix calculation.

[0059] Based on the color deviation values, a white balance correction matrix is ​​calculated. This matrix adjusts the gain of the red, green, and blue primary color channels to eliminate the color shift caused by the light source color temperature. The calculation process may involve polynomials or 3x3 color transformation matrices, such as using the gray world assumption or perfect reflection assumption model.

[0060] After applying the white balance correction matrix to adjust the image data, it is converted back to the commonly used sRGB color space, ensuring compatibility with most display devices and natural color rendering.

[0061] After completing the white balance correction, the adjusted image data is used to calculate the ambient light intensity E through the formula E=αL+βC. The brightness L and contrast C data here are more accurate because they have eliminated the influence of color temperature deviation, ensuring the accuracy of subsequent light intensity adjustment.

[0062] In addition, the present invention proposes a rearview mirror field of view adjustment system that can resist strong light interference, such as Figure 2 As shown, it includes: an image data acquisition module, a light intensity calculation module, a strong light interference level calculation module, a rearview mirror adjustment module, an image processing module and an image display module.

[0063] Specifically, the image data acquisition module is used to acquire image data captured by the rearview mirror camera in real time, wherein the image data includes brightness information L and contrast information C; Specifically, the light intensity calculation module is used to calculate the ambient light intensity E, according to the formula E=α*L+β*C, where α and β are preset coefficients, and dynamically adjust the interior lighting brightness according to the ambient light intensity E; Specifically, the strong light interference level calculation module is used to analyze the strong light area in the image to determine the strong light interference level D according to the formula D=f(E, T), where T is a preset threshold, and f is a function for determining the interference level according to the ambient light intensity and the threshold; Specifically, the rearview mirror adjustment module is used to dynamically adjust the polarization angle θ of the rearview mirror according to the result of the strong light interference level D, using the formula θ=g(D), where g is the polarization angle adjustment function; Specifically, the image processing module is used to adjust the image processing parameters to enhance the details of the non-light-intensive areas, using the formula P=h(L, C, θ), where h is a function for adjusting the image processing parameters according to the original brightness, contrast, and polarization angle, and P is the adjusted image processing parameter set to optimize the overall visual effect of the image; Specifically, the image display module is used to output the adjusted image data to the electronic rearview mirror display screen to achieve a visual field display that is resistant to strong light interference.

[0064] In addition, the above-mentioned image data acquisition module, light intensity calculation module, strong light interference level calculation module, rearview mirror adjustment module, image processing module and image display module are also used to execute other functions of the above-mentioned rearview mirror field of view adjustment method that can resist strong light interference, which will not be described one by one here.

[0065] In summary, by collecting image data in real time and calculating the ambient light intensity E based on the brightness information L and contrast information C, the intelligent adjustment of the interior lighting is realized, avoiding the visual discomfort caused by the incoordination of the lighting inside and outside the car. Then, the unique method of judging the strong light interference level D is used to accurately identify the strong light area in the image, and then dynamically adjust the polarization angle θ of the rearview mirror to effectively filter out the strong light and reduce the direct visual impact on the driver. At the same time, through the fine adjustment of the image processing parameters of the non-strong light area, the overall visual effect of the image is ensured, and the details of other areas will not be sacrificed due to strong light suppression, while maintaining the naturalness and color balance of the image. It not only significantly improves the use effect of the electronic rearview mirror in a strong light environment and reduces the risk of traffic accidents caused by strong light, but also optimizes the visual environment in the cab and improves driving comfort through intelligent interior lighting adjustment.

[0066] Finally, it should be noted that the above is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for adjusting the field of view of a rearview mirror capable of resisting strong light interference, the method being applied to an in-vehicle electronic rearview mirror, characterized in that: include: a) collecting image data captured by a rearview mirror camera in real time, wherein the image data includes brightness information L and contrast information C; b) Calculate the ambient light intensity E according to the formula E=α*L+β*C, where α and β are preset coefficients, and dynamically adjust the interior lighting brightness according to the ambient light intensity E; c) Analyze the strong light area in the image to determine the strong light interference level D according to the formula D=f(E,T), where T is the preset threshold and f is a function for determining the interference level based on the ambient light intensity and the threshold; d) According to the result of the strong light interference level D, the polarization angle θ of the rearview mirror is dynamically adjusted using the formula θ=g(D), where g is the polarization angle adjustment function; e) Adjust the image processing parameters to enhance the details of the non-light-intensive areas, using the formula P = h (L, C, θ), where h is the function that adjusts the image processing parameters according to the original brightness, contrast and polarization angle, and P is the adjusted image processing parameter set to optimize the overall visual effect of the image; f) Output the adjusted image data to the electronic rearview mirror display screen to achieve a visual field display that is resistant to strong light interference.

2. A rearview mirror field of view adjustment method capable of resisting strong light interference according to claim 1, characterized in that: In step a), the camera uses high dynamic range technology to collect image data captured by the rearview mirror camera in real time, including: Continuously capture multiple frames of images with different exposure times in the same scene, including at least one frame of short-exposure image to capture highlight details and one frame of long-exposure image to capture dark details; Align multiple frames of images to compensate for image displacement caused by vehicle movement and ensure pixel correspondence between each frame of images; The tone mapping algorithm is used to fuse the brightness information of multiple frames of images to generate an HDR image containing highlight details and dark details, and perform real-time brightness and contrast analysis.

3. A rearview mirror field of view adjustment method capable of resisting strong light interference according to claim 2, characterized in that: In step b), the interior lighting brightness is dynamically adjusted according to the ambient light intensity E, including: Using the ambient light information after HDR image processing, calculate the overall brightness of the current environment and the light intensity distribution of each area; Compare the calculated light intensity with the preset comfortable light range to determine whether the lighting in specific areas of the vehicle needs to be increased or decreased; According to the comparison results, the brightness and color temperature of the LED light group in the car are adjusted.

4. The method for adjusting the field of view of a rearview mirror capable of resisting strong light interference according to claim 1, characterized in that: In step c), analyzing the strong light area in the image to determine the strong light interference level D includes: Calculation of ambient light intensity E: First, calculate the light intensity E of the current environment according to the method mentioned in step b); Determine the threshold value T: preset a light intensity threshold value T based on the ambient light intensity under normal lighting conditions and the known critical point of strong light interference; Calculate the strong light interference level D: Use the function f(D=max(0,ET)) to determine the strong light interference level; if the calculated ambient light intensity E is greater than the preset threshold T, then D takes the positive value of the difference between E and T, indicating that there is a certain degree of strong light interference; if the ambient light intensity E is not greater than the preset threshold T, then D is 0, indicating that the current lighting conditions do not meet the standard of strong light interference; Classification and response level setting: According to the specific value of D, the strong light interference level is divided into several levels, and each level corresponds to a different response strategy; Triggering subsequent processing: After determining the strong light interference level D, this information input is passed to the dynamic adjustment of the polarization angle in step d) and the optimization processing of the brightness L and contrast C in step e); Real-time monitoring and dynamic evaluation: Continuously monitor changes in ambient light intensity E and recalculate D based on the latest E value.

5. The method for adjusting the field of view of a rearview mirror capable of resisting strong light interference according to claim 1, characterized in that: In step d), dynamically adjusting the polarization angle θ of the rearview mirror according to the result of the strong light interference level D includes: Define parameters: determine the slope coefficient k based on the sensitivity of the polarization angle to the strong light interference level D and select the polarization starting angle φ based on the optical characteristics of the electronic rearview mirror; Measuring the strong light interference level D: Real-time monitoring of the strong light interference level in the ambient light through the light intensity detector; Calculate the polarization angle θ: Use the function g(D)=θ=D*k+φ and calculate the polarization angle θ based on the currently measured strong light interference level D; Perform polarization angle adjustment: send the calculated polarization angle θ command to the polarization controller in the electronic rearview mirror, and dynamically adjust the angle of the polarizer according to the received command.

6. The method for adjusting the field of view of a rearview mirror capable of resisting strong light interference according to claim 1, characterized in that: In step e), optimizing the overall visual effect of the image is performed by dynamically adjusting the brightness L and contrast C according to the strong light interference level D, including: Determine adjustment coefficients m and n: Determine the values ​​of coefficients m and n based on experiments. Coefficients m and n respectively control the response amplitude of brightness L and contrast C to strong light interference level D; Calculate the adjusted brightness L' and contrast C': According to the function h, use the current strong light interference level D to calculate the adjusted brightness L' and contrast C' respectively. The calculation formulas are L'=L*(1+mD) and C'=C*(1+nD), where the value of D determines the degree of adjustment, and m and n determine the rate and direction of adjustment; Apply adjustment parameters: apply the calculated brightness L' and contrast C' to the original image data; Polarization angle integration: Integrate the polarization angle θ together with the adjusted brightness L' and contrast C' into the final image processing parameter set P; Image rendering and output: Use the adjusted parameter set P to render the original image.

7. The method for adjusting the field of view of a rearview mirror capable of resisting strong light interference according to claim 1, characterized in that: In f), anti-glare displays are also included.

8. The method for adjusting the field of view of a rearview mirror capable of resisting strong light interference according to claim 7, characterized in that: The anti-glare display comprises: A light sensor is integrated inside the electronic rearview mirror to monitor the light intensity and position of the vehicle coming from behind in real time. When the sensor detects that a high-intensity light source is directly irradiating or nearly irradiating the rearview mirror, the anti-glare processing unit is activated. The anti-glare processing unit dynamically adjusts the local brightness distribution of the electronic rearview mirror display screen according to the light source position information, and directly weakens or blocks the reflection of strong light sources on the screen through local dimming.

9. The method for adjusting the field of view of a rearview mirror capable of resisting strong light interference according to claim 1, characterized in that: In step b), it also includes: performing white balance correction before calculating the ambient light intensity E, including: Raw data acquisition: Get the RAW image data of the current scene from the electronic rearview mirror camera. The RAW data contains image information without any color processing. Color space conversion: convert RAW image data to a color space that can be white balanced; Determine the reference white point: Identify one or more areas in the image that should theoretically be neutral gray or white as reference points; Calculate color deviation: compare the value of the reference white point in the current color space with the ideal white to obtain the color deviation value; Applying a white balance correction matrix: According to the color deviation value, a white balance correction matrix is ​​calculated, and the matrix is ​​used to adjust the color component of each pixel in the image to eliminate the color deviation caused by the color temperature of the light source; Color space conversion back to RGB: Apply the white balance correction matrix to the adjusted image data and then convert it back to RGB color space; Ambient light intensity calculation: After completing white balance correction, use the adjusted image data to calculate the ambient light intensity E according to the formula E=α*L+β*C.

10. A rearview mirror field of view adjustment system capable of resisting strong light interference, characterized in that: include: An image data acquisition module, used for acquiring image data captured by a rearview mirror camera in real time, wherein the image data includes brightness information L and contrast information C; The light intensity calculation module is used to calculate the ambient light intensity E according to the formula E=α*L+β*C, where α and β are preset coefficients, and dynamically adjust the interior lighting brightness according to the ambient light intensity E; A strong light interference level calculation module is used to analyze the strong light area in the image to determine the strong light interference level D according to the formula D=f(E, T), where T is a preset threshold and f is a function for determining the interference level according to the ambient light intensity and the threshold; The rearview mirror adjustment module is used to dynamically adjust the polarization angle θ of the rearview mirror according to the result of the strong light interference level D, using the formula θ=g(D), where g is the polarization angle adjustment function; The image processing module is used to adjust the image processing parameters to enhance the details of the non-light-intensive areas, using the formula P=h(L, C, θ), where h is a function that adjusts the image processing parameters according to the original brightness, contrast, and polarization angle, and P is the adjusted image processing parameter set to optimize the overall visual effect of the image; The image display module is used to output the adjusted image data to the electronic rearview mirror display screen to achieve a field of view display that is resistant to strong light interference.

Citation Information

Cited By

  • Self-adaptive broadband spectrum underwater light source system

    CN119255427A

  • An adaptive wide-spectrum underwater light source system

    CN119255427B

  • Electronic rearview mirror parameter intelligent management method for reducing blind areas

    CN119893285A

  • Electronic control color-changing film light intensity adjusting system on surface of self-closed-loop car lamp and control method

    CN120521173A

  • Self-closing ring car lamp surface electro-controlled color-changing film light intensity adjusting system and control method

    CN120521173B