An auxiliary image analysis system and method for vehicle safety

Abstract

The present invention discloses an auxiliary image analysis system and method for vehicle safety, which can be adapted to a coupled variable-position intelligent rearview mirror structure, and relates to the technical field of image data processing. The auxiliary image analysis system for vehicle safety includes: an auxiliary image automatic start verification module, an automatic start verification data analysis module, a real-time auxiliary image acquisition module, an imaging quality data analysis module, and an applicable auxiliary image acquisition system adjustment module. In the analysis and processing of vehicle auxiliary images, the present invention can perform more accurate analysis and processing on the image data during vehicle driving, improving the safety of vehicle driving and the accuracy of image analysis. Through adaptive adjustment control, it avoids the cumbersome and uncertain manual intervention, improves the automation degree and operation efficiency of the system, and can dynamically adjust the applicable auxiliary image acquisition system in real time according to the driving changes to ensure high-quality auxiliary images can be obtained under various complex conditions.

Description

Technical Field

[0001] The present invention relates to the technical field of image data processing, and specifically to an auxiliary image analysis system and method for vehicle safety. Background Art

[0002] In the modern traffic environment, with the continuous increase in the number of vehicles, vehicle safety has become a crucial issue. To improve driving safety, various auxiliary image systems have emerged. These systems use technologies such as cameras, radars, and laser scanners to capture images around the vehicle in real time, and through image processing and analysis technologies, provide a more comprehensive view to the driver, thereby reducing blind spots and misjudgments.

[0003] The prior art, such as the invention patent with the publication number CN104424645B, is an image recognition device and method for a vehicle, including steps of shooting at least one image; calculating the brightness change amount of a region of interest extracted from the image; detecting a foreign object region in the region of interest; and distinguishing whether it is a foreign object image or a general image based on the brightness change amount of the region of interest relative to the number of the foreign object regions.

[0004] The prior art, such as the invention patent with the publication number CN110400255B, is a method, system, and vehicle for generating a panoramic image of a vehicle. Among them, the method for generating a panoramic image of a vehicle includes: collecting original images around the vehicle through multiple cameras; determining multiple calibration regions based on the overlapping regions in the original images around the vehicle; obtaining the mathematical model of image pixel point transformation of multiple calibration points in the calibration regions; transforming the original images around the vehicle collected by multiple cameras into target images respectively according to the mathematical model of image pixel point transformation of multiple calibration points; and stitching the target images into a panoramic image.

[0005] In view of the above solutions, in the current image processing for vehicle safety, it usually only focuses on image acquisition and basic quality assessment, or performs relatively simple stitching and foreign object detection processing on images, thereby achieving a certain degree of vehicle safety assistance. However, for the auxiliary image processing of vehicle safety, due to the diverse and complexly correlated image parameters involved, and the fact that there will be a certain loss of auxiliary image imaging interference values during the use of the vehicle auxiliary influence system, simple processing cannot fully guarantee the comprehensiveness and accuracy of the analysis of multiple image processing links, and data processing may have limitations, thus affecting the accuracy of the judgment of the vehicle safety condition. Summary of the Invention

[0006] Aiming at the deficiencies of the prior art, the present invention provides an auxiliary image analysis system and method for vehicle safety, which can be adapted to a coupled variable-position intelligent rearview mirror structure and can effectively solve the problems involved in the above background art.

[0007] To achieve the above object, the present invention is realized through the following technical solutions: In the first aspect of the present invention, an auxiliary image analysis system for vehicle safety is provided, including: An auxiliary image automatic startup verification module, configured to receive a vehicle startup signal through an in-vehicle electronic control unit, and synchronously start an auxiliary image acquisition system to perform automatic startup verification of the auxiliary image, and obtain automatic startup verification data of the auxiliary image acquisition system.

[0008] An automatic startup verification data analysis module, configured to analyze and process the automatic startup verification data of the auxiliary image acquisition system to obtain an automatic startup verification determination result of the auxiliary image acquisition system, perform adaptive adjustment control on the auxiliary image acquisition system based on the startup verification determination result, and mark the auxiliary image acquisition system after adaptive adjustment control as an applicable auxiliary image acquisition system.

[0009] A real-time auxiliary image acquisition module, configured to acquire real-time auxiliary images during vehicle driving through the applicable auxiliary image acquisition system, where the real-time auxiliary images include images of the outer rearview mirrors on both sides of the vehicle, forward field-of-view images on both sides of the vehicle, an image directly in front of the vehicle, and an image directly behind the vehicle, and extract real-time auxiliary image presentation quality data of vehicle driving therefrom.

[0010] A presentation quality data analysis module, configured to analyze and process based on the real-time auxiliary image presentation quality data of vehicle driving to obtain an auxiliary image presentation quality evaluation value of vehicle driving.

[0011] An applicable auxiliary image acquisition system adjustment module, configured to perform real-time adjustment of the applicable auxiliary image acquisition system for the vehicle according to the auxiliary image presentation quality evaluation value of vehicle driving.

[0012] As a preferred technical solution, the automatic startup verification data of the auxiliary image acquisition system, where the automatic startup verification data includes performance parameters of the auxiliary image acquisition system and auxiliary image presentation data.

[0013] The performance parameters of the auxiliary image acquisition system include the startup response time and the image acquisition frame rate of the auxiliary image acquisition system.

[0014] The auxiliary image presentation data includes the resolution of the auxiliary image presentation and the contrast of the auxiliary image presentation.

[0015] As a preferred technical solution, the analysis and processing to obtain the automatic startup verification determination result of the auxiliary image acquisition system, the specific analysis process is as follows:

[0016] Extract the reference automatic startup verification data of the auxiliary image acquisition system stored in the database. The reference automatic startup verification data includes the defined startup response time of the auxiliary image acquisition system, the reference image acquisition frame rate, the defined resolution of the auxiliary image rendering, and the defined contrast of the auxiliary image rendering.

[0017] Based on the automatic startup verification data and the reference automatic startup verification data of the auxiliary image acquisition system, comprehensively analyze and process to obtain the first automatic startup verification index of the auxiliary image acquisition system.

[0018] The first automatic startup verification index of the auxiliary image acquisition system is the numerical result of quantifying the automatic startup verification data and the reference automatic startup verification data of the auxiliary image acquisition system, and is used as the determination basis for the automatic startup verification performance of the auxiliary image acquisition system.

[0019] As a preferred technical solution, the process of obtaining the automatic startup verification determination result of the auxiliary image acquisition system through analysis and processing is as follows:

[0020] Extract the automatic startup verification threshold of the auxiliary image acquisition system preset in the database.

[0021] If the first automatic startup verification index of the auxiliary image acquisition system is greater than or equal to the automatic startup verification threshold of the auxiliary image acquisition system, define the automatic startup verification determination result of the auxiliary image acquisition system as normal automatic startup.

[0022] If the first automatic startup verification index of the auxiliary image acquisition system is less than the automatic startup verification threshold of the auxiliary image acquisition system, define the automatic startup verification determination result of the auxiliary image acquisition system as abnormal automatic startup.

[0023] As a preferred technical solution, the process of performing adaptive adjustment control on the auxiliary image acquisition system based on the startup verification determination result is as follows:

[0024] Based on the startup verification determination result, if the automatic startup verification determination result of the auxiliary image acquisition system is normal automatic startup, no adaptive adjustment control is performed.

[0025] If the automatic startup verification determination result of the auxiliary image acquisition system is determined to be abnormal automatic startup, extract the adaptive parameters of the auxiliary image acquisition system preset in the database, perform the first adaptive adjustment on the auxiliary image acquisition system, and re-analyze and process to obtain the first automatic startup verification index of the auxiliary image acquisition system after the first adaptive adjustment. Thus, mark the first automatic startup verification index of the auxiliary image acquisition system obtained by re-analysis and processing as the second automatic startup verification index of the auxiliary image acquisition system.

[0026] If the second automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system, no adaptive adjustment control is performed, and the auxiliary image acquisition system is marked as an applicable auxiliary image acquisition system.

[0027] If the second automatic start verification index of the auxiliary image acquisition system is less than the automatic start verification threshold of the auxiliary image acquisition system, the difference between the second automatic start verification index of the auxiliary image acquisition system and the first automatic start verification index of the auxiliary image acquisition system is processed to obtain the automatic start verification difference of the auxiliary image acquisition system.

[0028] If the automatic start verification difference of the auxiliary image acquisition system is less than zero, a warning message is generated and uploaded to the vehicle electronic control unit. If the automatic start verification difference of the auxiliary image acquisition system is greater than or equal to zero, the adjustment control is performed again with the preset adaptive parameters of the auxiliary image acquisition system until the second automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system. At this time, the adaptive adjustment control of the auxiliary image acquisition system is stopped synchronously, and the current auxiliary image acquisition system is marked as an applicable auxiliary image acquisition system.

[0029] As a preferred technical solution, the real-time auxiliary image imaging quality data of the vehicle driving includes the sharpness, brightness, image pixels, and signal-to-noise ratio of the auxiliary image imaging during vehicle driving.

[0030] As a preferred technical solution, the analysis and processing to obtain the auxiliary image imaging quality evaluation value of the vehicle driving is as follows:

[0031] Extract the reference imaging quality data stored in the database. The reference imaging quality data includes reference sharpness, reference brightness, critical image pixels, and reference signal-to-noise ratio.

[0032] Based on the real-time auxiliary image imaging quality data and the reference imaging quality data of the vehicle driving, the auxiliary image imaging quality evaluation value of the vehicle driving is obtained through comprehensive analysis and processing.

[0033] The auxiliary image imaging quality evaluation value of the vehicle driving is a numerical result of quantifying the real-time auxiliary image imaging quality data and the reference imaging quality data of the vehicle driving, and is used to characterize the imaging quality of the applicable auxiliary image acquisition system during vehicle driving.

[0034] As a preferred technical solution, the real-time adjustment of the applicable auxiliary image acquisition system for the vehicle is as follows:

[0035] Obtain the real-time influence parameters of the auxiliary image imaging through the applicable auxiliary image acquisition system, and analyze and process to obtain the auxiliary image imaging interference value of the vehicle driving.

[0036] The auxiliary image imaging real-time influence parameters include the vehicle vibration amplitude, vehicle speed, external environmental light intensity, and external environmental humidity.

[0037] The auxiliary image imaging interference value during vehicle driving is the numerical result of quantifying the auxiliary image imaging real-time influence parameters, and is used as the basis for determining the degree of interference suffered by the auxiliary image imaging.

[0038] Based on the auxiliary image imaging quality evaluation value during vehicle driving and the auxiliary image imaging interference value during vehicle driving, the auxiliary image comprehensive evaluation index during vehicle driving is obtained through analysis and processing.

[0039] The auxiliary image comprehensive evaluation index during vehicle driving is the numerical result of quantifying the auxiliary image imaging quality evaluation value during vehicle driving and the auxiliary image imaging interference value during vehicle driving, and is used as the basis for adjusting the applicable auxiliary image acquisition system in real time.

[0040] Extract the auxiliary image comprehensive evaluation threshold stored in the database during vehicle driving.

[0041] If the auxiliary image comprehensive evaluation index during vehicle driving is greater than or equal to the auxiliary image comprehensive evaluation threshold during vehicle driving, the applicable auxiliary image acquisition system is not adjusted. If the auxiliary image comprehensive evaluation index during vehicle driving is less than the auxiliary image comprehensive evaluation threshold during vehicle driving, the applicable auxiliary image acquisition system is adjusted in real time with the preset auxiliary image acquisition system process adjustment parameters.

[0042] As a preferred technical solution, the specific acquisition process of the auxiliary image comprehensive evaluation index during vehicle driving is as follows:

[0043] ,

[0044] Among them, is the auxiliary image comprehensive evaluation index during vehicle driving, is the auxiliary image imaging quality evaluation value during vehicle driving, is the auxiliary image imaging interference value during vehicle driving, is the weight value of the auxiliary image imaging quality evaluation value, is the weight value of the auxiliary image imaging interference value, is the natural constant.

[0045] The second aspect of the present invention provides an auxiliary image analysis method for vehicle safety, including the following steps: S1, receiving a vehicle start signal through an in-vehicle electronic control unit, and synchronously starting the auxiliary image acquisition system for automatic start verification of the auxiliary image, and obtaining the automatic start verification data of the auxiliary image acquisition system.

[0046] S2. Analyze and process the automatic start-up verification data of the auxiliary image acquisition system to obtain the automatic start-up verification determination result of the auxiliary image acquisition system. Based on the start-up verification determination result, perform adaptive adjustment control on the auxiliary image acquisition system, and mark the auxiliary image acquisition system after adaptive adjustment control as the applicable auxiliary image acquisition system.

[0047] S3. Use the applicable auxiliary image acquisition system to collect real-time auxiliary images during vehicle driving. The real-time auxiliary images include the vision images of the outer rearview mirrors on both sides of the vehicle, the forward vision images on both sides of the vehicle, the image directly in front of the vehicle, and the image directly behind the vehicle, and extract the imaging quality data of the real-time auxiliary images during vehicle driving.

[0048] S4. Analyze and process the imaging quality data of the real-time auxiliary images during vehicle driving to obtain the imaging quality evaluation value of the auxiliary images during vehicle driving.

[0049] S5. Based on the imaging quality evaluation value of the auxiliary images during vehicle driving, perform real-time adjustment of the applicable auxiliary image acquisition system for the vehicle.

[0050] Compared with the prior art, the embodiments of the present invention have at least the following beneficial effects:

[0051] (1) By providing an auxiliary image analysis system and method for vehicle safety, the present invention can concentrate resources to deeply analyze and process the image data during vehicle driving in the analysis and processing of vehicle auxiliary images, which is more accurate, improves the safety of vehicle driving and the accuracy of image analysis.

[0052] (2) By performing adaptive adjustment control on the auxiliary image acquisition system based on the start-up verification determination result, the present invention takes into account the negative impact brought by the possible loss of the auxiliary image acquisition system. Through preliminary adjustment, it can effectively avoid the unstable situation of auxiliary image acquisition caused by abnormal initial start-up, provide a reliable basis for subsequent vehicle safety auxiliary image analysis. The applicable auxiliary image acquisition system after adaptive adjustment control can provide more accurate and real-time auxiliary images for the vehicle, helping the driver better understand the situation around the vehicle. At the same time, the adaptive adjustment control process avoids the cumbersome and uncertainty of manual intervention, improving the automation degree and operation efficiency of the system.

[0053] (3) By performing real-time adjustment of the applicable auxiliary image acquisition system for the vehicle, through real-time adjustment of the applicable auxiliary image acquisition system, it can dynamically optimize the image acquisition parameters according to the changes during driving, ensuring high-quality auxiliary images can be obtained under various complex conditions.

[0054] Of course, it is not necessary for any product implementing the present invention to achieve all the above advantages simultaneously. Brief Description of the Drawings

[0055] Figure 1 It is a schematic diagram of the connection of the system modules of the present invention.

[0056] Figure 2 It is a schematic diagram of the method flow of the present invention. Detailed Embodiments

[0057] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0058] Please refer to Figure 1 As shown, an auxiliary image analysis system for vehicle safety provided by an embodiment of the present invention includes: an auxiliary image automatic startup verification module, configured to receive a vehicle startup signal through a vehicle-mounted electronic control unit and synchronously start an auxiliary image acquisition system for auxiliary image automatic startup verification to obtain automatic startup verification data of the auxiliary image acquisition system.

[0059] It should be noted that the vehicle-mounted electronic control unit is the core control module of the vehicle, which can be responsible for receiving the signals of the vehicle startup sensor and the warning information of the auxiliary image acquisition system, and at the same time controlling the automatic activation and verification analysis of the auxiliary image system.

[0060] The automatic startup verification data includes the performance parameters of the auxiliary image acquisition system and the auxiliary image rendering data.

[0061] The performance parameters of the auxiliary image acquisition system include the startup response time and the image acquisition frame rate of the auxiliary image acquisition system.

[0062] It should be understood that the startup response time of the auxiliary image acquisition system refers to the time interval from when the system receives the startup signal to when it starts to acquire images, and the image acquisition frame rate refers to the number of images acquired per unit time. A higher image acquisition frame rate can provide more detailed images.

[0063] The auxiliary image rendering data includes the resolution and the contrast of the auxiliary image rendering.

[0064] It should also be understood that the resolution of the auxiliary image rendering refers to the number of pixels displayed in the image, usually expressed by multiplying the number of horizontal pixels by the number of vertical pixels. A higher resolution means a clearer image and can display more details.

[0065] The contrast of the auxiliary image imaging refers to the degree of difference between the brightest part and the darkest part in the image. An image with high contrast can make the outline of the object clearer and the color more vivid, which helps to better identify the objects and features in the image.

[0066] Automatically start the verification data analysis module, which is used to analyze and process the automatic start verification data of the auxiliary image acquisition system to obtain the automatic start verification determination result of the auxiliary image acquisition system, perform adaptive adjustment control on the auxiliary image acquisition system based on the start verification determination result, and mark the auxiliary image acquisition system after adaptive adjustment control as the applicable auxiliary image acquisition system.

[0067] Analyze and process to obtain the automatic start verification determination result of the auxiliary image acquisition system. The specific analysis process is as follows: Extract the reference automatic start verification data of the auxiliary image acquisition system stored in the database. The reference automatic start verification data includes the defined start response time of the auxiliary image acquisition system, the reference image acquisition frame rate, the defined resolution of the auxiliary image imaging, and the defined contrast of the auxiliary image imaging.

[0068] It should be noted that the reference automatic start verification data stored in the database is obtained by performing mean processing on the historical data of the start response time and image acquisition frame rate of the auxiliary image acquisition system, as well as the resolution and contrast of the auxiliary image imaging before the establishment of the database.

[0069] It should be noted that the database is used to store reference index data, and the reference index data includes first reference index data, second reference index data, and third reference index data.

[0070] The first reference index data includes reference automatic start verification data, reference imaging quality data, and reference real-time influence parameters of the auxiliary image imaging, and also includes the adaptive parameters of the auxiliary image acquisition system and the process adjustment parameters of the auxiliary image acquisition system.

[0071] The second reference index data includes the automatic start verification threshold of the auxiliary image acquisition system and the comprehensive evaluation threshold of the auxiliary image for vehicle driving.

[0072] The third reference index data includes the weight value of the start response time, the weight value of the image acquisition frame rate, the weight value of the resolution, and the weight value of the contrast, and also includes the weight value of the sharpness, the weight value of the brightness, the weight value of the image pixels, and the weight value of the signal-to-noise ratio. It also includes the weight value of the vehicle vibration amplitude, the weight value of the vehicle speed, the weight value of the external environmental light intensity, the weight value of the external environmental humidity, the weight value of the auxiliary image imaging quality evaluation value, and the weight value of the auxiliary image imaging interference value.

[0073] Based on the automatic start verification data of the auxiliary image acquisition system and the reference automatic start verification data, comprehensively analyze and process to obtain the first automatic start verification index of the auxiliary image acquisition system.

[0074] The first automatic startup verification index of the auxiliary image acquisition system is a numerical result obtained by quantifying the automatic startup verification data of the auxiliary image acquisition system and the reference automatic startup verification data, and is used as the basis for determining the automatic startup verification performance of the auxiliary image acquisition system.

[0075] The specific acquisition process of the first automatic startup verification index of the auxiliary image acquisition system is as follows:

[0076] ,

[0077] where is the first automatic startup verification index of the auxiliary image acquisition system, is the startup response time of the auxiliary image acquisition system, is the defined startup response time, is the image acquisition frame rate of the auxiliary image acquisition system, is the reference image acquisition frame rate, is the resolution of the auxiliary image presentation, is the defined resolution of the auxiliary image presentation, is the contrast of the auxiliary image presentation, is the defined contrast of the auxiliary image presentation, is the weight of the startup response time, is the weight of the image acquisition frame rate, is the weight of the resolution, is the weight of the contrast, is the natural constant.

[0078] It should be noted that the value ranges of the startup response time weight, the image acquisition frame rate weight, the resolution weight, and the contrast weight are all between 0 and 1. In this embodiment, the startup response time weight is the preset startup response time weight in the database, which represents the value of the influence degree of the startup response time on the first automatic startup verification index of the auxiliary image acquisition system. The image acquisition frame rate weight is the preset image acquisition frame rate weight in the database, which represents the value of the influence degree of the image acquisition frame rate on the first automatic startup verification index of the auxiliary image acquisition system. The resolution weight is the preset resolution weight in the database, which represents the value of the influence degree of the resolution on the first automatic startup verification index of the auxiliary image acquisition system. The contrast weight is the preset contrast weight in the database, which represents the value of the influence degree of the contrast on the first automatic startup verification index of the auxiliary image acquisition system. When in use, the preset startup response time weight, image acquisition frame rate weight, resolution weight, and contrast weight can be directly obtained from the database, and their corresponding relationship can be a preset mapping relationship. For example, the startup response time, image acquisition frame rate, resolution, and contrast respectively form a mapping set with the preset startup response time weight, image acquisition frame rate weight, resolution weight, and contrast weight in the database. The real-time startup response time, image acquisition frame rate, resolution, and contrast are respectively input into the mapping set to obtain the startup response time weight, image acquisition frame rate weight, resolution weight, and contrast weight, and the mapping relationship therein is one-to-one correspondence.

[0079] It should also be noted that in this embodiment, the first automatic startup verification index of the auxiliary image acquisition system is obtained by processing the startup response time of the auxiliary image acquisition system, the image acquisition frame rate of the auxiliary image acquisition system, the resolution of the auxiliary image presentation, and the contrast of the auxiliary image presentation, taking into account the mutual influence between these parameters. For example, a shorter startup response time can ensure that the system quickly enters the working state, timely capture high-resolution image details, and enable the system to quickly respond to changes in light, improving the contrast. At the same time, the system can more timely detect changes in light, thereby quickly adjusting the contrast. When processing the first automatic startup verification index of the auxiliary image acquisition system, it is necessary to fully consider the interaction between these parameters to more accurately evaluate the first automatic startup verification index of the auxiliary image acquisition system.

[0080] The automatic startup verification determination result of the auxiliary image acquisition system is obtained through analysis and processing. The specific process is as follows: Extract the preset automatic startup verification threshold of the auxiliary image acquisition system in the database.

[0081] If the first automatic startup verification index of the auxiliary image acquisition system is greater than or equal to the automatic startup verification threshold of the auxiliary image acquisition system, the automatic startup verification determination result of the auxiliary image acquisition system is defined as normal automatic startup.

[0082] If the first automatic start-up verification index of the auxiliary image acquisition system is less than the automatic start-up verification threshold of the auxiliary image acquisition system, the automatic start-up verification determination result of the auxiliary image acquisition system is defined as abnormal automatic start-up.

[0083] It should be understood that when the first automatic start-up verification index of the auxiliary image acquisition system is greater than or equal to the automatic start-up verification threshold of the auxiliary image acquisition system, it indicates that the automatic start-up performance of the auxiliary image acquisition system is good, which can meet the image acquisition requirements during vehicle driving and can be started normally. When the first automatic start-up verification index of the auxiliary image acquisition system is less than the automatic start-up verification threshold of the auxiliary image acquisition system, it indicates that the automatic start-up performance of the auxiliary image acquisition system is relatively poor and it cannot be started automatically normally, and further adjustment is required.

[0084] Based on the start-up verification determination result, adaptive adjustment control is performed on the auxiliary image acquisition system. The specific process is as follows: Based on the start-up verification determination result, if the automatic start-up verification determination result of the auxiliary image acquisition system is normal automatic start-up, no adaptive adjustment control is performed.

[0085] If the automatic start-up verification determination result of the auxiliary image acquisition system is determined to be abnormal automatic start-up, the preset adaptive parameters of the auxiliary image acquisition system in the database are extracted, and the first adaptive adjustment is performed on the auxiliary image acquisition system. After the first adaptive adjustment, re-analysis and processing are performed to obtain the first automatic start-up verification index of the auxiliary image acquisition system. Thus, the first automatic start-up verification index of the auxiliary image acquisition system obtained by re-analysis and processing is marked as the second automatic start-up verification index of the auxiliary image acquisition system.

[0086] It should be noted that the adaptive parameters of the auxiliary image acquisition system refer to a series of parameter settings used to automatically adjust the auxiliary image acquisition system to make it reach the normal working state, and are obtained by analyzing and optimizing a large amount of auxiliary image data in different driving environments. Specifically, under various lighting conditions, weather conditions, road scenes, etc., a large number of auxiliary image samples are collected, and then data analysis algorithms and models are used to extract and analyze the image features of these samples to determine the parameter combination that can make the auxiliary image acquisition system work well in different situations.

[0087] If the second automatic start-up verification index of the auxiliary image acquisition system is greater than or equal to the automatic start-up verification threshold of the auxiliary image acquisition system, no adaptive adjustment control is performed, and the auxiliary image acquisition system is marked as a suitable auxiliary image acquisition system.

[0088] If the second automatic start-up verification index of the auxiliary image acquisition system is less than the automatic start-up verification threshold of the auxiliary image acquisition system, the difference between the second automatic start-up verification index and the first automatic start-up verification index of the auxiliary image acquisition system is processed to obtain the automatic start-up verification difference of the auxiliary image acquisition system.

[0089] It should be noted that the automatic start-up verification difference of the auxiliary image acquisition system is the result of subtracting the first automatic start-up verification index of the auxiliary image acquisition system from the second automatic start-up verification index of the auxiliary image acquisition system, and this result can have three states: greater than zero, equal to zero, and less than zero.

[0090] If the automatic start-up verification difference of the auxiliary image acquisition system is less than or equal to zero, a warning message is generated and uploaded to the vehicle electronic control unit. If the automatic start-up verification difference of the auxiliary image acquisition system is greater than zero, the adaptive adjustment control is performed again with the preset adaptive parameters of the auxiliary image acquisition system until the second automatic start-up verification index of the auxiliary image acquisition system is greater than or equal to the automatic start-up verification threshold of the auxiliary image acquisition system. At this time, the adaptive adjustment control of the auxiliary image acquisition system is stopped synchronously, and the current auxiliary image acquisition system is marked as the applicable auxiliary image acquisition system.

[0091] It should be noted that the generated warning message can be that the verification difference of the auxiliary image acquisition system is less than zero, the system automatic adjustment fails, please repair it in time.

[0092] It should be noted that if the automatic start-up verification difference of the auxiliary image acquisition system is less than or equal to zero, it means that the adaptive adjustment of the auxiliary image acquisition system fails and the automatic start-up verification cannot be performed. If the automatic start-up verification difference of the auxiliary image acquisition system is greater than zero, it means that the adaptive adjustment of the auxiliary image acquisition system is relatively successful and further judgment can be made.

[0093] In this embodiment, the adaptive adjustment control of the auxiliary image acquisition system based on the start-up verification determination result takes into account the negative impact brought by the possible loss of the auxiliary image acquisition system. Through preliminary adjustment, the situation of unstable auxiliary image acquisition caused by abnormal initial start-up can be effectively avoided, providing a reliable basis for subsequent vehicle safety auxiliary image analysis. The applicable auxiliary image acquisition system after adaptive adjustment control can provide more accurate and real-time auxiliary images for the vehicle, helping the driver better understand the situation around the vehicle. At the same time, the adaptive adjustment control process avoids the cumbersome and uncertainty of manual intervention, improving the automation degree and operation efficiency of the system.

[0094] A real-time auxiliary image acquisition module is used to collect real-time auxiliary images during vehicle driving through an applicable auxiliary image acquisition system. The real-time auxiliary images include the vision images of the outer rearview mirrors on both sides of the vehicle, the forward vision images on both sides of the vehicle, the image directly in front of the vehicle, and the image directly behind the vehicle, and extract the imaging quality data of the real-time auxiliary images for vehicle driving from them.

[0095] The imaging quality data of the real-time auxiliary images for vehicle driving includes the sharpness, brightness, image pixels, and signal-to-noise ratio of the imaging of the auxiliary images for vehicle driving.

[0096] Input the real-time auxiliary images during vehicle driving into the built-in image processor of the system for recognition and processing to obtain the imaging quality data of the real-time auxiliary images for vehicle driving. Among them, sharpness can reflect the clarity of the contour edges of the image, brightness can reflect the light and dark degree of the image, image pixels can reflect the clarity and richness of details of the image, and the signal-to-noise ratio, that is, the ratio of the signal to the noise in the image, can reflect the anti-interference ability and image quality purity of the image. Considering the above four parameters comprehensively, the imaging quality of the auxiliary images can be reflected more comprehensively.

[0097] An imaging quality data analysis module is used to analyze and process the imaging quality data of the real-time auxiliary images for vehicle driving to obtain an imaging quality evaluation value of the auxiliary images for vehicle driving.

[0098] Analyze and process to obtain an imaging quality evaluation value of the auxiliary images for vehicle driving. The specific analysis process is as follows: Extract the reference imaging quality data stored in the database. The reference imaging quality data includes reference sharpness, reference brightness, critical image pixels, and reference signal-to-noise ratio.

[0099] It should be noted that the reference imaging quality data stored in the database is obtained by averaging the historical data of the sharpness, brightness, image pixels, and signal-to-noise ratio of the imaging of the auxiliary images for vehicle driving before the database is established.

[0100] Based on the imaging quality data of the real-time auxiliary images for vehicle driving and the reference imaging quality data, comprehensively analyze and process to obtain an imaging quality evaluation value of the auxiliary images for vehicle driving.

[0101] The imaging quality evaluation value of the auxiliary images for vehicle driving is a numerical result obtained by quantifying the imaging quality data of the real-time auxiliary images for vehicle driving and the reference imaging quality data, and is used to characterize the imaging quality of the images collected by the applicable auxiliary image acquisition system during vehicle driving.

[0102] The method for specifically obtaining the imaging quality evaluation value of the auxiliary images for vehicle driving is as follows:

[0103] ,

[0104] Among them, is the evaluation value of the imaging quality of the auxiliary image for vehicle driving, is the sharpness of the imaging of the auxiliary image for vehicle driving, is the reference sharpness, is the brightness of the imaging of the auxiliary image for vehicle driving, is the reference brightness, is the image pixels of the imaging of the auxiliary image for vehicle driving, is the critical image pixels, is the signal-to-noise ratio of the imaging of the auxiliary image for vehicle driving, is the reference signal-to-noise ratio, is the sharpness weight, is the brightness weight, is the image pixel weight, is the signal-to-noise ratio weight, is the natural constant.

[0105] It should be noted that the sharpness weight, brightness weight, image pixel weight, and signal-to-noise ratio weight all have a value range between 0 and 1. In this embodiment, the sharpness weight is the preset sharpness weight in the database, which represents the numerical value of the influence degree of sharpness on the evaluation value of the imaging quality of the auxiliary image for vehicle driving. The brightness weight is the preset brightness weight in the database, which represents the numerical value of the influence degree of brightness on the evaluation value of the imaging quality of the auxiliary image for vehicle driving. The image pixel weight is the preset image pixel weight in the database, which represents the numerical value of the influence degree of image pixels on the evaluation value of the imaging quality of the auxiliary image for vehicle driving. The signal-to-noise ratio weight is the preset signal-to-noise ratio weight in the database, which represents the numerical value of the influence degree of signal-to-noise ratio on the evaluation value of the imaging quality of the auxiliary image for vehicle driving. When in use, the preset sharpness weight, brightness weight, image pixel weight, and signal-to-noise ratio weight can be directly obtained from the database, and their corresponding relationships can be pre-set mapping relationships. For example, sharpness, brightness, image pixels, and signal-to-noise ratio respectively form a mapping set with the preset sharpness weight, brightness weight, image pixel weight, and signal-to-noise ratio weight in the database. The real-time sharpness, brightness, image pixels, and signal-to-noise ratio are respectively input into the mapping set to obtain the sharpness weight, brightness weight, image pixel weight, and signal-to-noise ratio weight, and the mapping relationship therein is one-to-one correspondence.

[0106] It should also be noted that in this embodiment, the quality evaluation value of the auxiliary image for vehicle driving is obtained by processing the sharpness, brightness, image pixels, and signal-to-noise ratio of the auxiliary image presented during vehicle driving. This is because of the mutual influence among these parameters. For example, excessive brightness may cause details in the image to be submerged, reducing the sharpness performance. High-pixel images usually support higher sharpness adjustments because high-pixel images contain more detailed information and are less likely to exhibit jaggedness and distortion when sharpness is enhanced. By enhancing sharpness, high-pixel images can be made clearer. Similarly, high pixels mean that the image contains more detailed information and richer color levels. At the same signal intensity, high-pixel images have a relatively smaller proportion of noise in the entire image due to having more pixel points, thus having a higher signal-to-noise ratio. When processing to obtain the quality evaluation value of the auxiliary image for vehicle driving, it is necessary to fully consider the interaction among these parameters to more accurately evaluate the quality evaluation value of the auxiliary image for vehicle driving.

[0107] The applicable auxiliary image acquisition system adjustment module is used to perform real-time adjustment of the applicable auxiliary image acquisition system for the vehicle according to the quality evaluation value of the auxiliary image for vehicle driving.

[0108] The real-time adjustment of the applicable auxiliary image acquisition system for the vehicle is as follows: The real-time influencing parameters of the auxiliary image presentation are obtained through the applicable auxiliary image acquisition system, and the interference value of the auxiliary image presentation for vehicle driving is analyzed and processed.

[0109] The real-time influencing parameters of the auxiliary image presentation include the vehicle vibration amplitude, vehicle speed, external environmental light intensity, and external environmental humidity.

[0110] It should be understood that both the vehicle vibration amplitude and vehicle speed can be measured by an acceleration sensor. The vibration and speed changes during vehicle driving may cause the camera to shake, thereby affecting the stability and clarity of the image.

[0111] It should be understood that both the external environmental light intensity and humidity can be collected by corresponding sensors. The external environmental light intensity and external environmental humidity will both affect the image quality. Under strong light, the image may be overexposed, and under weak light, the image may be dim and unclear. In a high-humidity environment, the camera lens may fog up, thereby reducing the clarity of the image.

[0112] In this embodiment, the real-time influencing parameters of the auxiliary image presentation are collected and obtained through the corresponding sensors built into the vehicle. These sensors are usually connected to the vehicle's database, and the auxiliary image acquisition system can be connected to the vehicle's database and retrieve the corresponding sensing data, that is, the real-time influencing parameters of the auxiliary image presentation described above.

[0113] The interference value of the auxiliary image presentation during vehicle driving is the numerical result of quantifying the real-time influence parameters of the auxiliary image presentation, and is used as the basis for judging the degree of interference suffered by the auxiliary image presentation.

[0114] The interference value of the auxiliary image presentation during vehicle driving is obtained specifically as follows: Extract the reference real-time influence parameters of the auxiliary image presentation stored in the database, and the reference real-time influence parameters of the auxiliary image presentation include the reference vehicle vibration amplitude, the reference vehicle speed, the reference external environmental light intensity, and the reference external environmental humidity.

[0115] It should be noted that the reference real-time influence parameters of the auxiliary image presentation stored in the database are obtained by averaging the historical data of the vehicle vibration amplitude, vehicle speed, external environmental light intensity, and external environmental humidity before the database is established.

[0116] Based on the real-time influence parameters of the auxiliary image presentation and the reference real-time influence parameters of the auxiliary image presentation, the interference value of the auxiliary image presentation during vehicle driving is obtained through comprehensive analysis and processing.

[0117] ,

[0118] Among them, is the interference value of the auxiliary image presentation during vehicle driving, is the vehicle vibration amplitude, is the reference vehicle vibration amplitude, is the vehicle speed, is the reference vehicle speed, is the external environmental light intensity, is the reference external environmental light intensity, is the external environmental humidity, is the reference external environmental humidity, is the vehicle vibration amplitude weight, is the vehicle speed weight, is the external environmental light intensity weight, is the external environmental humidity weight is the natural constant.

[0119] It should be noted that the value ranges of the vehicle vibration amplitude weight, vehicle speed weight, external environment light intensity weight, and external environment humidity weight are all between 0 and 1. In this embodiment, the vehicle vibration amplitude weight is the preset vehicle vibration amplitude weight in the database, which represents the numerical value of the influence degree of the vehicle vibration amplitude on the auxiliary image imaging interference value during vehicle driving. The vehicle speed weight is the preset vehicle speed weight in the database, which represents the numerical value of the influence degree of the vehicle speed on the auxiliary image imaging interference value during vehicle driving. The external environment light intensity weight is the preset external environment light intensity weight in the database, which represents the numerical value of the influence degree of the external environment light intensity on the auxiliary image imaging interference value during vehicle driving. The external environment humidity weight is the preset external environment humidity weight in the database, which represents the numerical value of the influence degree of the external environment humidity on the auxiliary image imaging interference value during vehicle driving. When in use, the preset vehicle vibration amplitude weight, vehicle speed weight, external environment light intensity weight, and external environment humidity weight can be directly obtained from the database, and their corresponding relationships can be pre-set mapping relationships. For example, the vehicle vibration amplitude, vehicle speed, external environment light intensity, and external environment humidity respectively form a mapping set with the preset vehicle vibration amplitude weight, vehicle speed weight, external environment light intensity weight, and external environment humidity weight in the database. By inputting the real-time vehicle vibration amplitude, vehicle speed, external environment light intensity, and external environment humidity into the mapping set respectively, the vehicle vibration amplitude weight, vehicle speed weight, external environment light intensity weight, and external environment humidity weight can be obtained, and the mapping relationship therein is one-to-one correspondence.

[0120] It should also be noted that in this embodiment, the auxiliary image imaging interference value during vehicle driving is obtained by processing based on the vehicle vibration amplitude, vehicle speed, external environment light intensity, and external environment humidity, taking into account the mutual influence between these parameters. For example, the greater the vehicle speed, the greater the vehicle vibration amplitude. Both the larger vehicle vibration amplitude and vehicle speed will affect the quality of image acquisition. Different external environment light intensities and excessive humidity will affect the performance of the image acquisition device. In strong light, overexposure may occur, making the image blurred. In weak light, the noise of the image will increase, which will also affect the image quality. At the same time, moisture will form water mist on the lens surface, reducing the image quality. When obtaining the auxiliary image imaging interference value during vehicle driving, it is necessary to fully consider the interaction between these parameters to more accurately evaluate the auxiliary image imaging interference value during vehicle driving.

[0121] Based on the auxiliary image imaging quality evaluation value during vehicle driving and the auxiliary image imaging interference value during vehicle driving, the auxiliary image comprehensive evaluation index during vehicle driving is analyzed and processed.

[0122] The comprehensive evaluation index of the auxiliary image for vehicle driving is a numerical result obtained by quantifying the imaging quality evaluation value and the imaging interference value of the auxiliary image for vehicle driving, and is used as the adjustment basis for the real-time applicable auxiliary image acquisition system.

[0123] The process of obtaining the comprehensive evaluation index of the auxiliary image for vehicle driving is as follows:

[0124] , where is the comprehensive evaluation index of the auxiliary image for vehicle driving, is the imaging quality evaluation value of the auxiliary image for vehicle driving, is the imaging interference value of the auxiliary image for vehicle driving, is the weight value of the imaging quality evaluation value of the auxiliary image, is the weight value of the imaging interference value of the auxiliary image, is the natural constant.

[0125] It should be noted that the weight value of the imaging quality evaluation value of the auxiliary image and the weight value of the imaging interference value of the auxiliary image both have a value range between 0 and 1. In this embodiment, the weight value of the imaging quality evaluation value of the auxiliary image is the weight value of the imaging quality evaluation value of the auxiliary image preset in the database, which represents the numerical value of the influence degree of the imaging quality evaluation value of the auxiliary image for vehicle driving on the comprehensive evaluation index of the auxiliary image for vehicle driving. The weight value of the imaging interference value of the auxiliary image is the weight value of the imaging interference value of the auxiliary image preset in the database, which represents the numerical value of the influence degree of the imaging interference value of the auxiliary image for vehicle driving on the comprehensive evaluation index of the auxiliary image for vehicle driving. When in use, the preset weight value of the imaging quality evaluation value of the auxiliary image and the weight value of the imaging interference value of the auxiliary image can be directly obtained from the database, and their corresponding relationship can be a pre-set mapping relationship. For example, the imaging quality evaluation value of the auxiliary image for vehicle driving and the imaging interference value of the auxiliary image for vehicle driving respectively form a mapping set with the weight value of the imaging quality evaluation value of the auxiliary image preset in the database and the weight value of the imaging interference value of the auxiliary image. The real-time imaging quality evaluation value of the auxiliary image for vehicle driving and the imaging interference value of the auxiliary image for vehicle driving are respectively input into the mapping set to obtain the weight value of the imaging quality evaluation value of the auxiliary image and the weight value of the imaging interference value of the auxiliary image, and the mapping relationship therein is one-to-one.

[0126] It should also be noted that in this embodiment, the comprehensive evaluation index of the auxiliary image for vehicle driving is obtained by processing the imaging quality evaluation value and the imaging interference value of the auxiliary image for vehicle driving. This is considering the mutual influence among these parameters. For example, the larger the imaging interference value of the auxiliary image for vehicle driving, the greater the interference in image acquisition during vehicle driving, which will to a certain extent affect the imaging quality of the images acquired during vehicle driving. The size of the imaging quality will in turn affect the imaging quality evaluation value of the auxiliary image for vehicle driving. The larger the quality evaluation value, the better the imaging quality of the images acquired during vehicle driving.

[0127] Taking four different sets of data involved in this embodiment as an example, the weight value of the imaging quality evaluation value of the auxiliary image is defined as 0.7, and the weight value of the imaging interference value of the auxiliary image is defined as 0.3. Based on different imaging quality evaluation values and imaging interference values of the auxiliary image for vehicle driving, the comprehensive evaluation index of the auxiliary image for vehicle driving obtained through processing is as follows in the table:

[0128] Table 1 Comprehensive Evaluation Index of the Auxiliary Image for Vehicle Driving

[0129]

[0130] As can be seen from the above table, the comprehensive evaluation index of the auxiliary image for vehicle driving in the fourth group is at the highest value, indicating that compared with other groups, the imaging quality of the images acquired by the auxiliary image acquisition system in the fourth group during vehicle driving is better and the image acquisition is more stable. The comprehensive evaluation index of the auxiliary image for vehicle driving in the first group is at the lowest value, indicating that compared with other groups, its imaging quality evaluation value of the auxiliary image for vehicle driving is smaller, while the imaging interference value of the auxiliary image for vehicle driving is larger, which means that the first group of auxiliary image acquisition systems encounter more interference during vehicle driving and the imaging quality of the acquired images is also poorer, and the auxiliary image acquisition system at this time needs to be further adjusted.

[0131] Extract the comprehensive evaluation threshold of the auxiliary image for vehicle driving stored in the database.

[0132] If the comprehensive evaluation index of the auxiliary image for vehicle driving is greater than or equal to the comprehensive evaluation threshold of the auxiliary image for vehicle driving, the applicable auxiliary image acquisition system will not be adjusted. If the comprehensive evaluation index of the auxiliary image for vehicle driving is less than the comprehensive evaluation threshold of the auxiliary image for vehicle driving, the applicable auxiliary image acquisition system will be adjusted in real time with the preset adjustment parameters for the auxiliary image acquisition system process.

[0133] It should be understood that if the comprehensive evaluation index of the auxiliary image for vehicle driving is greater than or equal to the comprehensive evaluation threshold of the auxiliary image for vehicle driving, it indicates that the interference on the auxiliary image acquisition system is small, the imaging quality of the acquired image is high, and no adjustment is required. If the comprehensive evaluation index of the auxiliary image for vehicle driving is less than the comprehensive evaluation threshold of the auxiliary image for vehicle driving, it means that the interference on the auxiliary image acquisition system is large, and the imaging quality of the acquired image is also poor. To ensure the safety of the driving process, further adjustment is required.

[0134] It should be noted that the process adjustment parameters of the auxiliary image acquisition system are preset parameters used to perform real-time adjustment on the applicable auxiliary image acquisition system when the comprehensive evaluation index of the auxiliary image for vehicle driving is less than the comprehensive evaluation threshold of the auxiliary image for vehicle driving. During the system design and development stage, through a large number of experiments and tests, for different vehicle vibration amplitudes, vehicle speeds, external environment light intensities, external environment humidities, etc., different adjustments are made to the auxiliary image acquisition system, and the well-performing adjustment parameter combinations are recorded, so as to determine the preset process adjustment parameters of the auxiliary image acquisition system.

[0135] In this embodiment, through the real-time adjustment of the applicable auxiliary image acquisition system for the vehicle, by adjusting the applicable auxiliary image acquisition system in real time, the image acquisition parameters can be dynamically optimized according to the changes during driving, ensuring high-quality auxiliary images can be obtained under various complex conditions.

[0136] Please refer to Figure 2 As shown, the embodiment of the present invention provides an auxiliary image analysis method for vehicle safety, including the following steps: S1, receiving a vehicle start signal through an in-vehicle electronic control unit, and synchronously starting the auxiliary image acquisition system for automatic start verification of the auxiliary image, to obtain the automatic start verification data of the auxiliary image acquisition system.

[0137] S2, analyzing and processing the automatic start verification data of the auxiliary image acquisition system to obtain the automatic start verification determination result of the auxiliary image acquisition system, performing adaptive adjustment control on the auxiliary image acquisition system based on the start verification determination result, and marking the adaptively adjusted auxiliary image acquisition system as the applicable auxiliary image acquisition system.

[0138] S3, collecting real-time auxiliary images during vehicle driving through the applicable auxiliary image acquisition system, where the real-time auxiliary images include the visual field images of the outer rearview mirrors on both sides of the vehicle, the forward visual field images on both sides of the vehicle, the image directly in front of the vehicle, and the image directly behind the vehicle, and extracting the real-time auxiliary image imaging quality data during vehicle driving from them.

[0139] S4, analyzing and processing the real-time auxiliary image imaging quality data during vehicle driving to obtain the auxiliary image imaging quality evaluation value during vehicle driving.

[0140] S5. Based on the evaluation value of the imaging quality of the auxiliary image during vehicle driving, the vehicle is thus adjusted in real time for the applicable auxiliary image acquisition system.

[0141] By providing an auxiliary image analysis system and method for vehicle safety, the present invention can concentrate resources to deeply analyze and process the image data during vehicle driving in the analysis and processing of vehicle auxiliary images, which is more accurate, and improves the safety of vehicle driving and the accuracy of image analysis.

[0142] In a specific embodiment, the present system can be applied to the full vehicle image, reverse image, and coupled variable-position intelligent rearview mirror image in an automobile, etc., and analyze and process their images.

[0143] In terms of the full vehicle image, the system collects image data through multiple cameras distributed around the vehicle body. The automatic startup verification module of the auxiliary image will quickly verify the full vehicle image acquisition system when the vehicle starts, ensuring that each camera can work normally and the acquisition parameters meet the requirements. During vehicle driving, the real-time auxiliary image acquisition module continuously obtains the full vehicle image and transmits it to the imaging quality data analysis module. This module will accurately analyze parameters such as the sharpness, brightness, image pixels, and signal-to-noise ratio of the image, so that the system can adjust the full vehicle image acquisition system in real time according to the analysis results. If the vehicle is driving in a strong light environment, the system may automatically reduce the sensitivity of the camera to avoid overexposure of the image. If it is driving in a low light environment or at night, the system will appropriately increase the sensitivity and may also adjust parameters such as contrast and brightness to ensure the clarity and visibility of the full vehicle image.

[0144] For the reverse image, the system immediately starts the relevant verification and acquisition processes when the vehicle is put into reverse gear. The automatic startup verification data of the reverse image acquisition system includes parameters such as startup response time and image acquisition frame rate. These parameters will be compared and analyzed with the reference data in the database to ensure that the reverse image can be quickly and accurately displayed on the vehicle's central control screen. During the reverse process, the system will dynamically adjust the image acquisition parameters according to the movement of the vehicle and the changes in the surrounding environment. For example, when there is a moving object approaching behind the vehicle, the system will automatically increase the frame rate of the image, enabling the driver to more clearly observe the movement trajectory of the object. At the same time, it will also slightly adjust the contrast and brightness of the image to highlight the outline of the object and improve the driver's judgment accuracy of the reverse environment.

[0145] The rearview mirror imaging system is also effectively managed by the system. When the vehicle is started, the auxiliary imaging automatic startup verification module will check the performance parameters and imaging data of the rearview mirror imaging acquisition system to ensure that it can work properly and provide clear images. During the vehicle's driving process, the real-time auxiliary imaging acquisition module continuously updates the rearview mirror image and sends it to the imaging quality data analysis module for evaluation. If the vehicle is driving at high speed, due to factors such as wind resistance, the rearview mirror camera may shake slightly. The system will automatically adjust the anti-shake settings of the camera or perform certain digital image processing on the image by analyzing parameters such as the sharpness and stability of the image to eliminate the blurred effect caused by the shake and provide the driver with a stable and clear rearview mirror image, helping the driver better observe the traffic conditions on both sides of the vehicle. Similarly, in rainy, snowy weather or at night when driving, it can effectively improve the visibility in different scenarios.

[0146] In addition, the system can also perform combined processing on various camera images. For example, when the vehicle is performing a lane change operation, the system can simultaneously obtain the full vehicle image, the rearview mirror image, and the possible side auxiliary camera images, and fuse these images to provide the driver with a more comprehensive and three-dimensional view of the vehicle's surrounding environment. By complementing the advantages of different images, the driver can more accurately judge the distance and position relationship between the vehicle and surrounding objects, improving the safety of the lane change operation.

[0147] It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device.

[0148] The preferred embodiments of the present invention disclosed above are only used to help illustrate the present invention. The preferred embodiments do not describe all the details in detail, nor limit the invention to the specific embodiments described. Obviously, many modifications and changes can be made according to the content of this specification. These embodiments are selected and specifically described in this specification to better explain the principles and practical applications of the present invention, so that those skilled in the art can understand and utilize the present invention well. As long as it does not deviate from the structure of the present invention or exceed the scope defined by the present invention, it should fall within the protection scope of the present invention.

Claims

1. An auxiliary image analysis system for vehicle safety, characterized in that: Including: An auxiliary image automatic startup verification module, which is used to receive a vehicle startup signal through a vehicle electronic control unit and synchronously start an auxiliary image acquisition system to perform automatic startup verification of the auxiliary image, and obtain automatic startup verification data of the auxiliary image acquisition system; An automatic startup verification data analysis module, which is used to analyze and process the automatic startup verification data of the auxiliary image acquisition system to obtain an automatic startup verification determination result of the auxiliary image acquisition system, perform adaptive adjustment control on the auxiliary image acquisition system based on the startup verification determination result, and mark the auxiliary image acquisition system after adaptive adjustment control as an applicable auxiliary image acquisition system; A real-time auxiliary image acquisition module, which is used to acquire real-time auxiliary images during vehicle driving through the applicable auxiliary image acquisition system. The real-time auxiliary images include the vision images of the outer rearview mirrors on both sides of the vehicle, the forward vision images on both sides of the vehicle, the image directly in front of the vehicle, and the image directly behind the vehicle, and extract the real-time auxiliary image imaging quality data of vehicle driving from them; An imaging quality data analysis module, which is used to analyze and process the real-time auxiliary image imaging quality data of vehicle driving to obtain an auxiliary image imaging quality evaluation value for vehicle driving; An applicable auxiliary image acquisition system adjustment module, which is used to perform real-time adjustment of the applicable auxiliary image acquisition system for the vehicle according to the auxiliary image imaging quality evaluation value of vehicle driving; The process of performing real-time adjustment of the applicable auxiliary image acquisition system for the vehicle is as follows: Obtain real-time influence parameters of auxiliary image imaging through the applicable auxiliary image acquisition system, and analyze and process them to obtain an auxiliary image imaging interference value for vehicle driving; The real-time influence parameters of auxiliary image imaging include the vehicle vibration amplitude, vehicle speed, external environmental light intensity, and external environmental humidity; The auxiliary image imaging interference value for vehicle driving is a numerical result obtained by quantifying the real-time influence parameters of auxiliary image imaging, and is used as a determination basis for the degree of interference suffered by auxiliary image imaging; Based on the auxiliary image imaging quality evaluation value for vehicle driving and the auxiliary image imaging interference value for vehicle driving, analyze and process them to obtain an auxiliary image comprehensive evaluation index for vehicle driving; The auxiliary image comprehensive evaluation index for vehicle driving is a numerical result obtained by quantifying the auxiliary image imaging quality evaluation value for vehicle driving and the auxiliary image imaging interference value for vehicle driving, and is used as an adjustment basis for the real-time applicable auxiliary image acquisition system; Extract the auxiliary image comprehensive evaluation threshold stored in the database for vehicle driving; If the auxiliary image comprehensive evaluation index for vehicle driving is greater than or equal to the auxiliary image comprehensive evaluation threshold for vehicle driving, no adjustment is made to the applicable auxiliary image acquisition system. If the auxiliary image comprehensive evaluation index for vehicle driving is less than the auxiliary image comprehensive evaluation threshold for vehicle driving, the applicable auxiliary image acquisition system is adjusted in real time with preset process adjustment parameters of the auxiliary image acquisition system; The specific processing conditions of the auxiliary image imaging interference value for vehicle driving are as follows: ， wherein, is the interference value of the auxiliary image rendering for vehicle driving, is the vehicle vibration amplitude, is the reference vehicle vibration amplitude, is the vehicle speed, is the reference vehicle speed, is the external environmental light intensity, is the reference external environmental light intensity, is the external environmental humidity, is the reference external environmental humidity, is the vehicle vibration amplitude weight, is the vehicle speed weight, is the external environmental light intensity weight, is the external environmental humidity weight, is the natural constant.

2. The auxiliary image analysis system for vehicle safety according to claim 1, wherein: The automatic startup verification data of the auxiliary image acquisition system, where the automatic startup verification data includes the performance parameters of the auxiliary image acquisition system and the auxiliary image imaging data; The performance parameters of the auxiliary image acquisition system include the startup response time and the image acquisition frame rate of the auxiliary image acquisition system; The auxiliary image rendering data includes the resolution of the auxiliary image rendering and the contrast of the auxiliary image rendering.

3. The auxiliary image analysis system for vehicle safety according to claim 2, wherein: The analysis and processing obtain the automatic startup verification determination result of the auxiliary image acquisition system. The specific analysis process is as follows: Extract the reference automatic startup verification data of the auxiliary image acquisition system stored in the database. The reference automatic startup verification data includes the defined startup response time of the auxiliary image acquisition system, the reference image acquisition frame rate, the defined resolution of the auxiliary image rendering, and the defined contrast of the auxiliary image rendering; Based on the automatic startup verification data and the reference automatic startup verification data of the auxiliary image acquisition system, comprehensively analyze and process to obtain the first automatic startup verification index of the auxiliary image acquisition system; The first automatic startup verification index of the auxiliary image acquisition system is the numerical result of quantifying the automatic startup verification data and the reference automatic startup verification data of the auxiliary image acquisition system, and is used as the determination basis for the automatic startup verification performance of the auxiliary image acquisition system.

4. The auxiliary image analysis system for vehicle safety according to claim 3, wherein: The analysis and processing obtain the automatic startup verification determination result of the auxiliary image acquisition system. The specific process is as follows: Extract the automatic startup verification threshold of the auxiliary image acquisition system preset in the database; If the first automatic startup verification index of the auxiliary image acquisition system is greater than or equal to the automatic startup verification threshold of the auxiliary image acquisition system, define the automatic startup verification determination result of the auxiliary image acquisition system as normal automatic startup; If the first automatic startup verification index of the auxiliary image acquisition system is less than the automatic startup verification threshold of the auxiliary image acquisition system, define the automatic startup verification determination result of the auxiliary image acquisition system as abnormal automatic startup.

5. The auxiliary image analysis system for vehicle safety according to claim 4, wherein: The adaptive adjustment control of the auxiliary image acquisition system based on the startup verification determination result is as follows: Based on the startup verification determination result, if the automatic startup verification determination result of the auxiliary image acquisition system is normal automatic startup, no adaptive adjustment control is performed; If the automatic startup verification determination result of the auxiliary image acquisition system is determined to be abnormal automatic startup, extract the adaptive parameters of the auxiliary image acquisition system preset in the database, perform the first adaptive adjustment on the auxiliary image acquisition system, and re-analyze and process after the first adaptive adjustment to obtain the first automatic startup verification index of the auxiliary image acquisition system. Thus, mark the first automatic startup verification index of the auxiliary image acquisition system obtained by re-analyzing and processing as the second automatic startup verification index of the auxiliary image acquisition system; If the second automatic startup verification index of the auxiliary image acquisition system is greater than or equal to the automatic startup verification threshold of the auxiliary image acquisition system, no adaptive adjustment control is performed, and the auxiliary image acquisition system is marked as a suitable auxiliary image acquisition system; If the second automatic start-up verification index of the auxiliary image acquisition system is less than the automatic start-up verification threshold of the auxiliary image acquisition system, the difference between the second automatic start-up verification index and the first automatic start-up verification index of the auxiliary image acquisition system is processed to obtain the automatic start-up verification difference of the auxiliary image acquisition system; If the automatic start-up verification difference of the auxiliary image acquisition system is less than zero, a warning message is generated and uploaded to the vehicle electronic control unit. If the automatic start-up verification difference of the auxiliary image acquisition system is greater than or equal to zero, adaptive adjustment control is performed again with the preset adaptive parameters of the auxiliary image acquisition system until the second automatic start-up verification index of the auxiliary image acquisition system is greater than or equal to the automatic start-up verification threshold of the auxiliary image acquisition system. At this time, the adaptive adjustment control of the auxiliary image acquisition system is stopped synchronously, and the current auxiliary image acquisition system is marked as the applicable auxiliary image acquisition system.

6. The auxiliary image analysis system for vehicle safety according to claim 1, wherein: The real-time auxiliary image imaging quality data during vehicle driving includes the sharpness, brightness, image pixels, and signal-to-noise ratio of the auxiliary image imaging during vehicle driving.

7. The auxiliary image analysis system for vehicle safety according to claim 6, wherein: The following is the specific analysis process for obtaining the auxiliary image imaging quality evaluation value during vehicle driving: Extract the reference imaging quality data stored in the database. The reference imaging quality data includes reference sharpness, reference brightness, critical image pixels, and reference signal-to-noise ratio; Based on the real-time auxiliary image imaging quality data and the reference imaging quality data during vehicle driving, comprehensive analysis and processing are performed to obtain the auxiliary image imaging quality evaluation value during vehicle driving; The auxiliary image imaging quality evaluation value during vehicle driving is a numerical result obtained by quantifying the real-time auxiliary image imaging quality data and the reference imaging quality data during vehicle driving, and is used to characterize the imaging quality of the images collected by the applicable auxiliary image acquisition system during vehicle driving.

8. The auxiliary image analysis system for vehicle safety according to claim 1, wherein: The following is the specific process for obtaining the comprehensive evaluation index of the auxiliary image during vehicle driving: ， Among them, is the comprehensive evaluation index of the auxiliary image for vehicle driving, is the imaging quality evaluation value of the auxiliary image for vehicle driving, is the imaging interference value of the auxiliary image for vehicle driving, is the weight value of the imaging quality evaluation value of the auxiliary image, is the weight value of the imaging interference value of the auxiliary image, is the natural constant.

9. A method for an auxiliary image analysis system for vehicle safety according to any one of claims 1-8, characterized in that: It includes the following steps: S1. Receive the vehicle start signal through the vehicle electronic control unit, and synchronously start the auxiliary image acquisition system for automatic start-up verification of the auxiliary image to obtain the automatic start-up verification data of the auxiliary image acquisition system; S2. According to the automatic start-up verification data of the auxiliary image acquisition system, analyze and process to obtain the automatic start-up verification determination result of the auxiliary image acquisition system. Based on the start-up verification determination result, perform adaptive adjustment control on the auxiliary image acquisition system, and mark the adaptively adjusted auxiliary image acquisition system as the applicable auxiliary image acquisition system; S3. Collect the real-time auxiliary images during vehicle driving through the applicable auxiliary image acquisition system. The real-time auxiliary images include the images of the outer rearview mirrors on both sides of the vehicle, the forward vision images on both sides of the vehicle, the image directly in front of the vehicle, and the image directly behind the vehicle, and extract the real-time auxiliary image imaging quality data during vehicle driving from them; S4. Based on the real-time auxiliary image imaging quality data during vehicle driving, analyze and process to obtain the auxiliary image imaging quality evaluation value during vehicle driving; S5. According to the auxiliary image imaging quality evaluation value during vehicle driving, perform real-time adjustment of the applicable auxiliary image acquisition system for the vehicle.

Images