Auxiliary image analysis system and method for vehicle safety

Through adaptive adjustment and real-time adjustment of image acquisition parameters, the auxiliary image analysis system in the existing technology is solved, and the analysis accuracy and image quality of the vehicle safety auxiliary system are improved, and the vehicle safety status is ensured. accurate judgment.

CN119068443AActive Publication Date: 2024-12-03LINYI UNIVERSITY

Patent Information

Application Number
CN202411547055.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-01
Publication Date
2024-12-03
Estimated Expiration
2044-11-01

AI Technical Summary

Technical Problem

The existing image processing system for vehicle safety has problems such as insufficient analysis in image acquisition, basic splicing and foreign object detection, which leads to possible image interference values ​​in use of vehicle safety assistance systems, affecting the judgment of vehicle safety status. Accuracy.

Method used

Provide an auxiliary image analysis system, including an automatic start verification module, a real-time auxiliary image acquisition module, a image quality data analysis module and an appropriate auxiliary image acquisition system adjustment module, through adaptive adjustment control and real-time adjustment of image acquisition parameters, ensure the vehicle High-quality presentation of images during driving.

Benefits of technology

Improve the accuracy and safety of vehicle driving image data analysis, avoid image acquisition instability caused by initial startup abnormalities, provide more accurate and real-time auxiliary images, reduce the cumbersomeness of manual intervention, and improve the system's degree of automation and operational efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119068443A_ABST
    Figure CN119068443A_ABST
Patent Text Reader

Abstract

The invention discloses an auxiliary image analysis system and method for vehicle safety, can be matched with a coupling type variable position intelligent rearview mirror structure, and relates to the technical field of image data processing. The auxiliary image analysis system for the vehicle safety comprises an auxiliary image automatic starting verification module, an automatic starting verification data analysis module, a real-time auxiliary image acquisition module, an imaging quality data analysis module and a suitable auxiliary image acquisition system adjustment module. The vehicle driving image data can be analyzed and processed more accurately, the safety of vehicle driving and the accuracy of image analysis are improved, the complexity and uncertainty of manual intervention are avoided through self-adaptive adjustment control, the automation degree and the operation efficiency of the system are improved, and the system reliability is improved. And the applicable auxiliary image acquisition system can be adjusted in real time according to the dynamic change of driving, so that high-quality auxiliary images can be obtained under various complex conditions.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of image data processing, and in particular to an auxiliary image analysis system and method for vehicle safety. Background Art

[0002] In the modern traffic environment, with the continuous increase in the number of vehicles, vehicle safety has become a crucial issue. In order to improve driving safety, various auxiliary imaging systems have emerged. These systems use cameras, radars, laser scanning and other technologies to capture images around the vehicle in real time, and through image processing and analysis technology, provide drivers with a more comprehensive field of view, thereby reducing blind spots and misjudgments.

[0003] The prior art, such as the invention patent with announcement number: CN104424645B, is a vehicle image recognition device and method, which includes the steps of shooting at least one image; calculating the brightness change of the area of ​​interest extracted from the image; detecting the foreign body area in the area of ​​interest; and distinguishing whether it is a foreign body image or a general image based on the brightness change of the area of ​​interest relative to the number of the foreign body areas.

[0004] The prior art, such as the invention patent with announcement number: CN110400255B, is a method, system and vehicle for generating a panoramic image of a vehicle, wherein the method for generating a panoramic image of a vehicle includes: collecting original images around the vehicle through multiple cameras; determining multiple calibration areas based on overlapping areas in the original images around the vehicle; obtaining an image pixel point transformation mathematical model of multiple calibration points in the calibration area; according to the image pixel point transformation mathematical model of the multiple calibration points, transforming the original images around the vehicle collected by multiple cameras into target images respectively; and splicing the target images into a panoramic image.

[0005] From the above scheme, it can be seen that the current image processing for vehicle safety usually only focuses on image acquisition and basic quality assessment, or performs relatively simple stitching and foreign object detection processing on the image, thereby achieving a certain degree of vehicle safety assistance. However, for auxiliary image processing for vehicle safety, since the image parameters involved are diverse and complexly interrelated, and the vehicle auxiliary influence system will have a certain loss of auxiliary image interference value during use, simple processing cannot fully guarantee the comprehensiveness and accuracy of the analysis of multiple image processing links, and data processing may have limitations, which will affect the accuracy of the judgment of the vehicle safety status. Summary of the invention

[0006] In view of the deficiencies in the prior art, the present invention provides an auxiliary image analysis system and method for vehicle safety, which can be adapted to a coupled variable position intelligent rearview mirror structure and can effectively solve the problems involved in the above-mentioned background technology.

[0007] To achieve the above objectives, the present invention is implemented through the following technical solutions: The first aspect of the present invention provides an auxiliary image analysis system for vehicle safety, including: an auxiliary image automatic start verification module, which is used to receive a vehicle start signal through an on-board electronic control unit, and synchronously start the auxiliary image acquisition system to perform auxiliary image automatic start verification, and obtain automatic start verification data of the auxiliary image acquisition system.

[0008] The automatic startup verification data analysis module is used to analyze and process the automatic startup verification data of the auxiliary image acquisition system to obtain the automatic startup verification judgment result of the auxiliary image acquisition system, perform adaptive adjustment and control on the auxiliary image acquisition system based on the startup verification judgment result, and mark the auxiliary image acquisition system after adaptive adjustment and control as a suitable auxiliary image acquisition system.

[0009] The real-time auxiliary image acquisition module is used to collect real-time auxiliary images during vehicle driving through an applicable auxiliary image acquisition system. The real-time auxiliary images include the field of view images of the exterior rearview mirrors on both sides of the vehicle, the forward field of view images on both sides of the vehicle, the image directly in front of the vehicle, and the image directly behind the vehicle, and the real-time auxiliary image presentation quality data of the vehicle driving is extracted therefrom.

[0010] The image quality data analysis module is used to analyze and process the real-time auxiliary image image quality data of the vehicle driving to obtain the auxiliary image quality evaluation value of the vehicle driving.

[0011] The auxiliary image acquisition system adjustment module is used to make real-time adjustments to the auxiliary image acquisition system of the vehicle according to the auxiliary image presentation quality evaluation value of the vehicle.

[0012] As a preferred technical solution, the automatic startup verification data of the auxiliary image acquisition system includes auxiliary image acquisition system performance parameters and auxiliary image presentation data.

[0013] The auxiliary image acquisition system performance parameters include the startup response time and image acquisition frame rate of the auxiliary image acquisition system.

[0014] The auxiliary image presentation data includes the resolution of the auxiliary image presentation and the contrast of the auxiliary image presentation.

[0015] As a preferred technical solution, the analysis and processing obtains the automatic start-up verification and determination result of the auxiliary image acquisition system. The specific analysis process is as follows: The reference automatic start verification data of the auxiliary image acquisition system stored in the database is extracted, wherein the reference automatic start verification data includes the defined start response time of the auxiliary image acquisition system, the reference image acquisition frame rate, the auxiliary image presentation defined resolution and the auxiliary image presentation defined contrast.

[0016] Based on the automatic start-up verification data of the auxiliary image acquisition system and the reference automatic start-up verification data, a first automatic start-up verification index of the auxiliary image acquisition system is obtained through comprehensive analysis and processing.

[0017] The first automatic startup verification index of the auxiliary image acquisition system is a numerical result of quantifying the automatic startup verification data of the auxiliary image acquisition system and the reference automatic startup verification data, and is used as a basis for determining the automatic startup verification performance of the auxiliary image acquisition system.

[0018] As a preferred technical solution, the analysis and processing obtains the automatic start-up verification and determination result of the auxiliary image acquisition system, and the specific process is as follows: Extract the automatic start verification threshold of the auxiliary image acquisition system preset in the database.

[0019] If the first automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system, the automatic start verification determination result of the auxiliary image acquisition system is defined as a normal automatic start.

[0020] If the first automatic start verification index of the auxiliary image acquisition system is less than the automatic start verification threshold of the auxiliary image acquisition system, the automatic start verification determination result of the auxiliary image acquisition system is defined as abnormal automatic start.

[0021] As a preferred technical solution, the auxiliary image acquisition system is adaptively adjusted and controlled based on the startup verification result, and the specific process is as follows: Based on the startup verification judgment result, if the automatic startup verification judgment result of the auxiliary image acquisition system is normal automatic startup, no adaptive adjustment control is performed.

[0022] If the automatic start-up verification result of the auxiliary image acquisition system is determined to be an abnormal automatic start-up, the auxiliary image acquisition system adaptive parameters preset in the database are extracted, the auxiliary image acquisition system is adaptively adjusted for the first time, and after the first adaptive adjustment, the system is re-analyzed and processed to obtain the first automatic start-up verification index of the auxiliary image acquisition system. The first automatic start-up verification index of the auxiliary image acquisition system obtained by re-analysis and processing is marked as the second automatic start-up verification index of the auxiliary image acquisition system.

[0023] If the second automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system, no adaptive adjustment control is performed, and the auxiliary image acquisition system is marked as an applicable auxiliary image acquisition system.

[0024] If the second automatic start-up verification index of the auxiliary image acquisition system is less than the automatic start-up verification threshold of the auxiliary image acquisition system, the second automatic start-up verification index of the auxiliary image acquisition system and the first automatic start-up verification index of the auxiliary image acquisition system are difference processed to obtain the automatic start-up verification difference of the auxiliary image acquisition system.

[0025] If the automatic start verification difference of the auxiliary image acquisition system is less than zero, a warning message is generated and uploaded to the vehicle-mounted electronic control unit. If the automatic start verification difference of the auxiliary image acquisition system is greater than or equal to zero, the preset auxiliary image acquisition system adaptive parameters are used for adjustment and control again until the second automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system. The adaptive adjustment and control of the auxiliary image acquisition system is synchronously stopped, and the current auxiliary image acquisition system is marked as an applicable auxiliary image acquisition system.

[0026] As a preferred technical solution, the real-time auxiliary image quality data of the vehicle driving includes the sharpness, brightness, image pixels and signal-to-noise ratio of the auxiliary image of the vehicle driving.

[0027] As a preferred technical solution, the analysis and processing obtains the auxiliary image quality evaluation value of vehicle driving, and the specific analysis process is as follows: Reference imaging quality data stored in a database is extracted, wherein the reference imaging quality data includes reference sharpness, reference brightness, critical image pixels, and reference signal-to-noise ratio.

[0028] Based on the real-time auxiliary image presentation quality data of the vehicle driving and the reference image presentation quality data, a comprehensive analysis and processing is performed to obtain an auxiliary image presentation quality assessment value of the vehicle driving.

[0029] The auxiliary image presentation quality evaluation value of vehicle driving is a numerical result of quantifying the real-time auxiliary image presentation quality data and reference image presentation quality data of vehicle driving, and is used to characterize the image quality collected by the auxiliary image acquisition system during vehicle driving.

[0030] As a preferred technical solution, the real-time adjustment of the vehicle applicable auxiliary image acquisition system is carried out in the following specific process: The auxiliary image acquisition system is used to obtain the real-time influencing parameters of the auxiliary image presentation, and the auxiliary image presentation interference value of the vehicle driving is obtained through analysis and processing.

[0031] The real-time influencing parameters of the auxiliary image presentation include vehicle vibration amplitude, vehicle speed, external environment light intensity, and external environment humidity.

[0032] The auxiliary image presentation interference value of the vehicle driving is a numerical result of quantifying the real-time influencing parameters of the auxiliary image presentation, and is used as a basis for determining the degree of interference to the auxiliary image presentation.

[0033] Based on the auxiliary image presentation quality evaluation value of the vehicle driving and the auxiliary image presentation interference value of the vehicle driving, the auxiliary image comprehensive evaluation index of the vehicle driving is obtained through analysis and processing.

[0034] The comprehensive evaluation index of the auxiliary image for vehicle driving is a numerical result of quantifying the auxiliary image presentation quality evaluation value and the auxiliary image presentation interference value of the auxiliary image for vehicle driving, and is used as a basis for adjusting the auxiliary image acquisition system applicable in real time.

[0035] Extract the comprehensive evaluation threshold of the auxiliary images of vehicle driving stored in the database.

[0036] If the comprehensive evaluation index of the auxiliary images of vehicle driving is greater than or equal to the comprehensive evaluation threshold of the auxiliary images of vehicle driving, the applicable auxiliary image acquisition system will not be adjusted. If the comprehensive evaluation index of the auxiliary images of vehicle driving is less than the comprehensive evaluation threshold of the auxiliary images of vehicle driving, the applicable auxiliary image acquisition system will be adjusted in real time with the preset auxiliary image acquisition system process adjustment parameters.

[0037] As a preferred technical solution, the auxiliary image comprehensive evaluation index of vehicle driving is specifically obtained in the following process: , in, It is the comprehensive evaluation index of auxiliary images for vehicle driving. is the evaluation value of the auxiliary image quality of vehicle driving. is the auxiliary image interference value of the vehicle driving, is the auxiliary image quality assessment value weight, is the auxiliary image interference value weight, is a natural constant.

[0038] A second aspect of the present invention provides an auxiliary image analysis method for vehicle safety, comprising the following steps: S1, receiving a vehicle start signal through an on-board electronic control unit, and synchronously starting an auxiliary image acquisition system to perform auxiliary image automatic start verification, to obtain automatic start verification data of the auxiliary image acquisition system.

[0039] S2, according to the automatic startup verification data of the auxiliary image acquisition system, analyze and process to obtain the automatic startup verification judgment result of the auxiliary image acquisition system, perform adaptive adjustment and control on the auxiliary image acquisition system based on the startup verification judgment result, and mark the auxiliary image acquisition system after adaptive adjustment and control as a suitable auxiliary image acquisition system.

[0040] S3, collecting real-time auxiliary images during vehicle driving by using an auxiliary image acquisition system, wherein the real-time auxiliary images include the field of view images of the exterior rearview mirrors on both sides of the vehicle, the forward field of view images on both sides of the vehicle, the image directly in front of the vehicle and the image directly behind the vehicle, and extracting the real-time auxiliary image presentation quality data of the vehicle driving.

[0041] S4, based on the real-time auxiliary image presentation quality data of the vehicle driving, analyzing and processing to obtain the auxiliary image presentation quality evaluation value of the vehicle driving.

[0042] S5, making real-time adjustments to the auxiliary image acquisition system applicable to the vehicle according to the auxiliary image presentation quality evaluation value of the vehicle.

[0043] Compared with the prior art, the embodiments of the present invention have at least the following beneficial effects: (1) The present invention provides an auxiliary image analysis system and method for vehicle safety. In the analysis and processing of vehicle auxiliary images, resources can be concentrated to conduct in-depth analysis and processing of vehicle driving image data with greater accuracy, thereby improving vehicle driving safety and the accuracy of image analysis.

[0044] (2) The present invention takes into account the negative impact of possible losses in the auxiliary image acquisition system by adaptively adjusting and controlling the auxiliary image acquisition system based on the startup verification judgment result. The preliminary adjustment can effectively avoid the instability of auxiliary image acquisition caused by initial startup abnormalities, thereby providing a reliable basis for subsequent vehicle safety auxiliary image analysis. The applicable auxiliary image acquisition system after adaptive adjustment and control can provide the vehicle with more accurate and real-time auxiliary images, helping the driver to better understand the situation around the vehicle. At the same time, the adaptive adjustment and control process avoids the tediousness and uncertainty of manual intervention, thereby improving the system's degree of automation and operating efficiency.

[0045] (3) The present invention can dynamically optimize image acquisition parameters according to driving changes by making real-time adjustments to the auxiliary image acquisition system applicable to the vehicle, thereby ensuring that high-quality auxiliary images can be obtained in a variety of complex situations.

[0046] Of course, any product implementing the present invention does not necessarily need to achieve all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 It is a schematic diagram of system module connection of the present invention.

[0048] Figure 2 It is a schematic diagram of the method flow of the present invention. DETAILED DESCRIPTION

[0049] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0050] See also Figure 1 As shown, an embodiment of the present invention provides an auxiliary image analysis system for vehicle safety, including: an auxiliary image automatic start verification module, which is used to receive a vehicle start signal through an on-board electronic control unit, and synchronously start an auxiliary image acquisition system to perform auxiliary image automatic start verification, and obtain automatic start verification data of the auxiliary image acquisition system.

[0051] It should be noted that the on-board electronic control unit is the core control module of the vehicle, which can be responsible for receiving signals from the vehicle start sensor and warning information from the auxiliary image acquisition system, and controlling the automatic activation and verification analysis of the auxiliary image system.

[0052] The automatic startup verification data includes auxiliary image acquisition system performance parameters and auxiliary image presentation data.

[0053] The auxiliary image acquisition system performance parameters include the startup response time and image acquisition frame rate of the auxiliary image acquisition system.

[0054] It should be understood that the startup response time of the auxiliary image acquisition system refers to the time interval from the system receiving the startup signal to the start of image acquisition, and the image acquisition frame rate refers to the number of image acquisition frames per unit time. A higher image acquisition frame rate can provide more detailed images.

[0055] The auxiliary image presentation data includes the resolution of the auxiliary image presentation and the contrast of the auxiliary image presentation.

[0056] It should also be understood that the resolution of the auxiliary image refers to the number of pixels displayed in the image, which is usually expressed as the number of horizontal pixels multiplied by the number of vertical pixels. A higher resolution means a clearer image and can display more details.

[0057] The contrast of auxiliary image presentation refers to the difference between the brightest and darkest parts of the image. High-contrast images can make the outline of objects clearer and the colors more vivid, which helps to better identify objects and features in the image.

[0058] The automatic startup verification data analysis module is used to analyze and process the automatic startup verification data of the auxiliary image acquisition system to obtain the automatic startup verification judgment result of the auxiliary image acquisition system, perform adaptive adjustment and control on the auxiliary image acquisition system based on the startup verification judgment result, and mark the auxiliary image acquisition system after adaptive adjustment and control as a suitable auxiliary image acquisition system.

[0059] The automatic start-up verification judgment result of the auxiliary image acquisition system is obtained by analysis and processing. The specific analysis process is as follows: the reference automatic start-up verification data of the auxiliary image acquisition system stored in the database is extracted, and the reference automatic start-up verification data includes the defined start-up response time of the auxiliary image acquisition system, the reference image acquisition frame rate, the auxiliary image presentation defined resolution and the auxiliary image presentation defined contrast.

[0060] It should be noted that the reference automatic startup verification data stored in the database is obtained by averaging the historical data of the startup response time and image acquisition frame rate of the auxiliary image acquisition system, as well as the resolution and contrast of the auxiliary image presentation before establishing the database.

[0061] It should be noted that the database is used to store reference indicator data, and the reference indicator data includes first reference indicator data, second reference indicator data and third reference indicator data.

[0062] The first reference index data includes reference automatic start-up verification data, reference imaging quality data and auxiliary image imaging reference real-time impact parameters, and also includes auxiliary image acquisition system adaptive parameters and auxiliary image acquisition system process adjustment parameters.

[0063] The second reference index data includes an automatic start-up verification threshold of the auxiliary image acquisition system and a comprehensive evaluation threshold of the auxiliary images of vehicle driving.

[0064] The third reference indicator data includes the startup response time weight, image acquisition frame rate weight, resolution weight and contrast weight, as well as sharpness weight, brightness weight, image pixel weight and signal-to-noise ratio weight, vehicle vibration amplitude weight, vehicle speed weight, external environment light intensity weight, external environment humidity weight, auxiliary image presentation quality assessment value weight and auxiliary image presentation interference value weight.

[0065] Based on the automatic start-up verification data of the auxiliary image acquisition system and the reference automatic start-up verification data, a first automatic start-up verification index of the auxiliary image acquisition system is obtained through comprehensive analysis and processing.

[0066] The first automatic startup verification index of the auxiliary image acquisition system is a numerical result of quantifying the automatic startup verification data of the auxiliary image acquisition system and the reference automatic startup verification data, and is used as a basis for determining the automatic startup verification performance of the auxiliary image acquisition system.

[0067] The first automatic start calibration index of the auxiliary image acquisition system is obtained as follows: , in, The first automatic start calibration index for the auxiliary image acquisition system, To assist the startup response time of the image acquisition system, To define the startup response time, The image acquisition frame rate of the auxiliary image acquisition system, is the reference image acquisition frame rate, The resolution of the auxiliary image is Defines the resolution for auxiliary image presentation, To assist in the contrast of the image, To define contrast for auxiliary image presentation, is the startup response time weight, is the image acquisition frame rate weight, is the resolution weight, is the contrast weight, is a natural constant.

[0068] It should be noted that the startup response time weight, image acquisition frame rate weight, resolution weight and contrast weight all have value ranges between 0 and 1. In the present embodiment, the startup response time weight is a startup response time weight preset in the database, which indicates the numerical value of the influence of the startup response time on the first automatic startup verification index of the auxiliary image acquisition system. The image acquisition frame rate weight is an image acquisition frame rate weight preset in the database, which indicates the numerical value of the influence of the image acquisition frame rate on the first automatic startup verification index of the auxiliary image acquisition system. The resolution weight is a resolution weight preset in the database, which indicates the numerical value of the influence of the resolution on the first automatic startup verification index of the auxiliary image acquisition system. The contrast weight is a contrast weight preset in the database. The degree weight represents the numerical value of the influence of contrast on the first automatic startup verification index of the auxiliary image acquisition system. When used, the preset startup response time weight, image acquisition frame rate weight, resolution weight and contrast weight can be directly obtained from the database, and the corresponding relationship can be a pre-set mapping relationship. For example, the startup response time, image acquisition frame rate, resolution and contrast are respectively mapped with the startup response time weight, image acquisition frame rate weight, resolution weight and contrast weight preset in the database to form a mapping set, and the real-time startup response time, image acquisition frame rate, resolution and contrast are respectively input into the mapping set to obtain the startup response time weight, image acquisition frame rate weight, resolution weight and contrast weight, wherein the mapping relationship is one-to-one correspondence.

[0069] It should also be noted that in this embodiment, the first automatic startup verification index of the auxiliary image acquisition system is obtained according to the startup response time of the auxiliary image acquisition system, the image acquisition frame rate of the auxiliary image acquisition system, the resolution of the auxiliary image presentation and the contrast of the auxiliary image presentation. This takes into account the mutual influence between these parameters. For example, a shorter startup response time can ensure that the system quickly enters the working state and captures high-resolution image details in time, and allows the system to respond quickly when the lighting changes to improve the contrast. At the same time, it enables the system to detect lighting changes more promptly, thereby quickly adjusting the contrast. When processing to obtain the first automatic startup verification index of the auxiliary image acquisition system, it is necessary to fully consider the interaction between these parameters in order to more accurately evaluate the first automatic startup verification index of the auxiliary image acquisition system.

[0070] The automatic start-up verification judgment result of the auxiliary image acquisition system is obtained by analysis and processing. The specific process is as follows: the automatic start-up verification threshold of the auxiliary image acquisition system preset in the database is extracted.

[0071] If the first automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system, the automatic start verification determination result of the auxiliary image acquisition system is defined as a normal automatic start.

[0072] If the first automatic start verification index of the auxiliary image acquisition system is less than the automatic start verification threshold of the auxiliary image acquisition system, the automatic start verification determination result of the auxiliary image acquisition system is defined as abnormal automatic start.

[0073] It should be understood that when the first automatic start-up verification index of the auxiliary image acquisition system is greater than or equal to the automatic start-up verification threshold of the auxiliary image acquisition system, it means that the automatic start-up performance of the auxiliary image acquisition system is good, it can meet the image acquisition requirements during vehicle driving, and it can be started normally. When the first automatic start-up verification index of the auxiliary image acquisition system is less than the automatic start-up verification threshold of the auxiliary image acquisition system, it means that the automatic start-up performance of the auxiliary image acquisition system is relatively poor, it cannot be automatically started normally, and further adjustment is required.

[0074] Based on the startup verification result, the auxiliary image acquisition system is adaptively adjusted and controlled. The specific process is as follows: based on the startup verification result, if the automatic startup verification result of the auxiliary image acquisition system is a normal automatic startup, no adaptive adjustment control is performed.

[0075] If the automatic start-up verification result of the auxiliary image acquisition system is determined to be an abnormal automatic start-up, the auxiliary image acquisition system adaptive parameters preset in the database are extracted, the auxiliary image acquisition system is adaptively adjusted for the first time, and after the first adaptive adjustment, the system is re-analyzed and processed to obtain the first automatic start-up verification index of the auxiliary image acquisition system. The first automatic start-up verification index of the auxiliary image acquisition system obtained by re-analysis and processing is marked as the second automatic start-up verification index of the auxiliary image acquisition system.

[0076] It should be noted that the auxiliary image acquisition system adaptive parameters refer to a series of parameter settings used to automatically adjust the auxiliary image acquisition system to achieve normal working conditions, which are obtained by analyzing and optimizing a large number of auxiliary image data under different driving environments. Specifically, a large number of auxiliary image samples may be collected under various lighting conditions, weather conditions, road scenes, etc., and then the image features of these samples are extracted and analyzed using data analysis algorithms and models to determine the parameter combination that enables the auxiliary image acquisition system to work well under different conditions.

[0077] If the second automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system, no adaptive adjustment control is performed, and the auxiliary image acquisition system is marked as an applicable auxiliary image acquisition system.

[0078] If the second automatic start-up verification index of the auxiliary image acquisition system is less than the automatic start-up verification threshold of the auxiliary image acquisition system, the second automatic start-up verification index of the auxiliary image acquisition system and the first automatic start-up verification index of the auxiliary image acquisition system are difference processed to obtain the automatic start-up verification difference of the auxiliary image acquisition system.

[0079] It should be noted that the automatic start-up verification difference of the auxiliary image acquisition system is the result of subtracting the first automatic start-up verification index of the auxiliary image acquisition system from the second automatic start-up verification index of the auxiliary image acquisition system. The result can be greater than zero, equal to zero, and less than zero.

[0080] If the automatic start verification difference of the auxiliary image acquisition system is less than or equal to zero, a warning message is generated and uploaded to the vehicle-mounted electronic control unit. If the automatic start verification difference of the auxiliary image acquisition system is greater than zero, the preset auxiliary image acquisition system adaptive parameters are used for adjustment and control again until the second automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system. The adaptive adjustment and control of the auxiliary image acquisition system is synchronously stopped, and the current auxiliary image acquisition system is marked as an applicable auxiliary image acquisition system.

[0081] It should be noted that the generated warning information may be that the verification difference of the auxiliary image acquisition system is less than zero, the system automatic adjustment fails, and timely maintenance is requested.

[0082] It should be noted that if the automatic startup verification difference of the auxiliary image acquisition system is less than or equal to zero, it means that the adaptive adjustment of the auxiliary image acquisition system has failed and the automatic startup verification cannot be performed. If the automatic startup verification difference of the auxiliary image acquisition system is greater than zero, it means that the adaptive adjustment of the auxiliary image acquisition system is relatively successful and further judgment can be made.

[0083] In this embodiment, the auxiliary image acquisition system is adaptively adjusted and controlled based on the startup verification judgment result. This is because the negative impact caused by possible losses in the auxiliary image acquisition system is taken into consideration. Preliminary adjustments can effectively avoid the instability of auxiliary image acquisition due to initial startup abnormalities, thereby providing a reliable basis for subsequent vehicle safety auxiliary image analysis. The applicable auxiliary image acquisition system after adaptive adjustment control can provide the vehicle with more accurate and real-time auxiliary images, helping the driver to better understand the situation around the vehicle. At the same time, the adaptive adjustment control process avoids the tediousness and uncertainty of manual intervention, and improves the system's degree of automation and operating efficiency.

[0084] The real-time auxiliary image acquisition module is used to collect real-time auxiliary images during vehicle driving through an applicable auxiliary image acquisition system. The real-time auxiliary images include the field of view images of the exterior rearview mirrors on both sides of the vehicle, the forward field of view images on both sides of the vehicle, the image directly in front of the vehicle, and the image directly behind the vehicle, and the real-time auxiliary image presentation quality data of the vehicle driving is extracted therefrom.

[0085] The real-time auxiliary image presentation quality data of vehicle driving includes the sharpness, brightness, image pixels and signal-to-noise ratio of the auxiliary image presentation of vehicle driving.

[0086] The real-time auxiliary images during vehicle driving are input into the system's built-in image processor for recognition and processing to obtain the real-time auxiliary image quality data of the vehicle driving. The sharpness can reflect the clarity of the image's contour edges, the brightness can reflect the brightness of the image, the image pixels can reflect the clarity and detail richness of the image, and the signal-to-noise ratio, that is, the ratio of the signal to the noise in the image, can reflect the image's anti-interference ability and image quality purity. Comprehensive consideration of the above four parameters can more comprehensively reflect the auxiliary image quality.

[0087] The image quality data analysis module is used to analyze and process the real-time auxiliary image image quality data of the vehicle driving to obtain the auxiliary image quality evaluation value of the vehicle driving.

[0088] The auxiliary image quality evaluation value of vehicle driving is obtained by analysis and processing. The specific analysis process is as follows: extract the reference image quality data stored in the database, and the reference image quality data includes reference sharpness, reference brightness, critical image pixels and reference signal-to-noise ratio.

[0089] It should be noted that the reference imaging quality data stored in the database is obtained by averaging the historical data of the sharpness, brightness, image pixels and signal-to-noise ratio of the auxiliary image of the vehicle before the database is established.

[0090] Based on the real-time auxiliary image presentation quality data of the vehicle driving and the reference image presentation quality data, a comprehensive analysis and processing is performed to obtain an auxiliary image presentation quality assessment value of the vehicle driving.

[0091] The auxiliary image presentation quality evaluation value of vehicle driving is a numerical result of quantifying the real-time auxiliary image presentation quality data and reference image presentation quality data of vehicle driving, and is used to characterize the image quality collected by the auxiliary image acquisition system during vehicle driving.

[0092] The auxiliary image quality evaluation value of vehicle driving is obtained as follows: , in, is the evaluation value of the auxiliary image quality of vehicle driving. The sharpness of the auxiliary image for vehicle driving. For reference sharpness, The brightness of the auxiliary image for the vehicle. is the reference brightness, The image pixels that represent the auxiliary image of the vehicle are is the critical image pixel, is the signal-to-noise ratio of the auxiliary image presented by the vehicle. is the reference signal-to-noise ratio, is the sharpness weight, is the brightness weight, is the image pixel weight, is the signal-to-noise ratio weight, is a natural constant.

[0093] It should be noted that the sharpness weight, brightness weight, image pixel weight and signal-to-noise ratio weight all have a value range between 0 and 1. In this embodiment, the sharpness weight is a sharpness weight preset in the database, which indicates the numerical value of the influence of sharpness on the auxiliary image quality evaluation value of vehicle driving. The brightness weight is a brightness weight preset in the database, which indicates the numerical value of the influence of brightness on the auxiliary image quality evaluation value of vehicle driving. The image pixel weight is an image pixel weight preset in the database, which indicates the numerical value of the influence of image pixels on the auxiliary image quality evaluation value of vehicle driving. The signal-to-noise ratio weight is a signal-to-noise ratio weight preset in the database. The ratio weight represents the numerical value of the influence of the signal-to-noise ratio on the auxiliary image quality assessment value of vehicle driving. When used, the preset sharpness weight, brightness weight, image pixel weight and signal-to-noise ratio weight can be directly obtained from the database, and the corresponding relationship can be a pre-set mapping relationship. For example, the sharpness, brightness, image pixel and signal-to-noise ratio respectively form a mapping set with the sharpness weight, brightness weight, image pixel weight and signal-to-noise ratio weight preset in the database, and the real-time sharpness, brightness, image pixel and signal-to-noise ratio are respectively input into the mapping set to obtain the sharpness weight, brightness weight, image pixel weight and signal-to-noise ratio weight, wherein the mapping relationship is one-to-one correspondence.

[0094] It should also be noted that in this embodiment, the auxiliary image quality evaluation value of vehicle travel is obtained by processing the sharpness, brightness, image pixels and signal-to-noise ratio of the auxiliary image of vehicle travel, taking into account the mutual influence between these parameters. For example, too high brightness may cause the details in the image to be submerged and reduce the sharpness performance. High-pixel images can usually support higher sharpness adjustment because high-pixel images contain more detail information and are less likely to have aliasing and distortion when the sharpness is improved. By enhancing the sharpness, the high-pixel image can be made clearer. Similarly, high pixels mean that the image contains more detail information and richer color levels. Under the same signal strength, the high-pixel image has more pixels, and its noise accounts for a relatively small proportion of the entire image, so it has a higher signal-to-noise ratio. When processing to obtain the auxiliary image quality evaluation value of vehicle travel, it is necessary to fully consider the interaction between these parameters to more accurately evaluate the auxiliary image quality evaluation value of vehicle travel.

[0095] The auxiliary image acquisition system adjustment module is used to make real-time adjustments to the auxiliary image acquisition system of the vehicle according to the auxiliary image presentation quality evaluation value of the vehicle.

[0096] The auxiliary image acquisition system is used to adjust the vehicle in real time. The specific process is as follows: the auxiliary image acquisition system is used to obtain the real-time influencing parameters of the auxiliary image presentation, and the auxiliary image presentation interference value of the vehicle driving is obtained through analysis and processing.

[0097] The real-time influencing parameters of the auxiliary image presentation include vehicle vibration amplitude, vehicle speed, external environment light intensity, and external environment humidity.

[0098] It should be understood that the vehicle vibration amplitude and speed can be measured by acceleration sensors. The vibration and speed changes during vehicle driving may cause the camera to shake, thereby affecting the stability and clarity of the image.

[0099] It should be understood that the external environment light intensity and humidity can be collected by corresponding sensors. The external environment light intensity and the external environment humidity will affect the image quality. Strong light may cause overexposure of the image, weak light may make the image dim and unclear, and high humidity environment may cause the camera lens to fog, thereby reducing the clarity of the image.

[0100] In this embodiment, the real-time influencing parameters of the auxiliary image presentation are collected and acquired through corresponding sensors built into the vehicle. These sensors are usually connected to the vehicle's database, and the auxiliary image acquisition system can connect to the vehicle's database and retrieve the corresponding sensor data, namely the real-time influencing parameters of the auxiliary image presentation mentioned above. The auxiliary image presentation interference value of the vehicle driving is a numerical result of quantifying the real-time influencing parameters of the auxiliary image presentation, and is used as a basis for determining the degree of interference to the auxiliary image presentation.

[0101] The auxiliary image presentation interference value of vehicle driving is specifically obtained through the following process: extracting the auxiliary image presentation reference real-time influencing parameters stored in the database, wherein the auxiliary image presentation reference real-time influencing parameters include reference vehicle vibration amplitude, reference vehicle speed, reference external environment light intensity and reference external environment humidity.

[0102] It should be noted that the auxiliary image presentation reference real-time influencing parameters stored in the database are obtained by averaging historical data of vehicle vibration amplitude, vehicle speed, external environment light intensity, and external environment humidity before the database is established.

[0103] Based on the auxiliary image presentation real-time influence parameter and the auxiliary image presentation reference real-time influence parameter, the auxiliary image presentation interference value of the vehicle driving is obtained through comprehensive analysis and processing.

[0104] , in, is the auxiliary image interference value of the vehicle driving, is the vehicle vibration amplitude, is the reference vehicle vibration amplitude, is the vehicle speed, is the reference speed, is the external ambient light intensity, To refer to the external ambient light intensity, is the external environment humidity, For reference to external ambient humidity, is the external environment humidity weight, is the vehicle vibration amplitude weight, is the vehicle speed weight, is the external environment light intensity weight, is a natural constant.

[0105] It should be noted that the vehicle vibration amplitude weight, vehicle speed weight, external environment light intensity weight and external environment humidity weight all have a value range between 0 and 1. In this embodiment, the vehicle vibration amplitude weight is a vehicle vibration amplitude weight preset in the database, which indicates the numerical value of the influence of the vehicle vibration amplitude on the auxiliary image imaging interference value of the vehicle driving. The vehicle speed weight is a vehicle speed weight preset in the database, which indicates the numerical value of the influence of the vehicle speed on the auxiliary image imaging interference value of the vehicle driving. The external environment light intensity weight is an external environment light intensity weight preset in the database, which indicates the numerical value of the influence of the external environment light intensity on the auxiliary image imaging interference value of the vehicle driving. The external environment humidity weight is an external environment humidity weight preset in the database, which indicates the external environment The numerical value of the influence degree of humidity on the auxiliary image interference value of vehicle driving can be directly used to obtain the preset vehicle vibration amplitude weight, vehicle speed weight, external environment light intensity weight and external environment humidity weight from the database when used. The corresponding relationship can be a pre-set mapping relationship. For example, the vehicle vibration amplitude, vehicle speed, external environment light intensity and external environment humidity are respectively mapped with the vehicle vibration amplitude weight, vehicle speed weight, external environment light intensity weight and external environment humidity weight preset in the database to form a mapping set. The real-time vehicle vibration amplitude, vehicle speed, external environment light intensity and external environment humidity are respectively input into the mapping set to obtain the vehicle vibration amplitude weight, vehicle speed weight, external environment light intensity weight and external environment humidity weight, and the mapping relationship is one-to-one correspondence.

[0106] It should also be noted that in this embodiment, the auxiliary image interference value of vehicle driving is obtained by processing according to the vehicle vibration amplitude, vehicle speed, external environment light intensity and external environment humidity, taking into account the mutual influence between these parameters. For example, the greater the vehicle speed, the greater the vehicle vibration amplitude. A larger vehicle vibration amplitude and vehicle speed will affect the quality of image acquisition. Different external environment light intensities and excessive humidity will affect the performance of the image acquisition equipment. In strong light, overexposure may occur, making the image blurred. In weak light, the image noise will increase, which will also affect the image quality. At the same time, moisture will form water mist on the lens surface, reducing the quality of the image. When processing to obtain the auxiliary image interference value of vehicle driving, it is necessary to fully consider the interaction between these parameters in order to more accurately evaluate the auxiliary image interference value of vehicle driving.

[0107] Based on the auxiliary image presentation quality evaluation value of the vehicle driving and the auxiliary image presentation interference value of the vehicle driving, the auxiliary image comprehensive evaluation index of the vehicle driving is obtained through analysis and processing.

[0108] The comprehensive evaluation index of the auxiliary image for vehicle driving is a numerical result of quantifying the auxiliary image presentation quality evaluation value and the auxiliary image presentation interference value of the auxiliary image for vehicle driving, and is used as a basis for adjusting the auxiliary image acquisition system applicable in real time.

[0109] The comprehensive evaluation index of auxiliary images for vehicle driving is obtained in the following specific process: ,in, It is the comprehensive evaluation index of auxiliary images for vehicle driving. is the evaluation value of the auxiliary image quality of vehicle driving. is the auxiliary image interference value of the vehicle driving, is the auxiliary image quality assessment value weight, is the auxiliary image interference value weight, is a natural constant.

[0110] It should be noted that the auxiliary image presentation quality assessment value weight and the auxiliary image presentation interference value weight both have value ranges between 0 and 1. In this embodiment, the auxiliary image presentation quality assessment value weight is the auxiliary image presentation quality assessment value weight preset in the database, which indicates the numerical value of the influence of the auxiliary image presentation quality assessment value of vehicle driving on the auxiliary image comprehensive assessment index of vehicle driving. The auxiliary image presentation interference value weight is the auxiliary image presentation interference value weight preset in the database, which indicates the numerical value of the influence of the auxiliary image presentation interference value of vehicle driving on the auxiliary image comprehensive assessment index of vehicle driving. When used, it can be directly obtained from The preset auxiliary image presentation quality assessment value weights and auxiliary image presentation interference value weights are obtained from the database, and the corresponding relationship can be a pre-set mapping relationship. For example, the auxiliary image presentation quality assessment value of vehicle driving and the auxiliary image presentation interference value of vehicle driving respectively form a mapping set with the auxiliary image presentation quality assessment value weights and the auxiliary image presentation interference value weights preset in the database, and the real-time auxiliary image presentation quality assessment value of vehicle driving and the auxiliary image presentation interference value of vehicle driving are respectively input into the mapping set to obtain the auxiliary image presentation quality assessment value weights and the auxiliary image presentation interference value weights, wherein the mapping relationship is one-to-one correspondence.

[0111] It should also be noted that in this embodiment, the comprehensive evaluation index of the auxiliary image of vehicle driving is obtained by processing the auxiliary image presentation quality evaluation value of the vehicle driving and the auxiliary image presentation interference value of the vehicle driving, taking into account the mutual influence between these parameters. For example, the larger the auxiliary image presentation interference value of the vehicle driving, the greater the interference of the collected image during the vehicle driving, which will affect the presentation quality of the collected image during the vehicle driving to a certain extent. The size of the imaging quality will affect the auxiliary image presentation quality evaluation value of the vehicle driving. The larger the quality evaluation value, the better the presentation quality of the image collected during the vehicle driving.

[0112] Taking the four different groups of data involved in this embodiment as an example, the weight of the auxiliary image quality evaluation value is defined as 0.7, and the weight of the auxiliary image interference value is defined as 0.3. On the basis of the different auxiliary image quality evaluation values ​​and auxiliary image interference values ​​of vehicle driving, the auxiliary image comprehensive evaluation index of vehicle driving obtained by processing is as follows: Table 1 Comprehensive evaluation index of auxiliary images for vehicle driving Combined with the above table, it can be seen that the comprehensive evaluation index of the auxiliary images of the fourth group of vehicle driving is at the highest value, indicating that compared with other groups, the image presentation quality of the fourth group of auxiliary image acquisition system collected during vehicle driving is better, and the image acquisition is more stable. The comprehensive evaluation index of the auxiliary images of the first group of vehicle driving is at the lowest value, indicating that compared with other groups, the auxiliary image presentation quality evaluation value of its vehicle driving is smaller, while the auxiliary image presentation interference value of vehicle driving is larger, indicating that the first group of auxiliary image acquisition system encountered more interference during vehicle driving, and the collected image presentation quality was also poor, and the auxiliary image acquisition system at this time needs to be further adjusted.

[0113] Extract the comprehensive evaluation threshold of the auxiliary images of vehicle driving stored in the database.

[0114] If the comprehensive evaluation index of the auxiliary images of vehicle driving is greater than or equal to the comprehensive evaluation threshold of the auxiliary images of vehicle driving, the applicable auxiliary image acquisition system will not be adjusted. If the comprehensive evaluation index of the auxiliary images of vehicle driving is less than the comprehensive evaluation threshold of the auxiliary images of vehicle driving, the applicable auxiliary image acquisition system will be adjusted in real time with the preset auxiliary image acquisition system process adjustment parameters.

[0115] It should be understood that if the comprehensive evaluation index of the auxiliary images of vehicle driving is greater than or equal to the comprehensive evaluation threshold of the auxiliary images of vehicle driving, it means that the auxiliary image acquisition system is less disturbed and the collected image presentation quality is high, and no adjustment is required. If the comprehensive evaluation index of the auxiliary images of vehicle driving is less than the comprehensive evaluation threshold of the auxiliary images of vehicle driving, it means that the auxiliary image acquisition system is more disturbed and the collected image presentation quality is poor. In order to ensure the safety of the driving process, further adjustment is required.

[0116] It should be noted that the auxiliary image acquisition system process adjustment parameters are preset parameters for real-time adjustment of the applicable auxiliary image acquisition system when the auxiliary image comprehensive evaluation index of vehicle driving is less than the auxiliary image comprehensive evaluation threshold of vehicle driving. During the system design and development stage, after a large number of experiments and tests, the auxiliary image acquisition system is adjusted differently for different vehicle vibration amplitudes, vehicle speeds, external environment light intensity, external environment humidity, etc., and the adjustment parameter combinations with good effects are recorded to determine the preset auxiliary image acquisition system process adjustment parameters.

[0117] In this embodiment, by making real-time adjustments to the auxiliary image acquisition system for the vehicle, the image acquisition parameters can be dynamically optimized according to changes in driving, ensuring that high-quality auxiliary images can be obtained in various complex situations.

[0118] See also Figure 2 As shown, an embodiment of the present invention provides an auxiliary image analysis method for vehicle safety, comprising the following steps: S1, receiving a vehicle start signal through an on-board electronic control unit, and synchronously starting an auxiliary image acquisition system to perform auxiliary image automatic start verification, to obtain automatic start verification data of the auxiliary image acquisition system.

[0119] S2, according to the automatic startup verification data of the auxiliary image acquisition system, analyze and process to obtain the automatic startup verification judgment result of the auxiliary image acquisition system, perform adaptive adjustment and control on the auxiliary image acquisition system based on the startup verification judgment result, and mark the auxiliary image acquisition system after adaptive adjustment and control as a suitable auxiliary image acquisition system.

[0120] S3, collecting real-time auxiliary images during vehicle driving by using an auxiliary image acquisition system, wherein the real-time auxiliary images include the field of view images of the exterior rearview mirrors on both sides of the vehicle, the forward field of view images on both sides of the vehicle, the image directly in front of the vehicle and the image directly behind the vehicle, and extracting the real-time auxiliary image presentation quality data of the vehicle driving.

[0121] S4, based on the real-time auxiliary image presentation quality data of the vehicle driving, analyzing and processing to obtain the auxiliary image presentation quality evaluation value of the vehicle driving.

[0122] S5, making real-time adjustments to the auxiliary image acquisition system applicable to the vehicle according to the auxiliary image presentation quality evaluation value of the vehicle.

[0123] The present invention provides an auxiliary image analysis system and method for vehicle safety. In the analysis and processing of vehicle auxiliary images, resources can be concentrated to conduct in-depth analysis and processing of vehicle driving image data with greater precision, thereby improving vehicle driving safety and the accuracy of image analysis.

[0124] In a specific embodiment, the system can be applied to the full-vehicle image, reversing image, coupled variable position intelligent rearview mirror image, etc. in the car, and analyze and process the images.

[0125] In terms of full-vehicle imaging, the system collects image data through multiple cameras distributed around the vehicle body. The auxiliary image automatic startup verification module will quickly verify the full-vehicle image acquisition system when the vehicle is started to ensure that each camera can work normally and the acquisition parameters meet the requirements. During the driving process of the vehicle, the real-time auxiliary image acquisition module continuously obtains full-vehicle images and transmits them to the image quality data analysis module. This module will accurately analyze parameters such as image sharpness, brightness, image pixels and signal-to-noise ratio, so that the system can make real-time adjustments to the full-vehicle image acquisition system based on the analysis results. If the vehicle is driving in a strong light environment, the system may automatically reduce the sensitivity of the camera to avoid overexposure of the image. If it is driving in a low-light environment or at night, the system will appropriately increase the sensitivity and may adjust parameters such as contrast and brightness to ensure the clarity and visibility of the full-vehicle image.

[0126] For reversing images, the system immediately starts the relevant verification and acquisition process when the vehicle is engaged in reverse gear. The automatic startup verification data of the reversing image acquisition system includes the startup response time and the image acquisition frame rate. These parameters will be compared and analyzed with the reference data in the database to ensure that the reversing image can be quickly and accurately displayed on the vehicle's central control screen. During the reversing process, the system will dynamically adjust the image acquisition parameters according to the movement of the vehicle and changes in the surrounding environment. For example, when a moving object approaches behind the vehicle, the system will automatically increase the frame rate of the image so that the driver can observe the object's movement trajectory more clearly. At the same time, the contrast and brightness of the image will be fine-tuned to highlight the outline of the object and improve the driver's judgment of the reversing environment.

[0127] The rearview mirror image system is also effectively managed by the system. When the vehicle is started, the auxiliary image automatic start verification module will check the performance parameters and image data of the rearview mirror image acquisition system to ensure that it can work normally and provide clear images. During the driving process of the vehicle, the real-time auxiliary image acquisition module continuously updates the rearview mirror image and hands it over to the image quality data analysis module for evaluation. If the rearview mirror camera may shake slightly due to factors such as wind resistance when the vehicle is driving at high speed, the system will automatically adjust the camera's anti-shake settings by analyzing parameters such as image sharpness and stability, or perform certain digital image processing on the image to eliminate the blurring effect caused by shaking, providing the driver with a stable and clear rearview mirror image to help the driver better observe the traffic conditions on both sides of the vehicle. Similarly, in rainy and snowy weather or driving at night, it can effectively improve the visual effect in different scenarios.

[0128] In addition, the system can also process various camera images in combination. For example, when the vehicle is changing lanes, the system can simultaneously obtain the full vehicle image, rearview mirror image, and possible side auxiliary camera images, and fuse these images to provide the driver with a more comprehensive and three-dimensional view of the vehicle's surroundings. By complementing the advantages of different images, the driver can more accurately judge the distance and position relationship between the vehicle and surrounding objects, thereby improving the safety of lane change operations.

[0129] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0130] The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that technicians in the relevant technical field can understand and use the present invention well. As long as they do not deviate from the structure of the present invention or exceed the scope defined by the present invention, they should all belong to the protection scope of the present invention.

Claims

1. An auxiliary image analysis system for vehicle safety, Features: include: The auxiliary image automatic start verification module is used to receive the vehicle start signal through the vehicle electronic control unit, and synchronously start the auxiliary image acquisition system to perform the auxiliary image automatic start verification, and obtain the automatic start verification data of the auxiliary image acquisition system; The automatic startup verification data analysis module is used to analyze and process the automatic startup verification data of the auxiliary image acquisition system to obtain the automatic startup verification judgment result of the auxiliary image acquisition system, perform adaptive adjustment control on the auxiliary image acquisition system based on the startup verification judgment result, and mark the auxiliary image acquisition system after adaptive adjustment control as a suitable auxiliary image acquisition system; A real-time auxiliary image acquisition module is used to acquire real-time auxiliary images during vehicle driving by using an auxiliary image acquisition system, wherein the real-time auxiliary images include images of the field of view of the exterior rearview mirrors on both sides of the vehicle, images of the forward field of view on both sides of the vehicle, images directly in front of the vehicle, and images directly behind the vehicle, and to extract the image quality data of the real-time auxiliary images of the vehicle driving; An image quality data analysis module is used to analyze and process the image quality data of the auxiliary image of the vehicle driving to obtain an evaluation value of the image quality of the auxiliary image of the vehicle driving; The auxiliary image acquisition system adjustment module is used to make real-time adjustments to the auxiliary image acquisition system of the vehicle according to the auxiliary image presentation quality evaluation value of the vehicle.

2. The auxiliary image analysis system for vehicle safety according to claim 1, Features: Automatic startup verification data of the auxiliary image acquisition system, wherein the automatic startup verification data includes auxiliary image acquisition system performance parameters and auxiliary image presentation data; The auxiliary image acquisition system performance parameters include the startup response time and image acquisition frame rate of the auxiliary image acquisition system; The auxiliary image presentation data includes the resolution of the auxiliary image presentation and the contrast of the auxiliary image presentation.

3. The auxiliary image analysis system for vehicle safety according to claim 2, Features: The analysis and processing obtains the automatic start-up verification and determination result of the auxiliary image acquisition system. The specific analysis process is as follows: Extracting reference automatic start verification data of the auxiliary image acquisition system stored in a database, wherein the reference automatic start verification data includes a defined start response time of the auxiliary image acquisition system, a reference image acquisition frame rate, an auxiliary image presentation defined resolution, and an auxiliary image presentation defined contrast; Based on the automatic start-up verification data of the auxiliary image acquisition system and the reference automatic start-up verification data, a first automatic start-up verification index of the auxiliary image acquisition system is obtained by comprehensive analysis and processing; The first automatic startup verification index of the auxiliary image acquisition system is a numerical result of quantifying the automatic startup verification data of the auxiliary image acquisition system and the reference automatic startup verification data, and is used as a basis for determining the automatic startup verification performance of the auxiliary image acquisition system.

4. The auxiliary image analysis system for vehicle safety according to claim 3, Features: The analysis and processing obtains the automatic start-up verification and determination result of the auxiliary image acquisition system, and the specific process is as follows: Extracting the automatic start verification threshold of the auxiliary image acquisition system preset in the database; If the first automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system, the automatic start verification judgment result of the auxiliary image acquisition system is defined as a normal automatic start; If the first automatic start verification index of the auxiliary image acquisition system is less than the automatic start verification threshold of the auxiliary image acquisition system, the automatic start verification determination result of the auxiliary image acquisition system is defined as abnormal automatic start.

5. The auxiliary image analysis system for vehicle safety according to claim 4, Features: The specific process of adaptively adjusting and controlling the auxiliary image acquisition system based on the startup verification result is as follows: Based on the startup verification judgment result, if the automatic startup verification judgment result of the auxiliary image acquisition system is normal automatic startup, no adaptive adjustment control is performed; If the result of the automatic start-up verification of the auxiliary image acquisition system is determined to be an abnormal automatic start-up, the auxiliary image acquisition system adaptive parameters preset in the database are extracted, the auxiliary image acquisition system is adaptively adjusted for the first time, and after the first adaptive adjustment is performed, the auxiliary image acquisition system is analyzed and processed again to obtain a first automatic start-up verification index of the auxiliary image acquisition system, thereby marking the first automatic start-up verification index of the auxiliary image acquisition system obtained by the re-analysis and processing as a second automatic start-up verification index of the auxiliary image acquisition system; If the second automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system, no adaptive adjustment control is performed, and the auxiliary image acquisition system is marked as an applicable auxiliary image acquisition system; If the second automatic start-up verification index of the auxiliary image acquisition system is less than the automatic start-up verification threshold of the auxiliary image acquisition system, performing difference processing on the second automatic start-up verification index of the auxiliary image acquisition system and the first automatic start-up verification index of the auxiliary image acquisition system to obtain an automatic start-up verification difference of the auxiliary image acquisition system; If the automatic start verification difference of the auxiliary image acquisition system is less than zero, a warning message is generated and uploaded to the vehicle-mounted electronic control unit. If the automatic start verification difference of the auxiliary image acquisition system is greater than or equal to zero, the preset auxiliary image acquisition system adaptive parameters are used for adjustment and control again until the second automatic start verification index of the auxiliary image acquisition system is greater than or equal to the automatic start verification threshold of the auxiliary image acquisition system. The adaptive adjustment and control of the auxiliary image acquisition system is synchronously stopped, and the current auxiliary image acquisition system is marked as an applicable auxiliary image acquisition system.

6. The auxiliary image analysis system for vehicle safety according to claim 1, Features: The real-time auxiliary image quality data of vehicle driving includes the sharpness, brightness, image pixels and signal-to-noise ratio of the auxiliary image of vehicle driving.

7. The auxiliary image analysis system for vehicle safety according to claim 6, Features: The analysis and processing obtains the auxiliary image quality evaluation value of the vehicle driving, and the specific analysis process is as follows: Extracting reference imaging quality data stored in a database, wherein the reference imaging quality data includes reference sharpness, reference brightness, critical image pixels, and reference signal-to-noise ratio; Based on the real-time auxiliary image presentation quality data of the vehicle driving and the reference image presentation quality data, a comprehensive analysis and processing is performed to obtain an auxiliary image presentation quality evaluation value of the vehicle driving; The auxiliary image presentation quality evaluation value of vehicle driving is a numerical result of quantifying the real-time auxiliary image presentation quality data and reference image presentation quality data of vehicle driving, and is used to characterize the image quality collected by the auxiliary image acquisition system during vehicle driving.

8. The auxiliary image analysis system for vehicle safety according to claim 1, Features: The specific process of real-time adjustment of the auxiliary image acquisition system applicable to the vehicle is as follows: The auxiliary image acquisition system is used to obtain the real-time influencing parameters of the auxiliary image presentation, and the auxiliary image presentation interference value of the vehicle driving is obtained through analysis and processing; The real-time influencing parameters of the auxiliary image presentation include vehicle vibration amplitude, vehicle speed, external environment light intensity, and external environment humidity; The auxiliary image interference value of the vehicle driving is a numerical result of quantifying the real-time influencing parameters of the auxiliary image, and is used as a basis for determining the degree of interference to the auxiliary image; Based on the auxiliary image presentation quality evaluation value of the vehicle driving and the auxiliary image presentation interference value of the vehicle driving, the comprehensive evaluation index of the auxiliary image of the vehicle driving is obtained by analysis and processing; The comprehensive evaluation index of the auxiliary image of vehicle driving is a numerical result of quantifying the imaging quality evaluation value of the auxiliary image of vehicle driving and the imaging interference value of the auxiliary image of vehicle driving, and is used as a basis for adjusting the auxiliary image acquisition system in real time; Extracting the comprehensive evaluation threshold of the auxiliary images of vehicle driving stored in the database; If the comprehensive evaluation index of the auxiliary images of vehicle driving is greater than or equal to the comprehensive evaluation threshold of the auxiliary images of vehicle driving, the applicable auxiliary image acquisition system will not be adjusted. If the comprehensive evaluation index of the auxiliary images of vehicle driving is less than the comprehensive evaluation threshold of the auxiliary images of vehicle driving, the applicable auxiliary image acquisition system will be adjusted in real time with the preset auxiliary image acquisition system process adjustment parameters.

9. The auxiliary image analysis system for vehicle safety according to claim 8, Features: The specific acquisition process of the auxiliary image comprehensive evaluation index of vehicle driving is as follows: , in, It is the comprehensive evaluation index of auxiliary images for vehicle driving. is the evaluation value of the auxiliary image quality of vehicle driving. is the auxiliary image interference value of the vehicle driving, is the auxiliary image quality assessment value weight, is the auxiliary image interference value weight, is a natural constant.

10. An auxiliary image analysis method for vehicle safety, Features: The following steps are involved: S1, receiving a vehicle start signal through the vehicle electronic control unit, and synchronously starting the auxiliary image acquisition system to perform auxiliary image automatic start verification, and obtaining automatic start verification data of the auxiliary image acquisition system; S2, analyzing and processing the automatic startup verification data of the auxiliary image acquisition system to obtain the automatic startup verification judgment result of the auxiliary image acquisition system, adaptively adjusting and controlling the auxiliary image acquisition system based on the startup verification judgment result, and marking the auxiliary image acquisition system after the adaptive adjustment and control as a suitable auxiliary image acquisition system; S3, collecting real-time auxiliary images during vehicle driving by using an auxiliary image acquisition system, wherein the real-time auxiliary images include images of the field of view of the exterior rearview mirrors on both sides of the vehicle, images of the forward field of view on both sides of the vehicle, images directly in front of the vehicle, and images directly behind the vehicle, and extracting the image quality data of the real-time auxiliary images of the vehicle driving; S4, analyzing and processing the real-time auxiliary image quality data of the vehicle driving to obtain an auxiliary image quality evaluation value of the vehicle driving; S5, making real-time adjustments to the auxiliary image acquisition system applicable to the vehicle according to the auxiliary image presentation quality evaluation value of the vehicle.

Citation Information

Patent Citations

  • Vehicle image recognition device and method thereof

    CN104424645B

  • Methods, systems, and vehicles for generating panoramic vehicle images

    CN110400255B

  • Double-mode multi-target imaging control method and device in intelligent transportation field

    CN104144290A

  • Unmanned aerial vehicle image acquisition and analysis system based on image analysis

    CN118590639A

  • Vehicle-mounted audio and video security monitoring method

    CN118660230A

Cited By

  • Reversing image optimization and early warning system

    CN119323900A