A method and system for detecting the picture quality of a vehicle-mounted lens

By analyzing the video data of the on-board lens and adjusting the voltage, the problem of on-board lens jitter is solved, the picture quality and the recognition accuracy of the autonomous driving system are improved, and driving safety is ensured.

CN119629332BActive Publication Date: 2025-07-22HENAN YONGTAI OPTOELECTRONICS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411824018.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-12-12
Publication Date
2025-07-22
Estimated Expiration
2044-12-12

AI Technical Summary

Technical Problem

The problem of jitter in the car lens, especially jitter caused by instability in the car voltage, affects the shooting quality and the identification accuracy of the autonomous driving system, and poses safety risks.

Method used

By analyzing the video data captured by the on-board lens, calculating the jitter coefficient and the picture jitter representation value, judging the picture stability, and adjusting the on-board voltage through the decision tree model to reduce jitter, and adjusting the frame rate using the jitter coefficient and voltage influence value.

Benefits of technology

Accurately judge the jitter of the on-board lens screen, reduce or avoid the jitter caused by on-board voltage fluctuations, improve shooting quality, and ensure driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119629332B_ABST
    Figure CN119629332B_ABST
Patent Text Reader

Abstract

The present invention discloses a method and system for detecting the picture quality of a vehicle-mounted lens, including: analyzing the video data captured by the vehicle-mounted lens to determine whether a frame jitter signal is generated; analyzing the number of times the frame jitter signal is generated, the duration of the frame jitter signal, and the jitter coefficient of the frame jitter image corresponding to the frame where the frame jitter signal is generated in consecutive frame images to determine that the picture jitter of the vehicle-mounted lens is relatively severe, that is, generating an unstable signal; based on the unstable signal, analyzing the vehicle-mounted voltage and the jitter coefficient corresponding to the unit time period generated by the consecutive frame images to determine whether the vehicle-mounted voltage affects the picture jitter of the vehicle-mounted lens, and based on the vehicle-mounted voltage influence signal, adjusting the frame rate of the vehicle-mounted lens picture. The present invention adjusts the vehicle-mounted voltage that causes the picture jitter of the vehicle-mounted lens to reduce or avoid the picture jitter caused by the vehicle-mounted voltage fluctuation, which is beneficial to improving the shooting quality of the vehicle-mounted lens picture.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of picture quality detection, and particularly relates to a method and system for detecting the picture quality of a vehicle-mounted lens. Background Art

[0002] A vehicle-mounted lens is an optical device installed on a vehicle to capture visual information outside or inside the vehicle. It is a key component of the vehicle vision system. The vehicle-mounted lens can record information such as road conditions, traffic signs, vehicles, and pedestrians during the vehicle's driving. In the event of a traffic accident or traffic dispute, the video recorded by the vehicle-mounted lens in the driving recorder can serve as important evidence to help restore the truth of the event. The vehicle-mounted lens can also provide visual assistance to the driver, such as displaying the situation behind the vehicle through the rear-view lens when reversing to avoid colliding with obstacles; some advanced vehicle-mounted lenses can also be used in lane keeping assistance systems to remind the driver whether the vehicle deviates from the lane by identifying the lane lines, and conduct real-time monitoring of the vehicle's surrounding environment to detect potential dangers.

[0003] However, in practical applications, the picture of the vehicle-mounted lens is often affected by various factors and jitters. Among them, the instability of the vehicle voltage is an important reason. The fluctuation of the vehicle voltage will cause the power supply of the vehicle-mounted camera to be unstable, thereby affecting the quality of the captured picture and generating picture jitters. Picture jitters will not only reduce the recognition accuracy of the autonomous driving system, but may also cause misjudgment, posing a threat to driving safety.

[0004] Therefore, we propose a method and system for detecting the picture quality of a vehicle-mounted lens. Summary of the Invention

[0005] The purpose of the present invention is to provide a method and system for detecting the picture quality of a vehicle-mounted lens to solve at least one of the above-mentioned prior art problems.

[0006] In the first aspect, the present invention provides a method for detecting the picture quality of a vehicle-mounted lens, including the following steps:

[0007] Step 1: Analyze the video data captured by the vehicle-mounted lens to obtain a jitter coefficient DX. Based on the jitter coefficient DX, determine whether to generate a frame jitter signal;

[0008] Wherein, the video data captured by the vehicle-mounted lens includes consecutive frame images;

[0009] Step 2: Analyze the number of times the frame jitter signal is generated, the duration of the frame jitter signal, and the jitter coefficient of the frame jitter image corresponding to the generated frame jitter signal in the consecutive frame images to obtain a picture jitter characterization value DB. If the picture jitter characterization value DB is greater than or equal to the picture jitter characterization threshold, the picture of the vehicle-mounted lens jitters severely, that is, an unstable signal is generated;

[0010] Step 3: Based on the unstable signal, analyze the vehicle-mounted voltage and jitter coefficient corresponding to each unit time period of consecutive frame images to obtain the vehicle-mounted voltage influence value. Based on the vehicle-mounted voltage influence value, determine whether the vehicle-mounted voltage affects the jitter of the vehicle-mounted camera lens screen, and the influence result includes the vehicle-mounted voltage influence signal;

[0011] Step 4: Based on the vehicle-mounted voltage influence signal, process all slope values in the slope ratio data group to obtain a regulation coefficient. Based on the regulation coefficient, obtain the vehicle-mounted voltage regulation value and adjust the frame rate generated by the vehicle-mounted camera lens screen.

[0012] In a second aspect, the present invention provides a picture quality detection system for a vehicle-mounted camera lens, and the system includes:

[0013] Jitter signal generation module: Analyze the video data captured by the vehicle-mounted camera lens to obtain the jitter coefficient DX. Based on the jitter coefficient DX, determine whether to generate a frame jitter signal;

[0014] Stability judgment module: Analyze the number of times of generating frame jitter signals, the duration of frame jitter signals, and the jitter coefficient of the frame jitter images corresponding to the generation of frame jitter signals in consecutive frame images to obtain the picture jitter characterization value DB. If the picture jitter characterization value DB is greater than or equal to the picture jitter characterization threshold, the jitter of the vehicle-mounted camera lens screen is relatively serious, that is, an unstable signal is generated;

[0015] Influence factor analysis module: Based on the unstable signal, analyze the vehicle-mounted voltage and jitter coefficient corresponding to each unit time period of consecutive frame images to obtain the vehicle-mounted voltage influence value. Based on the vehicle-mounted voltage influence value, determine whether the vehicle-mounted voltage affects the jitter of the vehicle-mounted camera lens screen, and the influence result includes the vehicle-mounted voltage influence signal;

[0016] Influence regulation module: Based on the vehicle-mounted voltage influence signal, process all slope values in the slope ratio data group to obtain a regulation coefficient. Based on the regulation coefficient, obtain the vehicle-mounted voltage regulation value and adjust the frame rate generated by the vehicle-mounted camera lens screen.

[0017] Advantages of the present invention:

[0018] 1. The present invention analyzes the video data captured by the vehicle-mounted camera lens to obtain the jitter coefficient DX. Based on the jitter coefficient DX, determine whether to generate a frame jitter signal; Analyze the number of times of generating frame jitter signals and the duration of frame jitter signals in consecutive frame images to obtain the picture jitter characterization value DB. If the picture jitter characterization value DB is greater than or equal to the picture jitter characterization threshold, the jitter of the vehicle-mounted camera lens screen is relatively serious, that is, an unstable signal is generated; By analyzing the video data captured by the vehicle-mounted camera lens, the present invention can accurately judge the jitter situation of the vehicle-mounted camera lens screen, which is applicable to the situation where the production of the vehicle-mounted camera lens is unqualified. When the picture jitter is serious, an unstable signal is generated in a timely manner.

[0019] 2. Based on the unstable signal, the present invention analyzes the vehicle-mounted voltage corresponding to the time period of consecutive frame images to obtain the vehicle-mounted voltage influence value, and judges whether the vehicle-mounted voltage affects the jitter of the vehicle-mounted camera lens screen based on the vehicle-mounted voltage influence value. The influence results include vehicle-mounted voltage influence signals and non-vehicle-mounted voltage influence signals; based on the vehicle-mounted voltage influence signals, the voltages at each corresponding time point within the time period when the consecutive frame images are generated are obtained, a decision tree model is constructed, and the frame rate of the vehicle-mounted camera lens screen is adjusted; the present invention is also applicable to the situation where the jitter of the vehicle-mounted camera lens screen is caused by abnormal vehicle-mounted voltage. By adjusting the coefficient, the vehicle-mounted voltage that causes the jitter of the vehicle-mounted camera lens screen is adjusted to reduce or avoid the picture jitter caused by the vehicle-mounted voltage fluctuation, which is beneficial to improving the shooting quality of the vehicle-mounted camera lens screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0021] Figure 1 It is a flowchart of a method for detecting the picture quality of a vehicle-mounted camera lens provided in Embodiment 1 of the present invention;

[0022] Figure 2 It is a schematic structural diagram of a system for detecting the picture quality of a vehicle-mounted camera lens provided in Embodiment 2 of the present invention;

[0023] Figure 3 It is a schematic structural diagram of an electronic device provided in the embodiments of the present invention;

[0024] Reference numerals in the drawings: 301, processor; 302, memory; 303, computer program. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0025] In order to enable those skilled in the art to better understand the solution of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0026] Embodiment 1

[0027] Figure 1The following is a flowchart of a method for detecting the picture quality of a vehicle-mounted lens provided in Embodiment 1 of the present invention. The embodiments of the present invention are applicable to the situation of picture jitter of a vehicle-mounted lens. The method for detecting the picture quality of a vehicle-mounted lens can be executed by a system for detecting the picture quality of a vehicle-mounted lens. The system for detecting the picture quality of a vehicle-mounted lens can be implemented by software and hardware, and the system for detecting the picture quality of a vehicle-mounted lens can be configured in a device for detecting the picture quality of a vehicle-mounted lens. Optionally, a device for detecting the picture quality of a vehicle-mounted lens can be an electronic device, and the electronic device can be a notebook, a desktop computer, a smart tablet, etc. The embodiments of the present invention do not limit this.

[0028] As Figure 1 shown, the method for detecting the picture quality of a vehicle-mounted lens provided in the embodiments of the present invention specifically includes the following steps:

[0029] Step 1: Analyze the video data captured by the vehicle-mounted lens to obtain a jitter coefficient DX. Based on the jitter coefficient DX, determine whether to generate a frame jitter signal;

[0030] Among them, the video data captured by the vehicle-mounted lens includes consecutive frame images;

[0031] Obtain the video data captured by the vehicle-mounted lens, use an image processing library such as OpenCV to decode the video data captured by the vehicle-mounted lens, extract the consecutive frame images within a unit time period T, and sequentially label the consecutive frame images as n, where n is 1, 2, 3...;

[0032] A1: Traverse and calculate the image offset degree ratio TPn of adjacent frame images;

[0033] Specifically:

[0034] A11: Take the vertex in the first frame image as the origin to construct a space coordinate system, where the horizontal direction is the X-axis, the vertical direction is the Y-axis, and the Z-axis direction is used to arrange consecutive frame images;

[0035] A12: Divide each frame image into several non-overlapping blocks with equal areas at a unit length e, and sequentially label the blocks as r, where r is 1, 2, 3...; Take the center pixel point of block r as the center coordinate point of block r, and mark the coordinates of block r in the X-Y plane of the space coordinate system as (x (n、r) , y (n、r) );

[0036] A13: Traverse and calculate the offset value PY(n, r) of the same-labeled block r in adjacent two frame images n and n-1;

[0037] Specifically:

[0038]

[0039] It should be noted that the value of n should be greater than 1;

[0040] A14: Sum up the offset values of all blocks in the previous frame image n - 1 and take the average to obtain the block offset average value. Subtract the block offset average value from the block offset value to obtain the relative block offset value. Sum up all the relative block offset values and take the average to obtain the relative block offset average value. Divide the relative block offset average value by the block offset average value to obtain the image offset degree ratio TPn - 1 of the frame image n - 1;

[0041] A2: Calculate the image correlation performance value NCCn of adjacent frame images;

[0042] Specifically including:

[0043] A21: Traverse and calculate the correlation values between the identically - marked blocks r in adjacent frame images n and n - 1 through the normalized cross - correlation calculation formula, including the following steps:

[0044] A211: Construct a block pixel coordinate system. Take the horizontal direction of the block in the frame image as the x - axis and the vertical direction of the block in the frame image as the y - axis. Denote the coordinates of each pixel point in the frame image block r as (i, j);

[0045] A212: Obtain the pixel value of each pixel point in the block r of the frame image n, denoted as B(i (n、r) , j (n、r) ); Then calculate and obtain the pixel average value BJ(n, r) of the pixel points in the block r of the frame image n;

[0046] A213: Through the normalized cross - correlation calculation formula:

[0047]

[0048] Calculate and obtain the block correlation value NCC(n, r) between the identically - marked blocks r in adjacent frame images;

[0049] A22: Sum up all the block correlation values in adjacent frame images and take the average to obtain the adjacent frame image correlation performance value NCCn;

[0050] Perform data processing on the correlation value NCCn and the image offset degree ratio TP through the formula: Calculate and obtain the jitter coefficient DX of adjacent frame images;

[0051] Compare the jitter coefficient DX with the jitter coefficient threshold:

[0052] If the jitter coefficient DX is less than or equal to the jitter coefficient threshold, mark the first frame image in the adjacent two frame images as the frame jitter image, and the frame jitter image correspondingly generates a frame jitter signal;

[0053] If the jitter coefficient DX is greater than the jitter coefficient threshold, the first frame image in two adjacent frame images is marked as a non-frame jitter image, and a non-frame jitter signal is generated corresponding to the non-frame jitter image;

[0054] Step 2: Analyze the number of times of generating the frame jitter signal, the duration of the frame jitter signal, and the jitter coefficient of the frame jitter image corresponding to generating the frame jitter signal in the continuous frame images to obtain the picture jitter characterization value DB. If the picture jitter characterization value DB is greater than or equal to the picture jitter threshold, the vehicle-mounted camera picture jitters severely, that is, an unstable signal is generated;

[0055] Obtain the number of times of generating the frame jitter signal in the continuous frame images, and perform a ratio process on it and the number of continuous frame images to obtain the frame jitter times ratio DC;

[0056] Mark the time period when the frame jitter signal appears as the frame jitter time period, obtain the duration corresponding to the frame jitter time period to get the frame jitter duration, perform a summation process on all the jitter durations, output the total jitter duration, and perform a ratio process on the total jitter duration and the total duration corresponding to the continuous frame images to obtain the jitter duration ratio DS;

[0057] It should be noted that the duration corresponding to the generation time of a single frame jitter signal is the duration of the frame jitter signal;

[0058] Obtain the difference between the jitter coefficient of the frame jitter image corresponding to generating the frame jitter signal and the jitter coefficient threshold to get the jitter deviation value. Perform a summation and averaging process on the jitter deviation values of all the frame jitter images in the continuous frame images to obtain the jitter deviation average value of the vehicle-mounted camera picture, and perform a ratio process on the jitter deviation average value and the jitter coefficient threshold to obtain the jitter degree ratio DD;

[0059] Perform data processing on the frame jitter times ratio DC, the jitter duration ratio DS, and the jitter degree ratio DD through the formula: Calculate the picture jitter characterization value DB of the continuous frame images, where s1, s2, and s3 are all preset proportionality coefficients, s1 takes the value of 1.022, s2 takes the value of 1.145, and s3 takes the value of 1.231;

[0060] It should be noted that the screen jitter characterization value DB is obtained by processing data on the frame jitter count ratio DC, the jitter duration ratio DS, and the jitter degree ratio DD. Among them, the frame jitter count ratio CC reflects the number of times a frame jitter signal is generated in consecutive frame images. The more times a frame jitter signal is generated in consecutive frame images, the greater the likelihood that the consecutive frame images are severely jittery; the jitter duration ratio DS reflects the duration of the frame jitter signal generated in consecutive frame images. The longer the duration of the frame jitter signal generated in consecutive frame images, the greater the likelihood that the consecutive frame images are severely jittery; the jitter degree ratio DD reflects the deviation degree between the jitter coefficient corresponding to the generation of the frame jitter signal in consecutive frame images and the jitter coefficient threshold. The greater the deviation degree, the greater the likelihood that the consecutive frame images are severely jittery;

[0061] Compare the screen jitter characterization value DB with the screen jitter characterization threshold:

[0062] If the screen jitter characterization value DB is less than the screen jitter characterization threshold, it indicates that the screen jitter of the vehicle-mounted lens is relatively light, that is, a stable signal is generated;

[0063] If the screen jitter characterization value DB is greater than or equal to the screen jitter characterization threshold, the screen jitter of the vehicle-mounted lens is relatively severe, that is, an unstable signal is generated;

[0064] The technical solution of the embodiment of the present invention is mainly: analyze the video data captured by the vehicle-mounted lens to obtain the jitter coefficient DX, and based on the jitter coefficient DX, determine whether to generate a frame jitter signal; analyze the number of times the frame jitter signal is generated and the duration of the frame jitter signal in consecutive frame images to obtain the screen jitter characterization value DB. If the screen jitter characterization value DB is greater than or equal to the screen jitter characterization threshold, the screen jitter of the vehicle-mounted lens is relatively severe, that is, an unstable signal is generated; through the analysis of the video data captured by the vehicle-mounted lens, the present invention can accurately judge the jitter situation of the vehicle-mounted lens screen, which is applicable to the situation where the production of the vehicle-mounted lens is unqualified. When the screen jitter is severe, an unstable signal is generated in a timely manner.

[0065] Embodiment Two

[0066] On the basis of Embodiment 1, please refer to Figure 1 As shown, when an unstable signal appears in the vehicle-mounted lens screen, it may be caused by unstable vehicle-mounted voltage. A method for detecting the picture quality of a vehicle-mounted lens according to an embodiment of the present invention further includes the following steps:

[0067] Step Three: Based on the unstable signal, analyze the vehicle-mounted voltage and the jitter coefficient corresponding to the consecutive frame images in a unit time period to obtain the vehicle-mounted voltage influence value, and judge whether the vehicle-mounted voltage affects the screen jitter of the vehicle-mounted lens based on the vehicle-mounted voltage influence value. The influence results include a vehicle-mounted voltage influence signal and a non-vehicle-mounted voltage influence signal;

[0068] Obtain the vehicle-mounted voltage and jitter coefficient corresponding to a unit time period from consecutive frame images, and mark them in the X-Y coordinate system respectively. Connect all the marked points of the vehicle-mounted voltage to obtain a broken line of vehicle-mounted voltage change. Connect all the marked points of the jitter coefficient to obtain a broken line of jitter coefficient change;

[0069] Draw a straight line parallel to the x-axis through the marked point of the rated vehicle-mounted voltage and mark it as the vehicle-mounted voltage limit line;

[0070] Obtain all the curve segments where the vehicle-mounted voltage change curve is higher than the vehicle-mounted voltage limit line, mark them as out-of-bounds curves, and obtain the corresponding time periods on the X-axis of the out-of-bounds curves to get the out-of-bounds time periods;

[0071] Perform coincidence analysis on the out-of-bounds time periods and the frame jitter time periods, obtain the coincidence time periods between the out-of-bounds time periods and the frame jitter time periods, and sum up the durations corresponding to all the coincidence time periods to get the coincidence duration;

[0072] Perform a ratio process on the coincidence duration and the total duration corresponding to the consecutive frame images to get the coincidence duration ratio, and mark it as CH;

[0073] It should be noted that there is a corresponding time period when frame jitter images are generated in consecutive frame images;

[0074] Based on the coincidence time periods, divide the coincidence time periods into several time points with equal time lengths;

[0075] Respectively obtain the sub-broken line of vehicle-mounted voltage change and the sub-broken line of jitter coefficient change corresponding between two adjacent time points, and integrate the obtained sub-broken line of vehicle-mounted voltage change and the sub-broken line of jitter coefficient change into a sub-broken line group;

[0076] Among them, the sub-broken line of vehicle-mounted voltage change is the connection line between two adjacent marked points of vehicle-mounted voltage values in the broken line of vehicle-mounted voltage change, and the sub-broken line of jitter coefficient change is the connection line between two adjacent marked points of jitter coefficients in the broken line of jitter coefficient change;

[0077] Respectively obtain the slopes of the sub-broken line of vehicle-mounted voltage change and the sub-broken line of jitter coefficient change in the sub-broken line group, and perform a ratio process on them to get the slope ratio of the sub-broken line group;

[0078] Integrate the slope ratios corresponding to all sub-broken line groups into a slope ratio data group, calculate the variance of the slope ratios in the slope ratio data group to get the change synchronization value, and mark it as FC;

[0079] Perform data processing on the obtained change synchronization value FC and the coincidence duration ratio CH, through the formula: Calculate the vehicle-mounted voltage influence value CYx, where c1 and c2 are both preset proportionality coefficients, c1 takes the value of 1.268, and c2 takes the value of 1.989;

[0080] Compare the vehicle-mounted voltage influence value with the vehicle-mounted voltage influence value threshold:

[0081] If the vehicle-mounted voltage influence value is greater than or equal to the vehicle-mounted voltage influence value threshold, it indicates that the vehicle-mounted voltage has a greater impact on the jitter of the vehicle-mounted camera lens image, and a vehicle-mounted voltage influence signal is generated;

[0082] If the vehicle-mounted voltage influence value is less than the vehicle-mounted voltage influence value threshold, it indicates that the vehicle-mounted voltage has a smaller impact on the jitter of the vehicle-mounted camera lens image, and further analysis is required for other factors affecting the quality of the vehicle-mounted camera lens image;

[0083] Step 4: Based on the vehicle-mounted voltage influence signal, process all the slope values in the slope ratio data group to obtain a regulation coefficient. Based on the regulation coefficient, obtain the vehicle-mounted voltage regulation value, and adjust the frame rate generated by the vehicle-mounted camera lens image;

[0084] Sum up and average all the slope values in the slope ratio data group to obtain the regulation coefficient;

[0085] Continuously monitor the video frames of the vehicle-mounted camera lens image to obtain a jitter coefficient;

[0086] Compare the jitter coefficient with the jitter coefficient threshold:

[0087] If the jitter coefficient is greater than or equal to the jitter coefficient threshold, subtract the corresponding jitter coefficient from the jitter coefficient threshold to obtain a jitter coefficient deviation value, and multiply the regulation coefficient by the jitter coefficient deviation value to obtain the vehicle-mounted voltage regulation value;

[0088] If the jitter coefficient is less than the jitter coefficient, no processing is performed.

[0089] The technical solution of the embodiment of the present invention is mainly: based on the unstable signal, analyze the vehicle-mounted voltage corresponding to the time period when the continuous frame images are generated to obtain the vehicle-mounted voltage influence value. Based on the vehicle-mounted voltage influence value, judge whether the vehicle-mounted voltage has an impact on the jitter of the vehicle-mounted camera lens image, and the influence results include the vehicle-mounted voltage influence signal and the non-vehicle-mounted voltage influence signal; based on the vehicle-mounted voltage influence signal, obtain the voltages at each corresponding time point during the time period when the continuous frame images are generated, construct a decision tree model, and adjust the frame rate generated by the vehicle-mounted camera lens image; the present invention is also applicable to the situation where the vehicle-mounted camera lens image jitters due to abnormal vehicle-mounted voltage. By adjusting the coefficient, the vehicle-mounted voltage that causes the vehicle-mounted camera lens image to jitter is adjusted to reduce or avoid the image jitter caused by the vehicle-mounted voltage fluctuation, which is beneficial to improving the shooting quality of the vehicle-mounted camera lens image.

[0090] Embodiment 3

[0091] Based on Embodiment 1, please refer to Figure 2 As shown, a picture quality detection system for a vehicle-mounted lens according to an embodiment of the present invention further includes the following steps:

[0092] Jitter signal generation module: Analyze the video data captured by the vehicle-mounted lens to obtain a jitter coefficient DX. Based on the jitter coefficient DX, determine whether to generate a frame jitter signal;

[0093] Stability judgment module: Analyze the number of times of generating frame jitter signals, the duration of frame jitter signals, and the jitter coefficients of frame jitter images corresponding to the frames generating frame jitter signals in consecutive frame images to obtain a picture jitter characterization value DB. If the picture jitter characterization value DB is greater than or equal to the picture jitter characterization threshold, the picture of the vehicle-mounted lens jitters severely, that is, an unstable signal is generated;

[0094] Influence factor analysis module: Based on the unstable signal, analyze the vehicle-mounted voltage and jitter coefficient corresponding to a unit time period of consecutive frame images to obtain a vehicle-mounted voltage influence value. Based on the vehicle-mounted voltage influence value, determine whether the vehicle-mounted voltage affects the picture jitter of the vehicle-mounted lens. The influence result includes a vehicle-mounted voltage influence signal;

[0095] Influence regulation module: Based on the vehicle-mounted voltage influence signal, process all slope values in the slope ratio data group to obtain a regulation coefficient. Based on the regulation coefficient, obtain a vehicle-mounted voltage regulation value and adjust the frame rate generated by the picture of the vehicle-mounted lens.

[0096] Embodiment Four

[0097] Refer to Figure 3 , an embodiment of the present invention further provides a computer device 3, including: a memory 302, a processor 301, and a computer program 303 stored on the memory 302. When the computer program 303 is executed on the processor 301, it implements a picture quality detection method for a vehicle-mounted lens as described in any one of the above methods.

[0098] The computer device 3 may be a computing device such as a desktop computer, a notebook, a palm computer, and a cloud server. The computer device 3 may include, but is not limited to, a processor 301 and a memory 302. Those skilled in the art can understand that

[0099] Figure 3 merely examples of the computer device 3 do not constitute a limitation on the computer device 3, and may include more or fewer components than shown in the figure, or combine some components, or different components. For example, it may also include input / output devices, network access devices, etc.

[0100] The so-called processor 301 may be a Central Processing Unit (CPU), and this processor 301 may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or this processor may also be any conventional processor, etc.

[0101] In some embodiments, the memory 302 may be an internal storage unit of the computer device 3, such as the hard disk or memory of the computer device 3. In some other embodiments, the memory 302 may also be an external storage device of the computer device 3, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, Flash Card, etc. equipped on the computer device 3. Further, the memory 302 may also include both the internal storage unit and the external storage device of the computer device 3. The memory 302 is used to store an operating system, application programs, a Boot Loader, data, and other programs, such as the program code of the computer program, etc. The memory 302 may also be used to temporarily store data that has been output or is to be output.

[0102] Embodiment Five

[0103] The embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is run by a processor, it implements a method for detecting the picture quality of an in-vehicle lens as described in any one of the above methods.

[0104] In this embodiment, if the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, to implement all or part of the processes in the method of the above embodiment in this application, a computer program can be used to instruct the relevant hardware to complete. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of the above method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file or some intermediate form, etc. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the photographing device / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal, and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk, or an optical disc, etc. In some jurisdictions, according to legislation and patent practice, the computer-readable medium cannot be an electrical carrier signal and a telecommunication signal.

[0105] In the above embodiments, the descriptions of the various embodiments have their own emphases. For the parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0106] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0107] In the embodiments disclosed in this application, it should be understood that the disclosed device / terminal device and method can be implemented in other ways. For example, the device / terminal device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of the devices or units can be in electrical, mechanical or other forms.

[0108] The unit described as a separation component may or may not be physically separated. The component shown as a unit may or may not be a physical unit, that is, it may be located in one place or distributed across multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0109] The above formulas are all dimensionless and take their numerical values for calculation. The formulas are obtained by collecting a large amount of data for software simulation to get a formula closest to the actual situation. The preset parameters in the formulas are set by those skilled in the art according to the actual situation.

[0110] The above has described in detail an embodiment of the present invention, but the content described is only a preferred embodiment of the present invention and cannot be considered as limiting the scope of implementation of the present invention. All equivalent changes and improvements made within the scope of the application of the present invention should still fall within the scope covered by the patent of the present invention.

Claims

1. A method for detecting the picture quality of a vehicle-mounted lens, characterized in that It includes the following steps: Step 1: Analyze the video data captured by the vehicle-mounted camera to obtain the jitter coefficient DX. Based on the jitter coefficient DX, determine whether to generate a frame jitter signal; Among them, the video data captured by the vehicle-mounted camera includes consecutive frame images; Step 2: Analyze the number of times the frame jitter signal is generated, the duration of the frame jitter signal, and the jitter coefficient of the frame jitter image corresponding to the generated frame jitter signal in the consecutive frame images to obtain the picture jitter characterization value DB. If the picture jitter characterization value DB is greater than or equal to the picture jitter threshold, the picture of the vehicle-mounted camera jitters severely, that is, an unstable signal is generated; Step 3: Based on the unstable signal, analyze the vehicle-mounted voltage and the jitter coefficient corresponding to the consecutive frame images in a unit time period to obtain the vehicle-mounted voltage influence value. Based on the vehicle-mounted voltage influence value, determine whether the vehicle-mounted voltage affects the picture jitter of the vehicle-mounted camera, and the influence result includes the vehicle-mounted voltage influence signal; Step 4: Based on the vehicle-mounted voltage influence signal, process all the slope values in the slope ratio data group to obtain the regulation coefficient. Based on the regulation coefficient, obtain the vehicle-mounted voltage regulation value and adjust the frame rate generated by the picture of the vehicle-mounted camera; The acquisition method of the slope ratio data group is as follows: Respectively obtain the slopes of the vehicle-mounted voltage change sub-fold line and the jitter coefficient change sub-fold line in the sub-fold line group, and perform ratio processing on them to obtain the slope ratio of the sub-fold line group; Integrate the slope ratios corresponding to all sub-fold line groups into a slope ratio data group.

2. The method for detecting the picture quality of a vehicle-mounted lens according to claim 1, characterized in that, The acquisition method of the jitter coefficient DX is as follows: Obtain the video data captured by the vehicle-mounted camera and analyze to obtain the image correlation performance value NCCn and the image offset degree ratio TP of adjacent frame images; Perform data processing on the relevant value NCCn and the image offset degree ratio TP through the formula: Calculate the jitter coefficient DX of adjacent frame images.

3. The method for detecting the picture quality of a vehicle-mounted lens according to claim 2, characterized in that, The acquisition method of the image offset degree ratio TP of adjacent frame images is as follows: Take the vertex in the first frame image as the origin to construct a spatial coordinate system, where the horizontal direction is the X-axis, the vertical direction is the Y-axis, and the Z-axis direction is used to arrange consecutive frame images; Divide each frame of the image into a number of non-overlapping blocks with equal area at unit length e, and sequentially label the blocks as r, where r is 1, 2, 3...; take the central pixel point of block r as the central coordinate point of block r, and label the coordinates of block r in the X-Y plane of the spatial coordinate system as (x (n、r) , y (n、r) ), Traverse and calculate the offset value PY(n, r) of the same marked block r in adjacent two frame images n and n - 1; Sum and average the offset values of all blocks in the previous frame image n - 1 to obtain the block offset average value. Subtract the block offset value from the block offset average value to obtain the block relative offset value. Sum and average all the block relative offset values to obtain the block relative offset average value. Perform ratio processing on the block relative offset average value and the block offset average value to obtain the image offset degree ratio TPn - 1 of the frame image n - 1.

4. A method for detecting the picture quality of a vehicle-mounted lens according to claim 3, characterized in that, The acquisition method of the image correlation performance value NCCn of adjacent frame images is as follows: Traverse and calculate the correlation values between the same marked blocks r in adjacent frame images n and n - 1 through the normalized cross-correlation calculation formula, including the following steps: Construct a block pixel point coordinate system, with the horizontal direction of the block in the frame image as the x-axis and the vertical direction of the block in the frame image as the y-axis, and record the coordinates of each pixel point in the frame image block r as (i, j); Obtain the pixel value of each pixel in block r of frame image n, denoted as B(i (n、r) , j (n、r) ); then calculate the pixel mean BJ(n, r) of the pixels in block r of frame image n; Through the normalized cross-correlation calculation formula: Calculate and obtain the block correlation value NCC(n, r) between the same marked blocks r in adjacent frame images; Sum and average all the block correlation values in the adjacent frame images to obtain the adjacent frame image correlation performance value NCCn.

5. A method for detecting the picture quality of a vehicle-mounted lens according to claim 1, characterized in that The method for obtaining the screen jitter characterization value DB of the continuous frame images is as follows: Obtain the number of times of generating frame jitter signals, the time periods when the frame jitter signals appear, and the jitter coefficients of the frame jitter images corresponding to the frame jitter signals in the continuous frame images, and analyze to obtain the frame jitter times ratio DC, the jitter duration ratio DS, and the jitter degree ratio DD; Perform data processing on the frame jitter count ratio DC, the jitter duration ratio DS, and the jitter degree ratio DD. Through the formula: Calculate the frame jitter characterization value DB of consecutive frame images. Among them, s1, s2, and s3 are all preset proportionality coefficients. The value of s1 is 1.022, the value of s2 is 1.145, and the value of s3 is 1.

231.

6. The method for detecting the picture quality of a vehicle-mounted lens according to claim 5, characterized in that, The methods for obtaining the frame jitter times ratio DC, the jitter duration ratio DS, and the jitter degree ratio DD are as follows: Obtain the number of times of generating frame jitter signals in the continuous frame images, and perform a ratio process on it and the number of continuous frame images to obtain the frame jitter times ratio DC; Mark the time periods when the frame jitter signals appear as frame jitter time periods, obtain the corresponding durations of the frame jitter time periods to get the frame jitter durations, sum up all the jitter durations, output the total jitter duration, and perform a ratio process on the total jitter duration and the total duration corresponding to the continuous frame images to obtain the jitter duration ratio DS; Perform a difference process on the jitter coefficient of the frame jitter image corresponding to the frame jitter signal and the jitter coefficient threshold to obtain the jitter deviation value, sum up and take the average of the jitter deviation values of all the frame jitter images in the continuous frame images to obtain the jitter deviation average value of the in-vehicle lens screen, and perform a ratio process on the jitter deviation average value and the jitter coefficient threshold to obtain the jitter degree ratio DD.

7. A method for detecting the picture quality of a vehicle-mounted lens according to claim 5, characterized in that, The method for obtaining the in-vehicle voltage influence value CYx is as follows: Obtain the in-vehicle voltage and the jitter coefficient corresponding to a unit time period of the continuous frame images, respectively construct an in-vehicle voltage change broken line and a jitter coefficient change broken line, and analyze the in-vehicle voltage change broken line and the jitter coefficient change broken line to obtain the change synchronization value FC and the coincidence duration ratio CH; The method for obtaining the change synchronization value FC is as follows: Perform a variance calculation on the slope ratios in the slope ratio data group to obtain the change synchronization value, and mark it as FC; Perform data processing on the obtained change synchronization value FC and the coincidence duration ratio CH through the formula: Calculate the vehicle-mounted voltage influence value CYx, where c1 and c2 are both preset proportionality coefficients, c1 takes the value of 1.268, and c2 takes the value of 1.

989.

8. A method for detecting the picture quality of a vehicle-mounted lens according to claim 1, characterized in that, The method for obtaining the in-vehicle voltage regulation value is as follows: Sum up and take the average of all the slope values in the slope ratio data group to obtain the regulation coefficient; Continuously monitor the video frames of the in-vehicle lens screen to obtain the jitter coefficient; Compare the jitter coefficient with the jitter coefficient threshold: If the jitter coefficient is greater than or equal to the jitter coefficient threshold, perform a difference process on the corresponding jitter coefficient and the jitter coefficient threshold to obtain the jitter coefficient deviation value, and perform a product process on the regulation coefficient and the jitter coefficient deviation value to obtain the in-vehicle voltage regulation value; If the jitter coefficient is less than the jitter coefficient, no processing is performed.

9. A picture quality detection system for a vehicle-mounted lens, characterized in that, This system is used to execute the method described in any one of claims 1-8 above. This system includes: Jitter signal generation module: Analyze the video data captured by the in-vehicle lens to obtain the jitter coefficient DX, and based on the jitter coefficient DX, determine whether to generate a frame jitter signal; Stability judgment module: Analyze the number of times of generating frame jitter signals, the duration of the frame jitter signals, and the jitter coefficients of the frame jitter images corresponding to the frame jitter signals in the continuous frame images to obtain the screen jitter characterization value DB. If the screen jitter characterization value DB is greater than or equal to the screen jitter characterization threshold, the in-vehicle lens screen jitters severely, that is, an unstable signal is generated; Influence factor analysis module: Based on the unstable signal, analyze the vehicle-mounted voltage and jitter coefficient corresponding to the continuous frame images in a unit time period to obtain the vehicle-mounted voltage influence value. Based on the vehicle-mounted voltage influence value, judge whether the vehicle-mounted voltage affects the jitter of the vehicle-mounted camera lens screen. The influence result includes the vehicle-mounted voltage influence signal; Influence regulation module: Based on the vehicle-mounted voltage influence signal, process all the slope values in the slope ratio data group to obtain the regulation coefficient. Based on the regulation coefficient, obtain the vehicle-mounted voltage regulation value and adjust the frame rate generated by the vehicle-mounted camera lens screen; The acquisition method of the slope ratio data group is as follows: Respectively obtain the slopes of the vehicle-mounted voltage change sub-fold line and the jitter coefficient change sub-fold line in the sub-fold line group, and perform ratio processing on them to obtain the slope ratio of the sub-fold line group; Integrate the slope ratios corresponding to all sub-fold line groups into a slope ratio data group.

Citation Information

Patent Citations

  • Display method of display apparatus, display apparatus and virtual reality VR system

    CN106960645A

  • Lens jitter compensation method and device, electronic equipment and storage medium

    CN117241141A