Adjustment method and device of vehicle around view system, electronic equipment and storage medium

Abstract

The invention relates to the technical field of vehicles, and discloses an adjustment method and device of a vehicle surround view system, electronic equipment and a storage medium, the surround view system comprises image acquisition equipment, and the method comprises the following steps: according to environment parameters and vehicle parameters, determining a preset comparison threshold of different types of image parameters, and determining adjustment parameters of the image acquisition equipment; adjusting the image acquisition equipment according to the adjustment parameters, and performing anomaly comparison on image parameters acquired by the image acquisition equipment according to each preset comparison threshold to determine image anomaly parameters; and determining an adjustment strategy corresponding to the image acquisition equipment according to the image abnormal parameter so as to adjust the image acquisition equipment. According to the invention, under the condition that the image abnormal parameters are determined according to the preset comparison threshold value, the image acquisition equipment is finely adjusted, so that the accuracy of the data acquired by the image acquisition equipment is improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to an adjustment method, device, electronic device and storage medium for a vehicle surround view system. Background Art

[0002] With the development of vehicle autonomous driving technology, the vehicle surround view system has become an important component of assisted autonomous driving. It relies on fixed fault detection methods and cannot be applied to different scenarios. Especially when the scene changes, the image acquisition equipment in the vehicle surround view system cannot be adaptively adjusted, resulting in low accuracy of the collected data. Summary of the invention

[0003] In view of the above problems, the present application provides a method, device, electronic device and storage medium for adjusting a vehicle surround view system, which are used to adaptively adjust an image acquisition device in the surround view system.

[0004] According to one aspect of the present application, there is provided an adjustment method for a vehicle surround view system, the surround view system comprising an image acquisition device, the adjustment method comprising: determining preset comparison thresholds for different types of image parameters according to environmental parameters and vehicle parameters, and determining adjustment parameters for the image acquisition device; adjusting the image acquisition device according to the adjustment parameters, and performing an abnormality comparison on the image parameters acquired by the image acquisition device according to each preset comparison threshold to determine image abnormality parameters; and determining an adjustment strategy corresponding to the image acquisition device according to the image abnormality parameters to adjust the image acquisition device.

[0005] In an optional manner, the adjustment parameters include defog parameters and anti-shake parameters; adjusting the image acquisition device according to the adjustment parameters includes: defogging the image acquisition device according to the defog parameters, and anti-shake processing the image acquisition device according to the anti-shake parameters; wherein the defog parameters are parameters determined based on the ambient humidity parameters in the environmental parameters, and the anti-shake parameters are parameters determined based on the vehicle shake parameters in the vehicle parameters.

[0006] In an optional manner, the vehicle shaking parameters include a vehicle shaking angle, and the vehicle shaking angle includes a current vehicle shaking angle and an adjacent historical vehicle shaking angle, and the adjacent historical vehicle shaking angle is a vehicle shaking angle collected at an adjacent historical moment of the current moment; the adjustment method also includes: if the current vehicle shaking angle and the adjacent historical vehicle shaking angle both exceed the preset shaking angle, then generating an anti-shake function activation instruction; wherein, the activation instruction includes the anti-shake parameters.

[0007] In an optional manner, the defog parameters include the current defog start time; the adjustment method also includes: calculating the current humidity value based on the historical ambient humidity parameters and the current ambient humidity parameters; determining the initial defog start time based on the current humidity value, and correcting the initial defog start time based on the historical defog start time to obtain the current defog start time.

[0008] In an optional manner, the environmental parameters include environmental lighting parameters, environmental weather parameters, and environmental temperature parameters; the vehicle parameters include vehicle driving status; and the preset comparison thresholds of different types of image parameters are determined based on the environmental parameters and vehicle parameters, including: determining a preset comparison threshold of the image frame rate based on the vehicle driving status; determining a preset comparison threshold of the exposure gain of the image acquisition device based on the environmental lighting parameters; determining a preset comparison threshold of the image contrast and a preset comparison threshold of the image sharpness based on the environmental weather parameters; and determining a preset comparison threshold of the image resolution based on the environmental temperature parameters.

[0009] In an optional manner, determining the adjustment strategy corresponding to the image acquisition device based on the image abnormality parameters includes: if the image abnormality parameters include exposure gain, determining a first sub-adjustment strategy for adjusting the frame rate parameters of the image acquisition device, and a second sub-adjustment strategy for adjusting the contrast parameters of the image acquisition device; if the image abnormality parameters include resolution, determining a third sub-adjustment strategy for adjusting the frame rate parameters, and a fourth sub-adjustment strategy for adjusting the sharpness parameters of the image acquisition device.

[0010] In an optional manner, the adjustment method also includes: sending a preset number of test data to the image acquisition device to receive feedback information returned by the image acquisition device in response to the target test data; wherein the feedback information includes a target number of the image acquisition device in response to the target test data; based on the target number and the preset number, calculating the data loss rate of the image acquisition device; if the data loss rate exceeds the preset loss rate, it indicates that the image acquisition device has a communication abnormality.

[0011] According to another aspect of the present application, there is provided an adjustment device for a vehicle surround view system, wherein the surround view system includes an image acquisition device, and the adjustment device includes: a determination module, which determines preset comparison thresholds of different types of image parameters and determines adjustment parameters of the image acquisition device according to environmental parameters and vehicle parameters; a comparison module, which adjusts the image acquisition device according to the adjustment parameters and performs an abnormality comparison on the image parameters acquired by the image acquisition device according to each preset comparison threshold to determine abnormal image parameters; and an adjustment module, which determines an adjustment strategy corresponding to the image acquisition device according to the abnormal image parameters to adjust the image acquisition device.

[0012] According to one aspect of the present application, an electronic device is provided, including: a controller; and a memory for storing one or more programs, wherein when the one or more programs are executed by the controller, the above-mentioned adjustment method is executed.

[0013] According to one aspect of the present application, a computer-readable storage medium is also provided, on which computer-readable instructions are stored. When the computer-readable instructions are executed by a processor of a computer, the computer executes the above-mentioned adjustment method.

[0014] According to one aspect of the present application, a computer program product or a computer program is also provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the above-mentioned adjustment method.

[0015] The present application determines multiple preset comparison thresholds applicable to the image acquisition device in the current scene based on environmental parameters and vehicle parameters, and performs preliminary debugging of the image acquisition device; when the image abnormality parameters are determined according to the preset comparison thresholds, the image acquisition device is fine-tuned to improve the accuracy of the data collected by the image acquisition device.

[0016] The above description is only an overview of the technical solution of the embodiment of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 It is a flowchart of a method for adjusting a vehicle surround view system shown in an exemplary embodiment of the present application.

[0019] Figure 2 is based on Figure 1 The exemplary embodiment shown is a schematic flow chart of another method for adjusting a vehicle surround view system.

[0020] Figure 3 is based on Figure 1 The exemplary embodiment shown is a schematic flow chart of another method for adjusting a vehicle surround view system.

[0021] Figure 4 It is a schematic diagram of an application scenario of the adjustment method of the vehicle surround view system of the present application.

[0022] Figure 5 1 is a schematic diagram of the structure of an adjustment device for a vehicle surround view system shown in an exemplary embodiment of the present application.

[0023] Figure 6 It is a structural diagram of a computer system of an electronic device shown in an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0024] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are only examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.

[0025] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0026] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0027] The term "multiple" as used in this application refers to two or more than two. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects are in an "or" relationship.

[0028] Image acquisition equipment is an important component in the vehicle surround view system. Related technologies use fixed fault detection methods to detect faults, which has poor scene adaptability, resulting in low accuracy of data collected by the image acquisition equipment.

[0029] To this end, one aspect of the present application provides a method for adjusting a vehicle surround view system. Figure 1 , Figure 1 1 is a flow chart of an exemplary embodiment of the present application showing a method for adjusting a vehicle surround view system. The adjustment method at least includes S110 to S130; wherein the surround view system includes an image acquisition device, which is described in detail as follows:

[0030] S110: Determine preset comparison thresholds of different types of image parameters and determine adjustment parameters of the image acquisition device according to the environmental parameters and the vehicle parameters.

[0031] Environmental parameters represent relevant parameters of the surrounding environment of the vehicle. For example: ambient light parameters, ambient weather parameters, ambient temperature parameters, ambient humidity parameters, etc. This embodiment does not limit the number of parameters represented and the specific parameters covered. In some embodiments, environmental parameters can be instantaneous parameters, such as environmental parameters at the current moment and environmental parameters at historical moments, so as to be applied to real-time changing scenes and better determine preset comparison thresholds applicable to different scenes.

[0032] Vehicle parameters represent vehicle-related parameters, which can be parameters collected or calculated by vehicle-related components. For example: vehicle speed, engine speed, motor speed, vehicle vibration parameters, etc. In some embodiments, vehicle parameters include but are not limited to instantaneous parameters, such as instantaneous vehicle speed, instantaneous acceleration, etc., so as to be applied to real-time changing scenes to better determine preset comparison thresholds applicable to different scenes.

[0033] The adjustment parameters in this step are parameters used for initial debugging of the image acquisition device, so that the debugged image acquisition device can better combine various preset comparison thresholds to determine the image abnormality parameters. Among them, the adjustment parameters include but are not limited to parameters at the hardware and software levels of the image acquisition device, such as: parameters for physical adjustment of the image acquisition device angle and jitter, and intrinsic adjustment parameters such as image exposure gain and pixel resolution. The image acquisition device is adjusted at the hardware and software levels, so that the adjustment of the image acquisition device covers different levels and can adjust the image acquisition device more comprehensively.

[0034] S120: adjusting the image acquisition device according to the adjustment parameters, and performing abnormal comparison on the image parameters acquired by the image acquisition device according to various preset comparison thresholds to determine abnormal image parameters.

[0035] Different types of preset comparison thresholds are used to judge abnormalities of different types of image parameters. This embodiment adaptively determines various preset comparison thresholds for different types of image parameters, so as to perform abnormal comparison on image parameters in a refined manner, thereby determining image abnormality parameters. The preset comparison threshold can be an interval value (i.e., a threshold interval composed of two end value thresholds) or a single critical value (i.e., a single threshold).

[0036] S130: Determine an adjustment strategy corresponding to the image acquisition device according to the image abnormality parameters to adjust the image acquisition device.

[0037] The adjustment strategy includes, but is not limited to, a sub-adjustment strategy corresponding to a single image abnormality parameter, and may also include sub-adjustment strategies corresponding to different types of image abnormality parameters.

[0038] Different types of image abnormality parameters have corresponding sub-adjustment strategies. Some types of image abnormality parameters are associated with each other, so that their corresponding sub-adjustment strategies need to be adaptively adjusted, and the image acquisition device is not adjusted by using only a single fixed adjustment strategy corresponding to each type.

[0039] Exemplarily, if the image abnormality parameter includes exposure gain, a first sub-adjustment strategy for adjusting a frame rate parameter of the image acquisition device and a second sub-adjustment strategy for adjusting a contrast parameter of the image acquisition device are determined.

[0040] When adjusting exposure, if you use a slower shutter speed or a larger aperture, the sensor will receive more light, so you can lower the ISO (exposure gain) value to avoid excessive noise. Conversely, if the ambient light is low, you may need to increase the ISO to get the proper exposure.

[0041] Frame rate is related to shutter speed, especially when using a mechanical shutter (such as in photography or filming). For example, a common rule is the "180-degree shutter rule", which states that the shutter speed is twice the frame rate. For example, when shooting 24fps video, the shutter speed is usually set to 1 / 48 second. The frame rate setting directly affects the exposure time, and therefore indirectly determines the brightness of the image.

[0042] Correct exposure will make the highlights and shadows in the image richer, thereby improving contrast. Overexposure or underexposure can lead to loss of details, especially in the bright or dark parts of the image, making the contrast less than expected. Increasing contrast can make the image look brighter and more vivid, but sometimes it can compress the dynamic range of the image, resulting in loss of details in some highlights and shadows.

[0043] In summary, if the exposure gain is abnormal, the frame rate and contrast may be abnormal. The abnormal situation of the image acquisition device can be improved by adjusting the frame rate and contrast, that is, adjusting the image acquisition device according to the first sub-adjustment strategy and the second sub-adjustment strategy.

[0044] In another exemplary embodiment, if the image abnormality parameter includes resolution, a third sub-adjustment strategy for adjusting the frame rate parameter and a fourth sub-adjustment strategy for adjusting the sharpness parameter of the image acquisition device are determined.

[0045] When shooting high-resolution (such as 4K) video at high frame rates (such as 60fps or higher), the requirements for storage and processing power are very high because more image data needs to be processed every second. This can lead to bottlenecks in processing performance and storage capacity, especially when there is not enough powerful hardware support. Higher resolutions (such as 4K or higher) will reduce frame rates because more computing power is required to process more pixel information for each frame. Many cameras and processors make a trade-off between high resolution and high frame rate and choose the appropriate setting.

[0046] Higher contrast can make details in an image stand out more, edges more distinct, and thus make sharpness appear higher. For low-contrast images, the improvement in sharpness may not be as significant because the distinction between light and dark areas of the image is not obvious, and the sharpening effect may not be as significant as for high-contrast images. Over-sharpening an image may cause edge artifacts (halo effect), which interfere with the true contrast in the image and reduce the image's sense of layering and depth, especially in high-contrast images.

[0047] In summary, if the resolution is abnormal, the frame rate and sharpness may be abnormal. The abnormal situation of the image acquisition device can be improved by adjusting the frame rate and sharpness, that is, the image acquisition device is adjusted according to the third sub-adjustment strategy and the fourth sub-adjustment strategy. Among them, the third sub-adjustment strategy and the above-mentioned second sub-adjustment strategy are both adjustment strategies for frame rate. The difference between the two lies in some adjustment details, such as: the size of the frame rate adjustment parameter, the adjustment frequency, etc. This application does not limit the specific adjustment parameters of the two sub-adjustment strategies.

[0048] This embodiment determines multiple preset comparison thresholds applicable to the image acquisition device in the current scene based on environmental parameters and vehicle parameters, and performs preliminary debugging of the image acquisition device; when image abnormality parameters are determined based on the preset comparison thresholds, the image acquisition device is fine-tuned to improve the accuracy of the data collected by the image acquisition device.

[0049] The adjustment of the vehicle surround view system recorded in the related art is generally based on preset parameters, without considering the impact of the environment and the vehicle itself.

[0050] To this end, in another exemplary embodiment of the present application, how to adjust the image acquisition device according to the adjustment parameters is described in detail. Figure 2 , Figure 2 is based on Figure 1 The exemplary embodiment shown is a flow chart of another method for adjusting a vehicle surround view system. Figure 1 The S120 shown includes S210; wherein the adjustment parameters include defogging parameters and anti-shake parameters, which are described in detail as follows:

[0051] S210: performing defogging processing on the image acquisition device according to the defogging parameters, and performing anti-shake processing on the image acquisition device according to the anti-shake parameters; wherein the defogging parameters are parameters determined based on the ambient humidity parameters in the environmental parameters, and the anti-shake parameters are parameters determined based on the vehicle shake parameters in the vehicle parameters.

[0052] The lens of the image acquisition device is generally made of photosensitive materials, which are sensitive to ambient humidity. If the ambient humidity is too high, water mist will easily form on the lens surface, thus affecting the clarity of the captured image of the image acquisition device. By analyzing the ambient humidity parameters, the defog parameters used for defog processing can be determined, including but not limited to the mirror heating temperature, heating time, defog start time, defog end time, etc.

[0053] In some embodiments, the defog parameters include the current defog start time. The following is an exemplary description of the origin of the defog start time:

[0054] The current humidity value is calculated based on the historical ambient humidity parameters and the current ambient humidity parameters; the initial defogger start time is determined based on the current humidity value, and the initial defogger start time is corrected based on the historical defogger start time to obtain the current defogger start time.

[0055] Among them, the historical environmental humidity parameters and the current environmental humidity parameters are all parameters directly collected by the vehicle humidity sensor and other components. If the vehicle humidity sensor fails, it will directly cause the collected parameters to be abnormal. If the abnormal parameters are directly used to calculate the subsequent parameters, large errors will occur. This application does not directly use the parameters collected by the vehicle humidity sensor, but introduces the historical environmental humidity parameters collected at the historical moment under the current environmental temperature parameters collected at the current moment to determine the current humidity value (similar to the parameters that accurately characterize the current moment environmental humidity after being corrected by the historical parameters).

[0056] In the process of calculating the current humidity value based on the historical environmental humidity parameters and the current environmental humidity parameters, weights can be assigned to the various environmental humidity parameters according to the chronological order. The closer the environmental humidity parameter is to the current moment, the greater the weight is. This ensures that the calculated current humidity value fully considers the changing trend of the environmental humidity parameters at historical moments while fitting the current scene.

[0057] The current humidity value is combined with the exemplary table shown in Table 1 to determine the successfully matched preset defogger on time, which is summed with the current time to obtain the initial defogger on time; and the initial defogger on time is corrected in combination with the historical defogger on time to reduce the error value of the current defogger on time, thereby improving the accuracy of the current defogger on time.

[0058] Table 1: Example of the correspondence between the preset humidity value and the preset defogger start time

[0059] Preset humidity value Preset defog time …… …… 40％ 5 minutes 50％ 8 minutes …… ……

[0060] For example, if the current time is 9:00, the current humidity value is 40%, and the preset defogger on time that matches successfully is 5 minutes, then the initial defogger on time is 9:05, and the error value (+1 minute) is introduced for correction, and the corrected defogger on time (i.e., the current defogger on time) is 9:06. The error value is calculated based on multiple historical defogger on times to obtain the average difference, variance, and other values ​​that can be used to correct parameters.

[0061] Vehicle shaking will affect the clarity of images captured by the image acquisition device. By analyzing the vehicle shaking parameters, the corresponding anti-shake parameters are determined, and the image acquisition device is subjected to anti-shake processing based on the anti-shake parameters. The anti-shake parameters can be used to correct image displacement, picture blur, etc. caused by shaking.

[0062] In some embodiments, the vehicle shaking parameter includes the vehicle shaking angle, and the vehicle shaking angle includes the current vehicle shaking angle and the adjacent historical vehicle shaking angle, and the adjacent historical vehicle shaking angle is the vehicle shaking angle collected at the adjacent historical moment of the current moment. The following is an exemplary description of the origin of the anti-shake parameter:

[0063] If the current vehicle shaking angle and the adjacent historical vehicle shaking angle both exceed the preset shaking angle, an anti-shake function activation instruction is generated; wherein the activation instruction includes anti-shake parameters. Considering the current vehicle shaking angle and the adjacent historical vehicle shaking angle at the same time, it is obvious that at least two parameters need to be compared with the preset shaking angle, which can avoid the accidental error of a single parameter (vehicle shaking angle) during the judgment process.

[0064] Adjacent historical moments are historical moments adjacent to the current moment, for example: historical moments include 9:00, 9:01, and 9:03. If the current moment is 9:04, then its adjacent historical moment is 9:03. According to the historical vehicle shaking angle corresponding to 9:03 and the current vehicle shaking angle corresponding to 9:04, determine whether to turn on the anti-shake function: compare the two vehicle shaking angles with the preset shaking angles respectively. If both are greater than the preset shaking angles, generate an instruction to turn on the anti-shake function.

[0065] This embodiment takes into account the impact of ambient humidity and vehicle shaking on the image acquisition device, and adjusts the image acquisition device accordingly through defog parameters and anti-shake parameters, so that the image captured by the image acquisition device is clearer.

[0066] The environmental parameters in the relevant technology are not comprehensive. Only a single environmental parameter is used to perform relevant data analysis, which makes the parameter consideration range relatively narrow, resulting in a low accuracy of the determined preset comparison threshold.

[0067] To this end, in another exemplary embodiment of the present application, it is described in detail how to determine the preset comparison thresholds of different types of image parameters according to the environmental parameters and the vehicle parameters. Figure 3 , Figure 3 is based on Figure 1 The exemplary embodiment shown is a flow chart of another method for adjusting a vehicle surround view system. Figure 1 The S110 shown includes at least S310 to S340; wherein the environmental parameters include environmental lighting parameters, environmental weather parameters, and environmental temperature parameters; and the vehicle parameters include the vehicle driving state, which are described in detail as follows:

[0068] S310: Determine a preset comparison threshold of the image frame rate according to the driving state of the vehicle.

[0069] The vehicle driving state includes but is not limited to high / low speed driving state, curved driving state, etc. The speed represented by the vehicle driving state will affect the image device's acquisition angle of view and image frame rate. For example, if the vehicle is driving too fast, if the preset comparison threshold of the image frame rate corresponding to the low speed driving state is used to judge the abnormality of the image frame rate, it will obviously result in a large error. The present application can adaptively select the preset comparison threshold of the image frame rate according to the vehicle driving state, so as to be applicable to the abnormal judgment of the image frame rate under different vehicle driving states.

[0070] S320: Determine a preset comparison threshold of the exposure gain of the image acquisition device according to the ambient lighting parameter.

[0071] Ambient lighting will affect the exposure gain of the image acquisition device. When the ambient lighting is strong, the required exposure gain is weak, and vice versa. This application can use ambient lighting parameters to characterize the vehicle in driving environments such as daytime, night, and tunnels, and adaptively select the preset comparison threshold of the exposure gain to be applicable to abnormal exposure gain judgment under different ambient lighting conditions.

[0072] S330: Determine a preset comparison threshold of image contrast and a preset comparison threshold of image sharpness according to the environmental weather parameters.

[0073] Ambient weather parameters are parameters that characterize the weather environment in which the vehicle is located, and can characterize, but are not limited to, sunny days, rainy days, foggy days, snowy days, etc. Different weather conditions have different effects on image contrast and image sharpness. This application uses ambient weather parameters to adaptively select image contrast and image sharpness, and the corresponding preset comparison thresholds, so as to be applicable to abnormal judgment of image contrast and image sharpness under different ambient weather conditions.

[0074] S340: Determine a preset comparison threshold of the image resolution according to the ambient temperature parameter.

[0075] High and low temperature environments will directly affect the image resolution. The present application adaptively selects a preset comparison threshold of the image resolution through the ambient temperature parameter to be applicable to abnormal determination of image resolution under different ambient temperatures.

[0076] This embodiment has a large number of parameter types for environmental parameter characterization, so that its characterization range is wider, that is, the scope of consideration of environmental parameters is larger, and different preset comparison thresholds are determined according to the adaptability of different environmental parameters to make abnormal judgments on each image parameter, so that the determination of abnormal parameters is more accurate and precise.

[0077] The vehicle surround view system includes not only image acquisition devices, but also ultrasonic sensors for detecting obstacles around the vehicle, especially when driving at low speed or parking, providing close distance information; radars for detecting obstacles at longer distances, especially when driving at high speed, providing location information of the vehicle in front or other obstacles. Therefore, in determining whether the vehicle surround view system is abnormal, other devices besides the image acquisition device need to be considered. In some embodiments, the device data loss rate is also considered to determine whether the device communication is abnormal.

[0078] Exemplarily, a preset amount of test data is sent to an image acquisition device to receive feedback information returned by the image acquisition device in response to the target test data; wherein the feedback information includes a target amount of the image acquisition device in response to the target test data; based on the target amount and the preset amount, a data loss rate of the image acquisition device is calculated; if the data loss rate exceeds the preset loss rate, it indicates that the image acquisition device has a communication abnormality.

[0079] Each time the image acquisition device responds to a test data, the target number in the feedback information increases by 1. According to the target number and the preset number, the application can simply and quickly determine the data loss rate of the image acquisition device to determine whether the image acquisition device has communication abnormalities.

[0080] The execution subject of this application can send a preset number of test data to the image acquisition device simultaneously to detect its instantaneous data loss rate, and can also send them in sequence at a uniform speed to detect the data loss rate within a preset time length. In other embodiments, the data transmission speed between the image acquisition device and the central processing unit in the vehicle surround view system can also be measured to ensure smooth video stream transmission without lag. For example: control the central processing unit to send 100 packets of data, record the start time t1 of the transmission, and record the end time t2 of the transmission, and obtain the transmission rate v1 = (100×1024) / ((t2-t1)×1024). When the transmission rate is less than the set threshold of 60, the data transmission rate is considered abnormal.

[0081] In some embodiments, the software version and memory status of the surround view system are periodically checked to ensure real-time updating of the software version, and when the memory capacity is less than the preset memory capacity, the memory space is released or an alarm is issued.

[0082] In another exemplary embodiment of the present application, the application scenarios of the above-mentioned multiple adjustment methods are exemplarily described. Figure 4 , Figure 4 Schematic diagram of the application scenario of the adjustment method of the vehicle surround view system of the present application, which includes a vehicle 100, an image acquisition device 200 and a server 300, which can be connected by wireless communication, and the present application does not limit the connection method between them.

[0083] like Figure 4 As shown, the vehicle surround view system to which the image acquisition device 200 belongs is placed in the vehicle 100 to collect images or video streams around the vehicle 100. The vehicle surround view system also includes an ultrasonic sensor for detecting obstacles around the vehicle, especially when driving at low speed or parking, to provide short-range distance information; and a radar for detecting obstacles at a longer distance, especially when driving at high speed, to provide position information of the vehicle in front or other obstacles.

[0084] The server 300 can be used as an execution subject to execute the adjustment method shown in any of the above exemplary embodiments, which is exemplarily described as follows:

[0085] The server 300 determines preset comparison thresholds of different types of image parameters and adjustment parameters of the image acquisition device 200 according to environmental parameters and vehicle parameters; the server 300 adjusts the image acquisition device 200 according to the adjustment parameters, and performs abnormality comparison on the image parameters acquired by the image acquisition device 200 according to each preset comparison threshold to determine abnormal image parameters; the server 300 determines the corresponding adjustment strategy of the image acquisition device 200 according to the abnormal image parameters to adjust the image acquisition device 200.

[0086] The server 300 may be as follows: Figure 4 As shown, it is placed in the vehicle 100, but it can also be a physical server independent of the vehicle 100, or it can be a server cluster or distributed system composed of multiple physical servers, wherein multiple servers can form a blockchain, and the server is a node on the blockchain. The server 300 can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network) and big data and artificial intelligence platforms, and there is no restriction on this here.

[0087] Another aspect of the present application also provides an adjustment device for a vehicle surround view system, such as Figure 5 As shown, Figure 5 1 is a schematic diagram of a structure of an adjustment device for a vehicle surround view system according to an exemplary embodiment of the present application. The surround view system includes an image acquisition device, and the adjustment device 500 includes:

[0088] The determination module 510 determines preset comparison thresholds of different types of image parameters and adjustment parameters of the image acquisition device according to the environmental parameters and the vehicle parameters;

[0089] The comparison module 530 adjusts the image acquisition device according to the adjustment parameters, and performs abnormal comparison on the image parameters acquired by the image acquisition device according to various preset comparison thresholds to determine the image abnormality parameters;

[0090] The adjustment module 550 determines an adjustment strategy corresponding to the image acquisition device according to the image abnormality parameters to adjust the image acquisition device.

[0091] In another exemplary embodiment, the adjustment parameters include a defog parameter and an anti-shake parameter; and the comparison module 530 includes:

[0092] The processing unit performs defogging processing on the image acquisition device according to the defogging parameters, and performs anti-shake processing on the image acquisition device according to the anti-shake parameters; wherein the defogging parameters are parameters determined based on the ambient humidity parameters in the environmental parameters, and the anti-shake parameters are parameters determined based on the vehicle shake parameters in the vehicle parameters.

[0093] In another exemplary embodiment, the vehicle shaking parameter includes a vehicle shaking angle, the vehicle shaking angle includes a current vehicle shaking angle and an adjacent historical vehicle shaking angle, the adjacent historical vehicle shaking angle is a vehicle shaking angle collected at an adjacent historical moment of the current moment; the adjustment device 500 also includes:

[0094] The instruction generation module generates an instruction to start the anti-shake function if the current vehicle shaking angle and the adjacent historical vehicle shaking angle both exceed the preset shaking angle; wherein the start instruction includes the anti-shake parameter.

[0095] In another exemplary embodiment, the defog parameters include the current defog start time; the adjustment device 500 further includes:

[0096] The first calculation module calculates the current humidity value according to the historical environmental humidity parameters and the current environmental humidity parameters;

[0097] The second calculation module determines an initial defogger start time according to the current humidity value, and corrects the initial defogger start time according to the historical defogger start time to obtain the current defogger start time.

[0098] In another exemplary embodiment, the environmental parameters include environmental lighting parameters, environmental weather parameters, and environmental temperature parameters; the vehicle parameters include vehicle driving status; and the determination module 510 includes:

[0099] A first determination unit determines a preset comparison threshold of an image frame rate according to a driving state of the vehicle;

[0100] A second determination unit determines a preset comparison threshold of the exposure gain of the image acquisition device according to the ambient light parameter;

[0101] A third determination unit determines a preset comparison threshold of image contrast and a preset comparison threshold of image sharpness according to the environmental weather parameter;

[0102] The fourth determining unit determines a preset comparison threshold of the image resolution according to the ambient temperature parameter.

[0103] In another exemplary embodiment, the adjustment module 550 includes:

[0104] A first adjustment unit, which determines a first sub-adjustment strategy for adjusting a frame rate parameter of an image acquisition device and a second sub-adjustment strategy for adjusting a contrast parameter of the image acquisition device if the image abnormality parameter includes an exposure gain;

[0105] The second adjustment unit determines a third sub-adjustment strategy for adjusting a frame rate parameter and a fourth sub-adjustment strategy for adjusting a sharpness parameter of an image acquisition device if the image abnormality parameter includes resolution.

[0106] In another exemplary embodiment, the adjusting device 500 further includes:

[0107] A sending and receiving module sends a preset amount of test data to the image acquisition device to receive feedback information returned by the image acquisition device in response to the target test data; wherein the feedback information includes the target amount of the image acquisition device in response to the target test data;

[0108] The loss rate calculation module calculates the data loss rate of the image acquisition device according to the target number and the preset number;

[0109] The communication anomaly determination module indicates that the communication of the image acquisition device is abnormal if the data loss rate exceeds a preset loss rate.

[0110] The adjustment device of the present application determines multiple preset comparison thresholds suitable for the image acquisition device in the current scene based on environmental parameters and vehicle parameters, and performs preliminary debugging of the image acquisition device; when the image abnormality parameters are determined according to the preset comparison thresholds, the image acquisition device is finely adjusted to improve the accuracy of the data collected by the image acquisition device.

[0111] It should be noted that the adjustment device provided in the above embodiment and the adjustment method provided in the above embodiment belong to the same concept, wherein the specific manner in which each module and unit performs the operation has been described in detail in the method embodiment and will not be repeated here.

[0112] Another aspect of the present application provides an electronic device, including: a controller; a memory for storing one or more programs, and when the one or more programs are executed by the controller, the above-mentioned adjustment method is executed.

[0113] See also Figure 6 , Figure 6 1 is a schematic diagram of the structure of a computer system of an electronic device shown in an exemplary embodiment of the present application, which shows a schematic diagram of the structure of a computer system of an electronic device suitable for implementing an embodiment of the present application.

[0114] It should be noted that Figure 6 The computer system 600 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0115] like Figure 6 As shown, the computer system 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 602 or the program loaded from the storage part 608 to the random access memory (RAM) 603, such as executing the method in the above embodiment. In the RAM 603, various programs and data required for system operation are also stored. The CPU 601, ROM 602 and RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0116] The following components are connected to the I / O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed so that a computer program read therefrom is installed into the storage section 608 as needed.

[0117] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 609, and / or installed from a removable medium 611. When the computer program is executed by a central processing unit (CPU) 601, various functions defined in the system of the present application are executed.

[0118] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium can include a data signal propagated in a baseband or as a part of a carrier wave, wherein a computer-readable computer program is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0119] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0120] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0121] Another aspect of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the adjustment method as described above is implemented. The computer-readable storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.

[0122] Another aspect of the present application also provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the adjustment method provided in each of the above embodiments.

[0123] According to one aspect of an embodiment of the present application, a computer system is also provided, including a central processing unit (CPU), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage portion into a random access memory (RAM), such as executing the method in the above embodiment. In RAM, various programs and data required for system operation are also stored. CPU, ROM and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.

[0124] The following components are connected to the I / O interface: an input part including a keyboard, a mouse, etc.; an output part including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage part including a hard disk, etc.; and a communication part including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication part performs communication processing via a network such as the Internet. A drive is also connected to the I / O interface as needed. Removable media, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., are installed on the drive as needed so that the computer program read therefrom is installed into the storage part as needed.

[0125] The above content is only a preferred exemplary embodiment of the present application and is not intended to limit the implementation scheme of the present application. A person skilled in the art can easily make corresponding changes or modifications based on the main concept and spirit of the present application. Therefore, the scope of protection of the present application shall be based on the scope of protection required by the claims.

Claims

1. A method for adjusting a vehicle surround view system, characterized in that: The surround view system includes an image acquisition device, and the adjustment method includes: Determining preset comparison thresholds of different types of image parameters and adjusting parameters of the image acquisition device according to the environmental parameters and the vehicle parameters; The image acquisition device is adjusted according to the adjustment parameters, and the image parameters acquired by the image acquisition device are compared for abnormality according to various preset comparison thresholds to determine the image abnormality parameters; An adjustment strategy corresponding to the image acquisition device is determined according to the image abnormality parameters to adjust the image acquisition device.

2. The adjustment method according to claim 1, characterized in that: The adjustment parameters include defog parameters and anti-shake parameters; The step of adjusting the image acquisition device according to the adjustment parameter comprises: The image acquisition device is defogged according to the defog parameters, and the image acquisition device is anti-shake processed according to the anti-shake parameters; wherein the defog parameters are parameters determined based on the ambient humidity parameters in the ambient parameters, and the anti-shake parameters are parameters determined based on the vehicle shake parameters in the vehicle parameters.

3. The adjustment method according to claim 2, characterized in that: The vehicle shaking parameter includes a vehicle shaking angle, and the vehicle shaking angle includes a current vehicle shaking angle and an adjacent historical vehicle shaking angle, and the adjacent historical vehicle shaking angle is a vehicle shaking angle collected at an adjacent historical moment of the current moment; The adjustment method further comprises: If the current vehicle shaking angle and the adjacent historical vehicle shaking angle both exceed the preset shaking angle, an anti-shake function activation instruction is generated; wherein the activation instruction includes the anti-shake parameter.

4. The adjustment method according to claim 2, characterized in that: The defog parameters include the current defog start time; the adjustment method also includes: According to the historical environmental humidity parameters and the current environmental humidity parameters, the current humidity value is calculated; An initial defogger on time is determined according to the current humidity value, and the initial defogger on time is corrected according to the historical defogger on time to obtain the current defogger on time.

5. The adjustment method according to claim 1, characterized in that: The environmental parameters include environmental lighting parameters, environmental weather parameters, and environmental temperature parameters; the vehicle parameters include vehicle driving status; Determining preset comparison thresholds of different types of image parameters according to the environmental parameters and the vehicle parameters includes: Determine a preset comparison threshold of the image frame rate according to the driving state of the vehicle; Determine a preset comparison threshold of the exposure gain of the image acquisition device according to the ambient light parameter; Determining a preset comparison threshold of image contrast and a preset comparison threshold of image sharpness according to the environmental weather parameter; A preset comparison threshold of the image resolution is determined according to the ambient temperature parameter.

6. The adjustment method according to claim 1, characterized in that: Determining the adjustment strategy corresponding to the image acquisition device according to the image abnormality parameter includes: If the image abnormality parameter includes exposure gain, determining a first sub-adjustment strategy for adjusting a frame rate parameter of the image acquisition device and a second sub-adjustment strategy for adjusting a contrast parameter of the image acquisition device; If the image abnormality parameter includes resolution, a third sub-adjustment strategy for adjusting the frame rate parameter and a fourth sub-adjustment strategy for adjusting the sharpness parameter of the image acquisition device are determined.

7. The adjustment method according to any one of claims 1 to 6, characterized in that: The adjustment method further comprises: Sending a preset amount of test data to the image acquisition device to receive feedback information returned by the image acquisition device in response to the target test data; wherein the feedback information includes the target amount of the image acquisition device in response to the target test data; Calculating the data loss rate of the image acquisition device according to the target number and the preset number; If the data loss rate exceeds a preset loss rate, it indicates that the communication of the image acquisition device is abnormal.

8. An adjustment device for a vehicle surround view system, characterized in that: The surround view system includes an image acquisition device, and the adjustment device includes: A determination module, which determines preset comparison thresholds of different types of image parameters and adjustment parameters of the image acquisition device according to environmental parameters and vehicle parameters; A comparison module, which adjusts the image acquisition device according to the adjustment parameters, and performs abnormal comparison on the image parameters acquired by the image acquisition device according to various preset comparison thresholds to determine abnormal image parameters; The adjustment module determines an adjustment strategy corresponding to the image acquisition device according to the image abnormality parameter to adjust the image acquisition device.

9. An electronic device, characterized in that: include: Controller; A memory for storing one or more programs, which, when executed by the controller, enables the controller to implement the adjustment method described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: Computer-readable instructions are stored thereon, and when the computer-readable instructions are executed by a processor of a computer, the computer is caused to execute the adjustment method according to any one of claims 1 to 7.

Images