ADAS camera lens dazzle light real-time control method and system, storage medium and device

Abstract

The invention provides an ADAS camera lens dazzle light real-time control method and system, a storage medium and a device. The method comprises the following steps: acquiring detected camera operation parameters to extract pixel exposure; performing threshold judgment based on the pixel exposure to obtain a dazzle light area; coordinate transformation is carried out based on the dazzle light area and the distance between the ADAS camera and the windshield to obtain black spot blocking data; and generating a black spot blocking control signal based on the black spot blocking data so as to control preset dimming glass to generate blocking black spots. According to the invention, the strong light dazzle light area on the image surface of the ADAS camera can be dynamically detected and positioned, and local blocking black spots are generated at the corresponding position of the dimming glass of the automobile windshield, so that the contrast ratio and definition of the whole imaging system in a strong light environment are effectively improved; and finally, target identification misjudgment caused by dazzle light interference of the automobile auxiliary driving system is obviously reduced, and the reliability and safety of the system are enhanced.

Description

Technical Field

[0001] This invention belongs to the field of data processing technology, and in particular relates to a method, system, storage medium and device for real-time control of camera glare in ADAS cameras. Background Technology

[0002] Currently, camera sensing systems are widely used in advanced driver-assistance systems (ADAS) and have become a key component for perceiving the environment. However, during vehicle operation, direct sunlight or strong streetlights (collectively known as glare) can be difficult to avoid. These high-intensity light sources can cause local pixel areas of the image sensor to be overexposed, which can not only lead to the complete loss of image information in that area and the formation of black spots, but also force the sensor to expand its dynamic range to cover the extreme contrast between light and dark.

[0003] Currently, there is no specifically designed operating system to avoid or block the effects of direct sunlight glare or streetlight glare. As a result, some pixels on the sensor will experience localized overexposure. This overexposure causes the sensor to increase its overall dynamic range to cover both the highlights and low shadows, thus reducing image detail and resolution. In addition, glare can also penetrate into surrounding pixels, causing distortion of the true signal portion of these pixels and making details difficult to distinguish. Therefore, the overall optical quality of the camera's imaging surface is affected, triggering false positives. Summary of the Invention

[0004] In view of the shortcomings of the prior art described above, the purpose of this invention is to provide a method, system, storage medium and device for real-time control of glare in ADAS cameras, to solve the problems of decreased image quality, loss of detail and resulting misjudgment in assisted driving caused by local overexposure of the image sensor in existing ADAS cameras under strong sunlight or streetlight glare.

[0005] In a first aspect, the present invention provides a method for real-time glare control of an ADAS camera, the method comprising:

[0006] Obtain the detected camera operating parameters to extract pixel exposure;

[0007] The glare area is obtained by threshold determination based on the pixel exposure.

[0008] Coordinate transformation is performed based on the glare area and the distance between the ADAS camera and the windshield to obtain data on the blocking black spots;

[0009] Based on the black spot blocking data, a black spot blocking control signal is generated to control the preset dimming glass to generate black spot blocking.

[0010] In some embodiments of the first aspect of this application, the step of performing coordinate transformation based on the glare area and the distance between the ADAS camera and the windshield to obtain black spot blocking data specifically includes:

[0011] Establish the geometric mapping relationship between the image sensor plane of the ADAS camera and the windshield plane based on the optical imaging model;

[0012] The position information of the glare area on the image sensor plane is converted into the dimming glass by combining the spacing to obtain the blocking black spot data, wherein the blocking black spot data includes the blocking black spot position and the blocking black spot area.

[0013] In some embodiments of the first aspect of this application, the step of generating a blocking black spot control signal based on the blocking black spot data to control a preset dimming glass to generate a blocking black spot specifically includes:

[0014] Based on the location of the blocked black spot, a black spot origin position signal is generated on the dimming glass, and the black spot origin position signal includes the circumscribed circle center or the center of a rectangle;

[0015] Based on the area of ​​the blocked black spot, a black spot shape signal is generated on the dimming glass, and the black spot shape signal includes a circumscribed circle or a minimum circumscribed rectangle;

[0016] The dimming glass is controlled to generate the corresponding blocking black spot based on the origin position signal and the shape signal of the black spot.

[0017] In some embodiments of the first aspect of this application, the step of obtaining the detected camera operating parameters to extract pixel exposure specifically includes:

[0018] The camera operating parameters transmitted by the image sensor of the ADAS camera are obtained. The camera operating parameters include raw image data composed of a two-dimensional pixel matrix, wherein each pixel in the matrix includes brightness information and / or color information.

[0019] The pixel exposure is obtained by extracting the brightness information corresponding to each pixel based on the two-dimensional pixel matrix.

[0020] In some embodiments of the first aspect of this application, the step of determining the glare region based on the pixel exposure threshold specifically includes:

[0021] The target pixel is extracted by comparing its exposure with a target threshold, wherein the target threshold may be a fixed threshold or a dynamic threshold.

[0022] The target pixels are obtained by extracting pixels that are greater than the target threshold, and the glare region is obtained by aggregating all the target pixels through connected component analysis. The number of glare regions includes at least one.

[0023] To achieve the above and other related objectives, a second aspect of this application provides a real-time control system for glare from an ADAS camera, the system comprising:

[0024] The acquisition module is used to acquire the detected camera operating parameters in order to extract pixel exposure.

[0025] The judgment module is used to determine the glare area by performing a threshold judgment based on the pixel exposure.

[0026] The conversion module is used to perform coordinate transformation based on the glare area and the distance between the ADAS camera and the windshield to obtain data on the blocking black spots;

[0027] The generation module is used to generate a black spot blocking control signal based on the black spot blocking data to control the preset dimming glass to generate black spots.

[0028] To achieve the above and other related objectives, a third aspect of this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the ADAS camera glare real-time control method described in any of the preceding claims.

[0029] To achieve the above and other related objectives, a fourth aspect of this application provides a computer program product, which includes computer program code that, when executed on a computer, causes the computer to implement the ADAS camera glare real-time control method described in any of the above claims.

[0030] To achieve the above and other related objectives, a fifth aspect of this application provides an electronic device, including a memory, a processor, and a computer program stored in the memory; the processor executes the computer program to implement the ADAS camera glare real-time control method described in any of the preceding claims.

[0031] To achieve the above and other related objectives, a sixth aspect of this application provides a real-time glare control device for an ADAS camera, comprising:

[0032] The module consists of an imaging module, a dimming module, and a control module.

[0033] The imaging module includes an ADAS camera, which is installed in a fixed position inside the vehicle to capture vehicle visual information;

[0034] The dimming module includes liquid crystal dimming glass or electrochromic glass, which is installed on the inside side of the windshield of the vehicle and is used to generate blocking black spots under control signals.

[0035] The control module includes a controller for executing the ADAS camera glare real-time control method described in any of the above-mentioned methods.

[0036] As described above, the ADAS camera glare real-time control method, system, storage medium, and device of the present invention have the following beneficial effects: they can dynamically detect and locate strong light glare areas on the image plane of the ADAS camera, and generate local blocking black spots at the corresponding positions on the dimming glass of the car windshield, thereby effectively improving the contrast and clarity of the entire imaging system in strong light environments, and ultimately significantly reducing target recognition misjudgment caused by glare interference in the car's assisted driving system, thus enhancing the reliability and safety of the system. Attached Figure Description

[0037] Figure 1 The diagram shows a step-by-step illustration of the ADAS camera glare real-time control method of the present invention in one embodiment;

[0038] Figure 2 The diagram shows a flowchart of extracting pixel exposure in one embodiment of the ADAS camera glare real-time control method of the present invention.

[0039] Figure 3 The diagram shows a flowchart of determining the glare area in one embodiment of the ADAS camera glare real-time control method of the present invention.

[0040] Figure 4 The diagram shows a step-by-step illustration of the ADAS camera glare real-time control method of the present invention in one embodiment;

[0041] Figure 5 The diagram shown is a structural schematic of an embodiment of the ADAS camera glare real-time control system of the present invention.

[0042] Figure 6 The diagram shown is a structural schematic of an embodiment of the ADAS camera glare real-time control device of the present invention.

[0043] Figure 7 The diagram shown is a structural schematic of an embodiment of the electronic device of the present invention.

[0044] Component designation explanation

[0045] S102~S108 step S402~S406 step 50 ADAS Camera Glare Real-time Control System 51 Get Module 52 Judgment Module 53 Conversion Module 54 Generate module 60 ADAS camera glare real-time control device 61 Imaging module 62 dimming module 63 Control module 701 processor 702 memory 7021 operating system 7022 app 703 Network interface 704 bus system 705 User Interface Detailed Implementation

[0046] The following specific examples illustrate the implementation of the present invention. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that, unless otherwise specified, the following embodiments and features described therein can be combined with each other.

[0047] It should be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of the present invention. Therefore, the drawings only show the components related to the present invention and are not drawn according to the actual number, shape and size of the components in the actual implementation. In the actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.

[0048] Furthermore, the use of terms such as "first" and "second" in this application is for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, the technical solutions of the various embodiments can be combined with each other, but only on the basis of being achievable by those skilled in the art. If the combination of technical solutions is contradictory or impossible to implement, such a combination of technical solutions should be considered non-existent and not within the scope of protection claimed in this application.

[0049] The existing technology has the following main drawbacks:

[0050] (1) Causing system misjudgment: The glare area and its penetration effect on surrounding pixels can obscure or distort the details of the real scene, such as pedestrians, obstacles or lane lines on the road, which can easily cause ADAS to make wrong judgments and constitute safety hazards.

[0051] (2) Sacrificing image quality: In order to adapt to glare scenes, dynamic range is often compressed or exposure strategy is adjusted to avoid global overexposure. However, this compromise directly sacrifices the details and resolution of the image in medium and low light areas, resulting in an overall blurry image.

[0052] (3) Increased system cost: In order to solve the glare problem, the industry tends to pursue image sensors with higher dynamic range and higher resolution, which undoubtedly significantly increases hardware cost and system complexity, and its effect still has physical limits.

[0053] To address this issue, this application proposes a method, system, storage medium, and device for real-time glare control of ADAS cameras. This method is applicable to various automotive assisted driving and autonomous driving scenarios equipped with forward-facing vision perception systems. Particularly when a vehicle is traveling towards another vehicle, encountering direct sunlight at low angles during sunrise or sunset, or being strongly illuminated by streetlights at night, it can generate a local shading area on the windshield that precisely corresponds to the strong light source in real time. This achieves physical-level glare suppression, ultimately improving the image signal-to-noise ratio, restoring scene details obscured by glare, and significantly reducing the false alarm and false negative rates of the perception system. The technical solutions in the embodiments of this invention will be described in detail below with reference to the accompanying drawings.

[0054] like Figure 1 As shown, in one embodiment of the invention, the real-time glare control method for ADAS camera of the present invention includes the following steps:

[0055] Step S102: Obtain the detected camera operating parameters to extract pixel exposure;

[0056] Step S104: Based on the pixel exposure, a threshold judgment is performed to obtain the glare area;

[0057] Step S106: Perform coordinate transformation based on the glare area and the distance between the ADAS camera and the windshield to obtain black spot blocking data;

[0058] Step S108: Generate a black spot blocking control signal based on the black spot blocking data to control the preset dimming glass to generate black spots.

[0059] It should be noted that, in this embodiment, firstly, the image captured in real time by the ADAS camera is acquired, and the pixel exposure is analyzed to identify the overexposed glare area. Then, based on the optical imaging principle, the coordinates of the glare area on the sensor are mapped and converted to the corresponding position and range of the dimming glass set on the windshield to obtain the corresponding blocking black spot data. If no glare area is detected, there is no need to generate a blocking black spot. Then, based on the blocking black spot data, a blocking black spot control signal is generated to control the preset dimming glass to generate a blocking black spot, that is, to generate a matching local black spot at a specified position, thereby physically blocking or reducing the incident glare. Throughout the process, image feedback is continuously monitored, and the black spot is dynamically adjusted until the glare effect is effectively suppressed. This cycle is used to achieve adaptive and real-time glare control.

[0060] Furthermore, in one embodiment of the invention, the step of acquiring the detected camera operating parameters to extract pixel exposure specifically includes:

[0061] The camera operating parameters transmitted by the image sensor of the ADAS camera are obtained. The camera operating parameters include raw image data composed of a two-dimensional pixel matrix, wherein each pixel in the matrix includes brightness information and / or color information.

[0062] The pixel exposure is obtained by extracting the brightness information corresponding to each pixel based on the two-dimensional pixel matrix.

[0063] It should be noted that, in this embodiment, as Figure 2 The diagram shows a flowchart for extracting pixel exposure. The process involves acquiring real-time camera operating parameters from the image sensor of an ADAS camera. These parameters include raw image data composed of a two-dimensional pixel matrix. Each pixel in the two-dimensional pixel matrix includes brightness information and / or color information. The pixel exposure can then be obtained by extracting the corresponding brightness information from each pixel based on the two-dimensional pixel matrix. Specifically, each frame of the image is captured from the video stream to extract the corresponding brightness information from each pixel and obtain the pixel exposure.

[0064] Furthermore, in one embodiment of the invention, the step of determining the glare region based on the pixel exposure threshold specifically includes:

[0065] The target pixel is extracted by comparing its exposure with a target threshold, wherein the target threshold may be a fixed threshold or a dynamic threshold.

[0066] The target pixels are obtained by extracting pixels that are greater than the target threshold, and the glare region is obtained by aggregating all the target pixels through connected component analysis. The number of glare regions includes at least one.

[0067] It should be noted that, in this embodiment, as Figure 3 The diagram illustrates the process of determining glare regions. When pixel exposure is obtained, it is compared with a corresponding target threshold to extract target pixels. The target threshold can be a fixed threshold or a dynamic threshold, where the dynamic threshold is based on the overall brightness distribution of the image. Pixels larger than the target threshold are then extracted as target pixels. These target pixels are marked during application, and connected component analysis is used to aggregate all marked target pixels to obtain the glare region. The number of glare regions can be one or more, depending on the connectivity threshold used in the connected component analysis.

[0068] Furthermore, in one embodiment of the invention, the step of performing coordinate transformation based on the glare area and the distance between the ADAS camera and the windshield to obtain black spot blocking data specifically includes:

[0069] Establish the geometric mapping relationship between the image sensor plane of the ADAS camera and the windshield plane based on the optical imaging model;

[0070] The position information of the glare area on the image sensor plane is converted into the dimming glass by combining the spacing to obtain the blocking black spot data, wherein the blocking black spot data includes the blocking black spot position and the blocking black spot area.

[0071] It should be noted that this embodiment mainly describes how to obtain the blocking black spot data. The blocking black spot data includes the blocking black spot position and the blocking black spot area. Since the camera will cause overexposure when imaging, it is necessary to block the amount of light. Since the ADAS camera is installed in the vehicle, the direct sunlight or the light from the direct street light enters through the windshield. Therefore, a geometric mapping relationship between the image sensor plane of the ADAS camera and the windshield plane can be established based on an optical imaging model (such as a Gaussian lens imaging model). In this way, the position information of the glare area on the image sensor plane can be converted to the dimming glass by combining the spacing to obtain the blocking black spot data. Specifically, the optical Gaussian lens imaging inverse conversion is used to calculate the required blocking black spot data on the windshield. The blocking black spot data includes the blocking black spot position and the corresponding blocking black spot area.

[0072] Furthermore, in one embodiment of the invention, the step of generating a black spot blocking control signal based on the black spot blocking data to control a preset dimming glass to generate black spot blocking, such as... Figure 4 As shown, the specific steps include the following:

[0073] Step S402: Generate a black spot origin position signal on the dimming glass based on the position of the blocked black spot. The black spot origin position signal includes the circumscribed circle center or the center of a rectangle.

[0074] Step S404: Generate a black spot shape signal on the dimming glass based on the area of ​​the blocked black spot, wherein the black spot shape signal includes a circumscribed circle or a minimum circumscribed rectangle;

[0075] Step S406: Control the dimming glass operation based on the black spot origin position signal and the black spot shape signal to generate the corresponding blocking black spot.

[0076] It should be noted that this embodiment specifically describes how to generate a blocking black spot on the dimming glass. Specifically, a black spot shape signal is generated on the dimming glass based on the area of ​​the blocking black spot. This black spot shape signal includes a circumscribed circle or a minimum circumscribed rectangle. The shape selection can be adjusted according to actual needs. In application, the black spot shape uses a circumscribed circle or a minimum circumscribed rectangle to block direct light. Further, a black spot origin position signal is generated on the dimming glass based on the position of the blocking black spot. This black spot origin position signal includes the center of the circumscribed circle or the center of the rectangle. The amount of direct sunlight entering the ground has a range. Therefore, when the shape is a circumcircle, the corresponding origin point of the black spot is the center of the circumcircle. If the shape is a minimum circumcircle rectangle, the corresponding origin point of the black spot is the center of the rectangle. Finally, based on the black spot origin point position signal and the black spot shape signal, the dimming glass is controlled to perform operations to generate the corresponding blocking black spot, such as forming a light-blocking area in the shape of a circumcircle or a light-blocking area in the shape of a minimum circumcircle rectangle. It should be noted that since it blocks the amount of direct sunlight, the width of the blocking black spot is generally "1-2cm", so it will not affect vehicle driving.

[0077] The scope of protection of the ADAS camera glare real-time control method described in this application is not limited to the execution order of the steps listed in this embodiment. Any solution implemented by adding, subtracting, or replacing steps in the prior art based on the principles of this application is included within the scope of protection of this application.

[0078] This application also provides a real-time control system for ADAS camera glare, which can implement the real-time control method for ADAS camera glare described in this application. However, the implementation device for the real-time control method for ADAS camera glare described in this application includes, but is not limited to, the structure of the real-time control system for ADAS camera glare listed in this embodiment. Any structural modifications and substitutions of the prior art made based on the principles of this application are included within the protection scope of this application.

[0079] Please see Figure 5 In one embodiment, this embodiment provides an ADAS camera glare real-time control system 50, the system comprising:

[0080] The acquisition module 51 is used to acquire the detected camera operating parameters in order to extract pixel exposure.

[0081] The judgment module 52 is used to determine the glare area by performing a threshold judgment based on the pixel exposure.

[0082] The conversion module 53 is used to perform coordinate transformation based on the glare area and the distance between the ADAS camera and the windshield to obtain blocking black spot data;

[0083] The generation module 54 is used to generate a blocking black spot control signal based on the blocking black spot data to control the preset dimming glass to generate blocking black spots.

[0084] It should be noted that, in this embodiment, since the specific implementation method corresponds to the aforementioned method embodiment, the same details will not be repeated here, and those skilled in the art should also understand this. Figure 5 The division of the modules in the embodiments is only a logical functional division. In actual implementation, they can be fully or partially integrated into one or more physical entities. These modules can be fully implemented in software through processing element calls, fully implemented in hardware, or some modules can be implemented in software through processing element calls and some modules can be implemented in hardware.

[0085] Please see Figure 6 In one embodiment, this embodiment provides an ADAS camera glare real-time control device 60, the device comprising:

[0086] Imaging module 61, dimming module 62, and control module 63, wherein,

[0087] The imaging module 61 includes an ADAS camera, which is installed in a fixed position inside the vehicle to capture vehicle visual information;

[0088] The dimming module 62 includes liquid crystal dimming glass or electrochromic glass, which is installed on the inside side of the windshield of the vehicle and is used to generate blocking black spots under control signals.

[0089] The control module 63 includes a controller for executing any of the above-described ADAS camera glare real-time control methods.

[0090] It should be noted that, in this embodiment, the ADAS camera glare real-time control device is a typical "perception-decision-execution" closed-loop control device, mainly composed of three core components: an imaging module 61, a dimming module 62, and a control module 63. The imaging module 61 includes an ADAS camera, installed in a fixed position inside the vehicle, typically near the rearview mirror facing forward, acquiring road images through the windshield to capture vehicle visual information. The dimming module 62 includes liquid crystal dimming glass or electrochromic glass, installed on the inside side of the windshield, and can be integrated into the vehicle during application. On the windshield, it can also be attached to the existing windshield as a layer, occupying a small part of the windshield, including the part that is completely cut by the camera's optical path. It is used to generate a blocking black spot under the control signal. It can change the light transmittance of a local area at a specified position and size to form a dark or nearly opaque "blocking black spot", thereby physically blocking or reducing glare from entering the camera's optical path. The control module 63 includes a controller for executing any of the above-described ADAS camera glare real-time control methods. Since the specific implementation of this embodiment corresponds to the aforementioned method embodiments, the same details will not be repeated here.

[0091] In the embodiments provided by this invention, it should be understood that the disclosed apparatus or method can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of modules / units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or units may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection of the apparatus or module or unit may be electrical, mechanical, or other forms.

[0092] The modules / units described as separate components may or may not be physically separate. The components shown as modules / units may or may not be physical modules; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules / units can be selected to achieve the objectives of the embodiments of the present invention, depending on actual needs. For example, the functional modules / units in the various embodiments of the present invention may be integrated into one processing module, or each module / unit may exist physically separately, or two or more modules / units may be integrated into one module / unit.

[0093] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0094] This invention also provides an electronic device, such as... Figure 7 As shown, the electronic device includes a processor and a memory.

[0095] like Figure 7 As shown, the electronic device includes: at least one processor 701, a memory 702, at least one network interface 703, and a user interface 705. The various components in the device are coupled together via a bus system 704. It is understood that the bus system 704 is used to implement communication between these components. In addition to a data bus, the bus system 704 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in… Figure 7 The general will label all buses as bus systems.

[0096] The user interface 705 may include a monitor, keyboard, mouse, trackball, clicker, button, touchpad, or touch screen.

[0097] It is understood that memory 702 can be volatile memory or non-volatile memory, or both. Non-volatile memory can be read-only memory (ROM) or programmable read-only memory (PROM), used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM) and synchronous static random access memory (SSRAM). The memories described in the embodiments of this invention are intended to include, but are not limited to, these and any other suitable categories of memory.

[0098] In this embodiment of the invention, the memory 702 is used to store various types of data to support the operation of the electronic terminal 700. Examples of this data include: any executable program for operation on the electronic terminal 700, such as the operating system 7021 and application program 7022; the operating system 7021 contains various system programs, such as the framework layer, core library layer, driver layer, etc., for implementing various basic services and handling hardware-based tasks. The application program 7022 may contain various applications, such as a media player, browser, etc., for implementing various application services. The ADAS camera glare real-time control method provided in this embodiment of the invention can be included in the application program 7022.

[0099] The methods disclosed in the above embodiments of the present invention can be applied to or implemented by processor 701. Processor 701 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in processor 701 or by instructions in software form. The processor 701 may be a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Processor 701 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. General-purpose processor 701 may be a microprocessor or any conventional processor, etc. The steps of the accessory optimization method provided in the embodiments of the present invention can be directly reflected as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium, which is located in memory. The processor reads the information in the memory and combines it with its hardware to complete the steps of the aforementioned method.

[0100] In an exemplary embodiment, the electronic terminal 700 may be used by one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), or complex programmable logic devices (CPLDs) to execute the aforementioned method.

[0101] According to the method provided in the embodiments of this application, this application also provides a computer program product, which includes: computer program code, which, when run on a computer, causes the computer to execute... Figures 1 to 3 The method of any of the embodiments shown.

[0102] According to the method provided in the embodiments of this application, this application also provides a computer-readable storage medium storing program code, which, when executed on a computer, causes the computer to perform... Figures 1 to 3 The method of any of the embodiments shown.

[0103] The terms “component,” “module,” “system,” etc., used in this specification are used to refer to computer-related entities, hardware, firmware, combinations of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program, and / or a computer. As illustrated, applications running on computing devices and computing devices can both be components. One or more components may reside in a process and / or an execution thread, and components may be located on a single computer and / or distributed among two or more computers. Furthermore, these components can be executed from various computer-readable media on which various data structures are stored. Components can communicate, for example, via local and / or remote processes based on signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system, and / or a network, such as the Internet interacting with other systems via signals).

[0104] Those skilled in the art will recognize that the various illustrative logical blocks and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.

[0105] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0106] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0107] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0108] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0109] In the above embodiments, the functions of each functional unit can be implemented entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. A computer program product includes one or more computer instructions (programs). When the computer program instructions (programs) are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. Computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., high-density digital video discs, DVDs), or semiconductor media (e.g., solid-state disks, SSDs, etc.).

[0110] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0111] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0112] In summary, this application provides a method, system, storage medium, and device for real-time glare control of an ADAS camera. It can dynamically detect and locate strong light glare areas on the image plane of the ADAS camera, and generate local blocking black spots at corresponding positions on the dimming glass of the car windshield accordingly. This effectively improves the contrast and clarity of the entire imaging system in strong light environments, and ultimately significantly reduces target recognition misjudgments caused by glare interference in the automotive driver assistance system, thereby enhancing the reliability and safety of the system.

[0113] The above embodiments are merely illustrative of the principles and effects of this application and are not intended to limit this application. Any person skilled in the art can modify or alter the above embodiments without departing from the spirit and scope of this application. Therefore, all equivalent modifications or alterations made by those skilled in the art without departing from the spirit and technical concept disclosed in this application should still be covered by the claims of this application.

Claims

1. A method for real-time glare control of an ADAS camera, characterized in that, include: Obtain the detected camera operating parameters to extract pixel exposure; The glare area is obtained by threshold determination based on the pixel exposure. Coordinate transformation is performed based on the glare area and the distance between the ADAS camera and the windshield to obtain data on the blocking black spots; Based on the black spot blocking data, a black spot blocking control signal is generated to control the preset dimming glass to generate black spot blocking.

2. The real-time glare control method for ADAS cameras according to claim 1, characterized in that, The process of performing coordinate transformation based on the glare area and the distance between the ADAS camera and the windshield to obtain black spot blocking data specifically includes: Establish the geometric mapping relationship between the image sensor plane of the ADAS camera and the windshield plane based on the optical imaging model; The position information of the glare area on the image sensor plane is converted into the dimming glass by combining the spacing to obtain the blocking black spot data, wherein the blocking black spot data includes the blocking black spot position and the blocking black spot area.

3. The real-time glare control method for ADAS cameras according to claim 1, characterized in that, The step of generating a black spot blocking control signal based on the black spot blocking data to control the preset dimming glass to generate black spot blocking specifically includes: Based on the location of the blocked black spot, a black spot origin position signal is generated on the dimming glass, and the black spot origin position signal includes the circumscribed circle center or the center of a rectangle; Based on the area of ​​the blocked black spot, a black spot shape signal is generated on the dimming glass, and the black spot shape signal includes a circumscribed circle or a minimum circumscribed rectangle; The dimming glass is controlled to generate the corresponding blocking black spot based on the origin position signal and the shape signal of the black spot.

4. The real-time glare control method for ADAS camera according to claim 1, characterized in that, The process of acquiring the detected camera operating parameters to extract pixel exposure specifically includes: The camera operating parameters transmitted by the image sensor of the ADAS camera are obtained. The camera operating parameters include raw image data composed of a two-dimensional pixel matrix, wherein each pixel in the matrix includes brightness information and / or color information. The pixel exposure is obtained by extracting the brightness information corresponding to each pixel based on the two-dimensional pixel matrix.

5. The real-time glare control method for ADAS cameras according to claim 1, characterized in that, The step of determining the glare area based on the pixel exposure threshold specifically includes: The target pixel is extracted by comparing its exposure with a target threshold, wherein the target threshold may be a fixed threshold or a dynamic threshold. The target pixels are obtained by extracting pixels that are greater than the target threshold, and the glare region is obtained by aggregating all the target pixels through connected component analysis. The number of glare regions includes at least one.

6. A real-time control system for camera glare in ADAS cameras, characterized in that, include: The acquisition module is used to acquire the detected camera operating parameters in order to extract pixel exposure. The judgment module is used to determine the glare area by performing a threshold judgment based on the pixel exposure. The conversion module is used to perform coordinate transformation based on the glare area and the distance between the ADAS camera and the windshield to obtain data on the blocking black spots; The generation module is used to generate a black spot blocking control signal based on the black spot blocking data to control the preset dimming glass to generate black spots.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by the processor, the program implements the real-time glare control method for ADAS cameras as described in any one of claims 1 to 6.

8. A computer program product, characterized in that, The computer program product includes computer program code, which, when run on a computer, enables the computer to implement the real-time glare control method for ADAS cameras as described in any one of claims 1 to 6.

9. An electronic device, characterized in that, The electronic device includes a processor and a memory; wherein the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory to enable the electronic device to perform the ADAS camera glare real-time control method as described in any one of claims 1 to 6.

10. A real-time glare control device for an ADAS camera, characterized in that, include: The module consists of an imaging module, a dimming module, and a control module. The imaging module includes an ADAS camera, which is installed in a fixed position inside the vehicle to capture vehicle visual information; The dimming module includes liquid crystal dimming glass or electrochromic glass, which is installed on the inside side of the windshield of the vehicle and is used to generate blocking black spots under control signals. The control module includes a controller for executing the real-time camera glare control method for ADAS cameras as described in any one of claims 1 to 6.

Images