Automobile adaptive field of view system control method, device, system and vehicle
By using multiple sensors to identify and automatically execute operations such as wiping, washing, and heating, the problem of insufficient adaptive control in automotive vision systems has been solved, achieving automated vision cleaning and improved safety.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-05-22
- Publication Date
- 2026-08-04
AI Technical Summary
Existing automotive vision systems lack adaptive control, causing drivers to react slowly or require manual operation when their vision is obstructed, thus affecting driving safety.
By using multi-sensor fusion to identify external attachments and internal frost and fog, the system automatically performs operations such as wipers, washers, heaters, and defrosters. Combined with driver eye-point monitoring and camera radar to compensate for field of vision, it achieves adaptive vision system control.
Without requiring manual operation by the driver, the system automatically judges the stubbornness of the stains and takes appropriate cleaning methods, avoiding blind scraping or wasting cleaning fluid, thus improving driving convenience and safety.
Smart Images
Figure CN122501280A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of vehicle technology, specifically to a method, device, system, and vehicle for controlling an adaptive vision system for automobiles. Background Technology
[0002] Currently, automotive vision systems typically include front and rear wiper blades, front and rear window washer / heater, and rearview mirror adjustment. However, drivers need to maintain a high level of concentration while driving, and may not notice obstructed vision in time, or may need to manually press buttons or move levers after noticing it, potentially creating safety hazards. Therefore, how to achieve adaptive control of the automotive vision system to improve overall driving safety is a pressing technical issue that requires research in the industry. Summary of the Invention
[0003] This invention provides a method, apparatus, system, and vehicle for controlling an adaptive vision system in automobiles, in order to solve the problem of poor safety caused by the lack of adaptation in the vision system in the prior art, and at least provides a beneficial option or creates conditions.
[0004] This invention provides a control method for an adaptive vision system for automobiles, comprising: acquiring environmental information of the vehicle's location through multiple sensors; Based on the environmental information, identify whether there are any external attachments on the front and rear windshields and left and right exterior rearview mirrors of the vehicle that may affect the driver's vision; If external attachments are detected on the front and rear windshields, the following actions are executed in sequence: control the wipers to perform one wipe; if the external attachments are still present after wiping, control the cleaning system to spray cleaning fluid onto the corresponding glass surface while simultaneously controlling the wipers to perform another wipe; if the external attachments are still not removed, generate a reminder message and display it on the central control screen. If external attachments are detected on the left or right side mirrors, the cleaning system is controlled to clean the mirror surface of the corresponding mirror.
[0005] Furthermore, the vehicle adaptive vision system control method also includes: identifying whether there is internal frost or fog on the front and rear windshields and left and right windows of the vehicle that affects the driver's vision based on the environmental information; if internal frost or fog is identified on the front and rear windshields and left and right windows, controlling the vehicle's air conditioning system to turn on for defrosting.
[0006] Furthermore, the vehicle adaptive vision system control method also includes: if internal frost or fog is detected on the front and rear windshields and left and right windows, the heating element at the corresponding position is controlled to perform heating and defrosting.
[0007] Furthermore, the vehicle adaptive vision system control method also includes: acquiring the driver's eye position in real time through a driver monitoring system, and automatically adjusting the lens angle of the left and right exterior rearview mirrors according to the eye position to ensure that the driver obtains the optimal field of vision.
[0008] Furthermore, the vehicle adaptive vision system control method also includes: when it is identified that the field of vision in a certain direction is largely obstructed in the windshield and affects driving safety, the camera and radar in that direction are automatically controlled to identify and scan the scene in that direction, and the image of the scene is projected onto the vehicle's central control screen.
[0009] Furthermore, the display area of the central control screen is divided into two parts, with the left half displaying the surrounding scenery of the vehicle from a top-down angle, and the right half displaying the image of the scene in the obscured direction.
[0010] Furthermore, the vehicle adaptive vision system control method also includes: when the sunlight sensor detects strong light shining towards the driver in front of the vehicle, and the driver monitoring system detects that the driver's pupils have significantly constricted, the light transmittance of a specific position on the driver's side windshield is adjusted to reduce the light intensity entering the driver's eyes.
[0011] On the other hand, an adaptive vision system control device for automobiles is provided, comprising: a processor and a memory, wherein the memory is used to store a computer-readable program; when the computer-readable program is executed by the processor, the processor causes the processor to implement the adaptive vision system control method for automobiles as described in any of the above technical solutions.
[0012] On the other hand, a control system for an adaptive vision system for automobiles is provided, including: an acquisition module, a recognition module, and a control module; The acquisition module is used to: acquire environmental information about the vehicle's location through multiple sensors; The identification module is used to: identify, based on the environmental information, whether there are any external attachments on the front and rear windshields and left and right exterior rearview mirrors of the vehicle that affect the driver's vision; The control module is used to: if external attachments are detected on the front and rear windshields, then sequentially execute the following: control the wipers to perform one wipe; if the external attachments still exist after wiping, control the cleaning system to spray cleaning fluid onto the corresponding glass surface and simultaneously control the wipers to perform another wipe; if the external attachments are still not removed, then generate a reminder message and display it on the central control screen. If external attachments are detected on the left or right side mirrors, the cleaning system is controlled to clean the mirror surface of the corresponding mirror.
[0013] On the other hand, a vehicle is provided that integrates an adaptive vision system control system for automobiles, as described in any one of the above-mentioned technical solutions.
[0014] This invention offers at least the following advantages: The method of this invention identifies external attachments through multi-sensor fusion and executes different removal strategies based on the location of the attachments, achieving adaptive and tiered treatment of external stains on vehicle windows and rearview mirrors. Without requiring manual operation of the wipers or washer buttons, the system automatically determines the stubbornness of the stains and adopts the most appropriate removal method, avoiding blindly wiping multiple times and causing glass wear or wasting waster fluid. When automatic removal fails, the system promptly alerts the driver to intervene, balancing automation and safety, and significantly improving driving convenience and visibility efficiency. Furthermore, this invention also provides corresponding devices, systems, and vehicles, the advantages of which are similar to the method and will not be repeated here. This invention is primarily applicable to the field of vehicle technology. Attached Figure Description
[0015] The accompanying drawings are provided to further understand the technical solutions of the present invention and constitute a part of the specification. They are used together with the embodiments of the present invention to explain the technical solutions of the present invention, and do not constitute a limitation on the technical solutions of the present invention.
[0016] Figure 1 This is a flowchart of the steps involved in the control method of an adaptive vision system for automobiles. Figure 2 This is a schematic diagram of the structure of the control device for an automotive adaptive vision system; Figure 3 This is the hardware structure of a vehicle adaptive vision system control device according to another embodiment; Figure 4 This is a schematic diagram of the system connection structure of the adaptive vision system control system for automobiles; Figure 5 This is a rendering of the cockpit. Detailed Implementation
[0017] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.
[0018] It should be noted that although functional modules are divided in the system diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the system or the order in the flowchart. The terms "first," "second," etc., in the specification, claims, and the aforementioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.
[0019] Research has revealed that current vehicle visibility systems may not detect obstructed vision in a timely manner, or require manual button presses or lever movements after detection, thus impacting driving safety. Therefore, improving driving safety is a pressing technical issue requiring research within the industry.
[0020] Please refer to Figure 1 , Figure 1 This is a flowchart of the steps involved in the control method of an adaptive vision system for automobiles.
[0021] To address the problems existing in the prior art, this application discloses a control method for an adaptive vision system for automobiles. This method, through multi-sensor fusion identification and adaptive actuator control, can automatically remove or compensate for various obstacles affecting the driver's vision during driving, thereby improving driving safety and convenience.
[0022] The vehicle adaptive vision system control method includes the following steps: Step 1: Obtain environmental information about the vehicle's location using multiple sensors.
[0023] The system includes various sensors, including but not limited to: sunlight and rain sensors, in-vehicle cameras, exterior cameras, temperature sensors, humidity sensors, lidar, millimeter-wave radar, and a driver monitoring system. Specifically, the sunlight and rain sensors detect light intensity and rainfall; the cameras capture images of the windows, rearview mirrors, and the vehicle's surroundings; the temperature sensors detect the ambient temperature inside and outside the vehicle, as well as the surface temperature of the window glass; and the driver monitoring system captures the driver's eye position and pupil state.
[0024] Step 2: Based on the environmental information, identify whether there are any external attachments on the front and rear windshields and left and right side mirrors of the vehicle that may affect the driver's vision.
[0025] External attachments include, but are not limited to, mud, bird droppings, leaves, snow, and dust. Real-time analysis of surface images of the front and rear windshields and left and right side mirrors is performed using external cameras, with the aid of rain sensor signals to determine the presence of obstructions. For example, if the image recognition algorithm detects a non-transparent, irregularly shaped area on the glass surface, and that area exceeds a preset threshold, it is determined that an external attachment is present.
[0026] Step 3: Perform the corresponding adaptive clearing operation based on the recognition results.
[0027] The specific adaptive cleaning operation includes the following steps: If external attachments are detected on the front and rear windshields, the following actions are executed sequentially: the wipers are controlled to perform one wipe; if the external attachments remain after wiping, the cleaning system is controlled to spray cleaning fluid onto the corresponding glass surface while simultaneously controlling the wipers to perform another wipe; if the external attachments are still not removed, a reminder message is generated and displayed on the central control screen. If external attachments are detected on the left and right exterior rearview mirrors, the cleaning system is controlled to clean the mirror surfaces of the corresponding rearview mirrors.
[0028] Specifically, regarding external attachments on the front and rear windshields: if external attachments are detected on the front and rear windshields, the system first controls the wipers to perform a single wipe. Simultaneously, the system uses a camera to capture images of the wiped glass again to determine if the attachments have been completely removed.
[0029] If the external deposits remain after wiping, such as dried bird droppings or sticky stains that cannot be removed by dry wiping, the system controls the cleaning system to spray cleaning fluid onto the corresponding glass surface while simultaneously controlling the wipers to perform multiple wiping strokes. The cleaning fluid is typically windshield washer fluid containing surfactants, which can soften or break down stubborn stains.
[0030] If the external deposits (such as hardened resin or ice) are not removed after spraying the washer fluid and using the wipers, the system generates a reminder message and displays it on the central control screen. The reminder message can be a text prompt (such as "Stubborn stains on the windshield, please clean manually") or an audible alarm signal.
[0031] Regarding external attachments on the left and right exterior rearview mirrors: If external attachments are detected on the left or right exterior rearview mirrors, the system directly controls the cleaning system on the corresponding rearview mirrors to clean the mirror surfaces. Specifically, the rearview mirror base integrates micro-nozzles, which can spray cleaning fluid onto the mirror surface upon system command. Combined with the micro-vibration or airflow drying function of the rearview mirror surface, the dirt is quickly removed. Since the rearview mirrors are small and usually do not have wipers, no wiping action is performed; only cleaning is performed.
[0032] This invention uses multi-sensor fusion to identify external attachments and executes different cleaning strategies (wipers, washers, alarms) based on the attachment's location (front or rear windshield or exterior rearview mirrors), achieving adaptive and tiered treatment of external stains on vehicle windows and rearview mirrors. Without requiring manual operation of the wipers or washers, the system automatically assesses the stubbornness of the stains and adopts the most appropriate cleaning method, avoiding repeated, indiscriminate wiping that could damage the glass or waste wasting cleaning fluid. When automatic cleaning fails, the system promptly alerts the driver to intervene, balancing automation and safety, and significantly improving driving convenience and visibility efficiency.
[0033] In some further specific embodiments, this embodiment addresses the handling of frost and fog inside the vehicle windows. The vehicle adaptive vision system control method further includes: identifying, based on the environmental information, whether there is internal frost or fog on the front and rear windshields and left and right windows that affects the driver's vision; if internal frost or fog is identified on the front and rear windshields and left and right windows, controlling the vehicle's air conditioning system to turn on for defrosting.
[0034] Specifically, based on the environmental information, the system identifies whether there is internal frost or fog on the front and rear windshields and left and right windows of the vehicle that affects the driver's visibility. Internal frost or fog typically occurs when there is a large temperature difference between the inside and outside of the vehicle and high humidity, such as in winter or rainy weather. By capturing images of the inner surface of the glass using an in-vehicle camera and comparing them with the temperature of the inner surface of the glass detected by a temperature sensor and the dew point temperature inside the vehicle, the system can accurately determine whether fogging or frost has formed.
[0035] If frost or fog is detected on the front and rear windshields and the left and right windows, the system will activate the vehicle's air conditioning system to defrost. Specifically, the system will automatically switch the air conditioning to external circulation mode, turn on the compressor, adjust the airflow direction to blow towards the windshield, and appropriately increase the temperature or activate the cooling and dehumidification function to raise the temperature of the inner surface of the glass or lower the relative humidity, thereby quickly eliminating the frost or fog.
[0036] This embodiment automatically determines whether the front and rear windshields and side windows are fogged or frosted by recognizing the interior temperature, humidity, and images of the inner surface of the glass, and then uses the vehicle's air conditioning system to defrost and defog. It can promptly eliminate interior visibility obstruction caused by temperature differences and humidity, without requiring the driver to manually adjust the air conditioning mode, fan speed, and temperature. It is especially suitable for scenarios with frequent fogging, such as winter or rainy days, effectively reducing driver distraction and improving driving safety.
[0037] In some further specific embodiments, another supplementary solution for handling frost and fog inside the vehicle windows is provided. The vehicle adaptive vision system control method further includes: if frost and fog are detected on the front and rear windshields and the left and right windows, controlling the heating elements at the corresponding locations to perform heating and defrosting.
[0038] Many vehicles have embedded electrically heated resistance wires (such as the rear window defroster grid) inside the front and rear windshields and, on some models, the side windows. The system determines the severity of frost or fog based on the glass surface temperature detected by temperature sensors and then automatically activates the corresponding heating element. The heating element generates heat, rapidly raising the temperature of the inner surface of the glass above the dew point, thus evaporating or melting the frost or fog. This method is more energy-efficient and faster-responding than air conditioning defrosting, especially effective when the engine is not running or the air conditioning is not working properly.
[0039] In this embodiment, when internal frost or fog is detected, direct heating and defrosting are performed using heating resistance wires embedded in the glass. Compared to air conditioning defrosting, the heating element responds faster, consumes less energy, and can still work reliably when the engine is not running or the air conditioning is not heating effectively (such as in low-temperature environments for pure electric vehicles). The front and rear windshields and side windows can be heated independently, which can quickly melt ice or evaporate frost and fog, restoring clear visibility. This is especially suitable for extremely cold regions or during cold starts in the morning.
[0040] In some further specific embodiments, the vehicle adaptive vision system control method further includes: acquiring the driver's eye position in real time through a driver monitoring system, and automatically adjusting the lens angle of the left and right exterior rearview mirrors according to the eye position to ensure that the driver obtains the optimal field of vision.
[0041] This embodiment further includes an adaptive rearview mirror adjustment function based on the above embodiment. The driver's eye position is acquired in real time through a driver monitoring system (DMS). The driver monitoring system is typically installed near the steering column or instrument panel, using an infrared camera to capture the driver's three-dimensional facial features and calculate the three-dimensional spatial coordinates of the left and right pupils, i.e., the eye position, in real time.
[0042] The system automatically adjusts the lens angles of the left and right exterior rearview mirrors based on the eye point position. The specific algorithm is as follows: The coordinates of the center point of the rearview mirror surface and the parameters of the target field of view area behind the vehicle are pre-stored. Based on the real-time eye point coordinates, the optimal lens deflection angle is calculated using the geometric optics reflection law. This allows the system to control a miniature stepper motor inside the rearview mirror to make fine adjustments in the horizontal and vertical directions, enabling the driver to obtain the widest and clearest rear view without turning their head. When the driver's posture changes (e.g., adjusting the seat height or backrest angle), the eye point position changes accordingly, and the system automatically readjusts the rearview mirror lenses without manual operation from the driver.
[0043] This embodiment uses a driver monitoring system to acquire the driver's eye position in real time and automatically adjusts the angle of the left and right exterior rearview mirrors accordingly. When the driver changes their seating position or adjusts the seat, the rearview mirrors automatically adjust to follow the eye position, maintaining the optimal rear field of vision at all times, avoiding the tedious manual adjustment of the mirrors. It also adapts to drivers of different statures and driving habits, requiring no manual settings after vehicle start-up or driver switching, greatly improving the level of intelligence and driving comfort.
[0044] In some further specific embodiments, the vehicle adaptive vision system control method further includes: when it is identified that the field of vision in a certain direction is largely obstructed in the windshield and affects driving safety, the camera and radar in that direction are automatically controlled to identify and scan the scene in that direction, and the image of the scene is projected onto the vehicle's central control screen.
[0045] This embodiment further includes an electronic vision compensation function for scenarios with large-area obstruction of vision, based on the above embodiments. When the system detects that the view in a certain direction is largely obstructed in the windshield and affects driving safety (for example, the windshield is covered by more than one-third of its area by fallen leaves, snow, or mud, and the aforementioned wipers and washers cannot clear it in time, or the obstruction is located in the wiper blind spot), it automatically controls the camera and radar in that direction to identify and scan the scene in that direction, and projects the image of the scene onto the vehicle's central control screen.
[0046] A specific application example is as follows: When a vehicle is traveling at high speed, a large amount of mud and water suddenly splashes onto the left side of the windshield, and the wipers cannot completely cover this area, making it impossible for the driver to see the road conditions on the left. At this time, the system automatically calls upon the wide-angle camera installed on the left side of the front bumper or below the left-side rearview mirror, and integrates it with target detection information from millimeter-wave radar to collect real-time video images and obstacle distance information from the left side. After image processing, the images are displayed on the central control screen for the driver's reference when changing lanes or avoiding obstacles.
[0047] This embodiment automatically activates the camera and radar in that direction when the driver's field of vision is significantly obstructed and cannot be cleared in time by physical means (such as windshield wipers or washers) (e.g., encountering mud splashes or fallen leaves while driving at high speed). The external scene is projected onto the central control screen in real time, achieving electronic vision compensation. The driver can safely obtain traffic conditions in the obstructed area through the screen without stopping to clear the obstruction. This is particularly suitable for scenarios such as high-speed driving, tunnels, and in inclement weather where immediate stopping to clear the obstruction is not possible. It effectively avoids the risk of collisions caused by blind spots and greatly improves driving safety in emergency situations.
[0048] refer to Figure 5 , Figure 5 This is a rendering of the driver's cockpit. In some further specific embodiments, the display area of the central control screen is divided into two parts, with the left half displaying the surrounding scenery of the vehicle from a top-down perspective, and the right half displaying the image of the scene in the obscured direction.
[0049] This embodiment primarily defines the display method of the central control screen. The display area of the central control screen is divided into two parts: the left half displays the surrounding scenery of the vehicle from a top-down perspective, and the right half displays the image of the scene in the obscured direction. The top-down panoramic view in the left half is generated by stitching together images from multiple surround-view cameras (e.g., four fisheye cameras: front, rear, left, and right), which can intuitively show the relative positional relationship between the vehicle and surrounding obstacles. The right half specifically displays a high-definition real-time image of the obscured direction. This image can be the original camera footage or an enhanced image (e.g., brightness correction, dynamic range compression). The simultaneous display of both parts allows the driver to have both an overall grasp of the environment and a clear view of the specific details in the obscured direction, thus enabling safe passage through complex road conditions.
[0050] In this embodiment, the central control screen displays a panoramic view from above on the left and a real-world image of the obscured direction on the right. The driver can intuitively grasp the relative position of the vehicle to surrounding obstacles and lane lines (such as whether it is crossing the line or how far it is from the shoulder) through the top-down view, and can also see specific details of the obscured direction (such as vehicles approaching from behind, pedestrians, or obstacles) through the real-world image on the right. These two complementary perspectives avoid the information loss caused by a single viewpoint, enabling the driver to make accurate and quick driving judgments even when visibility is obstructed, significantly reducing the accident rate caused by blind spots.
[0051] In some further specific embodiments, the vehicle adaptive vision system control method further includes: when the sunlight sensor detects strong light shining towards the driver in front of the vehicle, and the driver monitoring system detects that the driver's pupils have significantly constricted, the light transmittance of a specific position on the driver's side windshield is adjusted to reduce the light intensity entering the driver's eyes.
[0052] This embodiment mainly introduces the adaptive light intensity adjustment function. When the sunlight sensor detects strong light shining towards the driver in front of the vehicle (such as direct sunlight, oncoming vehicle headlights, or strong light at the tunnel exit), and the driver monitoring system detects that the driver's pupils are significantly constricted, the light transmittance of a specific position on the driver's side windshield is adjusted to reduce the light intensity entering the driver's eyes.
[0053] One method for adjusting the light transmittance of the windshield involves sandwiching an adjustable light-transmitting medium, such as an electrochromic material or a photosensitive medium filling layer, inside the driver's side area of the windshield. When strong light conditions are met, the system applies a control voltage or mechanical pressure to this area, causing a change in the structure within the medium layer. If a photosensitive medium filling scheme is used, the medium (such as magnesium fluoride solution or nanoporous silica) is rapidly injected into the microchannels within the glass gap. Utilizing the principle of total internal reflection, strong light incident at a large angle undergoes total internal reflection at the glass-medium interface, preventing it from entering the driver's eyes, allowing only dimmer light at a small angle to pass through, thus achieving an automatic "sunshade" effect. When the strong light disappears, the system retracts the photosensitive medium into the reservoir, and the glass returns to its normal light-transmitting state. The entire process eliminates the need for the driver to manually operate the sun visor or wear sunglasses, significantly improving driving comfort and safety. Of course, the location of this adjustable light-transmitting medium should not obstruct the driver's normal driving vision. It is generally placed at the top of the windshield to achieve the sunshade effect.
[0054] This embodiment automatically adjusts the light transmittance of the driver's side windshield (e.g., by using a light-diffusing medium to achieve total internal reflection) when a sunlight sensor detects strong light and the driver's pupils constrict. This instantly reduces the intensity of light entering the driver's eyes, effectively preventing glare from strong light (such as oncoming high beams or direct sunlight at sunrise and sunset), without requiring the driver to manually lower the sun visor or wear sunglasses. Since the adjustment area is limited to the glass area corresponding to the driver's line of sight, it does not affect the vision of other passengers, and the response speed is extremely fast (milliseconds). Compared to traditional electrochromic or photochromic glass, it has a higher dynamic range and lower cost, significantly improving driving safety and comfort in strong light environments.
[0055] refer to Figure 2 , Figure 2 This is a schematic diagram of the control device for an automotive adaptive vision system.
[0056] On the other hand, an adaptive vision system control device for automobiles is provided, comprising: a processor and a memory, the memory being used to store a computer-readable program. When the computer-readable program is executed by the processor, the processor causes the processor to implement the adaptive vision system control method for automobiles as described in any of the above specific embodiments.
[0057] Those skilled in the art will understand that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. As is known to those skilled in the art, communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.
[0058] Please see Figure 3 , Figure 3 This is another embodiment of the hardware structure of an adaptive vision system control device for automobiles. The adaptive vision system control device for automobiles includes: a processor 901, a memory 902, an input / output interface 903, a communication interface 904, and a bus 905.
[0059] The processor 901 can be implemented using a general-purpose CPU (Central Processing Unit), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the vehicle adaptive vision system control method provided in the embodiments of this application.
[0060] The memory 902 can be implemented as a read-only memory (ROM), static storage device, dynamic storage device, or random access memory (RAM). The memory 902 can store the operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 902 and is called and executed by the processor 901 using the methods described in the embodiments of this application.
[0061] The input / output interface 903 is used to implement information input and output.
[0062] The communication interface 904 is used to enable communication and interaction between this device and other devices. Communication can be achieved via wired means (such as USB, Ethernet cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).
[0063] Bus 905 transmits information between various components of the device, such as processor 901, memory 902, input / output interface 903, and communication interface 904.
[0064] The processor 901, memory 902, input / output interface 903, and communication interface 904 are connected to each other within the device via bus 905.
[0065] On the other hand, reference Figure 4 , Figure 4 This is a schematic diagram of the system connection structure of the adaptive vision system control system for automobiles.
[0066] A control system for an adaptive vision system for automobiles is provided, comprising: an acquisition module, an identification module, and a control module.
[0067] The acquisition module is used to acquire environmental information about the vehicle's location through multiple sensors.
[0068] The identification module is used to: identify, based on the environmental information, whether there are any external attachments on the front and rear windshields and left and right exterior rearview mirrors of the vehicle that affect the driver's vision.
[0069] The control module is used to: if external attachments are detected on the front and rear windshields, then sequentially execute the following: control the wipers to perform one wipe; if the external attachments still exist after wiping, control the cleaning system to spray cleaning fluid onto the corresponding glass surface and simultaneously control the wipers to perform another wipe; if the external attachments are still not removed, generate a reminder message and display it on the central control screen; if external attachments are detected on the left and right exterior rearview mirrors, control the cleaning system to clean the mirror surfaces of the corresponding rearview mirrors.
[0070] On the other hand, a vehicle is provided that integrates the vehicle adaptive vision system control system described in the above specific embodiments.
[0071] On the other hand, a computer-readable storage medium is provided, wherein a processor-executable program is stored, which, when executed by a processor, is used to implement the vehicle adaptive vision system control method as described in any of the above specific embodiments.
[0072] This application also discloses a computer program product, including a computer program or computer instructions, which are stored in a computer-readable storage medium. The processor of the computer device reads the computer program or computer instructions from the computer-readable storage medium and executes the computer program or computer instructions, causing the computer device to perform the vehicle adaptive vision system control method as described in any of the preceding embodiments.
[0073] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatuses.
[0074] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.
[0075] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, apparatuses, or units, and may be electrical, mechanical, or other forms.
[0076] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0077] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0078] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0079] Although the description of this application has been quite detailed and particularly focused on several of the described embodiments, it is not intended to limit itself to any of these details or embodiments or any particular embodiment. Rather, it should be considered as effectively covering the intended scope of this application by referring to the appended claims and taking into account the prior art, which provides for a broad possible interpretation of these claims. Furthermore, the foregoing description of this application with respect to embodiments foreseeable by the inventors is intended to provide a useful description, and non-substantial modifications to this application that have not yet been foreseen may still represent equivalent modifications.
[0080] It should be noted that in all specific embodiments of this application, when processing data related to user identity or characteristics, such as user information, user behavior data, user historical data, and user location information, user permission or consent is obtained first. Furthermore, the collection, use, and processing of this data comply with relevant laws, regulations, and standards. In addition, when embodiments of this application require access to sensitive personal information of users, separate permission or consent from the user is obtained through pop-ups or redirection to confirmation pages. Only after obtaining the user's separate permission or consent is the necessary user-related data required for the proper functioning of these embodiments acquired.
Claims
1. A control method for an adaptive vision system for automobiles, characterized in that, include: The vehicle acquires environmental information using multiple sensors; Based on the environmental information, identify whether there are any external attachments on the front and rear windshields and left and right exterior rearview mirrors of the vehicle that may affect the driver's vision; If external attachments are detected on the front and rear windshields, the following actions are executed in sequence: control the wipers to perform one wipe; if the external attachments are still present after wiping, control the cleaning system to spray cleaning fluid onto the corresponding glass surface while simultaneously controlling the wipers to perform another wipe; if the external attachments are still not removed, generate a reminder message and display it on the central control screen. If external attachments are detected on the left or right side mirrors, the cleaning system is controlled to clean the mirror surface of the corresponding mirror.
2. The control method of claim 1, wherein, Also includes: Based on the environmental information, identify whether there is internal frost or fog on the front and rear windshields and left and right windows of the vehicle that affects the driver's vision; If frost or fog is detected on the front and rear windshields and the left and right windows, the vehicle's air conditioning system will be activated to defrost the vehicle.
3. The vehicle adaptive vision system control method according to claim 1, characterized in that, Also includes: If frost or fog is detected on the front and rear windshields and the left and right windows, the corresponding heating element will be activated to perform defrosting.
4. The control method of claim 1, wherein, Also includes: The driver monitoring system acquires the driver's eye position in real time and automatically adjusts the lens angle of the left and right exterior rearview mirrors based on the eye position to ensure the driver has the best field of vision.
5. The vehicle adaptive vision system control method according to claim 1, characterized in that, Also includes: When it is detected that the view in a certain direction is largely obstructed in the windshield and affects driving safety, the camera and radar in that direction are automatically controlled to identify and scan the scene in that direction, and the image of the scene is projected onto the vehicle's central control screen.
6. The vehicle adaptive vision system control method according to claim 5, characterized in that, The central control screen is divided into two parts: the left half displays the surrounding scenery of the vehicle from a top-down perspective, and the right half displays the image of the scene in the obscured direction.
7. The vehicle adaptive vision system control method according to claim 1, characterized in that, Also includes: When the sunlight sensor detects strong light shining towards the driver from in front of the vehicle, and the driver monitoring system detects that the driver's pupils are significantly constricted, the light transmittance of a specific position on the driver's side windshield is adjusted to reduce the light intensity entering the driver's eyes.
8. A control device for an adaptive vision system for automobiles, characterized in that, include: processor; Memory, used to store computer-readable programs; When the computer-readable program is executed by the processor, the processor causes the processor to implement the vehicle adaptive vision system control method as described in any one of claims 1-7.
9. An automotive adaptive vision system control system, characterized by, include: Acquisition module, identification module, and control module; The acquisition module is used to: acquire environmental information about the vehicle's location through multiple sensors; The identification module is used to: identify, based on the environmental information, whether there are any external attachments on the front and rear windshields and left and right exterior rearview mirrors of the vehicle that affect the driver's vision; The control module is used to: if external attachments are detected on the front and rear windshields, then sequentially execute the following: control the wipers to perform one wipe; if the external attachments still exist after wiping, control the cleaning system to spray cleaning fluid onto the corresponding glass surface and simultaneously control the wipers to perform another wipe; if the external attachments are still not removed, then generate a reminder message and display it on the central control screen. If external attachments are detected on the left or right side mirrors, the cleaning system is controlled to clean the mirror surface of the corresponding mirror.
10. A vehicle characterized by comprising: The system integrates the adaptive vision system control system for automobiles as described in claim 9.