Method and device for adjusting electronic rearview mirror and electronic equipment

By identifying and adjusting specific information in the electronic rearview mirror image and optimizing the viewing angle of the camera pantoon, the problems of low quality and difficult installation of the electronic rearview mirror image are solved, and driving safety and user experience are improved.

CN118928218APending Publication Date: 2024-11-12CHONGQING SELIS PHOENIX INTELLIGENT INNOVATION TECH CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411065440.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The image quality of existing electronic rearview mirrors is not high, have low practicality, and the camera is easily damaged by external factors, has inflexible viewing angle changes, and high installation position and accuracy requirements.

Method used

By acquiring the rearview mirror images, identify image information such as glare, obstacles, dirt and field of view deviation, adjust the camera gimbal to optimize the field of view angle, increase the image content information, and achieve higher quality rearview mirror image output.

Benefits of technology

Improves the image quality and adaptability of the electronic rearview mirror, enhances driving safety and comfort, simplifies the installation process, and reduces driving risks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118928218A_ABST
    Figure CN118928218A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of vehicle control, and provides an electronic rearview mirror adjusting method and device and electronic equipment. The method comprises the following steps: acquiring a rearview mirror image captured by an electronic rearview mirror of a target vehicle; the electronic rearview mirror comprises a camera and a camera holder connected with the camera, and the camera holder is used for adjusting the view angle of the camera; determining a current view angle of the camera based on the rearview mirror image; identifying image information from the rearview mirror image; based on the image information and the current view angle of the camera, controlling a camera holder to adjust the view angle of the camera; wherein the adjusted view angle of the camera is used for increasing image content information of the rearview mirror image captured by the camera under the condition that parameters, except the view angle, of the camera are not changed. According to the method for adjusting the electronic rearview mirror, the camera of the electronic rearview mirror can output rearview mirror images with higher quality.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and in particular to an adjustment method, device and electronic equipment for an electronic rearview mirror. Background Art

[0002] The rearview mirrors installed on vehicles are generally traditional rearview mirrors made by traditional optics. The traditional rearview mirrors are prone to unclear images at night, rainy and foggy weather, and other bad weather conditions, making it difficult to clearly observe the driving environment of the vehicle through the traditional rearview mirrors. To solve this problem, in the prior art, electronic rearview mirrors are used to replace traditional rearview mirrors. Most of the time, the driving environment of the vehicle can be clearly observed through the electronic rearview mirror. However, the camera part of the electronic rearview mirror is easily damaged by the outside world, and the electronic rearview mirror lacks flexibility when changing its viewing angle. When installing the electronic rearview mirror, high requirements are placed on the installation position and installation accuracy.

[0003] It can be seen that the existing technology has the problem of low practicality of electronic rearview mirrors. Therefore, how to provide a solution to the above technical problems is an urgent problem to be solved by those skilled in the art. Summary of the invention

[0004] In view of this, the embodiments of the present application provide an adjustment method, device and electronic device for an electronic rearview mirror to solve the problem of low image quality and low practicality of the electronic rearview mirror in the prior art.

[0005] According to a first aspect of an embodiment of the present application, a method for adjusting an electronic rearview mirror is provided, comprising:

[0006] Acquire a rearview mirror image captured by an electronic rearview mirror of a target vehicle; the electronic rearview mirror comprises a camera and a camera platform connected to the camera, the camera platform being used to adjust the field of view angle of the camera;

[0007] Based on the rearview mirror image, determining a current field of view angle of the camera;

[0008] Recognize and obtain image information from the rearview mirror image, the image information including at least one of glare information, obstacle blocking information, dirt information, field of view range information corresponding to the driving field of view, and field of view deviation information between the current field of view and the surround field of view;

[0009] Based on the image information and the current field of view angle of the camera, the camera gimbal is controlled to adjust the field of view angle of the camera; wherein the adjusted field of view angle of the camera is used to increase the image content information of the rearview mirror image captured by the camera without changing the parameters of the camera other than the field of view angle.

[0010] A second aspect of the embodiments of the present application provides an electronic rearview mirror, comprising:

[0011] A support arm, one end of which is connected to the body of the vehicle;

[0012] A camera bracket connected to the other end of the arm;

[0013] A camera gimbal connected to the camera bracket;

[0014] A camera is mounted on the camera platform, and the camera platform is used to adjust the viewing angle of the camera;

[0015] A camera shielding cover is installed on the support arm and is used to shield the camera when the camera is rotated to a preset shielding angle;

[0016] A scraping and cleaning structure, the scraping and cleaning structure includes a water applicator and a retractable scraper strip, the water applicator and the retractable scraper strip are installed on the support arm in parallel, the water applicator is used to apply water to the camera when the camera is rotated to within the preset cleaning angle range, and the retractable scraper strip is used to scrape the camera when the camera is rotated to within the preset cleaning angle range.

[0017] According to a third aspect of the embodiments of the present application, there is provided an adjustment device for an electronic rearview mirror, comprising:

[0018] An acquisition module is configured to acquire a rearview mirror image captured by an electronic rearview mirror of a target vehicle; the electronic rearview mirror includes a camera and a camera platform connected to the camera, the camera platform is used to adjust the field of view angle of the camera;

[0019] A first processing module is configured to determine a current field of view angle of the camera based on the rearview mirror image;

[0020] A second processing module is configured to identify and obtain image information from the rearview mirror image, wherein the image information includes at least one of glare information, obstacle blocking information, dirt information, field of view range information corresponding to the driving field of view, and field of view deviation information between the current field of view and the surround field of view;

[0021] The adjustment module is configured to control the camera gimbal based on image information and the current field of view of the camera to adjust the field of view of the camera; wherein the adjusted field of view of the camera is used to increase the image content information of the rearview mirror image captured by the camera without changing the parameters of the camera other than the field of view.

[0022] According to a fourth aspect of an embodiment of the present application, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above method when executing the computer program.

[0023] According to a fifth aspect of an embodiment of the present application, a computer-readable storage medium is provided, which stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0024] Compared with the prior art, the embodiments of the present application have the following beneficial effects: obtaining a rearview mirror image captured by an electronic rearview mirror of a target vehicle, wherein the electronic rearview mirror includes a camera and a camera platform connected to the camera, wherein the camera platform is used to adjust the field of view of the camera, and the rearview mirror image acquisition at various angles around the body of the target vehicle can be adjusted by adjusting the camera platform, thereby achieving full coverage of the field of view outside the vehicle; the current field of view angle of the camera can be determined according to the rearview mirror image, and image information can be identified from the rearview mirror image, wherein the image information includes at least one of glare information, obstacle blocking information, dirt information, field of view range information corresponding to the driving field of view, and field of view information of the deviation between the current field of view and the surround field of view; the camera platform is controlled according to the image information and the current field of view angle of the camera, thereby adjusting the field of view angle of the camera, thereby achieving targeted adjustment based on the image information, so that the image content information of the rearview mirror image captured by the camera can be increased without changing the parameters of the camera other than the field of view angle, thereby enabling the camera of the electronic rearview mirror to output a higher quality rearview mirror image, so that the output rearview mirror image has stronger adaptability and higher practicality, thereby improving the user experience of using the electronic rearview mirror. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0026] Figure 1 It is a flow chart of an adjustment method of an electronic rearview mirror provided in an embodiment of the present application;

[0027] Figure 2 is a schematic diagram of another adjustment method of an electronic rearview mirror provided in an embodiment of the present application;

[0028] Figure 3 is a schematic diagram of another adjustment method of an electronic rearview mirror provided in an embodiment of the present application;

[0029] Figure 4 It is one of the schematic diagrams of an electronic rearview mirror provided in an embodiment of the present application;

[0030] Figure 5 This is a second schematic diagram of an electronic rearview mirror provided in an embodiment of the present application;

[0031] Figure 6 is a schematic diagram of an adjustment device for an electronic rearview mirror provided in an embodiment of the present application;

[0032] Figure 7 It is a schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0033] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0034] A method and device for adjusting an electronic rearview mirror according to an embodiment of the present application will be described in detail below with reference to the accompanying drawings.

[0035] In the prior art, electronic rearview mirrors are used instead of traditional rearview mirrors to solve the problem of observing the driving environment of the vehicle when the driving environment is relatively difficult. However, electronic rearview mirrors are generally installed with fixed cameras, so there are many requirements for the characteristics of the camera, which increases the difficulty of installing and using electronic rearview mirrors on vehicles and also affects the output image quality, specifically:

[0036] Fixed-mounted cameras have high requirements for the camera's field of view (FOV), and blind spots cannot be completely avoided; single-view cameras have high difficulty in processing images within a limited FOV, and require high processor computing power; fixed-mounted cameras have high requirements for the installation location, and it is difficult for different vehicle types to share the same installation location, and it is difficult to debug the installation location; fixed-mounted cameras are usually additional cameras and cannot be shared with cameras with other functions such as surround-view cameras, increasing hardware costs; the lens part of the camera is exposed to the outside for a long time, which accelerates the aging of the lens, and there is usually no physical protection for the lens part, which makes the lens part vulnerable to external damage; electronic cameras are difficult to clean dirt and treat with water mist through physical means.

[0037] Based on the above problems, the present application obtains the rearview mirror image captured by the electronic rearview mirror of the target vehicle and the capture angle corresponding to the rearview mirror image, identifies the image information from the rearview mirror image, determines the preset adjustment strategy corresponding to the image information, and controls and adjusts the camera pan according to the preset adjustment strategy, thereby adjusting the camera's field of view angle, so that the rearview mirror image can display the information in the rearview mirror field of view of the target vehicle more clearly and completely. By referring to the image information, the camera pan is controlled and adjusted in a targeted manner to adjust the camera's field of view angle, so as to achieve the capture of the rearview mirror image at various angles of the target vehicle's driving environment, and achieve full coverage of the target vehicle's driving environment. Compared with the existing technology of collecting images with fixed viewing angles, it has a larger application range. Further, by controlling and adjusting the camera pan to adjust the camera's field of view angle, the field of view blind spot of the fixedly installed electronic rearview mirror can be eliminated, and the problem of greater debugging difficulty caused by different installation positions of different vehicle types can be reduced, thereby improving driving safety, convenience and comfort. The present application is described below through specific embodiments.

[0038] Figure 1 FIG. 1 is a flow chart of an adjustment method of an electronic rearview mirror provided in an embodiment of the present application. The adjustment method of the electronic rearview mirror can be executed by a controller in the cloud or in the target vehicle. Figure 1 As shown, the adjustment method of the electronic rearview mirror includes the following steps:

[0039] S101, acquiring a rearview mirror image captured by an electronic rearview mirror of a target vehicle;

[0040] The electronic rearview mirror includes a camera and a camera platform connected to the camera, the camera platform is used to adjust the camera's field of view. The electronic rearview mirror also includes a vehicle-mounted display screen installed in the vehicle, the vehicle-mounted display screen is used to display the rearview mirror image captured by the camera.

[0041] Specifically, the camera can continuously capture real-time images of the side, rear and rear of the target vehicle to form a rearview mirror image.

[0042] In addition, the camera gimbal can achieve 360-degree rotation in the horizontal direction and 180-degree rotation in the vertical direction, thereby controlling the camera to rotate in the horizontal direction within the range of 0° to 360° and in the vertical direction within the range of 0° to 180°. In this way, the camera gimbal can be used to accurately adjust the camera in the horizontal, vertical or tilted direction, thereby adjusting the camera's field of view to adapt to different driving needs and road environments. For example, the camera gimbal can be used to keep the camera stable under harsh road conditions and weather conditions, thereby obtaining a clear and stable rearview mirror image.

[0043] It should be noted that the camera pan / tilt can be directly mounted on the vehicle body; it can also be mounted on the vehicle body via a camera bracket; or the camera pan / tilt can be first connected to the camera bracket, and the camera bracket can be connected to the vehicle body via a support arm. The connection method between the camera pan / tilt and the vehicle body is not limited here, and it is only necessary to ensure that the camera can rotate 360 ​​degrees in the horizontal direction and 180 degrees in the vertical direction.

[0044] S102, determining a current field of view angle of the camera based on the rearview mirror image;

[0045] Specifically, by analyzing the rearview mirror image, the field of view of the rearview mirror image can be determined, and thus based on the correspondence between the field of view of the rearview mirror image and the field of view angle of the camera, the current field of view angle of the camera can be determined.

[0046] By determining the current field of view angle of the camera, a reference is provided for subsequent adjustment of the field of view angle of the camera.

[0047] S103, recognizing and obtaining image information from the rearview mirror image;

[0048] Specifically, in this embodiment, the rearview mirror image can be input into the image processing unit, so that the image processing unit performs image processing on the rearview mirror image to obtain image information included in the rearview mirror image.

[0049] The image information includes at least one of glare information, obstacle blocking information, dirt information, field of view range information corresponding to the driving field of view, and field of view information of deviation between the current field of view and the surround field of view. That is, the detected image information may include one or more of glare information, obstacle blocking information, dirt information, field of view range information corresponding to the driving field of view, and field of view information of deviation between the current field of view and the surround field of view. For example, the image information may include glare information and obstacle blocking information, or include glare information, dirt information, and field of view range information, etc. Any one or a combination of multiple categories of the above contents may be used as image information.

[0050] In addition, the glare information may include the glare position and glare size in the rearview mirror image. When identifying the glare information, it is possible to determine whether there is glare caused by sunlight, oncoming vehicle lights, etc. by identifying the area with abnormal brightness in the rearview mirror image. Glare may seriously affect the driver's vision.

[0051] When identifying obstacle occlusion information, the outline and position of objects in the rearview mirror image can be analyzed to determine whether there are obstacles such as vehicles close to the target vehicle, obstacles on the road, etc. that block the rearview mirror's field of view. Obstacle occlusion can easily affect driving safety.

[0052] The dirt information may include the location and size of the dirt in the rearview mirror image. When identifying the dirt information, it is possible to analyze whether there are areas with abnormal clarity in the rearview mirror image (e.g., low clarity or blank areas in the image), to check whether there are raindrops, dust, dirt accumulation, etc. on the camera of the electronic rearview mirror that affect the clarity of the rearview mirror image.

[0053] The visual field information corresponding to the driving visual field may include the size of the visual field. When identifying the visual field information, it may be determined whether the visual field of the current rearview mirror image is wide enough, that is, whether it is consistent with the preset visual field, based on the current driving information of the target vehicle, wherein the driving information includes at least one of the vehicle speed, steering wheel angle, and gear information of the target vehicle.

[0054] The deviation visual field information may include a deviation angle between the current visual field and the surround visual field. When identifying the deviation visual field information, the current visual field and the surround visual field may be compared to identify the deviation between the current visual field and the surround visual field.

[0055] By identifying the above image information in the rearview mirror image, the input image of the electronic rearview mirror can be optimized through the image information, that is, the field of view angle of the camera can be optimized. For example, assuming that the glare information is analyzed from the rearview mirror image, the field of view angle of the camera can be adjusted by controlling the adjustment of the angle of the camera gimbal, thereby reducing or eliminating the glare in the rearview mirror image to improve the clarity and field of view of the rearview mirror image; for another example, assuming that the obstacle occlusion information is analyzed from the rearview mirror image, the field of view angle of the camera can be adjusted by controlling the adjustment of the angle of the camera gimbal, thereby reducing the proportion of obstacles in the rearview mirror image to improve the field of view of the rearview mirror image; for another example, assuming that the field of view range information corresponding to the driving field of view is analyzed from the rearview mirror image, if the field of view range information is inconsistent with the required field of view range information, the field of view angle of the camera can be adjusted by controlling the adjustment of the angle of the camera gimbal, so as to obtain the required field of view range information.

[0056] S104, controlling the camera pan / tilt based on the image information and the current field of view of the camera to adjust the field of view of the camera;

[0057] The adjusted field of view angle of the camera is used to increase the image content information of the rearview mirror image captured by the camera without changing the parameters of the camera other than the field of view angle. In this way, after the field of view angle of the camera is adjusted in a targeted manner with reference to the image information, the image content information of the rearview mirror image can be increased without adjusting other parameters of the camera, thereby increasing the reference value of the rearview mirror image for vehicle driving.

[0058] Specifically, an adjustment strategy corresponding to the image information can be determined based on the image information, and then the camera gimbal is controlled and adjusted based on the current field of view of the camera and the adjustment strategy corresponding to the image information, thereby adjusting the field of view of the camera. The adjustment strategy corresponding to the image information is used to increase the image content information of the rearview mirror image captured by the camera without changing the parameters of the camera other than the field of view, thereby achieving targeted adjustment of the image information to achieve the best adjustment effect.

[0059] In addition, when controlling the camera gimbal, the angle of the camera gimbal in the horizontal and vertical directions can be controlled and adjusted, so that the field of view of the camera can be adjusted to optimize the rearview mirror image captured by the camera in an automatic or semi-automatic manner.

[0060] Furthermore, the adjusted field of view of the camera can also make the rearview mirror image clearer, specifically:

[0061] Adjusting the camera's field of view angle according to the glare information can eliminate or reduce the impact of glare on the rearview mirror image quality, making the rearview mirror image clearer and increasing the image content information of the rearview mirror image;

[0062] Adjusting the camera's field of view angle according to obstacle occlusion information can maximize the field of view, reduce obstacle occlusion, and increase the image content information of the rearview mirror image;

[0063] Adjust the camera's field of view according to dirt information to automatically clean or prompt the driver to clean the camera lens, making the rearview mirror image clearer;

[0064] By adjusting the camera's field of view angle according to the field of view range information, the image content information of the rearview mirror image can be increased;

[0065] The camera angle is adjusted according to the deviation field of view information to compensate for the field of view deviation, ensuring that the driver obtains a complete and clear surround view, which can increase the image content information of the rearview mirror image.

[0066] According to the technical solution provided by the embodiment of the present application, by capturing the rearview mirror image of the electronic rearview mirror, it is possible to identify image information that may affect driving safety, such as glare information, obstacle occlusion information, dirt information, field of view information, deviation field of view information, etc., so that the field of view angle of the camera can be adjusted to optimize the field of view of the rearview mirror, thereby reducing the visual blind spot, improving the driver's perception of the surrounding environment of the target vehicle, and preventing traffic accidents. At the same time, the rearview mirror image can be automatically optimized according to the driving environment and light conditions to avoid glare interference and obstacle occlusion in the rearview mirror image, providing the driver with a clearer and more comfortable driving field of view, and reducing visual fatigue caused by long-term driving; the camera gimbal can enable the camera to flexibly adjust the field of view angle in different directions, compared with the existing technology that can only collect rearview mirror images with a fixed angle of view, it has a larger application range, and in the process of adjusting the camera by adjusting the camera gimbal, the driver does not need to operate manually, which simplifies the operation process, avoids distracting the driver's attention during driving, and reduces driving risks, so that the electronic rearview mirror provided by this embodiment improves driving safety, convenience and comfort, and improves the driver's experience.

[0067] In some embodiments, the glare information includes the glare position and glare size of the glare in the rearview mirror image, and the obstacle occlusion information includes the obstacle position of the obstacle in the rearview mirror image and the proportion of the obstacle to the rearview mirror image;

[0068] If the image information includes glare information and / or obstacle occlusion information, the camera gimbal is controlled based on the image information and the current field of view of the camera to adjust the field of view of the camera, including:

[0069] If the image information is glare information, determine the rotation direction of the camera gimbal based on the glare position, and use the current field of view angle as the starting angle, control the camera gimbal to rotate according to a first preset rotation step and rotation direction to adjust the field of view angle of the camera until the proportion of glare in the rearview mirror image is less than a first preset ratio threshold;

[0070] If the image information is obstacle occlusion information, determine the rotation direction of the camera gimbal based on the obstacle position, and use the current field of view angle as the starting angle, control the camera gimbal to rotate according to the second preset rotation step and rotation direction to adjust the field of view angle of the camera until the proportion of the obstacle in the rearview mirror image is less than the second preset ratio threshold;

[0071] If the image information includes glare information and obstacle occlusion information, with the current field of view angle as the starting angle, the camera gimbal is controlled to rotate according to a third preset rotation step, and the proportion of glare in the rearview mirror image and the proportion of obstacles in the rearview mirror image at different angles after the camera gimbal is rotated are determined; based on the proportion of glare in the rearview mirror image and the proportion of obstacles in the rearview mirror image, a correction angle is obtained, and the camera gimbal is controlled to rotate to adjust the current field of view angle to the correction angle.

[0072] Specifically, glare information and obstacle occlusion information are related to whether the driver can obtain a clear, unobstructed view through the rearview mirror image, thereby improving driving safety. Among them, glare information includes the glare position and glare size of the glare in the rearview mirror image, and obstacle information includes the obstacle position in the rearview mirror image and the proportion of the obstacle in the rearview mirror image. The image field of view can be optimized according to the glare information and obstacle information to ensure that important road information is not blocked.

[0073] In addition, when the image information includes glare information and obstacle occlusion information, or only includes glare information, or only includes obstacle occlusion information, the camera can be controlled to rotate in different ways according to the information included in the image information to optimize the field of view, thereby minimizing interference factors and improving the driving experience.

[0074] When the image information is glare information, the direction in which the camera gimbal needs to rotate is determined according to the position of the glare in the rearview mirror image. In this process, it is usually the direction away from the glare, and the current field of view angle is used as the starting point. The rotation angle of the camera gimbal is adjusted according to a first preset rotation step, and the rotation of the camera gimbal is gradually controlled and adjusted, and then the field of view angle of the camera is adjusted until the proportion of glare in the rearview mirror image is less than a first preset ratio threshold, thereby effectively reducing or eliminating the impact of glare on the driver's line of sight, improving the clarity of the rearview mirror image and increasing the image field of view of the rearview mirror image.

[0075] For example, when the glare position is above the rearview mirror image, the rotation direction of the camera is determined to be downward, and the rotation direction of the camera gimbal is determined according to the rotation association between the camera and the camera gimbal, and the camera gimbal is rotated according to a first preset rotation step length to adjust the field of view angle of the rearview mirror image until the proportion of glare in the rearview mirror image is less than a first preset ratio threshold, wherein the first preset rotation step length can be a smaller angle value, and a suitable first preset rotation step length, such as 0.5° (degrees, angle unit), can be determined based on preliminary tests, so as to ensure smoothness and precision during the adjustment process of the camera gimbal.

[0076] In addition, when the image information is obstacle occlusion information, the direction in which the camera gimbal needs to rotate is determined according to the position of the obstacle occlusion in the rearview mirror image. In this process, the obstacle is usually avoided or moved to the edge of the field of view, and the current field of view angle is used as the starting point. The rotation angle of the camera gimbal is adjusted according to the second preset rotation step control, and the rotation of the camera gimbal is gradually adjusted, and then the field of view angle of the camera is adjusted until the proportion of the obstacle occlusion in the rearview mirror image is less than the second preset ratio threshold, thereby effectively reducing or eliminating the impact of the obstacle occlusion on the driver's line of sight, improving the clarity of the rearview mirror image and increasing the image field of view of the rearview mirror image.

[0077] For example, when the obstacle obstructing the view is on the left side of the rearview mirror image, the rotation direction is determined to be right, and the camera gimbal is rotated to the right according to the second preset rotation step length, thereby adjusting the field of view angle of the rearview mirror image until the proportion of the obstacle obstructing the view mirror image is less than the second preset ratio threshold value, wherein the second preset rotation step length may be a smaller angle value, and a suitable first preset rotation step length, such as 1° (degree, angle unit), may be determined based on preliminary tests, thereby ensuring smoothness and precision during the adjustment of the camera gimbal.

[0078] In addition, when the image information includes both glare information and obstacle occlusion information, the current field of view angle is used as the starting angle, and a tentative rotation is performed according to the third preset rotation step. Each time the third preset rotation step is rotated, the proportion of the glare information and the obstacle information in the rearview mirror image is determined in real time. According to the proportion of glare in the rearview mirror image and the proportion of obstacles in the rearview mirror image, a correction angle is obtained that can effectively reduce glare interference and minimize obstacle occlusion, that is, a correction angle obtained by combining the proportion of glare in the rearview mirror image and the proportion of obstacle occlusion in the rearview mirror image.

[0079] Among them, the third preset rotation step is determined based on preliminary experiments, and different glare information and obstacle occlusion information correspond to different third preset rotation step lengths. For example, the third preset rotation step length may be between the first preset rotation step length and the second preset rotation step length to balance the adjustment requirements of glare and obstacle occlusion.

[0080] In addition, after obtaining the correction angle, the camera gimbal is controlled to rotate and the current field of view angle is adjusted to the correction angle, thereby optimizing the current field of view, increasing the range of the current field of view in the rearview mirror image, and being able to output a higher quality rearview mirror image, thereby improving the user's driving experience.

[0081] According to the technical solution provided in the embodiment of the present application, it is possible to adjust the image content information included in the rearview mirror image by controlling and adjusting the camera gimbal, thereby specifically improving the clarity and completeness of the target vehicle's outside field of view, clearing visual obstacles, and outputting higher quality rearview mirror images, reducing the processing of the rearview mirror image by the vehicle-computer system, and improving the driver's driving experience.

[0082] In some embodiments, the dirt information includes the location of the dirt in the rearview mirror image and the size of the dirt; the electronic rearview mirror also includes a scraping cleaning structure, which is installed on the support arm and is used to apply water and scrape the camera when the camera rotates to a preset cleaning angle range, and the support arm is used to connect the body of the target vehicle and the camera bracket, and the camera gimbal is installed on the camera bracket;

[0083] If the image information includes dirt information, the camera pan / tilt is controlled based on the image information and the current field of view of the camera to adjust the field of view of the camera, including:

[0084] Based on the preset cleaning angle range and the current field of view angle, determine the angle and direction of the camera pan / tilt to be rotated; control the camera pan / tilt to rotate according to the angle and direction to control the camera to rotate to the preset cleaning angle range;

[0085] When it is detected that the camera has rotated to within the preset cleaning angle range, the camera is controlled to rotate within the preset cleaning angle range, and the scraping cleaning structure is controlled to apply water to and scrape the camera until preset conditions are met. The preset conditions include that the scraping frequency is greater than the preset frequency or the size of the dirt in the rearview mirror image does not exceed a preset value.

[0086] Specifically, the dirt information indicates the condition of dirt attached to the camera mirror, such as point dirt, line dirt, flaky dirt or large area covered with dust. The dirt information includes the position and size of the dirt in the rearview mirror image, such as the presence of 3 cm circular dirt in the central area, edge area or specific area of ​​the rearview mirror image.

[0087] In addition, in order to effectively clean dirt, the electronic rearview mirror also includes a scraping cleaning structure, which is installed on the camera arm to ensure the stability and precise positioning of the camera. The scraping cleaning structure is used to apply water and scrape the camera mirror surface when the camera is rotated to the preset cleaning angle range, so as to quickly clean the dirt on the camera mirror surface.

[0088] In addition, when the image information includes dirt information, the angle and direction that the camera gimbal needs to rotate is determined based on the preset cleaning angle range and the current field of view of the camera, thereby ensuring that the camera can accurately enter the effective working area of ​​the scraping and cleaning structure and effectively clean the camera mirror.

[0089] For example, the difference between the current field of view angle and the maximum value corresponding to the preset cleaning angle range can be determined as the rotation angle. The preset cleaning angle range can be set comprehensively based on the mechanical structure of the camera, the effective working area of ​​the scraping cleaning structure, and avoiding interference with the driver's vision.

[0090] In addition, the camera gimbal is controlled to rotate according to the rotation angle and direction until the camera rotates to the preset cleaning angle range. During this process, the position of the camera can also be monitored in real time to ensure the accuracy and safety of the rotation.

[0091] In addition, when the camera reaches a preset cleaning angle range, the scraping cleaning structure can be activated to control the scraping cleaning structure to apply water and scrape the camera, and the water application and scraping operations are performed in a cycle. At the same time, the real-time dirt information in the rearview mirror image is monitored, and the camera gimbal is controlled to rotate according to the real-time dirt information to control the camera to make fine adjustments within the preset cleaning angle range. The scraping frequency is greater than the preset frequency or the size of the dirt in the rearview mirror image does not exceed the preset value. The preset frequency and preset value can be limited according to actual needs. For example, the preset frequency can be 30 times, and the preset value can be 5 cubic centimeters, thereby ensuring that the driver can clean the rearview mirror camera at any time, improving the convenience of cleaning the camera, and improving driving safety and comfort.

[0092] Furthermore, in order to ensure safety during driving, the camera of the rearview mirror can be divided into areas, the area where the dirt information is located and the cleaning angle range corresponding to the area can be determined, the camera can be controlled to rotate within the cleaning angle range, and the scraping plot structure can be controlled to apply water and scrape the camera, thereby reducing cleaning time and improving cleaning efficiency, thereby ensuring safety.

[0093] According to the technical solution provided in the embodiment of the present application, the rotation of the camera gimbal can be controlled to control the camera to rotate to a preset cleaning angle range, so that the scraping cleaning structure can apply water and scrape the camera, thereby achieving the purpose of cleaning the camera. The scraping cleaning structure cleans the camera by physical means, and can also achieve defogging and decontamination of the camera, quickly and efficiently outputting a clear rearview mirror image, thereby improving driving safety, convenience and comfort, and enhancing the driving experience.

[0094] In some embodiments, the visual field information corresponding to the driving visual field includes the size of the visual field;

[0095] If the image information includes field of view range information corresponding to the driving field of view, the camera gimbal is controlled based on the image information and the current field of view angle of the camera to adjust the field of view angle of the camera, including:

[0096] Acquiring current driving information of the target vehicle, the current driving information including at least one of vehicle speed, steering wheel angle, and gear position information of the target vehicle;

[0097] Based on the corresponding relationship between the driving information and the visual field size obtained by the experiment, determining a preset visual field size corresponding to the current driving information;

[0098] When the size of the field of view is inconsistent with the preset field of view, the rotation direction of the camera gimbal is determined based on the current field of view angle, and the current field of view angle is used as the starting angle. According to the rotation direction and the rotation step corresponding to the current driving information, the camera gimbal is controlled to rotate accordingly to adjust the camera's field of view angle until the size of the field of view is consistent with the preset field of view size.

[0099] Specifically, the field of view information corresponding to the driving field of view may include horizontal angle coverage, vertical angle coverage and possible blind spot analysis. The field of view can directly affect the driver or the automatic driving system's perception of the target vehicle's driving environment.

[0100] In addition, if the image information includes field of view information corresponding to the driving field of view, the current driving information of the target vehicle is obtained, wherein the driving information includes at least one of the vehicle speed, steering wheel angle and gear information of the target vehicle. The driving information can be obtained in real time through the sensor corresponding to the target vehicle to ensure immediate response to dynamic changes of the target vehicle.

[0101] In addition, a correspondence between driving information and the size of the visual field can be established based on a large amount of test data and statistical analysis. According to the current driving information, a preset visual field size corresponding to the current driving information can be quickly looked up or calculated based on the correspondence. The correspondence between driving information and the size of the visual field can be: for example, a wider visual field is required when the vehicle speed is high, and when the vehicle speed is low or when turning, more attention needs to be paid to the distance between the vehicle body and surrounding obstacles, that is, a relatively smaller visual field is required. Determining the preset visual field size corresponding to the current driving information through the correspondence between driving information and the size of the visual field can quickly determine the corresponding preset visual field size, which is efficient and takes a short calculation time.

[0102] For example, the correspondence between driving information and the size of the field of view can be that when the current vehicle speed is 60 km / h, the horizontal rotation step length corresponding to the field of view angle is 1°, and the horizontal rotation step length increases by 0.1° for every 1 km / h increase in vehicle speed, and the steering wheel angle and gear position information can be set in the same way. Similarly, when any two of the vehicle speed, steering wheel angle, and gear position information exist, tests and calibrations are performed to determine the reasonable correspondence between driving information and the size of the field of view; when all of the vehicle speed, steering wheel angle, and gear position information exist, tests and calibrations are performed to determine the reasonable correspondence between driving information and the size of the field of view.

[0103] In addition, the current field of view size is compared with the preset field of view size. When the field of view size is consistent with the preset field of view size, there is no need to adjust the camera pan and field of view angle. When the field of view size is inconsistent with the preset field of view size, the rotation direction of the camera pan is determined according to the difference between the current field of view angle and the preset field of view angle corresponding to the preset field of view size, that is, it is determined that the camera pan needs to rotate in at least one direction of up, down, left or right.

[0104] In addition, according to the rotation direction and the rotation step corresponding to the current driving information, the rotation of the camera gimbal is controlled with the current field of view angle as the starting angle, thereby adjusting the field of view angle of the camera until the field of view range is consistent with the preset field of view range.

[0105] Furthermore, the rotation step length can be set to different values ​​according to the urgency of the current driving information. For example, if the vehicle speed is high or rapid adjustment is required for emergency obstacle avoidance, the rotation step length can be set to a larger value, and the normal state can be used at other times.

[0106] Furthermore, in the process of adjusting the camera's field of view, safety and stability also need to be considered. For example, the camera head should be prevented from causing visual interference to the driver due to rapid or large rotations. At the same time, it is necessary to ensure the ability to capture key information under any circumstances to ensure driving safety.

[0107] According to the technical solution provided in the embodiment of the present application, by comprehensively applying image information, the camera's current field of view angle and the target vehicle's driving information, precise control and adjustment of the camera gimbal can be achieved, thereby optimizing the field of view angle and capturing the best field of view in a targeted manner. It is possible to obtain the vehicle's driving speed and the distance information of surrounding vehicles in real time through vehicle-side sensors, such as distance sensors, speed sensors, etc. According to these driving information, the position of the camera can be intelligently adjusted without the need for manual operation by the driver, thereby improving driving safety and comfort.

[0108] In some embodiments, the deviation field of view information is the angle difference between the current field of view angle and the preset surround field of view angle of the camera;

[0109] If the image information is the deviation field of view information between the current field of view and the surround field of view, the camera gimbal is controlled based on the image information and the current field of view angle of the camera to adjust the field of view angle of the camera, including:

[0110] Based on whether the angle difference is greater than zero, determine the rotation direction of the camera pan / tilt, take the current field of view angle as the starting angle, and control the camera pan / tilt rotation angle difference according to the rotation direction to adjust the field of view angle of the camera;

[0111] A deviation compensation image corresponding to the angle difference is obtained, and the deviation compensation image is spliced ​​to the rearview mirror image to obtain a surround view image corresponding to the surround view field, so as to increase the image content information of the rearview mirror image captured by the camera.

[0112] Specifically, the deviation field of view information is the angle difference between the current field of view angle and the preset surround field of view angle of the camera, which is quantified in degrees. The angle difference is obtained by comparing the direction of the current field of view with the full coverage requirement of the preset surround field of view. For example, the rearview mirror image captured by the camera facing straight back is a panoramic image, but due to some reasons, such as the existence of glare information, the angle of the camera is now biased to the left, and the deviation field of view information will reflect the above-mentioned left deviation angle.

[0113] In addition, the current camera's field of view angle is compared with the preset surround field of view angle to determine the specific angle difference, and to determine whether the angle difference is greater than zero, wherein the direction of the camera pan tilt to the left can be set as the negative direction, and the right direction can be set as the positive direction, or the direction of the camera pan tilt to the right can be set as the positive direction, and the left direction can be set as the negative direction. When the angle difference is greater than zero, it is determined that the camera pan tilt needs to be rotated in the preset positive direction to reduce the deviation, and vice versa, when the angle difference is less than zero, it is determined that the camera pan tilt needs to be rotated in the preset reverse direction to reduce the deviation.

[0114] In addition, after determining the rotation direction of the camera gimbal, the current field of view angle is used as the starting angle, and the camera rotation angle difference is controlled according to the rotation direction. During this process, the camera continuously captures the rearview mirror image. The captured rearview mirror image can compensate for the field of view deviation before the rotation as the camera gimbal rotates. When the camera gimbal completes the rotation according to the angle difference, the current field of view angle and the preset surround field of view angle are aligned, and the obtained image is used as the deviation compensation image. The deviation compensation image can compensate the rearview mirror image output at the current field of view angle to obtain a more comprehensive rearview mirror image under the preset surround field of view angle, which increases the image content information of the output rearview mirror image, making the output rearview mirror image more comprehensive and complete.

[0115] In addition, after obtaining the deviation compensation image, the deviation compensation image and the original rearview mirror image are spliced ​​to obtain a surround view image corresponding to the surround view field of view. When splicing the deviation compensation image and the original rearview mirror image, it is necessary to consider the overlapping area between the two images, and optimize the splicing effect through an algorithm to ensure the continuity and consistency of the surround view image.

[0116] In addition, when the camera pan tilt rotates by the angle difference, that is, after rotating to the preset surround angle, the camera pan tilt is controlled to rotate to the previous position to ensure the effectiveness of the rearview mirror's field of view during driving. Furthermore, a compensation cycle can be set to control the camera pan tilt to rotate in the above manner every compensation cycle to obtain a deviation compensated image, thereby ensuring the integrity and real-time nature of the surround image.

[0117] According to the technical solution provided in the embodiment of the present application, the hardware layout cost can be reduced by reusing multiple viewing angles, and the surround view image can be collected by compensating for the deviation view information and expanding the field of view, so that the driver can obtain a more comprehensive visual experience. At the same time, the surround view image obtained through the deviation view information can be widely used in various application scenarios, such as environmental perception of autonomous driving vehicles, panoramic monitoring of monitoring systems, etc., to improve driving safety and the driver's driving experience.

[0118] Figure 2 is a schematic diagram of another adjustment method of an electronic rearview mirror provided in an embodiment of the present application, such as Figure 2 As shown, after acquiring the rearview mirror image, the following steps are performed:

[0119] Detecting the brightness of the rearview mirror image, and when it is determined based on the brightness that the image information includes glare information, determining the rotation direction and rotation angle of the camera gimbal according to the glare position, controlling the camera gimbal to rotate and continuously determining whether there is glare information until the camera gimbal rotates until the proportion of glare in the rearview mirror image is less than a first preset proportion threshold, and outputting the rearview mirror image to avoid glare image output;

[0120] Detect the size of an object in an area of ​​interest in a rearview mirror image, and when it is detected that the image information includes obstacle occlusion information, determine the rotation direction and rotation angle of the camera gimbal according to the obstacle occlusion position, control the camera gimbal to rotate and continuously determine whether there is obstacle occlusion information, until the camera gimbal rotates to the point where the proportion of the obstacle occlusion in the rearview mirror image is less than a second preset ratio threshold, and output the rearview mirror image to avoid the obstacle occluding the image output;

[0121] Detecting the size of dirt on the rearview mirror image, when the image information includes rain and fog occlusion and / or dirt information, identifying the rain and fog and / or dirt according to the image recognition result, determining the rotation direction and rotation angle of the camera pan / tilt, until the camera pan / tilt rotates to a preset cleaning angle range, controlling the camera pan / tilt to rotate and continuously determining whether there is dirt information, if there is no dirt information or the scratching frequency is greater than a preset frequency or the size of the dirt in the rearview mirror image does not exceed a preset value, outputting the rearview mirror image;

[0122] Obtain the vehicle speed and the current image field of view ratio. When the vehicle speed is inconsistent with the preset correspondence between the vehicle speed and the field of view, control the camera pan / tilt to rotate and continue to determine whether the current vehicle speed and the field of view correspond, until the camera pan / tilt rotates to the field of view angle corresponding to the vehicle speed, and output the rearview mirror image.

[0123] Get the ratio of the steering wheel angle to the current image field of view. When the current field of view corresponding to the steering wheel angle is inconsistent with the preset field of view corresponding to the steering wheel angle, control the camera pan to rotate and continue to determine whether the current steering wheel angle corresponds to the field of view until the camera pan rotates to the field of view corresponding to the steering wheel angle, and output the rearview mirror image, which can expand the field of view, reduce the blind spot of turning, and improve driving safety.

[0124] Get the gear information and the current image field of view ratio. When the current field of view corresponding to the gear information is inconsistent with the preset field of view corresponding to the gear information, control the rotation of the camera gimbal and continue to judge whether the gear information and the field of view correspond, until the camera gimbal rotates to the field of view angle corresponding to the reverse gear, output the rearview mirror image, which can expand the field of view, reduce the blind spot in turns, and improve driving safety.

[0125] Determine the angle difference between the surround view angle and the current rearview mirror angle, take the current field of view angle as the starting angle, control the camera gimbal to rotate the angle difference, obtain the deviation compensation image corresponding to the angle difference, splice the deviation compensation image to the rearview mirror image, obtain the surround view image corresponding to the surround field of view, and output the rearview mirror image to increase the image content information of the rearview mirror image captured by the camera.

[0126] According to the technical solution provided in the embodiment of the present application, the viewing angle of the camera can be adjusted according to different vehicle speeds, steering wheel angles, gear information and other information as well as the field of view outside the vehicle. At the same time, the hardware layout cost is reduced by reusing multiple field of view angles, and the surround view image is collected by compensating for deviation field of view information and expanding the field of view, so that the driver can obtain a more comprehensive visual experience.

[0127] In some embodiments, when the image information includes at least two of glare information, obstacle occlusion information, dirt information, and field of view information, the camera gimbal is controlled based on the image information and the current field of view angle of the camera to adjust the field of view angle of the camera, including:

[0128] The image information is input into the trained angle fusion model to obtain the target field of view angle; the angle fusion model is used to weightedly fuse the field of view angles adjusted by the cameras corresponding to the single image information;

[0129] The camera pan / tilt is controlled to rotate based on the current field of view and the target field of view to adjust the current field of view to the target field of view.

[0130] Specifically, when the image information includes at least two of the glare information, obstacle occlusion information, dirt information and field of view range information, for example, image information including glare information and obstacle occlusion information, or image information including a combination of obstacle occlusion information, dirt information and field of view range information, the image information and the rearview mirror image are input into a pre-trained angle fusion model, and the output of the angle fusion model is the target field of view angle.

[0131] Among them, the angle fusion model is used to weightedly fuse the adjusted field of view angles of the camera corresponding to the single image information. The angle fusion model can receive and process different image information and fuse them. Different weights are assigned according to the importance of each image information to the adjustment of the camera's field of view angle. For example, since the obstacle occlusion information blocks the line of sight, the obstacle occlusion information can be set with the highest priority and corresponding weight, while the dirt information can be given a relatively low weight according to the degree of dirtiness and location. According to the results of weighted fusion, the optimal target field of view angle is determined, so that the clarity and coverage of the field of view angle can be maximized, while avoiding glare and obstacles as much as possible.

[0132] In addition, after determining the target field of view angle, the current field of view angle is used as the starting angle to control the rotation of the camera gimbal, thereby adjusting the camera field of view angle, adjusting the current field of view angle to the target field of view angle, increasing the image content information of the rearview mirror image, and making the rearview mirror image clearer and more complete.

[0133] Furthermore, the rearview mirror image captured after the current field of view angle is adjusted to the target field of view angle is processed to obtain image information of the adjusted rearview mirror image, and the image information of the rearview mirror image before the adjustment is compared to verify whether the adjusted image field of view has been adjusted as expected, and fine-tuning can be performed to a certain extent.

[0134] Furthermore, as the camera captures the rearview mirror image during the process of adjusting the image field of view, the parameters and strategies of the angle fusion model are continuously optimized based on the new image information and user feedback, thereby improving the accuracy and efficiency of the image field of view adjustment.

[0135] According to the technical solution provided in the embodiment of the present application, when there are multiple image information, the target field of view angle that can balance the image information can be obtained through the angle fusion model, so that the presence of each image information in the rearview mirror image reaches a smaller proportion, and the adaptability and versatility for adjusting various image information are strong.

[0136] In some embodiments, the electronic rearview mirror further includes a camera shielding cover, which is mounted on a support arm and is used to shield the camera when the camera is rotated to a preset shielding angle, the support arm is used to connect the body of the target vehicle and the camera bracket, and the camera gimbal is mounted on the camera bracket;

[0137] Based on the image information and the current field of view of the camera, the camera pan / tilt is controlled to adjust the field of view of the camera, and further includes:

[0138] When it is detected that the target vehicle is powered off, the difference between the current field of view angle and the preset shielding angle is determined as the shielding deviation angle;

[0139] Based on whether the shielding deviation angle is greater than zero, the rotation direction of the camera gimbal is determined. Taking the current field of view angle as the starting angle, the camera gimbal is controlled to rotate the shielding deviation angle according to the rotation direction to rotate the camera into the camera shielding cover.

[0140] Specifically, the support arm and the camera shield provide safety and stability for the camera, while also providing it with sufficient room for movement to cope with different driving needs.

[0141] In addition, when it is detected that the target vehicle is powered off, the difference between the current field of view angle and the preset occlusion angle, that is, the occlusion deviation angle, is determined, and the rotation direction of the camera gimbal is judged based on whether the occlusion deviation angle is greater than zero.

[0142] The leftward rotation direction of the camera platform can be set as the negative direction, and the rightward rotation direction can be set as the positive direction, or the rightward rotation direction of the camera platform can be set as the positive direction, and the leftward rotation direction can be set as the negative direction. When the occlusion deviation angle is greater than zero, it is determined that the camera platform needs to be rotated in the preset positive direction to reduce the deviation. Conversely, when the occlusion deviation angle is less than zero, it is determined that the camera platform needs to be rotated in the preset reverse direction to reduce the deviation.

[0143] In addition, after the rotation direction is determined, the camera gimbal is controlled to rotate according to the rotation direction until the camera is rotated into the camera shielding cover, thereby extending the service life of the camera and improving the reliability and durability of the electronic rearview mirror.

[0144] According to the technical solution provided in the embodiment of the present application, after the target vehicle is powered off, the camera gimbal can be rotated to a preset shielding angle, and the camera can be rotated into the camera shielding cover to avoid the risk of the camera being scratched or exposed to rain during parking, reduce the risk of aging due to long-term exposure of the camera, increase its service life, and improve the user experience.

[0145] Figure 3 is a flow chart of another electronic rearview mirror adjustment method provided in an embodiment of the present application, such as Figure 3 As shown, after the target vehicle is powered on, the electronic rearview mirror system and the surround view system are started, and the electronic rearview mirror system and the surround view system are controlled to adjust the field of view angle of the camera according to the image information, thereby increasing the image field of view of the rearview mirror image captured by the camera.

[0146] The electronic rearview mirror system is used to optimize the field of view. The field of view of the rearview mirror is optimized according to at least one of the vehicle speed, steering wheel angle and gear position information. The field of view optimization includes:

[0147] When the image information includes glare information, determining the rotation direction of the camera gimbal according to the glare position, and controlling the camera gimbal to rotate until the proportion of glare in the rearview mirror image is less than a first preset ratio threshold, so as to avoid glare image output;

[0148] When the image information includes obstacle occlusion information, determine the rotation direction of the camera gimbal according to the obstacle occlusion position, and control the camera gimbal to rotate until the proportion of the obstacle occlusion in the rearview mirror image is less than a second preset ratio threshold, so as to avoid the obstacle occluding the image output;

[0149] When the image information includes glare information and obstacle occlusion information, determining the rotation direction of the camera gimbal according to the glare position and the obstacle occlusion position, and controlling the camera gimbal to rotate to a position where the proportion of glare in the rearview mirror image and the proportion of the obstacle in the rearview mirror image are both small;

[0150] When the image information includes rain, fog and / or dirt information, the rain, fog and / or dirt are identified according to the image recognition result, the rotation direction of the camera pan / tilt is determined, and the camera pan / tilt is controlled to rotate to a preset cleaning angle range for cleaning to avoid image blur;

[0151] Optimizing the field of view according to the vehicle speed includes: obtaining the vehicle speed of the target vehicle, determining whether the driving speed is high speed or low speed according to the comparison between the vehicle speed and the preset speed threshold, and controlling the camera gimbal to rotate to a specified angle corresponding to the vehicle speed according to the correspondence between high speed or low speed and the preset vehicle speed and field of view size; wherein, when the driving speed is high speed, the adjustment target is to expand the field of view, and when the driving speed is low speed, the adjustment target is to focus on the distance between the vehicle body and the obstacle;

[0152] Optimizing the field of view according to the steering wheel angle includes: identifying the steering wheel angle of the target vehicle, and controlling the camera gimbal to rotate to a specified angle corresponding to the steering wheel angle according to the corresponding relationship between the steering wheel angle and the field of view, thereby expanding the field of view, reducing the blind spot in turning, and improving driving safety;

[0153] Optimizing the field of view based on gear information includes: identifying the current gear information of the target vehicle. When the current gear information is the reverse gear, based on the correspondence between the reverse gear and the field of view, the camera gimbal is controlled to rotate to the specified angle corresponding to the reverse gear. This can expand the field of view, reduce blind spots when turning, and improve driving safety.

[0154] The surround view system includes a surround view system for driving status and a surround view system corresponding to the parking status. It determines the angle difference between the current field of view angle and the surround view field of view angle, takes the current field of view angle as the starting angle, controls the camera gimbal to rotate the angle difference, obtains the deviation compensation image corresponding to the angle difference, splices the deviation compensation image to the rearview mirror image, and obtains the surround view image corresponding to the surround view field of view, so as to increase the image content information of the rearview mirror image captured by the camera.

[0155] Furthermore, the image information can be input into the trained angle fusion model to obtain the target field of view angle; the angle fusion model is used to weightedly fuse the adjusted field of view angles corresponding to the single image information, and control the camera gimbal to adjust the current field of view angle to the target field of view angle.

[0156] When it is detected that the target vehicle is powered off, the camera pan / tilt is controlled to rotate the shielding deviation angle to rotate the camera into the camera shielding cover.

[0157] According to the technical solution provided in the embodiments of the present application, the viewing angle of the camera can be adjusted according to different vehicle speeds, steering wheel angles, gear information and other information as well as the field of view outside the vehicle. For example, the viewing angle of the camera can be adjusted according to the distance of surrounding vehicles to realize the function of clearing obstacles in the field of view. By identifying the lights of the vehicles behind and adjusting the viewing angle of the camera, the anti-glare function can be realized, etc., thereby completing the field of view optimization and outputting a higher quality rearview mirror image. The camera can also be rotated to the camera shielding cover after the target vehicle is powered off, which can avoid the risk of the camera being scratched during parking, reduce the risk of lens aging due to long-term exposure, and enhance the user experience.

[0158] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0159] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present application, which will not be described one by one here.

[0160] Figure 4 and Figure 5 is a schematic diagram of an electronic rearview mirror provided in an embodiment of the present application, such as Figure 4 and Figure 5 As shown, the electronic rearview mirror is applied to the adjustment method of the electronic rearview mirror in the above embodiment, and the electronic rearview mirror comprises:

[0161] A support arm 402, one end of the support arm 402 is connected to a body 401 of the vehicle;

[0162] A camera bracket 403 is connected to the other end of the arm 402;

[0163] A camera platform 404 is connected to the camera bracket 403;

[0164] The camera 405 is mounted on the camera platform 404, and the camera platform is used to adjust the field of view of the camera 405;

[0165] A camera shielding cover 406 is installed on the support arm 402 and is used to shield the camera 405 when the camera 405 rotates to a preset shielding angle;

[0166] The scraping cleaning structure 407 includes a water applicator and a retractable scraper strip, which are installed in parallel on the support arm 402. The water applicator is used to apply water to the camera 405 when the camera 405 is rotated to within the preset cleaning angle range, and the retractable scraper strip is used to scrape the camera 405 when the camera 405 is rotated to within the preset cleaning angle range.

[0167] Specifically, the arm 402 is a support structure, one end of the arm 402 is connected to the body of the target vehicle, and the other end is connected to the camera head through the camera bracket to ensure that the camera device can work stably under various roads and driving conditions. The arm is connected to the camera bracket (the connection relationship is not shown in the figure, and a stable connection relationship is acceptable), and the camera head is installed on the camera bracket (the installation relationship is not shown in the figure, and a stable connection relationship is acceptable).

[0168] The camera platform 404 is used to adjust the field of view of the camera 405. In one embodiment, the camera platform 404 can be a spherical two-axis camera platform, including a horizontal rotation axis and a vertical rotation axis, and can adjust the camera platform 404 in the horizontal direction or the vertical direction. The rotation angle range of the horizontal rotation axis is 0° to 360°, and the rotation angle range of the vertical rotation axis is 0° to 180. It should be noted that the installation relationship between the camera platform and the camera bracket only needs to satisfy that when the camera platform is in the horizontal and vertical center position, the camera can capture an image with the maximum viewing angle. For example, the support arm is horizontally installed on the vehicle body, the camera bracket is vertically arranged with the support arm, and the camera platform is installed on the horizontal plane of the camera bracket, so that the camera platform can rotate without hindrance.

[0169] The camera shield 406 is used to shield the camera 405 when the camera 405 is rotated to a preset shielding angle, so as to prevent the camera 405 from aging too quickly when the camera 405 is not in use, increase the service life of the camera 405, and effectively protect the user's privacy and avoid unnecessary image acquisition. It should be noted that the camera shield can be vertically installed on the support arm, and the opening of the camera shield is facing away from the vehicle body, so that the camera can be easily rotated into the camera shield.

[0170] The water applicator (not shown in the figure) and the retractable scraper (not shown in the figure) can both be vertically mounted on the support arm to ensure coordination during operation. In one embodiment, when the camera 405 rotates to a preset cleaning angle range, the water applicator is started to evenly apply water on the lens surface, and the retractable scraper is controlled to extend quickly and scrape along the lens surface to effectively remove dust, raindrops and other pollutants, and restore the clear field of view of the camera 405. It should be noted that the height of the water applicator and the retractable scraper can be consistent or inconsistent, and this is not limited here.

[0171] It should be noted that the electronic rearview mirror module also includes an on-board display screen installed in the vehicle, which is used to display the rearview mirror image captured by the camera.

[0172] According to the technical solution provided in the embodiment of the present application, by controlling the camera through the camera gimbal, image acquisition at various angles can be realized, achieving full coverage of the target vehicle's outside view, and improving versatility. By rotating the camera gimbal and the scraping cleaning structure and camera shielding cover, physical cleaning and defogging of the camera can be achieved, thereby extending the service life of the camera device.

[0173] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0174] Figure 6 Schematic diagram of an adjustment device for an electronic rearview mirror provided in an embodiment of the present application. Figure 6 As shown, the electronic rearview mirror adjustment device includes: an acquisition module 601, a first processing module 602, a second processing module 603, and an adjustment module 604, wherein:

[0175] The acquisition module 601 is configured to acquire a rearview mirror image captured by an electronic rearview mirror of a target vehicle; the electronic rearview mirror includes a camera and a camera gimbal connected to the camera, and the camera gimbal is used to adjust the field of view angle of the camera;

[0176] A first processing module 602 is configured to determine a current field of view angle of the camera based on the rearview mirror image;

[0177] The second processing module 603 is configured to identify and obtain image information from the rearview mirror image, where the image information includes at least one of glare information, obstacle blocking information, dirt information, field of view range information corresponding to the driving field of view, and field of view deviation information between the current field of view and the surround field of view;

[0178] The adjustment module 604 is configured to control the camera gimbal based on the image information and the current field of view of the camera to adjust the field of view of the camera; wherein the adjusted field of view of the camera is used to increase the image content information of the rearview mirror image captured by the camera without changing the parameters of the camera other than the field of view.

[0179] In some embodiments, the glare information includes the glare position and glare size of the glare in the rearview mirror image, and the obstacle occlusion information includes the obstacle position in the rearview mirror image and the proportion of the obstacle in the rearview mirror image; if the image information includes glare information and / or obstacle occlusion information, the adjustment module 604 is configured as follows: if the image information is glare information, the rotation direction of the camera gimbal is determined based on the glare position, and with the current field of view angle as the starting angle, the camera gimbal is controlled to rotate according to a first preset rotation step and rotation direction to adjust the field of view angle of the camera until the proportion of glare in the rearview mirror image is less than a first preset ratio threshold; if the image information is obstacle occlusion information, the rotation direction of the camera gimbal is determined based on the obstacle position. The camera pan / tilt is controlled to rotate according to a third preset rotation step length, and the current field of view angle is used as the starting angle, and the camera pan / tilt is controlled to rotate according to a second preset rotation step length and rotation direction to adjust the field of view angle of the camera until the proportion of the obstacle in the rearview mirror image is less than a second preset ratio threshold value; if the image information includes glare information and obstacle occlusion information, the current field of view angle is used as the starting angle, and the camera pan / tilt is controlled to rotate according to a third preset rotation step length, and the proportion of glare in the rearview mirror image and the proportion of obstacles in the rearview mirror image at different angles after the camera pan / tilt is rotated are determined; based on the proportion of glare in the rearview mirror image and the proportion of obstacles in the rearview mirror image, a correction angle is obtained, and the camera pan / tilt is controlled to rotate to adjust the current field of view angle to the correction angle.

[0180] In some embodiments, the dirt information includes the size of the dirt and the position of the dirt in the rearview mirror image; the electronic rearview mirror also includes a scraping and cleaning structure, which is installed on a support arm and is used to apply water and scrape the camera when the camera rotates to a preset cleaning angle range. The support arm is used to connect the body of the target vehicle and the camera bracket, and the camera gimbal is installed on the camera bracket; if the image information includes dirt information, the adjustment module 604 is configured to: determine the angle and direction to be rotated of the camera gimbal based on the preset cleaning angle range and the current field of view angle; control the camera gimbal to rotate according to the angle and direction to control the camera to rotate to the preset cleaning angle range; when it is detected that the camera rotates to the preset cleaning angle range, control the camera to rotate within the preset cleaning angle range, and control the scraping and cleaning structure to apply water and scrape the camera until a preset condition is met, the preset condition includes that the scraping frequency is greater than the preset frequency or the size of the dirt in the rearview mirror image does not exceed a preset value.

[0181] In some embodiments, the field of view information corresponding to the driving field of view includes the field of view size; if the image information includes the field of view information corresponding to the driving field of view; the adjustment module 604 is configured to: obtain the current driving information of the target vehicle, the current driving information includes at least one of the vehicle speed, steering wheel angle and gear information of the target vehicle; based on the correspondence between the driving information and the field of view size obtained by the experiment, determine the preset field of view size corresponding to the current driving information; when the field of view size is inconsistent with the preset field of view size, determine the rotation direction of the camera gimbal based on the current field of view angle, and take the current field of view angle as the starting angle, according to the rotation direction and the rotation step corresponding to the current driving information, control the camera gimbal to rotate accordingly to adjust the camera's field of view angle, until the field of view size is consistent with the preset field of view size.

[0182] In some embodiments, the deviation field of view information is the angle difference between the current field of view angle and the preset surround field of view angle of the camera; if the image information is the deviation field of view information between the current field of view and the surround field of view, the adjustment module 604 is configured to: determine the rotation direction of the camera gimbal based on whether the angle difference is greater than zero, take the current field of view angle as the starting angle, and control the camera gimbal to rotate the angle difference according to the rotation direction to adjust the field of view angle of the camera; obtain the deviation compensation image corresponding to the angle difference; splice the deviation compensation image to the rearview mirror image to obtain the surround view image corresponding to the surround field of view, so as to increase the image content information of the rearview mirror image captured by the camera.

[0183] In some embodiments, when the image information includes at least two of glare information, obstacle occlusion information, dirt information and field of view range information, the adjustment module 604 is configured to: input the image information into the trained angle fusion model to obtain the target field of view angle; the angle fusion model is used to weightedly fuse the field of view angles of the camera adjusted corresponding to the single image information; and control the rotation of the camera gimbal based on the current field of view angle and the target field of view angle to adjust the current field of view angle to the target field of view angle.

[0184] In some embodiments, the electronic rearview mirror also includes a camera shielding cover, which is installed on a support arm and is used to shield the camera when the camera is rotated to a preset shielding angle. The support arm is used to connect the body of the target vehicle and the camera bracket, and the camera gimbal is installed on the camera bracket; the adjustment module 604 is configured to adjust the camera gimbal based on the image information and the current field of view angle of the camera. After adjusting the field of view angle of the camera, it is also configured to: when it is detected that the target vehicle is powered off, the difference between the current field of view angle and the preset shielding angle is determined as the shielding deviation angle; based on whether the shielding deviation angle is greater than zero, the rotation direction of the camera gimbal is determined, and the current field of view angle is used as the starting angle. According to the rotation direction, the camera gimbal is controlled to rotate the shielding deviation angle to rotate the camera into the camera shielding cover.

[0185] Figure 7 Schematic diagram of an electronic device 7 provided in an embodiment of the present application. Figure 7 As shown, the electronic device 7 of this embodiment includes: a processor 701, a memory 702, and a computer program 703 stored in the memory 702 and executable on the processor 701. When the processor 701 executes the computer program 703, the steps in the above-mentioned method embodiments are implemented. Alternatively, when the processor 701 executes the computer program 703, the functions of the modules / units in the above-mentioned device embodiments are implemented.

[0186] The electronic device 7 may be a desktop computer, a notebook, a PDA, a cloud server, or other electronic device. The electronic device 7 may include, but is not limited to, a processor 701 and a memory 702. Those skilled in the art will appreciate that Figure 7 The electronic device 7 is merely an example and does not limit the electronic device 7 , and may include more or less components than those shown in the figure, or different components.

[0187] The processor 701 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0188] The memory 702 may be an internal storage unit of the electronic device 7, for example, a hard disk or memory of the electronic device 7. The memory 702 may also be an external storage device of the electronic device 7, for example, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the electronic device 7. The memory 702 may also include both an internal storage unit of the electronic device 7 and an external storage device. The memory 702 is used to store computer programs and other programs and data required by the electronic device.

[0189] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0190] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium (e.g., a computer-readable storage medium). Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. The computer program may include computer program code, which may be in source code form, object code form, executable file or some intermediate form. Computer-readable storage media may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc.

[0191] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for adjusting an electronic rearview mirror, characterized in that: include: Acquire a rearview mirror image captured by an electronic rearview mirror of a target vehicle; the electronic rearview mirror comprises a camera and a camera platform connected to the camera, the camera platform being used to adjust the field of view angle of the camera; Based on the rearview mirror image, determining a current field of view angle of the camera; Recognize and obtain image information from the rearview mirror image, the image information including at least one of glare information, obstacle blocking information, dirt information, field of view range information corresponding to the driving field of view, and field of view deviation information between the current field of view and the surround field of view; Based on the image information and the current field of view angle of the camera, the camera gimbal is controlled to adjust the field of view angle of the camera; wherein the adjusted field of view angle of the camera is used to increase the image content information of the rearview mirror image captured by the camera without changing the parameters of the camera other than the field of view angle.

2. The method according to claim 1, characterized in that The glare information includes the glare position and glare size of the glare in the rearview mirror image, and the obstacle blocking information includes the obstacle position of the obstacle in the rearview mirror image and the proportion of the obstacle in the rearview mirror image; If the image information includes glare information and / or obstacle blocking information, the controlling the camera gimbal based on the image information and the current field of view angle of the camera to adjust the field of view angle of the camera includes: If the image information is the glare information, determine the rotation direction of the camera gimbal based on the glare position, and use the current field of view angle as a starting angle, control the camera gimbal to rotate according to a first preset rotation step and the rotation direction to adjust the field of view angle of the camera until the proportion of the glare in the rearview mirror image is less than a first preset ratio threshold; If the image information is the obstacle occlusion information, determine the rotation direction of the camera gimbal based on the obstacle position, and use the current field of view angle as a starting angle, control the camera gimbal to rotate according to a second preset rotation step and the rotation direction to adjust the field of view angle of the camera until the proportion of the obstacle in the rearview mirror image is less than a second preset ratio threshold; If the image information includes the glare information and the obstacle occlusion information, taking the current field of view angle as the starting angle, controlling the camera gimbal to rotate according to a third preset rotation step, and determining the proportion of the glare in the rearview mirror image and the proportion of the obstacle in the rearview mirror image at different angles after the camera gimbal rotates; Based on the proportion of the glare in the rearview mirror image and the proportion of the obstacle in the rearview mirror image, a correction angle is obtained, and the camera gimbal is controlled to rotate to adjust the current field of view angle to the correction angle.

3. The method according to claim 1, characterized in that The dirt information includes the position of the dirt in the rearview mirror image and the size of the dirt; the electronic rearview mirror also includes a scraping and cleaning structure, which is installed on a support arm and is used to apply water and scrape the camera when the camera rotates to a preset cleaning angle range, the support arm is used to connect the body of the target vehicle and the camera bracket, and the camera gimbal is installed on the camera bracket; If the image information includes the dirt information, based on the image information and the current field of view angle of the camera, the camera pan / tilt is controlled to adjust the field of view angle of the camera, including: Based on the preset cleaning angle range and the current field of view angle, determining the angle and direction of rotation of the camera pan / tilt; Controlling the camera gimbal to rotate according to the angle and direction, so as to control the camera to rotate to the preset cleaning angle range; When it is detected that the camera rotates to within the preset cleaning angle range, the camera is controlled to rotate within the preset cleaning angle range, and the scraping cleaning structure is controlled to apply water to and scrape the camera until a preset condition is met, wherein the preset condition includes that the scraping frequency is greater than a preset frequency or the size of the dirt in the rearview mirror image does not exceed a preset value.

4. The method according to claim 1, characterized in that: The visual field information corresponding to the driving visual field includes the size of the visual field; If the image information includes field of view range information corresponding to the driving field of view, based on the image information and the current field of view angle of the camera, the camera gimbal is controlled to adjust the field of view angle of the camera, including: Acquire current driving information of the target vehicle, wherein the current driving information includes at least one of vehicle speed, steering wheel angle, and gear position information of the target vehicle; Determine a preset visual range size corresponding to the current driving information based on the corresponding relationship between the driving information and the visual range size obtained by the experiment; When the size of the field of view is inconsistent with the preset field of view, the rotation direction of the camera gimbal is determined based on the current field of view angle, and with the current field of view angle as the starting angle, the camera gimbal is controlled to rotate accordingly according to the rotation direction and the rotation step corresponding to the current driving information to adjust the field of view angle of the camera until the size of the field of view is consistent with the preset field of view.

5. The method according to claim 1, characterized in that The deviation visual field information is the angle difference between the current visual field angle and the preset surround visual field angle of the camera; If the image information is the deviation field of view information between the current field of view and the surround field of view, based on the image information and the current field of view angle of the camera, the camera gimbal is controlled to adjust the field of view angle of the camera, including: Based on whether the angle difference is greater than zero, determining the rotation direction of the camera gimbal, taking the current field of view angle as the starting angle, and controlling the camera gimbal to rotate the angle difference according to the rotation direction to adjust the field of view angle of the camera; A deviation compensation image corresponding to the angle difference is obtained, and the deviation compensation image is spliced ​​to the rearview mirror image to obtain a surround view image corresponding to the surround view field, so as to increase the image content information of the rearview mirror image captured by the camera.

6. The method according to claim 1, characterized in that When the image information includes at least two of the glare information, the obstacle blocking information, the dirt information, and the field of view range information, the controlling the camera gimbal based on the image information and the current field of view angle of the camera to adjust the field of view angle of the camera includes: The image information is input into the trained angle fusion model to obtain the target field of view angle; the angle fusion model is used to weightedly fuse the field of view angles adjusted by the cameras corresponding to the single image information; The camera pan / tilt is controlled to rotate based on the current viewing angle and the target viewing angle to adjust the current viewing angle to the target viewing angle.

7. The method according to claim 1, characterized in that The electronic rearview mirror further comprises a camera shielding cover, which is mounted on a support arm and is used to shield the camera when the camera is rotated to a preset shielding angle, the support arm is used to connect the body of the target vehicle and the camera bracket, and the camera gimbal is mounted on the camera bracket; After the camera pan / tilt is controlled based on the image information and the current viewing angle of the camera to adjust the viewing angle of the camera, the method further includes: When it is detected that the target vehicle is powered off, the difference between the current field of view angle and the preset shielding angle is determined as a shielding deviation angle; Based on whether the shielding deviation angle is greater than zero, the rotation direction of the camera gimbal is determined, and the current field of view angle is used as the starting angle. According to the rotation direction, the camera gimbal is controlled to rotate the shielding deviation angle to rotate the camera into the camera shielding cover.

8. An electronic rearview mirror, characterized in that: include: A support arm, one end of which is connected to the body of the vehicle; A camera bracket connected to the other end of the arm; A camera gimbal connected to the camera bracket; A camera is mounted on the camera platform, and the camera platform is used to adjust the viewing angle of the camera; A camera shielding cover is installed on the support arm and is used to shield the camera when the camera is rotated to a preset shielding angle; A scraping and cleaning structure, the scraping and cleaning structure includes a water applicator and a retractable scraper strip, the water applicator and the retractable scraper strip are installed on the support arm in parallel, the water applicator is used to apply water to the camera when the camera is rotated to within the preset cleaning angle range, and the retractable scraper strip is used to scrape the camera when the camera is rotated to within the preset cleaning angle range.

9. An adjustment device for an electronic rearview mirror, characterized in that: include: An acquisition module is configured to acquire a rearview mirror image captured by an electronic rearview mirror of a target vehicle; the electronic rearview mirror includes a camera and a camera platform connected to the camera, the camera platform is used to adjust the field of view angle of the camera; A first processing module is configured to determine a current field of view angle of the camera based on the rearview mirror image; a second processing module, configured to identify and obtain image information from the rearview mirror image, wherein the image information includes at least one of glare information, obstacle blocking information, dirt information, field of view range information corresponding to the driving field of view, and field of view deviation information between the current field of view and the surround field of view; The adjustment module is configured to control the camera gimbal based on the image information and the current field of view angle of the camera to adjust the field of view angle of the camera; wherein the adjusted field of view angle of the camera is used to increase the image content information of the rearview mirror image captured by the camera without changing the parameters of the camera other than the field of view angle.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

Citation Information

Cited By

  • Intelligent tunneling robot cooperative control method based on virtual-real fusion

    CN121126120A

  • System and method for preventing blockage in field of view of sensing device

    GB2705453A