Electronic rearview mirror control method, apparatus, electronic device, and storage medium

Abstract

Embodiments of the present application disclose an electronic rearview mirror control method and device, electronic equipment and a storage medium, relating to the technical field of vehicle control. The specific implementation scheme is: obtaining current vehicle driving state information and a rearview mirror image collected by an electronic rearview mirror; when the rearview mirror image and the current vehicle driving state information meet a trigger adjustment condition, determining a standard visual area of the electronic rearview mirror; and adjusting the visual area of the electronic rearview mirror to the standard visual area. According to the vehicle driving state information and the rearview mirror image collected by the electronic rearview mirror, the embodiments of the present application determine the standard visual area of the electronic rearview mirror, and then adjust the visual area of the electronic rearview mirror to the standard visual area, so that the standard visual area of the current vehicle driving state can be quickly determined and the electronic rearview mirror can be automatically adjusted in real time, thereby improving the safety of the vehicle driving process.

Description

Technical Field

[0001] This invention relates to the field of vehicle control technology, and in particular to an electronic rearview mirror control method, device, electronic device, and storage medium. Background Technology

[0002] Rearview mirrors reflect the surrounding road and driving conditions, allowing drivers to indirectly observe their surroundings, expanding their field of vision, and reducing blind spots by adjusting their angles up, down, left, and right. They are an important component in vehicle operation and can greatly reduce safety hazards.

[0003] Currently, vehicle rearview mirrors are mainly controlled by electric adjustment, allowing for targeted adjustments to the mirror angle based on different driver seating positions.

[0004] However, with existing rearview mirror control methods, even slight adjustments to the driver's posture can greatly affect the field of vision in the rearview mirror, making it impossible to achieve real-time automatic adjustment of the rearview mirror and resulting in low vehicle driving safety. Summary of the Invention

[0005] This invention provides an electronic rearview mirror control method, device, electronic device, and storage medium to achieve real-time automatic adjustment of the electronic rearview mirror and improve vehicle driving safety.

[0006] In a first aspect, embodiments of the present invention provide an electronic rearview mirror control method, comprising:

[0007] Acquire current vehicle driving status information and rearview mirror images captured by the electronic rearview mirror;

[0008] When the rearview mirror image and the current vehicle driving status information meet the trigger adjustment conditions, the standard visual area of ​​the electronic rearview mirror is determined.

[0009] Adjust the viewing area of ​​the electronic rearview mirror to the standard viewing area.

[0010] Secondly, embodiments of the present invention also provide an electronic rearview mirror control device, comprising:

[0011] The data acquisition module is used to acquire current vehicle driving status information and rearview mirror images captured by the electronic rearview mirror;

[0012] The standard vision module is used to determine the standard vision area of ​​the electronic rearview mirror when the rearview mirror image and the current vehicle driving status information meet the trigger adjustment conditions.

[0013] The rearview mirror adjustment module is used to adjust the viewing angle area of ​​the electronic rearview mirror to the standard viewing angle area.

[0014] Thirdly, embodiments of the present invention also provide an electronic device, comprising:

[0015] At least one processor; and

[0016] A memory that is communicatively connected to at least one processor; wherein,

[0017] The memory stores a computer program that can be executed by at least one processor, such that the at least one processor is able to perform the electronic rearview mirror control method of any of the embodiments of the present invention.

[0018] Fourthly, embodiments of the present invention also provide a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, which are used to cause a processor to execute and implement the electronic rearview mirror control method of any one of the embodiments of the present invention.

[0019] According to the technical solution of the present invention, based on vehicle driving status information and rearview mirror images collected by the electronic rearview mirror, the standard visual area of ​​the electronic rearview mirror is determined, and then the viewing angle area of ​​the electronic rearview mirror is adjusted to the standard viewing angle area. This achieves rapid determination of the standard visual area of ​​the current vehicle driving status and real-time automatic adjustment of the electronic rearview mirror, improving the safety of vehicle driving. It should be understood that the content described in this section is not intended to identify key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily apparent from the following description. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 This is a flowchart of an electronic rearview mirror control method according to Embodiment 1 of the present invention;

[0022] Figure 2 A flowchart of another electronic rearview mirror control method provided according to Embodiment 2 of the present invention;

[0023] Figure 3 A flowchart of another electronic rearview mirror control method provided according to Embodiment 3 of the present invention;

[0024] Figure 4 This is a schematic diagram of the structure of an electronic rearview mirror control device according to Embodiment 4 of the present invention;

[0025] Figure 5 This is a schematic diagram of the structure of an electronic device according to Embodiment 5 of the present invention;

[0026] Figure 6 This is a schematic diagram of the air-space ratio perspective provided by an embodiment of the present invention;

[0027] Figure 7 This is a schematic diagram of a wheel perspective provided according to an embodiment of the present invention;

[0028] Figure 8 This is a structural principle block diagram of an electronic rearview mirror control system according to an embodiment of the present invention. Explanation of reference numerals:

[0029] 1. Rearview mirror folding rod; 2. Rearview mirror; 3. Rotary motor; 4. Rotary motor shaft; 5. Camera. Detailed Implementation

[0030] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0031] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0032] Example 1

[0033] Figure 1 The flowchart of an electronic rearview mirror control method provided in Embodiment 1 of the present invention is applicable to situations where the vehicle rearview mirror is automatically adjusted in real time based on the image captured by the rearview mirror and the current driving status of the vehicle. The method can be executed by an electronic rearview mirror control device, which can be implemented in hardware and / or software and can be configured in an electronic device.

[0034] like Figure 1 As shown, the electronic rearview mirror control method provided in this embodiment may include:

[0035] S110: Obtain current vehicle driving status information and rearview mirror images collected by the electronic rearview mirror.

[0036] In this embodiment, the vehicle driving status information can reflect whether the vehicle is currently driving normally, reversing, or parked. For example, vehicle gear information and vehicle driving direction information; the rearview mirror image is an image collected by the electronic rearview mirror that can reflect the situation around the vehicle. For example, it includes images of the vehicle wheels and the road near the vehicle.

[0037] Specifically, information such as vehicle gear position and driving direction can be collected to reflect the vehicle's driving status. This information can be analyzed to determine whether the vehicle is in reverse, driving normally, or parked. For example, if the vehicle is currently in reverse gear and moving in reverse direction, the analysis will show that the vehicle is currently in reverse. Additionally, rearview mirror images of the vehicle's surroundings can be acquired. The image acquisition period of the electronic rearview mirror can be set, for example, 60 frames per second.

[0038] S120. When the rearview mirror image and the current vehicle driving status information meet the trigger adjustment conditions, determine the standard visual area of ​​the electronic rearview mirror.

[0039] In this embodiment, the standard visual area can be pre-set or input by the user, which is the range of viewing angles that the electronic rearview mirror should have when the vehicle is in a certain driving state.

[0040] Specifically, the system can analyze the images of the vehicle's surroundings captured by the electronic rearview mirror and the current vehicle driving status information to determine whether the rearview mirror image and the current vehicle driving status information meet the trigger adjustment conditions for rearview mirror adjustment, and whether the vehicle currently needs to adjust the electronic rearview mirror viewing angle. When the trigger adjustment conditions are met, the standard visual area of ​​the electronic rearview mirror corresponding to the current vehicle driving status is determined.

[0041] S130. Adjust the visual area of ​​the electronic rearview mirror to the standard visual area.

[0042] Specifically, when it is determined that the viewing angle of the electronic rearview mirror needs to be adjusted, a control adjustment method can be used to adjust the visual area of ​​the electronic rearview mirror until it is adjusted to the standard visual area of ​​the vehicle under the current state. For example, PID control is used to realize multi-loop positive and negative feedback control to adjust the viewing angle of the rearview mirror during the automatic control process, and PLC control, which introduces microelectronics technology, computer technology, automatic control technology and communication technology on the basis of traditional sequential controller, establishes a flexible remote control system to adjust the viewing angle of the rearview mirror.

[0043] The technical solution provided by this invention obtains the current vehicle driving status information and the rearview mirror image collected by the electronic rearview mirror. When the rearview mirror image and the current vehicle driving status information meet the trigger adjustment conditions, the standard visual area of ​​the electronic rearview mirror is determined and the visual area of ​​the electronic rearview mirror is adjusted to the standard visual area. This realizes the rapid determination of the standard visual area of ​​the current vehicle driving status and the real-time automatic adjustment of the electronic rearview mirror, thereby improving the safety of the vehicle driving process.

[0044] Based on the above embodiments, obtaining current vehicle driving status information includes at least one of the following:

[0045] Collect the vehicle's current gear information as the vehicle's current driving status information;

[0046] Collect the vehicle's direction of motion as current vehicle driving status information;

[0047] The vehicle's speed is collected as information about the vehicle's current driving status.

[0048] Specifically, when acquiring current vehicle driving status information, a gear information sensor can be used to collect information such as the vehicle's current parking gear, reverse gear, and drive gear; a direction information sensor can be used to collect information such as the vehicle's forward and reverse movement direction; and a speed information sensor can be used to collect information such as the vehicle's specific speed. At least one of these information can be used as the current vehicle driving status information. For example, collecting information such as the vehicle's current gear being reverse and its movement direction being forward can be used as the current vehicle driving status information.

[0049] Example 2

[0050] Figure 2 This is a flowchart of another electronic rearview mirror control method provided in Embodiment 2 of the present invention. This embodiment is further optimized and expanded based on the above embodiments.

[0051] like Figure 2 As shown, another electronic rearview mirror control method provided in this embodiment may include:

[0052] S210: Obtain current vehicle driving status information and rearview mirror images collected by the electronic rearview mirror.

[0053] S220. Identify the target object image within the rearview mirror image and determine the acquisition angle within the rearview mirror image according to the target object image.

[0054] In this embodiment, the target identification image can be an image of an object with different positions and angles within the image captured by the rearview mirror. The object can be located at different positions around the vehicle and can only be captured by the rearview mirror at different angles. For example, the target identification image can be an image of the sky, the ground, and the wheels.

[0055] Specifically, after acquiring the rearview mirror image, the target object in the image and its proportion or position in the image captured by the rearview mirror can be analyzed and identified to determine the main viewing angle of the current vehicle. For example, when the target image is the sky and the ground, the proportion of the sky and the ground in the rearview mirror image can be analyzed to determine the acquisition angle of the electronic rearview mirror.

[0056] S230. Determine the current vehicle status based on the current vehicle driving status information, wherein the current vehicle status includes at least one of parking, reversing, or normal driving.

[0057] Specifically, the current vehicle status can be determined by analyzing the obtained current vehicle gear position information, direction of movement, and other driving status information. The current vehicle status can be at least one of parking, reversing, or normal driving. For example, if the obtained current vehicle driving status information is that the vehicle is in reverse gear, the current vehicle status is determined to be reversing. If the obtained current vehicle driving status information is that the vehicle is in drive gear and the direction of movement is forward, the current vehicle status is determined to be normal driving.

[0058] S240. When the correspondence between the current vehicle status and the acquisition viewpoint does not belong to the preset correspondence, determine that the trigger adjustment condition is met, and search for the standard visual area stored in the preset strategy set that is associated with the current vehicle status.

[0059] In this embodiment, the preset correspondence can be a one-to-one correspondence between the acquisition viewpoint and the current vehicle state, pre-set according to the actual situation. For example, when the acquisition viewpoint is the wheel viewpoint, the corresponding current vehicle state is reversing; when the acquisition viewpoint is the sky-to-ground ratio viewpoint, the corresponding current vehicle state is normal driving. The preset strategy set can be a standard visual area corresponding to different vehicle states, pre-set according to the actual situation. This may include the standard visual area of ​​the wheel viewpoint corresponding to the current vehicle state of reversing, the standard visual area of ​​the sky-to-ground ratio viewpoint corresponding to the current vehicle state of normal driving, and the standard visual area of ​​the sky-to-ground ratio viewpoint corresponding to the current vehicle state of parking, etc. Specifically, the acquired rearview mirror image and the current vehicle driving state information can be analyzed to obtain the acquisition viewpoint and the current vehicle state. It can be analyzed whether it is a preset correspondence. If it is not a preset correspondence, it means that the current acquisition viewpoint cannot meet the required viewing range under the current vehicle state. In this case, the conditions for electronic rearview mirror adjustment are met, and the corresponding standard visual area in the strategy set, which is the required viewing range under the current vehicle state, is found according to the current vehicle state.

[0060] S250, a rotary motor that controls the electronic rearview mirror for progressively rotating electronic rearview mirrors.

[0061] In this embodiment, the rotary motor can be a rotating electromagnet operating based on the principle of electromagnetic induction. One rotary motor can be installed near the vehicle body on each of the left and right rearview mirror folding rods. The rotary motors control the rotation of the folding rods, supporting both coarse and fine adjustments to the rearview mirror viewing angle. Specifically, when adjusting the electronic rearview mirror viewing angle, adjustments can be made using the rotary motors installed near the vehicle body. The rotary motors control the rotation of the folding rods by a certain angle, supporting both coarse and fine adjustments. The electronic rearview mirror camera is fixed to the rotary motor shaft to achieve viewing angle adjustment.

[0062] S260: Real-time acquisition of images of the electronic rearview mirror during its rotation.

[0063] Specifically, during the adjustment of the electronic rearview mirror's viewing angle, a camera fixed on the rotating motor shaft continues to capture images of objects around the vehicle, including the sky, the ground, and the wheels. As the rotating motor controls the folding rod to rotate, the camera's shooting angle also changes, capturing images of the vehicle's surroundings during the process of adjusting the rearview mirror's visual area to the standard visual area.

[0064] S270. The adjustment is completed when the visual area of ​​the image during the rotation process is consistent with the preset standard visual area of ​​the current vehicle driving status information.

[0065] Specifically, the real-time visual area of ​​the electronic rearview mirror during the rotation process can be obtained by analyzing objects such as the sky, the ground, and the wheels in the image and their proportion or position in the image. When the visual area is consistent with the standard visual area set according to the current vehicle driving status information, that is, when the current visual area meets the viewing angle range required under the current vehicle status, the adjustment of the electronic rearview mirror is stopped.

[0066] The technical solution provided by this invention acquires current vehicle driving status information and rearview mirror images captured by an electronic rearview mirror. It analyzes the electronic rearview mirror's acquisition angle and the current vehicle status to determine if they correspond to a preset relationship. If not, it searches for a standard visual area associated with the current vehicle status within a preset strategy set and gradually rotates the electronic rearview mirror using a rotary motor to adjust its acquisition angle. During this process, it acquires images of the rotation process in real time to analyze the real-time acquisition angle of the electronic rearview mirror and determine if it matches the standard visual area of ​​the current vehicle status. When the visual area of ​​the rotation process image matches the preset standard visual area of ​​the current vehicle driving status information, the adjustment is completed. This achieves rapid determination of the standard visual area of ​​the current vehicle driving status and real-time automatic adjustment of the electronic rearview mirror. It realizes real-time automatic adjustment of the electronic rearview mirror based on a rotary motor, which is relatively easy to implement, cost-effective, and widely applicable, thus improving vehicle driving safety.

[0067] Based on the above embodiments, the preset correspondence includes at least one of the following:

[0068] When the data collection perspective is the air-to-space ratio perspective, the current vehicle status is normal driving;

[0069] When the camera is viewed from the wheel perspective, the current vehicle is in reverse.

[0070] In this embodiment, the sky-to-ground ratio viewing angle can be the image captured by the electronic rearview mirror. When the target recognition image consists of the sky and the ground, the electronic rearview mirror acquisition viewing angle is determined by analyzing the proportions of the sky and the ground in the rearview mirror image. For example, see [link to example]. Figure 6 When the target recognition image consists of sky 01 and earth 02, and the ratio of sky 01 to earth 02 in the image is 6:4, then the current electronic rearview mirror's acquisition perspective is the sky-to-sky ratio perspective. The wheel perspective can be the image acquired by the electronic rearview mirror. When the target recognition image is a wheel, the acquisition perspective is determined by whether the wheel appears completely in the acquisition position in the rearview mirror image. For an example, see [link to example]. Figure 7 When the target image is wheel 102, and wheel 102 appears completely at the acquisition position 101 in the image, then the current acquisition angle of the electronic rearview mirror is the wheel angle.

[0071] Specifically, there is a pre-set one-to-one correspondence between the viewing angle collected by the electronic rearview mirror and the current driving status of the vehicle. The current vehicle status can be obtained by analyzing the current viewing angle of the rearview mirror. This one-to-one correspondence may include at least one of the following: when the viewing angle is the sky-to-ground ratio view, the current vehicle status is normal driving; when the viewing angle is the wheel view, the current vehicle status is reversing. For example, when the viewing angle is the sky-to-ground ratio view, the current vehicle status is determined to be normal driving according to the preset correspondence.

[0072] Based on the above embodiments, the rearview mirror image or the rotation process image is processed by a preset image feature extraction model for image acceleration, wherein the preset image feature extraction model includes at least a convolutional neural network model.

[0073] In this embodiment, image acceleration processing can be an image processing method that extracts features from an image based on a deep learning model; the convolutional neural network model can be a feedforward neural network, whose artificial neurons can respond to a portion of the surrounding units within the coverage area. It is the most widely used network structure in the field of image processing and can accelerate the recognition of target images in rearview mirror images and rotation process images.

[0074] Specifically, in order to more quickly identify and extract the image features of the target object in the image or rotation process image captured by the electronic rearview mirror, a preset image feature extraction model can be used to speed up the image feature extraction. The preset image feature extraction model can include at least a convolutional neural network model, or other deep learning models, such as neural network models, restricted Boltzmann machines, etc.

[0075] Based on the above embodiments, the acquisition angle is determined according to the target object image within the rearview mirror image, including:

[0076] When the target recognition image consists of the sky and the ground, the acquisition angle is determined according to the proportion of the sky and the ground occupying the rearview mirror image, respectively.

[0077] When the target image is a wheel, the acquisition angle is determined according to the position of the wheel in the rearview mirror image.

[0078] Specifically, the acquisition angle can be determined based on the proportion of the target object within the rearview mirror image. This can include determining the acquisition angle according to the proportion of the sky and the ground occupying the rearview mirror image, respectively, when the target image consists of the sky and the ground. For an example, see [link to example]. Figure 6When the target recognition image consists of sky 01 and earth 02, and the ratio of sky 01 to earth 02 in the image is 6:4, then the current electronic rearview mirror's acquisition perspective is the sky-to-sky ratio perspective. The wheel perspective can be the image acquired by the electronic rearview mirror. When the target recognition image is a wheel, the acquisition perspective is determined by whether the wheel appears completely in the acquisition position in the rearview mirror image. For an example, see [link to example]. Figure 7 When the target image is wheel 102, and wheel 102 appears completely at the acquisition position 101 in the image, then the current acquisition angle of the electronic rearview mirror is the wheel angle.

[0079] Example 3

[0080] Figure 3 This is a flowchart of another electronic rearview mirror control method provided in Embodiment 2 of the present invention. This embodiment is further optimized and expanded based on the above embodiments.

[0081] like Figure 3 As shown, another electronic rearview mirror control method provided in this embodiment may include:

[0082] S310, rearview mirror image acquisition.

[0083] Specifically, it can collect information from the left / right rearview mirrors, and can collect data at a set number of frames per second, for example, at 60 frames per second.

[0084] S320, Gear information collection.

[0085] Specifically, it can collect and analyze the vehicle's current gear status information. For example, it can collect whether the vehicle is currently in reverse gear and analyze whether the vehicle is reversing.

[0086] S330, image acceleration processing, to obtain air-to-sky ratio viewpoint features and wheel viewpoint features.

[0087] Specifically, deep learning models can be used to accelerate the processing of image information from the left / right rearview mirrors of a vehicle, and obtain the sky-to-sky ratio and wheel perspective features. For example, a convolutional neural network model can be used to accelerate the processing of image information from the left / right rearview mirrors of a vehicle, analyze the proportion or position of the sky, ground, wheels, etc. in the rearview mirror image, and obtain the sky-to-sky ratio and wheel perspective features.

[0088] S340: Determine if the vehicle is currently in reverse gear and adjust the rearview mirror angle adjustment mode.

[0089] Specifically, the gear position information can be used to determine if the vehicle is in a non-reverse gear, and the angle adjustment mode can be switched to the air-to-sky ratio view mode; if the gear position information is used to determine if the vehicle is in reverse gear, the angle adjustment mode can be switched to the wheel view mode.

[0090] S350: The rearview mirror angle is adjusted using PID control according to the target's viewing angle relative to the airspace.

[0091] In this embodiment, the target for the air-to-space ratio viewing angle can be a pre-set or user-inputted range of the electronic rearview mirror's field of view when the vehicle is in a non-reverse gear; PID regulation is a basic regulation method of control system in classical control theory. It is a linear regulation law with proportional, integral and derivative actions, which can stably adjust the angle of the rotating motor.

[0092] Specifically, the sky-to-sky ratio viewing angle features obtained from image acceleration processing can be adjusted using PID control according to the default settings or the sky-to-sky ratio viewing angle target input by the customer, so that the sky-to-sky ratio viewing angle features obtained from image acceleration processing are consistent with the target.

[0093] S360: Adjusts the rearview mirror angle using PID control based on the target's perspective from the wheel.

[0094] In this embodiment, the target wheel view can be a pre-set or user-inputted range of the electronic rearview mirror's field of view when the vehicle is in reverse gear.

[0095] Specifically, the wheel view features obtained from image acceleration processing can be used to adjust the angle of the rotary motor using PID control, based on the default settings or the wheel view target input by the customer, so that the wheel view features obtained from image acceleration processing are consistent with the target.

[0096] The technical solution provided by this invention obtains the current vehicle gear information and the rearview mirror image captured by the electronic rearview mirror, performs image acceleration processing on the rearview mirror image to obtain the air-to-sky ratio angle feature and wheel angle feature, determines whether the vehicle is in reverse gear based on the gear information, adjusts the rearview mirror angle adjustment mode, and performs PID adjustment of the rearview mirror angle according to the air-to-sky ratio angle target / vehicle angle target. This achieves rapid matching between the current vehicle gear and the rearview mirror angle adjustment mode and real-time automatic adjustment of the electronic rearview mirror, thereby improving the safety of vehicle driving.

[0097] Example 4

[0098] Figure 4 This is a schematic diagram of an electronic rearview mirror control device provided in Embodiment 4 of the present invention. This embodiment can perform the above-described implementation method. This embodiment is applicable to situations where the vehicle's rearview mirror is automatically adjusted in real time based on the image captured by the rearview mirror and the current vehicle driving status. This device can be implemented in hardware / software and can be configured in an electronic device.

[0099] like Figure 4As shown, the data acquisition module 401, standard vision module 402, and rearview mirror adjustment module 403 provided in this embodiment include:

[0100] The data acquisition module 401 is used to acquire current vehicle driving status information and rearview mirror images acquired by the electronic rearview mirror;

[0101] The standard vision module 402 is used to determine the standard vision area of ​​the electronic rearview mirror when the rearview mirror image and the current vehicle driving status information meet the trigger adjustment conditions.

[0102] The rearview mirror adjustment module 403 is used to adjust the viewing angle area of ​​the electronic rearview mirror to the standard viewing angle area.

[0103] The technical solution provided by this invention acquires current vehicle driving status information and rearview mirror images collected by an electronic rearview mirror. When the rearview mirror image and current vehicle driving status information meet the trigger adjustment conditions, the standard visual area of ​​the electronic rearview mirror is determined, and then the visual area of ​​the electronic rearview mirror is adjusted to the standard visual area. This achieves rapid determination of the standard visual area of ​​the current vehicle driving status and real-time automatic adjustment of the electronic rearview mirror, improving the safety of vehicle driving. Based on the above embodiments, the data acquisition module 401 includes at least one of the following:

[0104] The gear information acquisition unit is used to collect the vehicle's current gear information as the vehicle's current driving status information.

[0105] The motion direction acquisition unit is used to acquire the vehicle's motion direction as current vehicle driving status information.

[0106] The motion speed acquisition unit is used to collect the vehicle's motion speed as information about the current vehicle driving status.

[0107] Based on the above embodiments, the standard vision module 402 includes:

[0108] The acquisition angle determination unit is used to identify the target object image in the rearview mirror image and determine the acquisition angle in the rearview mirror image according to the target object image.

[0109] The vehicle status determination unit is used to determine the current vehicle status according to the current vehicle driving status information, wherein the current vehicle status includes at least one of parking, reversing, and normal driving.

[0110] The standard visual region determination unit is used to determine whether the trigger adjustment conditions are met when the correspondence between the current vehicle state and the acquisition viewpoint does not belong to the preset correspondence, and to search for the standard visual region associated with the current vehicle state in the preset strategy set.

[0111] Based on the above embodiments, the standard vision module 402 further includes:

[0112] The normal driving correspondence unit is used to collect data on the current vehicle status as normal driving when the viewing angle is the air-to-sky ratio view.

[0113] The reversing correspondence unit is used to collect data on the current vehicle state as reversing when the viewpoint is the wheel viewpoint.

[0114] Based on the above embodiments, the rearview mirror adjustment module 403 includes:

[0115] The rearview mirror rotation unit is used to control the rotation motor of the electronic rearview mirror to gradually rotate the electronic rearview mirror.

[0116] The rotation process image acquisition unit is used to acquire images of the electronic rearview mirror during its rotation process in real time.

[0117] The rearview mirror adjustment stop unit is used to complete the adjustment when the visual area of ​​the image during the rotation process matches the preset standard visual area of ​​the current vehicle driving status information.

[0118] Based on the above embodiments, the standard vision module 402 and the viewing mirror adjustment module 403 further include:

[0119] An image acceleration processing unit is used to perform image acceleration processing on rearview mirror images or images during rotation through a preset image feature extraction model, wherein the preset image feature extraction model includes at least a convolutional neural network model.

[0120] Based on the above embodiments, the standard vision module 402 further includes:

[0121] The sky-to-ground ratio acquisition angle determination unit is used to determine the acquisition angle according to the proportion of the sky and the ground occupying the rearview mirror image when the target recognition image is the sky and the ground.

[0122] The wheel acquisition angle determination unit is used to determine the acquisition angle according to the position of the wheel in the rearview mirror image when the target recognition image is a wheel.

[0123] The electronic rearview mirror control device provided in Embodiment 4 of the present invention can execute any electronic rearview mirror control method provided in the embodiments of the present invention, and has the corresponding functional modules and beneficial effects of the method execution. Content not described in detail in this embodiment can be referred to the description in any method embodiment of the present invention.

[0124] Example 5

[0125] Figure 5This is a schematic diagram of an electronic device provided in Embodiment 5 of the present invention. The electronic device 50, which can be used to implement embodiments of the present invention, is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0126] like Figure 5 As shown, the electronic device 50 includes at least one processor 51 and a memory, such as a read-only memory (ROM) 52 or a random access memory (RAM) 53, communicatively connected to the at least one processor 51. The memory stores computer programs executable by the at least one processor. The processor 51 can perform various appropriate actions and processes based on the computer program stored in the ROM 52 or loaded from storage unit 58 into the RAM 53. The RAM 53 can also store various programs and data required for the operation of the electronic device 50. The processor 51, RAM 52, and RAM 53 are interconnected via a bus 54. An input / output (I / O) interface 55 is also connected to the bus 54.

[0127] Multiple components in electronic device 50 are connected to I / O interface 55, including: input unit 55, such as keyboard, mouse, etc.; output unit 57, such as various types of monitors, speakers, etc.; storage unit 58, such as disk, optical disk, etc.; and communication unit 59, such as network card, modem, wireless transceiver, etc. Communication unit 59 allows electronic device 50 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0128] Processor 51 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 51 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 51 performs the various methods and processes described above, such as electronic rearview mirror control methods.

[0129] In some embodiments, the electronic rearview mirror control method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 58. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 50 via ROM 52 and / or communication unit 59. When the computer program is loaded into RAM 53 and executed by processor 51, one or more steps of the electronic rearview mirror control method described above may be performed. Alternatively, in other embodiments, processor 51 may be configured to perform the electronic rearview mirror control method by any other suitable means (e.g., by means of firmware).

[0130] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0131] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0132] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0133] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0134] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0135] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through a communication network. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0136] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0137] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for controlling an electronic rearview mirror, characterized in that, The method includes: Acquire current vehicle driving status information and rearview mirror images captured by the electronic rearview mirror; When the rearview mirror image and the current vehicle driving status information meet the trigger adjustment conditions, the standard visual area of ​​the electronic rearview mirror is determined. Adjust the visual area of ​​the electronic rearview mirror to the standard visual area; The step of determining the standard visual area of ​​the electronic rearview mirror when the rearview mirror image and the current vehicle driving status information meet the trigger adjustment conditions includes: Identify the target object image within the rearview mirror image, and determine the acquisition angle within the rearview mirror image according to the target object image; The current vehicle status is determined according to the current vehicle driving status information, wherein the current vehicle status includes at least one of parking, reversing, and normal driving; When the correspondence between the current vehicle state and the acquisition viewpoint does not belong to a preset correspondence, it is determined that the trigger adjustment condition is met, and the standard visual region associated with the current vehicle state is searched in the preset strategy set; wherein, the preset strategy set includes the standard visual region of the wheel viewpoint corresponding to the current vehicle state when it is reversing, the standard visual region of the sky-to-ground ratio viewpoint corresponding to the current vehicle state when it is driving normally, and the standard visual region of the sky-to-ground ratio viewpoint corresponding to the current vehicle state when it is parked. Adjusting the visual area of ​​the electronic rearview mirror to the standard visual area includes: The rotating motor controls the electronic rearview mirror to rotate the electronic rearview mirror progressively; the rotating motor is a rotating electromagnetic machine that operates based on the principle of electromagnetic induction, and one rotating motor is installed on each of the left and right rearview mirror folding rods near the vehicle body; Real-time acquisition of images of the electronic rearview mirror during its rotation; The adjustment is completed when the visual area of ​​the rotating image matches the preset standard visual area of ​​the current vehicle driving status information.

2. The method according to claim 1, characterized in that, The acquisition of current vehicle driving status information includes at least one of the following: The vehicle's current gear information is collected as the current vehicle driving status information; The vehicle's direction of motion is collected as the current vehicle driving status information; The vehicle's speed is collected as the current vehicle driving status information.

3. The method according to claim 1, characterized in that, The preset correspondence includes at least one of the following: When the acquisition perspective is the air-to-space ratio perspective, the current vehicle status is normal driving; When the acquisition perspective is the wheel perspective, the current vehicle state is reversing.

4. The method according to claim 1, characterized in that, The rearview mirror image or the rotation process image is processed by a preset image feature extraction model for image acceleration, wherein the preset image feature extraction model includes at least a convolutional neural network model.

5. The method according to claim 1, characterized in that, Determining the acquisition angle within the rearview mirror image based on the target object image includes: When the target recognition image is the sky and the ground, the acquisition angle is determined according to the proportion of the sky and the ground occupying the rearview mirror image, respectively. When the target recognition image is a wheel, the acquisition angle is determined according to the position of the wheel in the rearview mirror image.

6. An electronic rearview mirror control device, characterized in that, The device includes: The data acquisition module is used to acquire current vehicle driving status information and rearview mirror images captured by the electronic rearview mirror; The standard vision module is used to determine the standard vision area of ​​the electronic rearview mirror when the rearview mirror image and the current vehicle driving status information meet the trigger adjustment conditions. A rearview mirror adjustment module is used to adjust the visual area of ​​the electronic rearview mirror to the standard visual area; The standard vision module includes: The acquisition angle determination unit is used to identify the target object image in the rearview mirror image and determine the acquisition angle in the rearview mirror image according to the target object image. A vehicle status determination unit is used to determine the current vehicle status according to the current vehicle driving status information, wherein the current vehicle status includes at least one of parking, reversing, and normal driving; A standard visual region determination unit is used to determine that the trigger adjustment condition is met when the correspondence between the current vehicle state and the acquisition viewpoint does not belong to a preset correspondence, and to search for the standard visual region stored in a preset strategy set that is associated with the current vehicle state; wherein, the preset strategy set includes the standard visual region of the wheel viewpoint corresponding to the current vehicle state when the current vehicle state is reversing, the standard visual region of the sky-to-ground ratio viewpoint corresponding to the current vehicle state when the current vehicle state is driving normally, and the standard visual region of the sky-to-ground ratio viewpoint corresponding to the current vehicle state when the vehicle is parked. The rearview mirror adjustment module includes: The rearview mirror rotation unit is used to control the rotating motor of the electronic rearview mirror to gradually rotate the electronic rearview mirror; the rotating motor is a rotating electromagnetic machine that operates based on the principle of electromagnetic induction, and one rotating motor is installed on each of the left and right rearview mirror folding rods near the vehicle body. The rotation process image acquisition unit is used to acquire images of the electronic rearview mirror during its rotation process in real time; The rearview mirror adjustment stop unit is used to complete the adjustment when the visual area of ​​the image during the rotation process matches the preset standard visual area of ​​the current vehicle driving status information.

7. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the electronic rearview mirror control method according to any one of claims 1-5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute the electronic rearview mirror control method according to any one of claims 1-5.

Images