Method and system for controlling electronic rearview mirror of vehicle and vehicle

By processing the rearview mirror image data and generating processing signals according to different driving scenarios, the imaging problem of traditional rearview mirrors in bad weather and different driving scenarios is solved, low-latency, high-definition real-time display is achieved, and driving safety is improved.

CN116442908BActive Publication Date: 2025-10-17CHANGCHUN FUSHENG AUTOMOTIVE ELECTRONICS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310532942.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-05-12
Publication Date
2025-10-17
Estimated Expiration
2043-05-12

AI Technical Summary

Technical Problem

Traditional physical rearview mirrors have poor imaging effects in bad weather and different driving scenarios, affecting driving safety.

Method used

By collecting rearview mirror image data, the image processing unit generates processing signals according to different vehicle driving scenarios, processes the image data accordingly, and displays the processed image on the display unit, including operations such as zooming in, zooming out, gain adjustment and exposure control.

Benefits of technology

It achieves low-latency, high-definition real-time display in severe weather, enhances the rear-view range and field of view angle, and improves driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116442908B_ABST
    Figure CN116442908B_ABST
Patent Text Reader

Abstract

The application discloses a control method and system of a vehicle electronic rearview mirror and a vehicle, wherein the control method comprises collecting image information of a rearview mirror observation range of the vehicle to generate image data, and sending the image data to an image processing unit; a plurality of different vehicle driving scenes are preset; corresponding processing signals are generated according to the vehicle driving scenes; after the image processing unit receives the processing signals, the image data is processed according to the processing signals; the processed image data is sent to a display unit, and the image processed by the image processing unit is displayed on a screen of the display unit; the application provides an equipment capable of solving the drawbacks of the imaging principle of the lens, and can display in real time with low delay and high definition in severe weather, and through image zoom processing, the image field of view and angle are changed, the rearview range is increased, and the driving safety is improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicle control, in particular to a control method and system of a vehicle electronic rearview mirror and a vehicle. BACKGROUND

[0002] With the rapid development of the automotive electronics industry, automobiles are increasingly developing in the direction of intelligence and networking. The addition of cameras is indispensable to intelligence. The intelligence of rearview mirrors is achieved by introducing cameras to replace the lenses of traditional physical rearview mirrors. This technical solution can avoid some shortcomings of traditional physical rearview mirrors, such as the fact that the field of view of the image will change relatively with the reception of signals, so that obstacles can be clearly seen when reversing, and the field of view of the image can be enlarged when turning, and the image can be processed according to the ISP algorithm of the sensor to reduce the influence of adverse weather conditions. This technology will be recognized and accepted by a large number of users. SUMMARY

[0003] The present application aims to provide a control method and system of a vehicle electronic rearview mirror and a vehicle to solve the problems raised in the background.

[0004] To achieve the above-mentioned purpose, the present application provides the following technical solution: a control method of a vehicle electronic rearview mirror, comprising:

[0005] Collecting image information of the observation range of the vehicle rearview mirror to generate image data, and sending the image data to an image processing unit;

[0006] Predefining a plurality of different vehicle driving scenarios;

[0007] Generating a corresponding processing signal according to the vehicle driving scenario, and after the image processing unit receives the processing signal, processing the image data according to the processing signal, and sending the processed image data to a display unit to display the image processed by the image processing unit on the screen of the display unit.

[0008] Further comprising:

[0009] The vehicle driving scenario is vehicle turning;

[0010] Generating a processing signal, which is a turning signal;

[0011] After the image processing unit receives the turning signal, processing the image data so that the enlarged image processed by the image processing unit is displayed on the screen of the display unit.

[0012] Further comprising:

[0013] The vehicle driving scenario is high-speed driving of the vehicle;

[0014] A vehicle speed threshold is set, and a vehicle speed is collected. When the vehicle speed reaches the vehicle speed threshold, a processing signal is generated. The generated processing signal is a high-speed driving signal.

[0015] After the image processing unit receives the high-speed driving signal, the image data is processed, and the screen of the display unit displays the enlarged image processed by the image processing unit.

[0016] Further comprising:

[0017] The vehicle driving scenario is reversing;

[0018] The rearview mirror observation range of the vehicle during reversing is preset;

[0019] A processing signal is generated. The processing signal is a reversing signal;

[0020] After the image processing unit receives the reversing signal, the image data is processed, and the screen of the display unit displays the zoomed-out image processed by the image processing unit.

[0021] Further comprising:

[0022] The vehicle driving scenario is foggy weather;

[0023] A processing signal is generated. The processing signal is a foggy weather signal;

[0024] The image processing unit sets a fog concentration threshold;

[0025] After the image processing unit receives the foggy weather signal, the image data is identified. When the identified fog concentration is greater than the fog concentration threshold, the image data is subjected to gain adjustment;

[0026] Based on the automatic color equalization algorithm, the pixel value is corrected by calculating the light-dark contrast of the target pixel point and the surrounding pixel points.

[0027] Further, the automatic color equalization algorithm comprises:

[0028] Color correction, spatial image reconstruction, corresponding formula:

[0029]

[0030] The corrected image is dynamically adjusted, and the corresponding calculation formula is:

[0031]

[0032] Further comprising:

[0033] The vehicle driving scenario is an image highlight scenario;

[0034] A processing signal is generated. The processing signal is a highlight signal;

[0035] The image processing unit sets a brightness threshold value;

[0036] After receiving the highlight signal, the image processing unit identifies the image data with fog, and when the identified highlight is greater than the brightness threshold value, starts to adjust the image data;

[0037] The adjustment of the image data includes calibrating the range value of the exposure parameter, and through the control of the image data, the exposure parameter is within the calibrated range value of the exposure parameter.

[0038] Further comprising:

[0039] The image processing unit detects whether the generation and transmission of the image data are abnormal;

[0040] If there is no abnormality, the image processing unit sends the image data processed to the display unit, and displays the image processed by the image processing unit on the screen of the display unit;

[0041] If there is an abnormality, the image processing unit is controlled to reset;

[0042] If the image processing unit detects whether the generation and transmission of the image data are abnormal after resetting;

[0043] If there is still an abnormality, a fault alarm is sent;

[0044] If the abnormality disappears, the image processing unit sends the image data processed to the display unit, and displays the image processed by the image processing unit on the screen of the display unit.

[0045] On the other hand, a control system of a vehicle electronic rearview mirror is provided, comprising:

[0046] An image acquisition module, which is used to acquire image information of a rearview mirror observation range of a vehicle to generate image data;

[0047] An image processing unit, which is used to process the image data according to a vehicle driving scene;

[0048] A display module, which is used to receive the image data processed by the image processing unit, and display corresponding images on a display screen.

[0049] In another aspect, a vehicle is provided, comprising the control system of the vehicle electronic rearview mirror.

[0050] Compared with the prior art, the present application has the beneficial effects that the present application provides an equipment capable of solving the disadvantages of lens imaging principle, capable of low-delay, high-definition real-time display in bad weather, and realizing the transformation of image field of view and angle through image zoom processing, increasing the rear view range and improving the driving safety. BRIEF DESCRIPTION OF DRAWINGS

[0051] Figure 1 The control method flow chart of the vehicle electronic rearview mirror in the embodiment of the present application is shown in the figure.

[0052] Figure 2 The control system connection block diagram of the vehicle electronic rearview mirror in the embodiment of the present application is shown in the figure.

[0053] Figure 3 The control system connection block diagram of another vehicle electronic rearview mirror in the embodiment of the present application is shown in the figure.

[0054] Figure 4 The control method logic diagram of the vehicle electronic rearview mirror in the embodiment of the present application is shown in the figure.

[0055] Figure 5 The normal field of view and the rear view field of view comparison diagram when reversing in the embodiment of the present application is shown in the figure.

[0056] Figure 6 The normal field of view and the rear view field of view comparison diagram when turning in the embodiment of the present application is shown in the figure.

[0057] Figure 7 The vehicle foggy driving scene logic diagram in the embodiment of the present application is shown in the figure.

[0058] Figure 8 The foggy image and the de-fogging image comparison diagram in the vehicle foggy driving scene in the embodiment of the present application is shown in the figure.

[0059] Figure 9 The image highlight scene logic diagram in the embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0060] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the protection scope of the present application.

[0061] In the description of the present application, unless otherwise specified and limited, the term "a plurality of" means two or more; the terms "upper", "lower", "left", "right", "inner", "outer", "front end", "rear end", "head", "tail" and the like indicate the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first", "second", "third" and the like are only for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0062] In the description of the present application, it should be noted that, unless otherwise specified and limited, the terms "connected", "connected" should be understood broadly, for example, it can be fixedly connected, or it can be detachably connected, or integrally connected; it can be mechanically connected, or it can be electrically connected; it can be directly connected, or it can be indirectly connected through an intermediate medium. For those skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0063] Please refer to the drawings, the present application provides a technical solution: as Figure 1 shown, a control method of a vehicle electronic rearview mirror, comprising the following steps:

[0064] S102, collecting image information of the observation range of the vehicle rearview mirror to generate image data, and sending the image data to an image processing unit;

[0065] S104, presetting a plurality of different vehicle driving scenes;

[0066] S106, generating a corresponding processing signal according to the vehicle driving scene, after the image processing unit receives the processing signal, processing the image data according to the processing signal, and sending the processed image data to a display unit, displaying the image processed by the image processing unit on the screen of the display unit.

[0067] In the above embodiment, as Figure 3As shown, the preferred image processing unit is selected as a domestic soc, which establishes contact with the vehicle controller MCU through IPC. The image acquisition module is two high-definition sensor cameras. The display module is selected as two high-definition display screens. The camera is installed in the original outside rearview mirror position of the car. Due to its small size, it will also reduce the wind resistance during driving, thereby also reducing fuel consumption to some extent. In addition, it can improve the field of view. The two screens are installed on the left and right A-pillars inside the car. The advantage is that the driver's head rotation for rearview mirror observation is smaller, the field of view distance is smaller, and the safety is improved to some extent. The main point is that the screen is a high-definition display. The technology is mainly applied in electronic rearview mirror equipment, which can drive two 7-inch display screens with a display resolution of 1080P and a frame rate of up to 60 frames. It has the advantages of fast cold start (2s), image data frame inspection mechanism, error processing, functional safety level, image display delay time less than 70ms, camera heating treatment technology at low temperature, technical parameter requirements meet European legal and regulatory standards, image display perspective transformation, image scaling processing and other related functions, image ISP processing algorithm in harsh environment, strong light suppression, image brightness enhancement, color correction and other related processing methods.

[0068] Optionally, the method further comprises the following steps:

[0069] The vehicle driving scene is vehicle steering;

[0070] A processing signal is generated, and the processing signal is a steering signal;

[0071] After the image processing unit receives the steering signal, the image data is processed, and the screen of the display unit displays the enlarged image processed by the image processing unit.

[0072] In the above embodiment, as shown in Figure 4 The embodiment is steering assistance, which is zoom processing of the accessed image, and the image is enlarged through Figure 6 The front view is the normal field of view, and the rear view is the enlarged field of view. The comparison between the front and rear views of the image in the dashed line shows that the field of view of the image after receiving the steering signal is obviously enlarged, which is conducive to the observation of the target on that side and greatly improves the safety.

[0073] Optionally, the method further comprises the following steps:

[0074] The vehicle driving scene is high-speed driving of the vehicle;

[0075] A vehicle speed threshold is set, and the vehicle speed is collected. When the vehicle speed reaches the vehicle speed threshold, a processing signal is generated, and the generated processing signal is a high-speed driving signal;

[0076] The image processing unit receives the high-speed driving signal, processes the image data, and causes the display unit to display the enlarged image processed by the image processing unit on the screen.

[0077] In the above embodiment, as shown in Figure 4 The embodiment is a high-speed auxiliary, which is a zoom processing of the access image. When the vehicle is driving at high speed, the vehicle speed threshold is set to 80 km / h. When the vehicle speed is greater than 80 km / h, the field of view is expanded, the driver's left and right field of view is enhanced, and the driving safety is improved.

[0078] Optionally, the method further comprises the following steps:

[0079] The vehicle driving scene is reversing;

[0080] The preset rearview mirror observation range of the vehicle when reversing;

[0081] A processing signal is generated, and the processing signal is a reversing signal;

[0082] The image processing unit receives the reversing signal, processes the image data, and causes the display unit to display the zoomed image processed by the image processing unit on the screen.

[0083] In the above embodiment, as shown in Figure 4 The embodiment is a reversing auxiliary. As shown in Figure 5 The front view is a normal rear view, and the rear view is a reversing rear view. After receiving the reversing signal, the target image is zoomed out to be larger, and the field of view angle is changed. In this way, the position of the rear wheel and the obstacles can be seen, and the markings on the ground can be observed at any time. The angle and distance between the rear wheel and the markings can be seen, and unnecessary collisions can be reduced when parking laterally.

[0084] Optionally, as shown in Figure 7 The method further comprises the following steps:

[0085] The vehicle driving scene is foggy;

[0086] Specifically, it is determined whether it is foggy.

[0087] A processing signal is generated, and the processing signal is a fog signal;

[0088] Specifically, the fog signal is generated by a fog acquisition function in the image acquisition module.

[0089] The image processing unit sets a fog concentration threshold;

[0090] The image processing unit receives the fog signal, identifies the image data, and starts gain adjustment on the image data when the identified fog concentration is greater than the fog concentration threshold.

[0091] Specifically, through the ISP processing of the image processing unit, it is identified whether the image has fog, and if it is identified that the image has fog, gain adjustment is started on the image data, image enhancement processing is completed, and the image is sent to the display module for display.

[0092] Based on the automatic color equalization algorithm, the pixel value is corrected by calculating the light-dark contrast of the target pixel point and the surrounding pixel points.

[0093] As shown in the above embodiment, Figure 8 The front image is a foggy image, and the rear image is a de-fog image. Foggy weather is a great challenge for drivers, and they cannot see the road a few meters ahead, let alone the left and right rearview mirror images. There is a great danger, and there is a high probability of accidents when encountering drivers driving too fast. Therefore, people hope to reduce or even remove the foggy image through image algorithms to display the normal image and restore the real image as much as possible, while improving the safety of driving. When a foggy image is identified: adjust the image gain, appropriately increase the gain parameter, and overall improve the brightness of the dark area. The gain is reasonably controlled through the calibration method. Based on the automatic color equalization algorithm, the effective pixel value is corrected by calculating the light-dark contrast of the target pixel point and the surrounding pixel points, which can effectively correct the color and brightness of the image, thereby enhancing the image and sharpening the processing.

[0094] Optionally, the automatic color equalization algorithm comprises:

[0095] Color correction, spatial image reconstruction, and corresponding formula:

[0096]

[0097] The corrected image is dynamically adjusted, and the corresponding calculation formula is:

[0098]

[0099] In the above embodiment, Ic(p)-Ic(j) is the gray scale difference between p and j, d(p,j) represents the Euclidean distance between p and j, Sa(x) is a brightness representation function (odd function), and [minR,maxR] is the entire domain of the intermediate quantity L(x).

[0100] Optionally, as shown in the above embodiment, Figure 9 Further comprising the following steps:

[0101] The vehicle driving scene is a high-light scene of the image;

[0102] A processing signal is generated, and the processing signal is a high-light signal;

[0103] The image processing unit sets a brightness threshold value;

[0104] The image processing unit receives the highlight signal, identifies the image data with fog, and starts adjusting the image data when the identified highlight is greater than the brightness threshold value;

[0105] The adjusting of the image data includes calibrating the range value of the exposure parameter, and controlling the image data to make the exposure parameter within the calibrated range value of the exposure parameter.

[0106] In the above embodiment, the image is overexposed, and the image seen on the display screen has already stimulated the human eye, and even the normal picture cannot be seen, so the image needs to be controlled to prevent overexposure, and the exposure parameter can be controlled to achieve the effect of suppressing overexposure. The range value of the exposure parameter needs to be calibrated. Overexposure will cause great harm to the driver and passengers. When strong light shines on the image sensor, the situation behind cannot be seen clearly, which makes the driver unable to easily change lanes and increases the risk of accidents. Therefore, it is necessary to reasonably control the occurrence of such a situation; for example Figure 9 As shown, the specific process is to start identification, the image is accessed to the image processing unit, the image processing unit performs ISP processing on the image, judges whether the image is overexposed, if overexposed, the image processing unit performs image highlight processing on the image, and displays on the display module.

[0107] Optionally, the following steps are further included:

[0108] The image processing unit detects whether the generation and transmission of the image data are abnormal;

[0109] If there is no abnormality, the image processing unit sends the image data processed to the display unit, and displays the image processed by the image processing unit on the screen of the display unit;

[0110] If there is an abnormality, the image processing unit is reset;

[0111] If the image processing unit is reset, the image processing unit detects whether the generation and transmission of the image data are abnormal;

[0112] If there is still an abnormality, a fault alarm is sent;

[0113] If the abnormality disappears, the image processing unit sends the image data processed to the display unit, and displays the image processed by the image processing unit on the screen of the display unit.

[0114] In the above embodiment, the self-checking process of the image data is implemented, and the function module is mainly used for detecting whether the sensor generates and transmits data, and when the system is started, the automatic detection function of the image is implemented, if the data transmission is not implemented during the system starting process, the real-time detection process is implemented on the software, if there is no data, the soft reset operation is implemented, the sensor module is reset, the image data is generated again after the reset, the image data is transmitted to the processor normally, the image is processed, and finally the image is output to the screen for display, if there is still no image data, it is indicated that the sensor appears a problem, and the sensor hardware needs to be detected completely.

[0115] In another aspect, a control system of a vehicle electronic rearview mirror is provided, comprising:

[0116] An image acquisition module 10 is configured to acquire image information of a viewing range of the vehicle electronic rearview mirror and generate image data;

[0117] An image processing unit 20 is configured to process the image data according to a driving scene of the vehicle;

[0118] A display module 30 is configured to receive the image data processed by the image processing unit and display corresponding images on a display screen.

[0119] In another aspect, a vehicle is provided, comprising the control system of the vehicle electronic rearview mirror.

[0120] Although the embodiments of the present application have been shown and described, it is to be understood that various changes, modifications, substitutions and variations can be made to these embodiments without departing from the principles and spirit of the present application, and the scope of the present application is defined by the appended claims and their equivalents.

Claims

1. A method for controlling a vehicle electronic rearview mirror, characterized in that: include: Collecting image information within the observation range of the vehicle's rearview mirror to generate image data, and sending the image data to the image processing unit; Preset multiple different vehicle driving scenarios; Generates corresponding processing signals according to the vehicle driving scene, and after receiving the processing signals, the image processing unit processes the image data accordingly according to the processing signals; Sending the processed image data to the display unit, and displaying the image processed by the image processing unit on the screen of the display unit; The vehicle driving scene is foggy, and a processing signal is generated. The processing signal is a fog signal. The image processing unit sets a fog concentration threshold. After receiving the fog signal, the image processing unit identifies the image data. When the fog concentration is greater than the fog concentration threshold, the image data gain adjustment is started. Based on the automatic color balancing algorithm, the pixel value is corrected by calculating the brightness and darkness contrast of the target pixel and the surrounding pixels. The automatic color balancing algorithm includes: Color correction, spatial domain image reconstruction, corresponding formula: The corrected image is dynamically adjusted, and the corresponding calculation formula is: Where p and j are two pixel points, Ic(p)-Ic(j) is the grayscale difference between the two pixel points p and j, d(p,j) represents the Euclidean distance between the two points p and j, Sa(x) is the brightness representation function, which is an odd function here, and [minR,maxR] is the entire definition domain of the intermediate quantity L(x).

2. The method for controlling a vehicle electronic rearview mirror according to claim 1, wherein: include: The vehicle driving scenario is vehicle turning; generating a processing signal, where the processing signal is a turning signal; After receiving the turn signal, the image processing unit processes the image data so that the amplified image processed by the image processing unit is displayed on the screen of the display unit.

3. The control method of a vehicle electronic rearview mirror according to claim 1, characterized in that: include: The vehicle driving scenario is a vehicle driving at high speed; A speed threshold is set and the speed is collected. When the speed reaches the speed threshold, a processing signal is generated. The generated processing signal is a high-speed driving signal. After receiving the high-speed driving signal, the image processing unit processes the image data, so that the screen of the display unit displays the enlarged image processed by the image processing unit.

4. The control method of a vehicle electronic rearview mirror according to claim 1, characterized in that: include: The vehicle driving scenario is reversing; Preset the vehicle rearview mirror viewing range when reversing; generating a processing signal, where the processing signal is a reversing signal; After receiving the reversing signal, the image processing unit processes the image data, so that the reduced image processed by the image processing unit is displayed on the screen of the display unit.

5. The method for controlling a vehicle electronic rearview mirror according to claim 1, wherein: include: The vehicle driving scene is the image highlight scene; Generate a processing signal, the processing signal is a highlight signal; The image processing unit sets a brightness threshold; After receiving the highlight signal, the image processing unit identifies the image data with fog, and starts to adjust the image data when the highlight is greater than the brightness threshold; The adjusting of the image data includes calibrating a range of exposure parameters, and controlling the image data so that the exposure parameters are within the range of the calibrated exposure parameters.

6. A method for controlling a vehicle electronic rearview mirror according to any one of claims 1 to 5, characterized in that: include: The image processing unit detects whether the generation and transmission of image data are abnormal; If there is no abnormality, the image processing unit processes the image data and sends it to the display unit, and the image processed by the image processing unit is displayed on the screen of the display unit; If there is any abnormality, the image processing unit is controlled to reset; If the image processing unit detects whether the generation and transmission of image data are abnormal after reset; If there is still an abnormality, a fault alarm will be issued; If the abnormality disappears, the image processing unit processes the image data and sends it to the display unit, and the image processed by the image processing unit is displayed on the screen of the display unit.

7. A control system for a vehicle electronic rearview mirror, applying the control method for a vehicle electronic rearview mirror according to any one of claims 1 to 6, characterized in that: include: An image acquisition module, the image acquisition module is used to collect image information within the observation range of the vehicle rearview mirror to generate image data; An image processing unit, configured to process image data according to a vehicle driving scene; The display module is used to receive the image data processed by the image processing unit and display the corresponding image on the display screen.

8. A vehicle, characterized in that: A control system for a vehicle electronic rearview mirror comprising the method described in claim 7.

Citation Information

Patent Citations

  • Vehicle-mounted rearview display system and image display method thereof

    CN106205502A

  • Double-curvature electronic rearview mirror system

    CN110509850A