Camera monitor system, control method, electronic device, storage medium, and vehicle

Abstract

A method for controlling the display of a camera monitor system (1), a camera monitor system, an electronic device, a storage medium, and a vehicle. A camera (20) of the camera monitor system (1) comprises a plurality of different types of image sensors (40), and the plurality of image sensors (40) support different optical bands for imaging. The method for controlling the display of the camera monitor system (1) comprises: determining at least one target image sensor (40) of at least one target type matching the intensity of ambient light; and on the basis of image information obtained by the target image sensor (40), controlling a display screen (10) of the camera monitor system (1) for display.

Description

Electronic rearview mirror system and control method, electronic device, storage medium, and vehicle

[0001] Cross-reference to Related Applications

[0002] The present application claims priority to the Chinese patent application No. 202411041864.8, filed on July 31, 2024, and entitled “Electronic rearview mirror system and control method, electronic device, storage medium, and vehicle”, the entire content of which is incorporated herein by reference. TECHNICAL FIELD

[0003] The present disclosure relates to the technical field of vehicles, and in particular, to a method for controlling display of an electronic rearview mirror system, and an electronic device, a non-volatile readable storage medium, an electronic rearview mirror system, and a vehicle. BACKGROUND

[0004] In related technologies, with the continuous progress of science and technology, automobile electronic technology has been widely applied, among which the electronic rearview mirror (Camera Monitor System, CMS) has gradually become a new technology to replace the traditional optical rearview mirror. Compared with the traditional optical rearview mirror, the electronic rearview mirror has many advantages. For example, the CMS system can optimize the fluid mechanics characteristics of the vehicle, thereby reducing the wind resistance coefficient of the vehicle. At the same time, the CMS can expand the driving field of view of the driver, thereby reducing the blind area. In addition, in rainy days, the display effect of the electronic rearview mirror is better than that of the traditional optical rearview mirror.

[0005] However, the existing vehicle-mounted CMS system has significant differences in performance under different light intensities, especially in low light intensity environments such as at night, the image display effect is poor. This is mainly because the image processing algorithm in the CMS cannot be adaptively adjusted according to different light intensities, resulting in a decline in image display quality under low illumination, affecting the accuracy of the driver's judgment of the vehicle's surrounding environment, reducing the auxiliary function of the electronic rearview mirror, and easily causing safety hazards.

[0006] SUMMARY

[0007] The present disclosure aims to at least solve one of the technical problems existing in the prior art.

[0008] To this end, one object of the present disclosure is to provide a method for controlling display of an electronic rearview mirror system.

[0009] A second object of the present disclosure is to provide an electronic device.

[0010] A third object of the present disclosure is to provide a non-volatile readable storage medium.

[0011] A fourth object of the present disclosure is to provide an electronic rearview mirror system.

[0012] A fifth object of the present disclosure is to provide a vehicle.

[0013] To achieve the above objects, the method for controlling the display of an electronic rearview mirror system according to a first aspect of the present disclosure, the camera of the electronic rearview mirror system is equipped with multiple image sensors of different types, which support different light wave bands for imaging. The method comprises: determining at least one target image sensor of at least one target type that matches the ambient light intensity; and controlling the display screen of the electronic rearview mirror system to display according to the image information obtained by the target image sensor.

[0014] The method for controlling the display of an electronic rearview mirror system according to an embodiment of the present disclosure, the camera of the electronic rearview mirror system is equipped with multiple image sensors of different types, which support different light wave bands for imaging. Different light wave bands of image sensors have different light sensing characteristics, and thus can provide different imaging capabilities according to different ambient light intensities. By detecting the ambient light intensity, the system can determine at least one target image sensor of at least one target type that matches the ambient light intensity. This selection process is based on the real-time changes of the ambient light intensity, ensuring the selection of the best image sensor under different ambient light intensities. By selecting the image sensor suitable for the ambient light intensity, the system can adaptively process images under different ambient light intensities; then, the system dynamically adjusts the display content of the display screen of the electronic rearview mirror system according to the image information obtained by the target image sensor, to ensure the display of the best quality and clear images under different ambient light intensities. This adaptive selection and adjustment process significantly improves the image display effect of the electronic rearview mirror system under different ambient light intensities, enhances the driver's perception of the surrounding environment, and thus improves the safety of driving.

[0015] In some embodiments, the number of target image sensors is multiple, and the image information is obtained by image fusion of image data collected by the multiple target image sensors.

[0016] In some embodiments, the multiple target image sensors are image sensors of the same target type, or the multiple target image sensors include at least image sensors of two target types.

[0017] In some embodiments, if the ambient light intensity is less than a first light intensity threshold, the target image sensor includes at least one infrared image sensor, and the image information is image information collected by the at least one infrared image sensor.

[0018] In some embodiments, if the ambient light intensity is greater than a second light intensity threshold, the second light intensity threshold is greater than or equal to the first light intensity threshold, the target image sensor comprises at least one RGB (Red Green Blue) image sensor, and the image information is image information collected by the at least one RGB image sensor.

[0019] In some embodiments, the target image sensor is a plurality of infrared image sensors or a plurality of RGB image sensors; and the image information is image information obtained by screening image information collected by the plurality of infrared image sensors or the plurality of RGB image sensors.

[0020] In some embodiments, if the current ambient light intensity is greater than or equal to the first light intensity threshold and less than or equal to the second light intensity threshold; the image information is obtained by image fusion of image information collected by the infrared image sensor and image information collected by the RGB image sensor.

[0021] In some embodiments, in the first display control mode, when the ambient light intensity is less than the first light intensity threshold, the target image sensor is at least one infrared image sensor; and when the ambient light intensity is greater than a second light intensity threshold, the target image sensor is at least one RGB image sensor, and the second light intensity threshold is greater than the first light intensity threshold.

[0022] In some embodiments, in the second display control mode, the target image sensor comprises at least one infrared image sensor and at least one RGB image sensor. The image information is obtained by image fusion of image information collected by at least one infrared image sensor and image information collected by at least one RGB image sensor.

[0023] In some embodiments, the first display control mode is a display control mode in which the display mode selection unit of the camera is in a first triggered state; and / or, the second display control mode is a display control mode in which the display mode selection unit is in a second triggered state.

[0024] In some embodiments, the method further comprises: controlling the working state of a heating module in the camera according to a current ambient temperature, the current ambient temperature being obtained according to image collection information of the infrared image sensor.

[0025] In some embodiments, the method further comprises: prompting the working state of the plurality of image sensors.

[0026] In some embodiments, the method further comprises: performing noise reduction processing on the image information before controlling the display screen of the electronic rearview mirror system to display.

[0027] To achieve the above object, the electronic device of the second aspect of the present disclosure comprises: at least one processor; and a memory in communication connection with the at least one processor; the memory stores a computer program executable by the at least one processor, and the at least one processor executes the computer program to realize the method of controlling the electronic rearview mirror system to display as described in the above embodiments.

[0028] According to the electronic device of the present disclosure, by executing the method of controlling the electronic rearview mirror system to display of the above embodiments by the at least one processor, the adaptive selection of the image sensor under different ambient light intensities can be realized, the image quality and clarity displayed by the electronic rearview mirror system under different ambient light intensities are improved, the driver's perception ability of the surrounding environment is enhanced, and thus the driving safety is improved.

[0029] To achieve the above object, the non-volatile readable storage medium of the third aspect of the present disclosure has a computer program stored thereon, and the computer program is executed to realize the method of controlling the electronic rearview mirror system to display as described in the above embodiments.

[0030] According to the non-volatile readable storage medium of the present disclosure, by using the non-volatile readable storage medium as described in the above embodiments, the adaptive selection of the image sensor under different ambient light intensities can be realized, the image quality and clarity displayed by the electronic rearview mirror system under different ambient light intensities are improved, the driver's perception ability of the surrounding environment is enhanced, and thus the driving safety is improved.

[0031] To achieve the above object, the electronic rearview mirror system of the fourth aspect of the present disclosure comprises: a display screen; a camera comprising a plurality of image sensors of different types, the plurality of image sensors supporting different light wave bands for imaging; and a light intensity detection module for detecting ambient light intensity; the display screen is configured to display images collected by at least one target image sensor of at least one target type matched with the ambient light intensity.

[0032] According to the electronic rearview mirror system of the embodiments of the present disclosure, the camera of the electronic rearview mirror system is configured with a plurality of image sensors of different types, and the image sensors support imaging of different light wave bands. The image sensors of different light wave bands have different light sensing characteristics, and thus can provide different imaging capabilities according to different light intensities. The light intensity detection module detects the ambient light intensity in real time, and the system can determine at least one target image sensor of at least one target type that matches the ambient light intensity. This selection process is based on the real-time changes of the ambient light intensity, ensuring that the optimal image sensor is selected under different light intensities. By selecting the image sensor suitable for the ambient light intensity, the system can adaptively process images under different ambient light intensities. Then, the system configures the display screen to display the images collected by the at least one target image sensor of the at least one target type that matches the ambient light intensity according to the image information obtained by the target image sensor, so as to ensure that the optimal and clear images are displayed under the ambient light intensity. This adaptive selection and adjustment process significantly improves the image display effect of the electronic rearview mirror system under different ambient light intensities, enhances the driver's perception of the surrounding environment, and thus improves the safety of driving.

[0033] In some embodiments, the electronic rearview mirror system further comprises the electronic device described in the above embodiments.

[0034] In some embodiments, the light intensity detection module comprises an electrochromic lens arranged in front of the lens of the camera.

[0035] In some embodiments, the plurality of image sensors comprises an infrared image sensor and an RGB image sensor.

[0036] In some embodiments, the camera further comprises a heating module configured to start heating when it is determined according to the image collection information of the infrared image sensor that the current ambient temperature is lower than a temperature threshold.

[0037] In some embodiments, the electronic rearview mirror system further comprises a prompt module arranged on the display screen and configured to prompt the working state of the plurality of image sensors.

[0038] In some embodiments, the camera further comprises an image processing module connected to each of the image sensors and configured to perform image processing.

[0039] In some embodiments, the camera further comprises a display mode selection unit configured to determine a target display control mode according to a user trigger instruction.

[0040] To achieve the above object, the vehicle of the fifth aspect of the present disclosure comprises at least one electronic rearview mirror system as described in the above embodiments, and / or comprises the electronic device as described in the above embodiments.

[0041] According to the vehicle of the embodiments of the present disclosure, by adopting at least one electronic rearview mirror system as described in the above embodiments, and / or the electronic device as described in the above embodiments, adaptive selection of the image sensor under different ambient light intensities can be realized, the image quality and clarity displayed by the electronic rearview mirror system under different light intensities are improved, the driver's perception ability of the surrounding environment is enhanced, and thus the safety of driving is improved.

[0042] In some embodiments, the vehicle comprises three electronic rearview mirror systems, and the three electronic rearview mirror systems correspond to the interior rearview mirror, the left exterior rearview mirror and the right exterior rearview mirror of the vehicle respectively.

[0043] In some embodiments, the display screen of the electronic rearview mirror system corresponding to the interior rearview mirror is located at the front windshield; and / or the display screen of the electronic rearview mirror system corresponding to the left exterior rearview mirror is located at the A-pillar or the door of the vehicle; and / or the display screen of the electronic rearview mirror system corresponding to the right exterior rearview mirror is located at the door or the A-pillar.

[0044] Additional aspects and advantages of the present disclosure will be in part apparent and in part pointed out hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0045] The above and / or additional aspects and advantages of the present disclosure will become apparent and be readily appreciated from the following description, including the appended drawings, wherein:

[0046] FIG. 1 is a block diagram of an electronic rearview mirror system according to one embodiment of the present disclosure;

[0047] FIG. 2 is a block diagram of a vehicle according to one embodiment of the present disclosure;

[0048] FIG. 3 is a block diagram of a vehicle according to another embodiment of the present disclosure;

[0049] FIG. 4 is a block diagram of a vehicle according to another embodiment of the present disclosure;

[0050] FIG. 5 is a flowchart of a method of controlling the display of an electronic rearview mirror system according to one embodiment of the present disclosure;

[0051] FIG. 6 is a flowchart of a method of controlling the display of an electronic rearview mirror system according to one embodiment of the present disclosure;

[0052] FIG. 7 is a block diagram of an electronic device according to one embodiment of the present disclosure;

[0053] Fig. 8 is a schematic block diagram of a camera according to an embodiment of the present disclosure;

[0054] Fig. 9 is a schematic block diagram of an electronic rearview mirror system according to an embodiment of the present disclosure.

[0055] Reference signs: vehicle 100; electronic rearview mirror system 1; display screen 10; camera 20; light intensity detection module 30; image sensor 40; heating module 50; prompt module 60; image processing module 70; display mode selection unit 80; electronic device 110; processor 111; memory 112. DETAILED DESCRIPTION

[0056] The embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0057] In the related art, the existing electronic rearview mirror system has significant differences in performance under different light intensities, especially in low light intensity environments such as at night, the image display effect is poor. This is mainly because the image processing algorithm in the electronic rearview mirror system cannot be adaptively adjusted according to different light intensities, resulting in a decline in image display quality under low illumination, affecting the accuracy of the driver's judgment of the vehicle's surrounding environment, reducing the auxiliary function of the electronic rearview mirror, and easily causing safety hazards.

[0058] To solve the above problems, the embodiments of the present disclosure propose a method for controlling the display of an electronic rearview mirror system, which can realize the adaptive selection of an image sensor under different light intensities, improve the image quality and clarity of the electronic rearview mirror system under different light intensities, enhance the driver's perception of the surrounding environment, and thus improve the safety of driving.

[0059] For the convenience of description of the technical solutions, the electronic rearview mirror system 1 of the embodiments of the present disclosure will be described below with reference to Fig. 1.

[0060] Fig. 1 is a block diagram of an electronic rearview mirror system 1 according to an embodiment of the present disclosure, as shown in Fig. 1, the electronic rearview mirror system 1 includes: a display screen 10, a camera 20, a light intensity detection module 30.

[0061] In some embodiments, the display screen 10 can be a liquid crystal display (LCD), an organic light emitting display (OLED), an electronic ink (E-ink) or other types of display screen 10. The main function of the display screen 10 is to display the image information captured by the camera 20 in real time to provide the driver with a clear rear view image, ensuring that the driver can view the environment around the vehicle in real time, helping the driver to better observe the blind area and avoid accidents. In addition, the display screen 10 can not only display the image captured by the camera 20, but also integrate navigation systems, back-up radar information and vehicle speed and other driving related information, thereby enhancing the driving experience of the driver.

[0062] In some embodiments, the display screen 10 can be installed at multiple locations inside the vehicle, for example, near the A-pillar, inside the door, below the front windshield, above the center console or other suitable locations. The position of the display screen 10 should conform to the viewing habits of the driver, ensuring that the driver can view the rear view information without the need to move the line of sight significantly, reducing fatigue and distraction. In addition, the installation position of the display screen 10 needs to consider the internal structure design of the vehicle, ensuring that the installation of the display screen 10 does not affect the normal use of other functional components, while being elegant and elegant. In addition, the position of the display screen 10 should avoid blocking the driver's line of sight or causing a blind area, ensuring that the driver can quickly view the display information in an emergency and make the correct judgment.

[0063] In some embodiments, referring to FIG. 8, the camera 20 can be a device for capturing images of the environment around the vehicle, and the camera 20 includes a plurality of image sensors 40 of different types, which support different light wave bands for imaging. That is, the camera 20 of the present disclosure can be a multi-spectral camera, which is a camera capable of imaging in multiple spectral bands (such as visible light and near-infrared light). The multi-spectral camera can have 2 to 100 wave bands, and such a camera is configured with multiple image sensors 40, each of which is optimized for a specific spectral band, so that the camera can provide high-quality images under different light intensities (such as day and night).

[0064] In some embodiments, the plurality of image sensors 40 can include an infrared image sensor and an RGB image sensor. The infrared image sensor can image by detecting infrared radiation emitted by objects in the environment, independent of external light sources. The infrared radiation can be converted into an electrical signal, which in turn generates a thermal image; while the RGB image sensor can be a CMOS (Complementary Metal-Oxide-Semiconductor) sensor based on RGB three primary colors, the surface of which is covered with red, green and blue color filters. Each pixel point captures a specific color of light through a filter, and then converts it into an electrical signal through a photodiode. Therefore, the red, green and blue color information captured by the RGB image sensor can be combined by the processing circuit to generate a color image.

[0065] In some embodiments, the RGB image sensor can capture more abundant color information and higher resolution in daylight or sufficient light. At night or in low light intensity, the infrared image sensor can provide clearer images using infrared light in the environment.

[0066] In some embodiments, the display screen 10 is configured to display images captured by at least one target image sensor 40 of at least one target species matching the ambient light intensity. The at least one target species can include one target species, two target species or more target species, and the at least one target image sensor 40 can include one target image sensor 40, two target image sensors 40 or more target image sensors 40. Therefore, by configuring the display screen 10 accordingly, the system can provide the best image display effect under various light intensities.

[0067] In some embodiments, the light intensity detection module 30 can be used to detect the ambient light intensity. Specifically, the light intensity detection module 30 can detect the light intensity of the environment around the vehicle in real time, which can be achieved by devices such as photoresistors, to ensure that the system can select the most suitable image sensor for image capture according to the current light intensity.

[0068] In some embodiments, the electronic rearview mirror system 1 further comprises an electronic device 110 as described in the following embodiments. The electronic device 110 can be an integrated device that includes a control unit, a storage unit, a communication unit, etc., and is capable of performing high-level control and data processing tasks. In embodiments, the electronic device 110 can be a controller of the vehicle or a vehicle terminal or other applicable electronic device. In embodiments, the electronic device 110 can be used to perform the method of controlling the display of the electronic rearview mirror system 1 in the embodiments of the present disclosure, which can be referred to the description of the following embodiments. The electronic device 110 can work with the display screen 10, the camera 20 and the light intensity detection module 30 to provide more intelligent and efficient image processing and display functions.

[0069] In some embodiments, the light intensity detection module 30 includes an electrochromic lens arranged in front of the lens of the camera 20. The electrochromic (EC) lens is a special lens that can adjust its transparency or transmittance through an electrical signal. In the electronic rearview mirror system 1, the electrochromic lens is used to adjust its transparency to adapt to different light intensities. By changing the transparency of the lens, the light intensity received by the camera 20 can be effectively adjusted, thereby affecting the clarity and quality of the image.

[0070] In some embodiments, the electrochromic lens can adopt a convex design, which helps to increase the optical reflection effect and improve the adjustment performance of light transmittance. This design can optimize the optical properties of the lens to make it more effectively adapt to the needs under different light intensities.

[0071] In some embodiments, the electrochromic lens is coated with a hydrophobic film and an anti-glare film on its outer surface. The hydrophobic film is coated to effectively resist the attachment of rainwater or other liquids, keep the lens surface clean, and avoid the influence of water droplets on the field of view. The application of the anti-glare film can reduce the reflection and interference from light sources to prevent glare problems that may occur under high light intensity, thereby improving the visibility of the image.

[0072] In some embodiments, when encountering light, the light intensity change of the surrounding environment can be detected in real time by sensors such as photosensitive resistors, and through the detected light intensity, the control system can adjust the transparency or transmittance of the electrochromic lens, thereby optimizing the image display effect of the electronic rearview mirror system 1.

[0073] According to the electronic rearview mirror system 1 of the embodiments of the present disclosure, the camera 20 of the electronic rearview mirror system 1 is configured with a plurality of image sensors 40 of different types, which support different light wave bands for imaging. The image sensors 40 of different light wave bands have different light sensing characteristics, and thus can provide different imaging capabilities according to different light intensities. The light intensity detection module 30 detects the ambient light intensity in real time, and the system can determine at least one target image sensor 40 of at least one target type that matches the ambient light intensity. This selection process is based on the real-time changes of the ambient light intensity, ensuring the selection of the optimal image sensor 40 under different light intensities. By selecting the image sensor 40 suitable for the ambient light intensity, the system can adaptively process images under different ambient light intensities; then, the system configures the display screen 10 to display the images collected by the at least one target image sensor 40 of the at least one target type that matches the ambient light intensity, to ensure the display of the best quality and clear images under the ambient light intensity. This adaptive selection and adjustment process significantly improves the image display effect of the electronic rearview mirror system 1 under different ambient light intensities, enhances the driver's perception of the surrounding environment, and thus improves the safety of driving.

[0074] In some embodiments, referring to FIG. 8, the camera 20 further includes a heating module 50. The heating module 50 is a device specially used for heating the lens of the camera 20 in a low-temperature environment to prevent the lens surface from frosting or fogging. The heating module 50 can include a heating wire, a temperature control device, and a power control unit. The heating wire can be made of a resistive material and generates heat when powered on, which is used to heat the lens surface; the temperature control device is used to monitor and adjust the temperature of the heating wire, to ensure that the heating effect is within a safe and effective range; and the power control unit is used to manage the power supply of the heating module 50, to control the power-on and power-off of the heating wire.

[0075] In some embodiments, the heating module 50 is used to start heating when it is determined according to the image information collected by the infrared image sensor that the current ambient temperature is lower than a temperature threshold. Specifically, the infrared image sensor can detect the ambient temperature and transmit the temperature information to the control unit of the system. The control unit can determine whether the current ambient temperature is lower than the preset threshold according to the preset temperature threshold. When the detected temperature is lower than the preset threshold, the control unit can start the heating module 50 to make the heating wire generate heat and raise the temperature around the lens to prevent frosting or fogging.

[0076] Therefore, by heating the camera 20 through the heating module 50, the temperature difference between the inside and outside of the camera can be effectively prevented from being too large, the condensation and wall-hanging phenomenon of the external water mist can be eliminated, the water film on the glass surface can be thinned and evaporated, the image distortion and blurring phenomenon caused by the water film can be prevented, and thus the camera 20 can capture clear images and the image quality can be improved.

[0077] In some embodiments, the temperature threshold can be preset according to environmental temperature, device material, user demand, and the like, which are not specifically limited herein.

[0078] In some embodiments, the electronic rearview mirror system 1 further comprises a prompt module 60. The prompt module 60 is arranged on the display screen 10 and is used to prompt the working state of the plurality of image sensors 40.

[0079] The prompt module 60 can indicate the working state of the image sensor 40 by using an LED (Light Emitting Display) indicator, for example, when the infrared image sensor is selected to detect the surrounding environment and generate an infrared image, the color of the LED indicator is yellow; when the RGB image sensor is selected to detect the surrounding environment and generate an RGB image, the color of the LED indicator is green.

[0080] In addition, the prompt module 60 can also prompt the working state of the image sensor 40 by icons or words. It should be noted that the prompt module 60 can be integrated in a corner or edge of the display screen 10 without affecting the display of the main image, for example, the upper right corner or the bottom of the display screen 10.

[0081] Therefore, by integrating the prompt module 60, the electronic rearview mirror system 1 can provide the driver with real-time working state information of the plurality of image sensors 40. This design not only improves the operability and intelligence of the system, but also enhances the driver's perception of the environment around the vehicle, further improving the safety and convenience of driving.

[0082] In some embodiments, referring to FIG. 8, the camera 20 further comprises an image processing module 70, which is connected with each image sensor 40 and is used for image processing.

[0083] Specifically, the control unit of the system receives the current ambient light intensity signal detected by the light intensity detection module 30, and according to the light intensity signal, a specific image sensor 40 that meets the conditions in the camera 20 can be selected as a target image sensor 40, for example, an RGB image sensor is selected under strong light intensity, and an infrared image sensor is selected under low light intensity.

[0084] Further, the target image sensor 40 starts to work and collects image information, and the collected image information is transmitted to the control unit through a gigabit multimedia serial link (GMSL, Gigabit Multimedia Serial Link) to ensure high speed and high bandwidth of data transmission. According to the type of the image sensor 40, the control unit can select different noise reduction modules. Different types of image sensors 40 can generate different types of noise, so targeted noise reduction processing is needed. For example, one noise reduction algorithm is used for RGB image sensors, and another noise reduction algorithm is used for infrared image sensors, to ensure that noise can be effectively eliminated under different light intensities and improve image quality.

[0085] Further, the image information transmitted is subjected to bilateral two-dimensional spatial domain noise reduction processing by the noise reduction module to eliminate interference signals such as salt and pepper noise in the image, thereby improving image quality. The image information after noise reduction processing is transmitted through a serial deserializer and finally displayed on the display screen 10 of the electronic rearview mirror.

[0086] In addition, in addition to noise reduction processing of the image, the image processing module 70 can also perform pre-processing, enhancement, compression and fusion operations on the image. Specifically, image preprocessing can be a preliminary processing of the image, such as white balance adjustment and color correction. Image enhancement can improve the brightness, contrast and color of the image, making the image clearer and more vivid. Image compression can be a compression processing of the image to reduce the amount of image data and improve transmission and storage efficiency. Image fusion can be to fuse data from image sensors of different wavebands to generate a comprehensive high-quality image.

[0087] In some embodiments, the image processing module 70 can include multiple dedicated image processing units, such as DSP (Digital Signal Processor), FPGA (Field-Programmable Gate Array) and GPU (Graphics Processing Unit), etc., for executing complex image processing algorithms.

[0088] In some embodiments, the camera 20 further includes a display mode selection unit 80, which is used to determine a target display control mode according to a user trigger instruction.

[0089] Specifically, the display mode selection unit 80 receives the triggering instruction from the user and transmits the instruction to the control unit of the system. The control unit parses the instruction and determines the target display control mode. According to the target display control mode, the control unit selects the appropriate image sensor 40 (such as an RGB image sensor or an infrared image sensor). The control unit adjusts the display content of the display screen 10 according to the image acquisition information of the selected image sensor 40 to ensure the best image quality.

[0090] In some embodiments, the display mode selection unit is a user interface device, which can be a button, a touch screen, a knob, a voice recognition system or other input device. Its main function is to receive the input instruction from the user so that the user can select different display control modes.

[0091] The vehicle 100 according to embodiments of the present disclosure is described below with reference to FIGS. 2-4.

[0092] FIG. 2 is a block diagram of the vehicle 100 according to one embodiment of the present disclosure, FIG. 3 is a block diagram of the vehicle 100 according to another embodiment of the present disclosure, and FIG. 4 is a block diagram of the vehicle 100 according to another embodiment of the present disclosure. As shown in FIGS. 2-4, the vehicle 100 includes at least one electronic rearview mirror system 1 as described in the above embodiments, and / or includes the electronic device 110 as described in the below embodiments.

[0093] The at least one electronic rearview mirror system 1 can be one electronic rearview mirror system 1, two electronic rearview mirror systems 1, three electronic rearview mirror systems 1, five electronic rearview mirror systems 1 or more electronic rearview mirror systems 1. The specific number of electronic rearview mirror systems 1 can be set according to the type and purpose of the vehicle, the driving environment, the safety requirement, the legal and regulatory requirement, the technical and cost factors. By reasonably configuring the electronic rearview mirror system 1, the vehicle 100 can maintain the best field of view in various complex driving environments and improve the driving safety and operational convenience.

[0094] In some embodiments, the electronic rearview mirror system 1 can be suitable for various types of vehicles 100, including but not limited to passenger cars (such as sedans, SUVs (Sport Utility Vehicles) and MPVs (multi-Purpose Vehicles)), commercial vehicles (such as vans, trucks and buses) or special purpose vehicles (such as ambulances, fire engines and engineering vehicles) and the like.

[0095] According to the vehicle 100 of the embodiment of the present disclosure, by adopting at least one electronic rearview mirror system 1 as described in the above embodiments, and / or the electronic device 110 as described in the above embodiments, adaptive selection of the image sensor 40 under different ambient light intensities can be realized, the image quality and clarity of the electronic rearview mirror system 1 under different light intensities are improved, the driver's perception of the surrounding environment is enhanced, and thus the safety of driving is improved.

[0096] In some embodiments, the vehicle 100 can include three electronic rearview mirror systems 1, which correspond to the interior rearview mirror, the left exterior rearview mirror and the right exterior rearview mirror of the vehicle 100 respectively. Among them, the electronic rearview mirror system 1 corresponding to the interior rearview mirror of the vehicle 100 can be used to provide a central rear view of the vehicle, assisting the driver in reversing, lane changing and observing the rear traffic; the electronic rearview mirror system 1 corresponding to the left exterior rearview mirror of the vehicle 100 can be used to provide a view of the left side and rear of the vehicle 100, assisting the driver in observing the left side blind area when changing lanes to the left, turning to the left and parking, and ensuring driving safety; the electronic rearview mirror system 1 corresponding to the right exterior rearview mirror of the vehicle 100 can provide a view of the right side and rear of the vehicle 100, assisting the driver in observing the right side blind area when changing lanes to the right, turning to the right and parking, and ensuring driving safety.

[0097] In some embodiments, the display screen 10 of the electronic rearview mirror system 1 corresponding to the interior rearview mirror is located at the front windshield. This arrangement makes the display screen 10 located at the natural extension of the driver's line of sight, and the driver can conveniently switch from the front view to the rear view, ensuring driving safety; and / or the display screen 10 of the electronic rearview mirror system 1 corresponding to the left exterior rearview mirror is located at the A-pillar or the door of the vehicle 100; and / or the display screen 10 of the electronic rearview mirror system 1 corresponding to the right exterior rearview mirror is located at the door or the A-pillar. This arrangement makes the display screen 10 located within the range of the driver's left and right side views, and the driver can conveniently view the images of the left and right exterior rearview mirrors, improving driving safety and operational convenience.

[0098] Based on the electronic rearview mirror system 1 and the vehicle 100 as described in the above embodiments, the method for controlling the display of the electronic rearview mirror system 1 according to the embodiment of the present disclosure is described below with reference to FIG. 3.

[0099] The camera 20 of the electronic rearview mirror system 1 includes a plurality of image sensors 40 of different types, which support different light wave bands for imaging. For example, the plurality of image sensors 40 includes an infrared image sensor and an RGB image sensor. The infrared image sensor is suitable for use at night or in low light intensity environments, and can provide clear images under low light conditions using infrared light. The RGB image sensor is suitable for use during the day or in well-lit environments, and can capture rich color information and high-resolution images to provide clear visible light images.

[0100] FIG. 5 is a flowchart of a method for controlling the display of an electronic rearview mirror system according to one embodiment of the present disclosure. As shown in FIG. 5, the method for controlling the display of the electronic rearview mirror system includes at least steps S1-S2, which are as follows:

[0101] S1, determining at least one target image sensor of at least one target type that matches the ambient light intensity.

[0102] In some embodiments, the ambient light intensity can be detected in real time by a light intensity detection module, which can use a photoresistor, a photodiode, or an electrochromic lens to detect the ambient light intensity. The electrochromic lens can be disposed in front of the lens of the camera and can adjust the light transmittance according to the ambient light intensity, providing more stable and accurate data for subsequent light intensity detection.

[0103] In some embodiments, the at least one target type can include one target type, two target types, or more target types, and the at least one target image sensor can include one target image sensor, two target image sensors, or more target image sensors. Thus, the system detects the ambient light intensity using the light intensity detection module. Based on the ambient light intensity, the system can select the type and number of target image sensors that are best suited to the current environment to ensure optimal imaging results under various ambient light intensities.

[0104] S2, controlling the display screen of the electronic rearview mirror system to display based on the image information obtained by the target image sensor.

[0105] Specifically, the target image sensor captures images in the current environment and generates image information. The image information is then transmitted to the image processing module for processing, and the processed image data is transmitted to the control unit of the electronic rearview mirror system through the Gigabit Multimedia Serial Link (GMSL). GMSL ensures high speed and low latency of image information during transmission, ensuring real-time display. During transmission, image information can be decoded by a serial deserializer to ensure the integrity and accuracy of data transmission. After the control unit receives the image information, it can further optimize the processing according to the image sensor type and environmental conditions. For example, for images of RGB image sensors, color enhancement and sharpening processing is performed; for images of infrared image sensors, thermal image enhancement and contrast adjustment are performed. The processed image information is transmitted to the display screen through IIC (Inter-Integrated Circuit) or SPI (Serial Peripheral Interface). The control unit can dynamically adjust the brightness, contrast and color settings of the display screen according to the ambient light conditions and the needs of the driver, ensuring the best display effect. The driver can clearly observe the environment around the vehicle through the display screen, which helps to improve driving safety.

[0106] According to the method for controlling the display of the electronic rearview mirror system according to the embodiments of the present disclosure, the camera of the electronic rearview mirror system is configured with multiple image sensors of different types, and the image sensors support different light wave bands for imaging. Different light wave bands of image sensors have different photosensitive characteristics, so they can provide different imaging capabilities according to different ambient light intensities. By detecting the ambient light intensity, the system can determine at least one target image sensor of at least one target type that matches the ambient light intensity. This selection process is based on the real-time changes of the ambient light intensity, ensuring the selection of the best image sensor under different ambient light intensities. By selecting an image sensor suitable for the ambient light intensity, the system can adaptively process images under different ambient light intensities. Then, the system dynamically adjusts the display content of the display screen of the electronic rearview mirror system according to the image information obtained by the target image sensor, to ensure that the best quality and clear images are displayed under the ambient light intensity. This adaptive selection and adjustment process significantly improves the image display effect of the electronic rearview mirror system under different ambient light intensities, enhances the driver's perception of the surrounding environment, and thus improves driving safety.

[0107] In some embodiments, the number of target image sensors is multiple, and the image information is obtained by image fusion of image data collected by the multiple target image sensors. The image fusion can refer to comprehensive processing of image data collected by the multiple target image sensors to generate higher-quality images. Specifically, image fusion can be achieved by feature extraction, alignment, and synthesis of data from multiple target image sensors, thereby generating images with higher resolution, better contrast, and more details.

[0108] In some embodiments, the multiple target image sensors are image sensors of the same target category, or at least two target categories of image sensors are included in the multiple target image sensors.

[0109] Therefore, by image fusion of image data collected by multiple target image sensors, the system can fully utilize the advantages of multiple image sensors of the same target category or multiple image sensors of different categories to generate more comprehensive and clear image information. Ultimately, the system controls the display screen of the electronic rearview mirror system according to the image information after fusion processing, significantly improving the clarity of the driver's field of view under different ambient light intensities, thereby enhancing the safety of driving.

[0110] In some embodiments, if the ambient light intensity is less than a first light intensity threshold, the target image sensors include at least one infrared image sensor. The image information is the image information collected by the at least one infrared image sensor.

[0111] The first light intensity threshold is a pre-set ambient light intensity reference value for determining a weak ambient light intensity condition, which can be determined by experimental data and actual use environment. When the ambient light intensity is weak, the infrared image sensor can better capture thermal radiation, so selecting an infrared image sensor helps to improve the clarity and contrast of the image at night or in low light intensity.

[0112] In some embodiments, the at least one infrared image sensor can include one infrared image sensor, two infrared image sensors, five infrared image sensors, or more. Different numbers of infrared image sensors can provide optimal coverage and performance for different vehicle types and application scenarios. Therefore, when designing the system, the type of vehicle, application scenario, safety requirements, and the complexity of cost and technology implementation can be considered to determine the appropriate number of infrared image sensor configurations.

[0113] In some embodiments, if the ambient light intensity is greater than a second light intensity threshold, the second light intensity threshold being greater than or equal to the first light intensity threshold, the target image sensor includes at least one RGB image sensor, and the image information is image information captured by the at least one RGB image sensor.

[0114] The second light intensity threshold is also a pre-set ambient light intensity reference value for determining a case where the ambient light intensity is strong, and the threshold can be determined through experimental data and actual use environment. When the ambient light intensity is strong, the RGB image sensor can capture rich color information and details, and is suitable for use in daytime or under strong light intensity. Selecting the RGB image sensor can provide more realistic and clear color images.

[0115] In some embodiments, the at least one RGB image sensor can include one RGB image sensor, two RGB image sensors, five RGB image sensors, or more. Different numbers of RGB image sensors can provide optimal coverage and performance for different vehicle types and application scenarios. Therefore, when designing the system, the type of vehicle, application scenario, safety requirements, and cost and complexity of technical implementation can be considered to determine the appropriate number of RGB image sensor configurations.

[0116] In some embodiments, the target image sensor is a plurality of infrared image sensors or a plurality of RGB image sensors, and the image information is image information obtained after screening image information captured by the plurality of infrared image sensors or the plurality of RGB image sensors.

[0117] Specifically, the system can screen the best image information according to a pre-set algorithm and conditions. This can involve evaluation and comparison of contrast, color saturation, and noise level, etc. to select image data most suitable for the current environment and application requirements. According to the current ambient light intensity and conditions, the system can adjust the screening criteria. For example, under low light intensity conditions, image data that captures more details and low noise can be preferred, while under strong light intensity conditions, color accuracy and dynamic range can be emphasized.

[0118] Therefore, the screening of image information can be dynamic and can be adjusted as the environmental conditions change. The system can periodically re-evaluate and adjust image processing parameters to ensure continuous optimization of display effect and performance.

[0119] In some embodiments, if the ambient light intensity is greater than or equal to the first light intensity threshold and less than or equal to the second light intensity threshold, the image information is obtained by image fusion of image information captured by the infrared image sensor and image information captured by the RGB image sensor.

[0120] Specifically, the RGB image sensor and the infrared image sensor can simultaneously collect image information of the current environment, and then feature extraction is performed on the image information collected by the RGB image sensor and the infrared image sensor. For example, the image information collected by the RGB image sensor can extract color information, texture features, edge information, etc.; and the image information collected by the infrared image sensor can extract thermal radiation intensity, shape features, contrast information, etc.

[0121] Further, the extracted features are superimposed and supplemented to form a comprehensive feature map. For example, superimposing the color information of the RGB image and the thermal radiation intensity of the infrared image can generate an image containing both color information and clear contours under night or low light intensity conditions. Feature superposition can use various methods such as weighted average method, feature selection method, and feature splicing method, etc. Through the comprehensive feature map after feature superposition, a new environment image is reconstructed. The reconstruction process uses image processing algorithms such as interpolation algorithm and deconvolution, etc., so that the fused image information retains the advantage features of each sensor as much as possible.

[0122] Therefore, the image information collected by the infrared image sensor and the RGB image sensor is extracted, and then appropriate algorithms (such as weighted average and feature cascade, etc.) are used to fuse the features of the two images together to enhance the details and contrast of the image. This method can retain the unique thermal imaging information of the infrared image sensor while using the color information of the RGB image sensor to enhance the realism and visual comfort of the image.

[0123] In some embodiments, in the first display control mode, if the ambient light intensity is less than a first light intensity threshold, the target image sensor is at least one infrared image sensor. If the ambient light intensity is greater than a second light intensity threshold, the target image sensor is at least one RGB image sensor, and the second light intensity threshold is greater than the first light intensity threshold.

[0124] The first display control mode can refer to a mode of using the same target type of image sensor to obtain image information and controlling the display screen to display according to the image information, that is, through internal logical processing method, at least one infrared image sensor or at least one RGB image sensor is selected to collect image information according to the ambient light intensity, rather than simultaneously selecting infrared image sensor and RGB image sensor for image collection and fusion processing. Therefore, according to the real-time ambient light intensity, the target image sensor matching the ambient light intensity is dynamically selected to ensure that the best image can be captured under different ambient light intensities and the driver's perception of the surrounding environment is enhanced.

[0125] In some embodiments, in the second display control mode, the target image sensor includes at least one infrared image sensor and at least one RGB image sensor. The second display control mode is the display control mode when the current ambient light intensity is between the first light intensity threshold and the second light intensity threshold. In this mode, the image information is obtained by image fusion of the image information collected by the at least one infrared image sensor and the image information collected by the at least one RGB image sensor. For example, during the dawn or sunset period, the ambient light intensity is moderate, and the system can combine the advantages of the infrared image sensor and the RGB image sensor to provide richer and more detailed image information.

[0126] In some embodiments, the first display control mode is the display control mode when the display mode selection unit is in the first trigger state, and / or the second display control mode is the display control mode when the display mode selection unit is in the second trigger state.

[0127] In some embodiments, the display mode selection unit can be a device or interface that allows the user to select the display control mode. It can be in various forms, such as: switch button, knob, touch screen interface, and voice control system, etc. The first trigger state and the second trigger state are specific settings or operating states of the display mode selection unit. By operating the display mode selection unit to different trigger states, the system can switch between different display control modes to meet the user's needs for display effects in different driving environments, thereby improving driving experience and safety.

[0128] In some embodiments, the method of controlling the display of the electronic rearview mirror system further includes controlling the working state of the heating module in the camera according to the current ambient temperature, which is obtained from the image acquisition information of the infrared image sensor.

[0129] Specifically, the system identifies the current ambient temperature by real-time acquisition of infrared image acquisition information through the infrared image sensor, and controls the working state of the heating module in the camera according to the obtained ambient temperature information. When the ambient temperature is lower than the preset temperature threshold, the heating module is started to make the heating wire generate heat, and the surface of the camera lens is heated to prevent frost or water mist on the lens surface, maintain a clear view, and ensure that the image quality is not affected by environmental conditions.

[0130] Therefore, by controlling the working state of the heating module in the camera, the temperature difference between the inside and outside of the camera can be effectively prevented, the condensation and wall-hanging phenomenon of external water mist can be eliminated, the water film on the glass surface can be evaporated, and the image distortion and blur caused by the water film can be prevented, thereby ensuring that the camera can clearly capture images and improving the image quality.

[0131] In some embodiments, the method of controlling the display of the electronic rearview mirror system further comprises prompting the working state of the plurality of image sensors. For example, the working state of the image sensors can be indicated by using an LED indicator, when the infrared image sensor is selected to detect the surrounding environment and generate an infrared image, the color of the LED indicator is yellow; when the RGB image sensor is selected to detect the surrounding environment and generate an RGB image, the color of the LED indicator is green. This prompt ensures that the driver can timely understand the running status of each image sensor, thereby improving the reliability and safety of the electronic rearview mirror system.

[0132] In some embodiments, the method of controlling the display of the electronic rearview mirror system further comprises performing noise reduction processing on the image information before controlling the display screen of the electronic rearview mirror system to display.

[0133] Specifically, the intensity of ambient light is detected in real time by the electrochromic lens and the photoresistor, when the detected intensity of ambient light is less than the first light intensity threshold, the infrared image sensor is started, and the corresponding two-dimensional noise reduction algorithm is selected to perform noise reduction processing on the image information under low light intensity. When the detected intensity of ambient light is greater than the second light intensity threshold, the RGB image sensor is started, and the corresponding two-dimensional noise reduction algorithm is selected to perform noise reduction processing on the image information under high light intensity. When the detected intensity of ambient light is between the first light intensity threshold and the second light intensity threshold, the infrared image sensor and the RGB image sensor can be started at the same time to perform fusion and noise reduction processing on the collected image information.

[0134] Therefore, different noise reduction modules can be selected according to the type of image sensor, and the image information transmitted is processed by the noise reduction module for bilateral two-dimensional spatial noise reduction, to eliminate interference signals such as salt and pepper noise in the image, thereby improving the image quality. The image information after noise reduction is transmitted through a serial deserializer and finally displayed on the display screen of the electronic rearview mirror.

[0135] FIG. 6 is a whole flow chart of the method of controlling the display of the electronic rearview mirror system according to one embodiment of the present disclosure, as shown in FIG. 6, the whole flow chart of the method of controlling the display of the electronic rearview mirror system at least includes steps S10-S22, which are as follows:

[0136] S10, power on.

[0137] S11, detecting the intensity of ambient light in real time by the light intensity detection module.

[0138] S12, determining at least one target image sensor of at least one target type matched with the intensity of ambient light according to the intensity of ambient light.

[0139] S13, determining whether the ambient light intensity is greater than or equal to the first light intensity threshold and less than or equal to the second light intensity threshold, if yes, entering step S20, if not, entering steps S14 and S17.

[0140] S14, selecting at least one infrared image sensor as the target image sensor when the ambient light intensity is less than the first light intensity threshold.

[0141] S15, controlling the infrared image sensor to output an infrared image, and performing noise reduction processing on the infrared image through the corresponding noise reduction module in the image processing module.

[0142] S16, transmitting the processed infrared image to the display screen of the electronic rearview mirror system for display, and at the same time, the LED indicator emits yellow light.

[0143] S17, selecting at least one RGB image sensor as the target image sensor when the ambient light intensity is greater than the second light intensity threshold.

[0144] S18, controlling the RGB image sensor to output an RGB image, and performing noise reduction processing on the RGB image through the corresponding noise reduction module in the image processing module.

[0145] S19, transmitting the processed RGB image to the display screen of the electronic rearview mirror system for display, and at the same time, the LED indicator emits green light.

[0146] S20, selecting at least one infrared image sensor and at least one RGB image sensor as the target image sensor.

[0147] S21, controlling the infrared image sensor to output an infrared image, and controlling the RGB image sensor to output an RGB image, and performing fusion and noise reduction processing on the infrared image and the RGB image.

[0148] S22, transmitting the processed fusion image to the display screen of the electronic rearview mirror system for display, and at the same time, the LED indicator emits green light and yellow light.

[0149] In summary, by selecting different image sensors, the system can adaptively process images under different lighting conditions. The system dynamically adjusts the display content of the display screen of the electronic rearview mirror system according to the image information collected by the target image sensor, to ensure that the best quality and clear image is displayed under different ambient light intensities. This adaptive selection and adjustment process can significantly improve the image display effect of the electronic rearview mirror system under different ambient light intensities, and enhance the driver's perception of the surrounding environment, thereby improving the safety of driving.

[0150] The electronic device 110 according to an embodiment of the disclosure is described below with reference to FIG. 7.

[0151] FIG. 7 is a block diagram of the electronic device 110 according to one embodiment of the present disclosure. As shown in FIG. 7, the electronic device 110 includes a memory 112 and at least one processor 111.

[0152] In some embodiments, the at least one processor 111 can be one processor 111, two processors 111, three processors 111, five processors 111, eight processors 111, ten processors 111, or the like. These processors 111 can be a core control unit in the electronic rearview mirror system 1, such as an Electronic Control Unit (ECU). The ECU is responsible for coordinating the work of the entire electronic rearview mirror system 1, including receiving data from the light intensity detection module 30, selecting the appropriate target image sensor, processing image data, and transmitting it to the display screen 10.

[0153] Specifically, the light intensity detection module 30 detects the ambient light intensity in real time and transmits the detection signal to the ECU, which analyzes the light intensity data to determine the current ambient light conditions. Based on the analysis results, the ECU selects an image sensor 40 (such as an RGB image sensor or an infrared image sensor) suitable for the current light conditions.

[0154] Further, the ECU configures the register parameters of the selected image sensor 40 through IIC (Inter-Integrated Circuit) and SPI (Serial Peripheral Interface) and initializes it to prepare for image acquisition. IIC is a serial communication protocol for short-distance communication, mainly used to connect low-speed devices. The ECU can send configuration commands to the sensor through the IIC interface to set its working parameters; while SPI is a high-speed synchronous serial communication protocol, used to connect high-speed devices, the ECU can quickly transmit data and commands to the sensor through the SPI interface to achieve fast initialization and data acquisition.

[0155] Further, the ECU is responsible for generating and sending control signals, which are used to activate and adjust the working state of the target image sensor 40. After receiving the control signal, the target image sensor 40 collects the environment image and transmits the image data to the ECU; the ECU receives and processes these image data; then, the ECU transmits the processed image data to the display screen 10 to adjust the display content to ensure the best image quality; according to the display effect and light changes, the ECU adjusts the sensor selection and image processing strategy in real time.

[0156] In some embodiments, the ECU can be a microcontroller (MCU) or a micro control ARM (Advanced RISC Machines). Among them, the MCU is a kind of microcomputer in embedded system, with CPU (Central Processing Unit), memory and I / O port, used to control various components in electronic system. In the electronic rearview mirror system 1, the MCU can efficiently process sensor data and respond quickly. ARM is a kind of microprocessor based on RISC (Reduced Instruction Set Computer) architecture. ARM is widely used in embedded systems for its high performance and low power consumption and strong computing power. In the electronic rearview mirror system 1, the ARM microcontroller can handle more complex computing tasks and support more peripheral interfaces.

[0157] In some embodiments, the memory 112 can include flash memory, random access memory (RAM), and electronic memory, etc. The memory 112 is communicatively connected with the at least one processor 111, and the memory 112 stores a computer program executable by the at least one processor 111, and the at least one processor 111 implements the method of controlling the display of the electronic rearview mirror system described in the above embodiments when executing the computer program.

[0158] According to the electronic device 110 of the embodiments of the present disclosure, by executing the method of controlling the display of the electronic rearview mirror system by the at least one processor 111, the adaptive selection of the image sensor 40 under different ambient light intensities can be realized, the image quality and clarity of the electronic rearview mirror system 1 under different ambient light intensities are improved, the driver's perception ability of the surrounding environment is enhanced, and thus the safety of driving is improved.

[0159] The embodiments of the present disclosure also propose a non-volatile readable storage medium, which stores a computer program, and the computer program is executed by the processor 111 to implement the method of controlling the display of the electronic rearview mirror system described in the above embodiments. The specific implementation process of the method of controlling the display of the electronic rearview mirror system can refer to the description of the above embodiments.

[0160] In some embodiments, the computer readable storage media can include, but is not limited to, a phase change memory (PRAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), other types of random access memory (RAM), a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a flash memory, or other optical and magnetic storage media, which are not listed one by one here.

[0161] According to the non-volatile readable storage medium of the embodiments of the present disclosure, by adopting the non-volatile readable storage medium described in the above embodiments, adaptive selection of the image sensor under different ambient light intensities can be realized, the image quality and definition displayed by the electronic rearview mirror system 1 under different ambient light intensities are improved, the driver's perception ability of the surrounding environment is enhanced, and thus the driving safety is improved.

[0162] In the description of the present specification, the description referring to the terms "one embodiment", "some embodiments", "exemplary embodiment", "example", "specific example", or "some examples" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present disclosure. In the present specification, the exemplary description of the above terms does not necessarily mean the same embodiment or example.

[0163] Although the embodiments of the present disclosure have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and variations can be made to these embodiments without departing from the principles and spirit of the present disclosure, and the scope of the present disclosure is defined by the claims and their equivalents.

Claims

1. A method of controlling the display of an electronic rearview mirror system, characterized in that, The camera of the electronic rearview mirror system comprises a plurality of image sensors of different types, the plurality of image sensors support different light wave bands for imaging, and the method comprises: determining at least one target image sensor of at least one target type matching the intensity of ambient light; and controlling the display screen of the electronic rearview mirror system to display according to image information obtained by the target image sensor.

2. The method of claim 1, wherein, The number of target image sensors is a plurality, and the image information is obtained by image fusion of image data collected by a plurality of target image sensors.

3. The method of claim 2, wherein, The plurality of target image sensors are image sensors of the same target type, or the plurality of target image sensors include at least two image sensors of different target types.

4. The method of any one of claims 1-3, wherein, if the intensity of ambient light is less than a first light intensity threshold, the target image sensor comprises at least one infrared image sensor, and the image information is image information collected by the at least one infrared image sensor.

5. The method of claim 4, wherein, if the intensity of ambient light is greater than a second light intensity threshold, the second light intensity threshold is greater than or equal to the first light intensity threshold, the target image sensor comprises at least one RGB image sensor, and the image information is image information collected by the at least one RGB image sensor.

6. The method of claim 5, wherein, the target image sensor is a plurality of infrared image sensors or a plurality of RGB image sensors; the image information is image information obtained by screening image information collected by a plurality of infrared image sensors or a plurality of RGB image sensors.

7. The method of claim 5 or 6, wherein, if the intensity of ambient light is greater than or equal to the first light intensity threshold and less than or equal to the second light intensity threshold, the image information is obtained by image fusion of image information collected by the infrared image sensor and image information collected by the RGB image sensor.

8. The method of any one of claims 1-3, wherein, in a first display control mode, when the intensity of ambient light is less than a first light intensity threshold, the target image sensor is at least one infrared image sensor; and when the intensity of ambient light is greater than a second light intensity threshold, the target image sensor is at least one RGB image sensor, and the second light intensity threshold is greater than the first light intensity threshold.

9. The method of claim 8, wherein, in a second display control mode, the target image sensor comprises at least one infrared image sensor and at least one RGB image sensor, and the image information is obtained by image fusion of image information collected by at least one infrared image sensor and image information collected by at least one RGB image sensor.

10. The method of claim 9, wherein, The first display control mode is a display control mode of the display mode selection unit in a first triggered state; and / or The second display control mode is a display control mode of the display mode selection unit in a second triggered state.

11. The method of any one of claims 4-7, wherein, The method further comprises: Controlling the working state of a heating module in the camera according to a current ambient temperature, the current ambient temperature being obtained according to image acquisition information of the infrared image sensor.

12. The method according to any one of claims 1-11, characterized in that, The method further comprises: prompting the working state of the multiple image sensors.

13. The method according to any one of claims 1-12, characterized in that, The method further comprises: Before controlling the display screen of the electronic rearview mirror system to display, performing noise reduction processing on the image information.

14. An electronic device (110), characterized by Comprise: At least one processor (111); And The memory (112) is in communication connection with the at least one processor (111); The memory (112) stores a computer program executable by the at least one processor (111), and the at least one processor (111) implements the method of controlling the display of the electronic rearview mirror system according to any one of claims 1-13 when executing the computer program.

15. A non-transitory readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed to implement the method of controlling the display of the electronic rearview mirror system according to any one of claims 1-13.

16. An electronic rearview mirror system (1), characterized in that Comprise: A display screen (10); A camera (20) comprising a plurality of image sensors (40) of different types, the plurality of image sensors (40) supporting different light wave bands for imaging; And A light intensity detection module (30) for detecting ambient light intensity; The display screen (10) is configured to display images captured by at least one target image sensor (40) of at least one target type matching the ambient light intensity.

17. The electronic rearview mirror system (1) according to claim 16, characterized in that The electronic rearview mirror system (1) further comprises an electronic device (110) according to claim 14.

18. The electronic rearview mirror system (1) according to claim 16 or 17, characterized in that The light intensity detection module (30) comprises an electrochromic lens arranged on the front side of the lens of the camera (20).

19. The electronic rearview mirror system (1) according to any of claims 16-18, characterized in that, The plurality of image sensors (40) comprises an infrared image sensor and an RGB image sensor.

20. The electronic rearview mirror system (1) according to any of claims 16-19, characterized in that The camera (20) further comprises: A heating module (50) for starting heating when it is determined according to image information captured by the infrared image sensor that the current ambient temperature is lower than a temperature threshold.

21. The electronic rearview mirror system (1) according to any of claims 16-20, characterized in that, The electronic rearview mirror system (1) further comprises: A prompt module (60) arranged on the display screen (10) for prompting the working state of the plurality of image sensors (40).

22. The electronic rearview mirror system (1) according to any of claims 16-21, characterized in that The camera (20) further comprises an image processing module (70) connected to each of the image sensors (40) for image processing.

23. The electronic rearview mirror system (1) according to any of claims 16-22, characterized in that, The camera (20) further comprises a display mode selection unit (80) for determining a target display control mode according to a user trigger instruction.

24. A vehicle (100), characterized in that Comprise: At least one electronic rearview mirror system (1) according to any one of claims 16-23; And / or The electronic device (110) according to claim 14.

25. The vehicle (100) according to claim 24, characterized by The vehicle (100) comprises three electronic rearview mirror systems (1), which correspond to the inside rearview mirror, the left outside rearview mirror and the right outside rearview mirror of the vehicle (100) respectively.

26. The vehicle (100) according to claim 25, characterized in that, the display screen of the electronic rearview mirror system (1) corresponding to the inside rearview mirror is located at the front windshield; and / or the display screen of the electronic rearview mirror system (1) corresponding to the left outside rearview mirror is located at the A-pillar or the door of the vehicle (100); and / or the display screen of the electronic rearview mirror system (1) corresponding to the right outside rearview mirror is located at the door or the A-pillar.

Images