Electronic rearview mirror system and control method, electronic device, storage medium and vehicle

Abstract

The present invention discloses a method for controlling the display of an electronic rearview mirror system, an electronic rearview mirror system, an electronic device, a storage medium and a vehicle, wherein the camera of the electronic rearview mirror system includes a plurality of image sensors of different types, and the plurality of image sensors support different optical bands for imaging, and the method for controlling the display of the electronic rearview mirror system includes: determining at least one target image sensor of at least one target type that matches the ambient light intensity; and controlling the display screen of the electronic rearview mirror system to display according to the image information obtained by the target image sensor. The method and system of the present invention can realize the adaptive selection of image sensors under different ambient light intensities, improve the image quality and clarity displayed by the electronic rearview mirror system under different ambient light intensities, enhance the driver's perception of the surrounding environment, and thus improve the safety of driving.

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a method for controlling the display of an electronic rearview mirror system, an electronic device, a non-volatile readable storage medium, an electronic rearview mirror system and a vehicle. Background Art

[0002] Among the related technologies, with the continuous advancement of science and technology, automotive electronic technology has also been widely used. Among them, electronic rearview mirrors (Camera Monitor System, CMS) have gradually become an emerging technology to replace traditional optical rearview mirrors. Compared with traditional optical rearview mirrors, electronic rearview mirrors have many advantages. For example, the CMS system can reduce the drag coefficient of the car by optimizing the fluid mechanics of the vehicle. At the same time, CMS can expand the driver's driving field of view and reduce blind spots. In addition, on rainy days, the display effect of electronic rearview mirrors is better than that of traditional optical rearview mirrors.

[0003] However, the existing in-vehicle CMS system has significant differences in performance under different light intensities, especially in low light intensity environments such as at night, where the image display effect is poor. This is mainly because the image processing algorithm in the CMS cannot be adaptively adjusted according to different light intensities, resulting in a decrease in image display quality under low illumination conditions, affecting the driver's accuracy in judging the vehicle's surroundings, reducing the auxiliary function of the electronic rearview mirror, and easily causing safety hazards. Summary of the invention

[0004] The present invention aims to solve at least one of the technical problems existing in the prior art.

[0005] To this end, an object of the present invention is to provide a method for controlling the display of an electronic rearview mirror system.

[0006] The second objective of the present invention is to provide an electronic device.

[0007] The third object of the present invention is to provide a non-volatile readable storage medium.

[0008] A fourth objective of the present invention is to provide an electronic rearview mirror system.

[0009] A fifth object of the present invention is to provide a vehicle.

[0010] In order to achieve the above-mentioned purpose, a method for controlling the display of an electronic rearview mirror system according to an embodiment of a first aspect of the present invention, wherein the camera of the electronic rearview mirror system includes a plurality of image sensors of different types, and the plurality of image sensors support different optical bands for imaging, and the method includes: determining at least one target image sensor of at least one target type that matches the ambient light intensity; and controlling the display screen of the electronic rearview mirror system to display according to image information obtained by the target image sensor.

[0011] According to the method for controlling the display of an electronic rearview mirror system of an embodiment of the present invention, the camera of the electronic rearview mirror system is configured with a plurality of image sensors of different types, and the light bands supported by these image sensors for imaging are different. Image sensors of different light bands have different photosensitivity characteristics, and thus can provide different imaging capabilities according to different ambient light intensities. By detecting the ambient light intensity, the system can determine at least one target image sensor of at least one target type that matches the ambient light intensity. This selection process is based on the real-time change of the ambient light intensity to ensure that the best image sensor is selected under different ambient light intensities. By selecting an image sensor suitable for the ambient light intensity, the system can adaptively process images under different ambient light intensities. Then, the system dynamically adjusts the display content of the display screen of the electronic rearview mirror system according to the image information obtained by the target image sensor to ensure that the best quality and clear images are displayed under different ambient light intensities. This adaptive selection and adjustment process significantly improves the image display effect of the electronic rearview mirror system under different ambient light intensities, enhances the driver's perception of the surrounding environment, and thus improves driving safety.

[0012] In some embodiments, there are multiple target image sensors, and the image information is obtained by performing image fusion on image data collected by the multiple target image sensors.

[0013] In some embodiments, the plurality of target image sensors are image sensors of the same target type, or the plurality of target image sensors include image sensors of at least two target types.

[0014] In some embodiments, if the ambient light intensity is less than a first light intensity threshold, the target image sensor includes at least one infrared image sensor, and the image information is image information collected by the at least one infrared image sensor.

[0015] In some embodiments, if the ambient light intensity is greater than a second light intensity threshold, the second light intensity threshold is greater than or equal to the first light intensity threshold, the target image sensor includes at least one RGB image sensor, and the image information is image information captured by the at least one RGB image sensor.

[0016] In some embodiments, the target image sensor is a plurality of the infrared image sensors or a plurality of the RGB image sensors; the image information is image information obtained after screening image information collected by the plurality of the infrared image sensors or the plurality of the RGB image sensors.

[0017] In some embodiments, if the current ambient light intensity is greater than or equal to the first light intensity threshold and less than or equal to the second light intensity threshold; the image information is obtained by performing image fusion of the image information collected by the infrared image sensor and the image information collected by the RGB image sensor.

[0018] In some embodiments, in the first display control mode, when the ambient light intensity is less than the first light intensity threshold, the target image sensor is at least one infrared image sensor, and when the ambient light intensity is greater than the second light intensity threshold, the target image sensor is at least one RGB image sensor, and the second light intensity threshold is greater than the first light intensity threshold.

[0019] In some embodiments, in the second display control mode, the target image sensor includes at least one infrared image sensor and at least one RGB image sensor. The image information is obtained by fusing image information collected by at least one infrared image sensor and image information collected by at least one RGB image sensor.

[0020] In some embodiments, the first display control mode is a display control mode in which the display mode selection unit of the camera is in a first trigger state; and / or, the second display control mode is a display control mode in which the display mode selection unit is in a second trigger state.

[0021] In some embodiments, the method further includes: controlling a working state of a heating module in the camera according to a current ambient temperature, wherein the current ambient temperature is obtained according to image acquisition information of the infrared image sensor.

[0022] In some embodiments, the method further includes: prompting the working status of the multiple image sensors.

[0023] In some embodiments, the method further includes: performing noise reduction processing on the image information before controlling the display screen of the electronic rearview mirror system to display.

[0024] In order to achieve the above-mentioned purpose, the electronic device of the second aspect embodiment of the present invention includes: at least one processor; a memory communicatively connected to the at least one processor; the memory stores a computer program executable by the at least one processor, and when the at least one processor executes the computer program, it implements the method of controlling the display of the electronic rearview mirror system described in the above embodiment.

[0025] According to the electronic device of the embodiment of the present invention, by executing the method of controlling the display of the electronic rearview mirror system of the above embodiment through at least one processor, adaptive selection of the image sensor under different ambient light intensities can be achieved, the image quality and clarity displayed by the electronic rearview mirror system under different ambient light intensities is improved, the driver's perception of the surrounding environment is enhanced, and thus driving safety is improved.

[0026] In order to achieve the above-mentioned purpose, the non-volatile readable storage medium of the third aspect of the present invention has a computer program stored thereon, and when the computer program is executed, the method for controlling the display of the electronic rearview mirror system described in the above embodiment is implemented.

[0027] According to the non-volatile readable storage medium of the embodiment of the present invention, by adopting the non-volatile readable storage medium described in the above embodiment, adaptive selection of image sensors under different ambient light intensities can be achieved, thereby improving the image quality and clarity displayed by the electronic rearview mirror system under different ambient light intensities, enhancing the driver's perception of the surrounding environment, and thus improving driving safety.

[0028] In order to achieve the above-mentioned objectives, the electronic rearview mirror system of the fourth aspect of the present invention comprises: a display screen; a camera, comprising a plurality of image sensors of different types, wherein the plurality of image sensors support different optical bands for imaging; a light intensity detection module for detecting the intensity of ambient light; and the display screen is configured to display an image captured by at least one target image sensor of at least one target type matching the ambient light intensity.

[0029] According to the electronic rearview mirror system of the embodiment of the present invention, the camera of the electronic rearview mirror system 1 is configured with a plurality of image sensors of different types, and the light bands supported by these image sensors for imaging are different. Image sensors of different light bands have different photosensitivity characteristics, and thus can provide different imaging capabilities according to different light intensities. The light intensity detection module detects the ambient light intensity in real time, and the system can determine at least one target image sensor of at least one target type that matches the ambient light intensity. This selection process is based on the real-time change of the ambient light intensity to ensure that the best image sensor is selected under different light intensities. By selecting an image sensor suitable for the ambient light intensity, the system can adaptively process images under different ambient light intensities. Then, according to the image information obtained by the target image sensor, the system configures the display screen to display the image collected by at least one target image sensor of at least one target type that matches the ambient light intensity, so as to ensure that the best quality and clear image is displayed under the ambient light intensity. This adaptive selection and adjustment process significantly improves the image display effect of the electronic rearview mirror system under different ambient light intensities, enhances the driver's perception of the surrounding environment, and thus improves driving safety.

[0030] In some embodiments, the electronic rearview mirror system further includes the electronic device described in the above embodiments.

[0031] In some embodiments, the light intensity detection module includes an electrochromic lens disposed in front of a lens of the camera.

[0032] In some embodiments, the plurality of image sensors include infrared image sensors and RGB image sensors.

[0033] In some embodiments, the camera further includes: a heating module, configured to start heating when it is determined that the current ambient temperature is lower than a temperature threshold based on the image acquisition information of the infrared image sensor.

[0034] In some embodiments, the electronic rearview mirror system further includes: a prompt module, which is arranged on the display screen and is used to prompt the working status of the multiple image sensors.

[0035] In some embodiments, the camera further includes an image processing module, which is connected to each of the image sensors for performing image processing.

[0036] In some embodiments, the camera further includes a display mode selection unit, and the display mode selection unit is used to determine a target display control mode according to a user trigger instruction.

[0037] In order to achieve the above-mentioned object, the vehicle of the fifth embodiment of the present invention includes at least one electronic rearview mirror system as described in the above embodiments, and / or includes the electronic device as described in the above embodiments.

[0038] The vehicle according to the embodiment of the present invention, by adopting at least one electronic rearview mirror system as described in the above embodiment, and / or the electronic device as described in the above embodiment, can realize adaptive selection of image sensors under different ambient light intensities, thereby improving the image quality and clarity displayed by the electronic rearview mirror system under different light intensities, enhancing the driver's perception of the surrounding environment, and thus improving driving safety.

[0039] In some embodiments, the vehicle includes three electronic rearview mirror systems, and the three electronic rearview mirror systems correspond to the interior rearview mirror, left exterior rearview mirror, and right exterior rearview mirror of the vehicle, respectively.

[0040] In some embodiments, the display screen of the electronic rearview mirror system corresponding to the interior rearview mirror is located on the front windshield; and / or the display screen of the electronic rearview mirror system corresponding to the left exterior rearview mirror is located at the A-pillar or the door of the vehicle; and / or the display screen of the electronic rearview mirror system corresponding to the right exterior rearview mirror is located at the door or the A-pillar.

[0041] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0043] Figure 1 is a block diagram of an electronic rearview mirror system according to an embodiment of the present invention;

[0044] Figure 2 is a block diagram of a vehicle according to one embodiment of the present invention;

[0045] Figure 3 is a block diagram of a vehicle according to another embodiment of the present invention;

[0046] Figure 4 is a block diagram of a vehicle according to another embodiment of the present invention;

[0047] Figure 5 is a flow chart of a method for controlling the display of an electronic rearview mirror system according to one embodiment of the present invention;

[0048] Figure 6is an overall flow chart of a method for controlling the display of an electronic rearview mirror system according to an embodiment of the present invention;

[0049] Figure 7 is a block diagram of an electronic device according to an embodiment of the present invention.

[0050] Reference numerals:

[0051] Vehicle 100;

[0052] Electronic rearview mirror system1;

[0053] Display screen 10; camera 20; light intensity detection module 30;

[0054] Electronic device 110;

[0055] Processor 111; memory 112. DETAILED DESCRIPTION

[0056] Embodiments of the present invention are described in detail below. The embodiments described with reference to the accompanying drawings are exemplary. Embodiments of the present invention are described in detail below.

[0057] In the related art, the performance of existing electronic rearview mirror systems under different light intensities varies significantly, especially in low light intensity environments such as at night, where the image display effect is poor. This is mainly because the image processing algorithm in the electronic rearview mirror system cannot be adaptively adjusted according to different light intensities, resulting in a decrease in image display quality under low illumination conditions, affecting the accuracy of the driver's judgment of the vehicle's surroundings, reducing the auxiliary function of the electronic rearview mirror, and easily causing safety hazards.

[0058] In response to the above problems, an embodiment of the present invention proposes a method for controlling the display of an electronic rearview mirror system. The method can achieve adaptive selection of image sensors under different light intensities, improve the image quality and clarity displayed by the electronic rearview mirror system under different light intensities, enhance the driver's perception of the surrounding environment, and thus improve driving safety.

[0059] In order to facilitate the description of the technical solution, the following reference Figure 1 First, the electronic rearview mirror system according to the embodiment of the present invention is described.

[0060] Figure 1 is a block diagram of an electronic rearview mirror system according to an embodiment of the present invention. Figure 1 As shown, the electronic rearview mirror system 1 includes: a display screen 10 , a camera 20 , and a light intensity detection module 30 .

[0061] In some embodiments, the display screen 10 may be a liquid crystal display (LCD), an organic light emitting display (OLED), an electronic ink screen (E-ink) or other types of display screens 10. The main function of the display screen 10 is to display the image information captured by the camera 20 in real time to provide the driver with a clear rear view image, ensure that the driver can view the environment around the vehicle in real time, and help the driver better observe the blind spot to avoid accidents. In addition, the display screen 10 can not only display the image captured by the camera 20, but also integrate driving-related information such as the navigation system, reversing radar information, and vehicle speed, thereby enhancing the driver's driving experience.

[0062] In some embodiments, the display screen 10 can be installed at multiple locations inside the vehicle, for example, near the A-pillar, inside the door, below the front windshield, above the center console, or other suitable locations. The location of the display screen 10 should be consistent with the driver's sight habits, ensuring that the driver can view the rear-view information without having to move his sight significantly, reducing fatigue and distraction. In addition, the installation location of the display screen 10 needs to take into account the internal structural design of the vehicle to ensure that the installation of the display screen 10 does not affect the normal use of other functional components, and at the same time it must be beautiful. In addition, the location of the display screen 10 should avoid blocking the driver's sight or causing a blind spot, ensuring that the driver can quickly view the displayed information and make correct judgments in an emergency.

[0063] In some embodiments, the camera 20 may be a device for capturing images of the vehicle's surroundings, and the camera 20 includes a plurality of image sensors of different types, and the plurality of image sensors support different light bands for imaging. That is, the camera 20 of the present invention may be a multi-spectral camera, which is a camera capable of imaging in multiple spectral bands (e.g., visible light and near-infrared light). A multi-spectral camera may have 2 to 100 bands, and such a camera is configured with a plurality of image sensors, each of which is optimized for a specific spectral band, so that the camera can provide high-quality images under different light intensities (e.g., day and night).

[0064] In some embodiments, the multiple image sensors may include an infrared image sensor and an RGB image sensor. Among them, the infrared image sensor can form an image by detecting infrared radiation emitted by objects in the environment without relying on external light sources. Infrared radiation can be converted into electrical signals to generate thermal images. The RGB image sensor can be a CMOS (Complementary Metal-Oxide-Semiconductor) sensor based on the three primary colors of RGB, and its surface is covered with red, green and blue filters. Each pixel captures light of a specific color through a filter, and then converts it into an electrical signal through a photodiode. Therefore, the information of the three colors of red, green and blue captured by the RGB image sensor can be combined through a processing circuit to generate a color image.

[0065] In some embodiments, during the day or in bright light conditions, the RGB image sensor can capture richer color information and higher resolution. At night or in low light intensity, the infrared image sensor can use infrared light in the environment to provide a clearer image.

[0066] In some embodiments, the display screen is configured to display an image captured by at least one target image sensor of at least one target type that matches the ambient light intensity. The at least one target type may include one target type, two target types, or more target types, and the at least one target image sensor may include one target image sensor, two target image sensors, or more target image sensors. Therefore, by configuring the display screen accordingly, the system can provide the best image display effect under various light intensities.

[0067] In some embodiments, the light intensity detection module 30 can be used to detect the ambient light intensity. Specifically, the light intensity detection module 30 can detect the light intensity of the vehicle's surrounding environment in real time. This detection can be achieved through devices such as photosensitive resistors to ensure that the system can select the most suitable image sensor for image capture according to the current light intensity.

[0068] In some embodiments, the electronic rearview mirror system further includes the electronic device described in the following embodiments. The electronic device may be a comprehensive device including a control unit, a storage unit, a communication unit, etc., capable of performing high-level control and data processing tasks. In an embodiment, the electronic device may be a controller of a vehicle or an on-board terminal or other applicable electronic device. In an embodiment, the electronic device may be used to execute the method for controlling the display of the electronic rearview mirror system in an embodiment of the present invention, which method may refer to the description of the following embodiments. The electronic device may work in conjunction with a display screen, a camera, and a light intensity detection module to provide more intelligent and efficient image processing and display functions.

[0069] In some embodiments, the light intensity detection module 30 includes an electrochromic lens disposed in front of the lens of the camera 20. Among them, the electrochromic (EC) lens is a special lens whose transparency or transmittance can be adjusted by an electrical signal. In the electronic rearview mirror system 1, the electrochromic lens is used to adjust its transparency to adapt to different light intensities. By changing the transparency of the lens, the light intensity received by the camera 20 can be effectively adjusted, thereby affecting the clarity and quality of the image.

[0070] In some embodiments, the electrochromic lens may adopt a convex design, which helps to increase the optical reflection effect and improve the adjustment performance of light transmittance. This design can optimize the optical properties of the lens and make it more effectively adapt to the needs under different light intensities.

[0071] In some embodiments, the surface of the electrochromic lens is coated with a hydrophobic film and an anti-glare film. The hydrophobic film is coated to effectively resist the adhesion of rain or other liquids, keep the lens surface clean, and avoid the impact of water droplets on the field of vision. The application of the anti-glare film can reduce reflection and interference from the light source to prevent glare problems under strong light intensity, thereby improving the visibility of the image.

[0072] In some embodiments, when encountering light, the changes in the light intensity of the surrounding environment can be detected in real time through sensors such as photoresistors. Based on the detected light intensity, the control system can adjust the transparency or transmittance of the electrochromic lens, thereby optimizing the image display effect of the electronic rearview mirror system 1.

[0073] According to the electronic rearview mirror system 1 of the embodiment of the present invention, the camera 20 of the electronic rearview mirror system 1 is configured with a plurality of image sensors of different types, and the light bands supported by these image sensors for imaging are different. Image sensors of different light bands have different photosensitivity characteristics, and thus can provide different imaging capabilities according to different light intensities. The light intensity detection module 30 detects the ambient light intensity in real time, and the system can determine at least one target image sensor of at least one target type that matches the ambient light intensity. This selection process is based on the real-time change of the ambient light intensity, ensuring that the best image sensor is selected under different light intensities. By selecting an image sensor suitable for the ambient light intensity, the system can adaptively process images under different ambient light intensities. Then, according to the image information obtained by the target image sensor, the system configures the display screen 10 to display the image collected by at least one target image sensor of at least one target type that matches the ambient light intensity, so as to ensure that the best quality and clear image is displayed under the ambient light intensity. This adaptive selection and adjustment process significantly improves the image display effect of the electronic rearview mirror system 1 under different ambient light intensities, enhances the driver's perception of the surrounding environment, and thus improves driving safety.

[0074] In some embodiments, the camera 20 also includes a heating module. The heating module is a device specifically used to heat the camera lens in a low temperature environment to prevent frost or fogging on the lens surface. The heating module may include a heating wire, a temperature control device and a power control unit. Among them, the heating wire can be made of a resistive material, which will generate heat when powered on to heat the lens surface. The temperature control device is used to monitor and adjust the temperature of the heating wire to ensure that the heating effect is within a safe and effective range. The power control unit is used to manage the power supply of the heating module and control the power on and off of the heating wire.

[0075] In some embodiments, the heating module is used to start heating when it is determined that the current ambient temperature is lower than a temperature threshold based on the image information collected by the infrared image sensor. Specifically, the infrared image sensor can detect the ambient temperature and transmit the temperature information to the control unit of the system. The control unit can determine whether the current ambient temperature is lower than the threshold based on a preset temperature threshold. When the detected temperature is lower than the preset threshold, the control unit can start the heating module to energize the heating wire to generate heat, increase the temperature around the lens, and prevent frost or fogging.

[0076] Therefore, by heating the camera 20 through the heating module, it is possible to effectively prevent the temperature difference between the inside and outside of the camera from being too large, eliminate the phenomenon of external water mist condensing on the wall, make the water film on the glass surface fade and evaporate, and prevent image deformation and blurring caused by the water film, thereby ensuring that the camera 20 can capture images clearly and improve image quality.

[0077] In some embodiments, the temperature threshold can be pre-set based on factors such as ambient temperature, equipment material, user needs, etc., and is not specifically limited here.

[0078] In some embodiments, the electronic rearview mirror system 1 further includes a prompt module. The prompt module is disposed on the display screen 10 and is used to prompt the working status of various image sensors.

[0079] The prompt module can indicate the working state of the image sensor by using an LED indicator light. For example, when the infrared image sensor is selected to detect the surrounding environment and generate an infrared image, the color of the LED indicator light is yellow. When the RGB image sensor is selected to detect the surrounding environment and generate an RGB image, the color of the LED indicator light is green.

[0080] In addition, the prompt module can also prompt the working status of the image sensor through icons or text. It should be noted that the prompt module can be integrated in a corner or edge of the display screen 10 without affecting the display of the main image. For example, the upper right corner or bottom of the display screen 10.

[0081] Therefore, by integrating the prompt module, the electronic rearview mirror system 1 can provide the driver with the working status information of multiple image sensors in real time. This design not only improves the operability and intelligence of the system, but also enhances the driver's perception of the vehicle's surrounding environment, further improving the safety and convenience of driving.

[0082] In some embodiments, the camera 20 further includes an image processing module, which is connected to each image sensor for performing image processing.

[0083] Specifically, the control unit of the system receives the current ambient light intensity signal detected by the light intensity detection module 30, and based on the light intensity signal, can select a specific image sensor in the camera 20 that meets the conditions as the target image sensor, for example, selecting an RGB image sensor under strong light intensity and selecting an infrared image sensor under low light intensity.

[0084] Further, the target image sensor starts working to collect image information, and the collected image information is transmitted to the control unit through the Gigabit Multimedia Serial Link (GMSL) to ensure high-speed and high-bandwidth data transmission. Depending on the type of image sensor, the control unit can select different noise reduction modules. Different types of image sensors may produce different types of noise, so targeted noise reduction processing is required. For example, one noise reduction algorithm is used for RGB image sensors and another noise reduction algorithm is used for infrared image sensors to ensure that noise can be effectively eliminated under different light intensities and improve image quality.

[0085] Furthermore, the transmitted image information is subjected to bilateral two-dimensional spatial noise reduction processing by the noise reduction module to eliminate interference signals such as salt and pepper noise in the image, thereby improving the image quality. The image information after the noise reduction processing is transmitted through the serial deserializer and finally displayed on the display screen 10 of the electronic rearview mirror.

[0086] In addition to image noise reduction, the image processing module can also perform preprocessing, enhancement, compression, fusion and other operations on the image. Specifically, image preprocessing can be a preliminary processing of the image, such as white balance adjustment, color correction, etc. Image enhancement can improve the brightness, contrast and color of the image, making the image clearer and more vivid. Image compression can be a compression process on the image, reducing the amount of image data and improving transmission and storage efficiency. Image fusion can be a fusion of data from image sensors of different bands to generate a comprehensive high-quality image.

[0087] In some embodiments, the image processing module may include multiple dedicated image processing units, such as a DSP (Digital Signal Processor), an FPGA (Field-Programmable Gate Array), a GPU (Graphics Processing Unit), etc., for executing complex image processing algorithms.

[0088] In some embodiments, the camera 20 further includes a display mode selection unit, and the display mode selection unit is used to determine a target display control mode according to a user trigger instruction.

[0089] Specifically, the display mode selection unit receives a trigger instruction from the user and transmits the instruction to the control unit of the system. The control unit parses the instruction and determines the target display control mode. According to the target display control mode, the control unit selects a suitable image sensor (such as an RGB image sensor or an infrared image sensor). The control unit adjusts the display content of the display screen 10 according to the image acquisition information of the selected image sensor to ensure the best image quality.

[0090] In some embodiments, the display mode selection unit is a user interface device, which may be a button, a touch screen, a knob, a voice recognition system or other input device. Its main function is to receive user input instructions so that the user can select different display control modes.

[0091] Reference below Figure 2-Figure 4 A vehicle according to an embodiment of the present invention is described.

[0092] Figure 2 is a block diagram of a vehicle according to an embodiment of the present invention, Figure 3is a block diagram of a vehicle according to yet another embodiment of the present invention, Figure 4 is a block diagram of a vehicle according to another embodiment of the present invention, Figure 2-Figure 4 As shown, the vehicle 100 includes at least one electronic rearview mirror system 1 as described in the above embodiments, and / or includes the electronic device 110 as described in the following embodiments.

[0093] Among them, at least one electronic rearview mirror system 1 can be one electronic rearview mirror system 1, two electronic rearview mirror systems 1, three electronic rearview mirror systems 1, five electronic rearview mirror systems 1 or more electronic rearview mirror systems 1. The specific number of electronic rearview mirror systems 1 can be set according to the type and purpose of the vehicle, the driving environment, safety requirements, legal and regulatory requirements, technology and cost factors. By reasonably configuring the electronic rearview mirror system 1, the vehicle 100 can maintain the best field of view in various complex driving environments, improving driving safety and operating convenience.

[0094] In some embodiments, the electronic rearview mirror system 1 can be applicable to various types of vehicles 100, including but not limited to: passenger cars (such as sedans, SUVs, MPVs), commercial vehicles (such as vans, trucks, buses) or special purpose vehicles (such as ambulances, fire trucks, engineering vehicles), etc.

[0095] According to the vehicle of the embodiment of the present invention, by adopting at least one electronic rearview mirror system 1 as described in the above embodiment, and / or the electronic device 110 as described in the above embodiment, it is possible to achieve adaptive selection of image sensors under different ambient light intensities, thereby improving the image quality and clarity displayed by the electronic rearview mirror system 1 under different light intensities, enhancing the driver's perception of the surrounding environment, and thus improving driving safety.

[0096] In some embodiments, the vehicle 100 may include three electronic rearview mirror systems 1, which correspond to the interior rearview mirror, left exterior rearview mirror, and right exterior rearview mirror of the vehicle 100, respectively. Among them, the electronic rearview mirror system 1 corresponding to the interior rearview mirror of the vehicle 100 can be used to provide a central field of view behind the vehicle, assisting the driver in reversing, changing lanes, and observing the rear traffic situation. The electronic rearview mirror system 1 corresponding to the left exterior rearview mirror of the vehicle 100 can be used to provide a field of view on the left and rear of the vehicle 100, assisting the driver in observing the left blind spot when changing lanes, turning left, and parking on the left, and ensuring driving safety. The electronic rearview mirror system 1 corresponding to the right exterior rearview mirror of the vehicle 100 can provide a field of view on the right and rear of the vehicle 100, assisting the driver in observing the right blind spot when changing lanes, turning right, and parking on the right, and ensuring driving safety.

[0097] In some embodiments, the display screen 10 of the electronic rearview mirror system 1 corresponding to the interior rearview mirror is located on the front windshield. This arrangement allows the display screen 10 to be located at a natural extension of the driver's line of sight, and the driver can easily switch from the front view to the rear view to ensure driving safety. And / or, the display screen 10 of the electronic rearview mirror system 1 corresponding to the left exterior rearview mirror is located at the A-pillar or the door of the vehicle 100; and / or, the display screen of the electronic rearview mirror system corresponding to the right exterior rearview mirror is located at the door or the A-pillar. This arrangement allows the display screen 10 to be located within the field of vision of the left and right sides of the driver, and the driver can easily view the images of the left and right exterior rearview mirrors, improving driving safety and operating convenience.

[0098] Based on the electronic rearview mirror system and vehicle described in the above embodiments, Figure 3 A method for controlling the display of an electronic rearview mirror system according to an embodiment of the present invention is described.

[0099] The camera of the electronic rearview mirror system includes a variety of image sensors of different types, and the image sensors support different light bands for imaging. For example, the image sensors include infrared image sensors and RGB image sensors. The infrared image sensor is suitable for night or low light intensity environments. It can use infrared light to provide clear images in low light conditions. The RGB image sensor is suitable for daytime or well-lit environments. It can capture rich color information and high-resolution images and provide clear visible light images.

[0100] Figure 5 is a flow chart of a method for controlling the display of an electronic rearview mirror system according to an embodiment of the present invention. Figure 5 As shown, the method for controlling the display of the electronic rearview mirror system includes at least steps S1-S2, which are as follows:

[0101] S1, determining at least one target image sensor of at least one target category matching the ambient light intensity.

[0102] In some embodiments, the ambient light intensity can be detected in real time by a light intensity detection module, which can use a photoresistor, a photodiode or an electrochromic lens to detect the ambient light intensity. The electrochromic lens can be set in front of the camera lens, and can adjust the light transmittance according to the ambient light intensity, providing more stable and accurate data for subsequent light intensity detection.

[0103] In some embodiments, the at least one target type may include one target type, two target types, or more target types, and the at least one target image sensor may include one target image sensor, two target image sensors, or more target image sensors. Therefore, the system detects the ambient light intensity through the light intensity detection module. Based on the ambient light intensity, the system can select the type and number of target image sensors that best suit the current environment to ensure that the best imaging effect can be obtained under various ambient light intensities.

[0104] S2, controlling the display screen of the electronic rearview mirror system to display according to the image information obtained by the target image sensor.

[0105] Specifically, the target image sensor captures the image in the current environment and generates image information. The image information is then transmitted to the image processing module for processing, and the processed image data is transmitted to the control unit of the electronic rearview mirror system through the Gigabit Multimedia Serial Link (GMSL). GMSL ensures that the image information is transmitted at high speed and low latency to ensure real-time display. During the transmission process, the image information can be decoded by the serial deserializer to ensure the integrity and accuracy of data transmission. After receiving the image information, the control unit can further optimize it according to the image sensor type and environmental conditions. For example, for the image of the RGB image sensor, color enhancement and sharpening are performed. For the image of the infrared image sensor, thermal image enhancement and contrast adjustment are performed. The processed image information is transmitted to the display screen through IIC (Integrated Circuit Bus) or SPI (Serial Peripheral Interface). The control unit can dynamically adjust the brightness, contrast and color settings of the display screen according to the ambient light conditions and driver needs to ensure the best display effect. The driver can clearly observe the surrounding environment of the vehicle through the display screen, which helps to improve driving safety.

[0106] According to the method for controlling the display of an electronic rearview mirror system of an embodiment of the present invention, the camera of the electronic rearview mirror system is configured with a plurality of image sensors of different types, and the light bands supported by these image sensors for imaging are different. Image sensors of different light bands have different photosensitivity characteristics, and thus can provide different imaging capabilities according to different ambient light intensities. By detecting the ambient light intensity, the system can determine at least one target image sensor of at least one target type that matches the ambient light intensity. This selection process is based on the real-time change of the ambient light intensity to ensure that the best image sensor is selected under different ambient light intensities. By selecting an image sensor suitable for the ambient light intensity, the system can adaptively process images under different ambient light intensities. Then, the system dynamically adjusts the display content of the display screen of the electronic rearview mirror system according to the image information obtained by the target image sensor to ensure that the best quality and clear image is displayed under the ambient light intensity. This adaptive selection and adjustment process significantly improves the image display effect of the electronic rearview mirror system under different ambient light intensities, enhances the driver's perception of the surrounding environment, and thus improves driving safety.

[0107] In some embodiments, there are multiple target image sensors, and the image information is obtained by performing image fusion on the image data collected by the multiple target image sensors. Image fusion may refer to comprehensive processing of image data collected from multiple target image sensors to generate higher quality images. Specifically, image fusion may generate images with higher resolution, better contrast, and more details by performing feature extraction, alignment, and synthesis on the data of multiple target image sensors.

[0108] In some embodiments, the multiple target image sensors are image sensors of the same target type, or the multiple target image sensors include image sensors of at least two target types.

[0109] Therefore, by fusing the image data collected by multiple target image sensors, the system can fully utilize the advantages of multiple image sensors of the same target type or multiple image sensors of different types to generate more comprehensive and clear image information. Finally, the system controls the display screen of the electronic rearview mirror system to display according to the fused image information, which significantly improves the driver's field of vision clarity under different ambient light intensities, thereby enhancing driving safety.

[0110] In some embodiments, if the ambient light intensity is less than the first light intensity threshold, the target image sensor includes at least one infrared image sensor. The image information is image information collected by the at least one infrared image sensor.

[0111] The first light intensity threshold is a preset ambient light intensity reference value used to judge the situation where the ambient light intensity is weak. The threshold can be determined by experimental data and the actual use environment. When the ambient light intensity is weak, the infrared image sensor can better capture the thermal radiation. Therefore, at night or in low light intensity, choosing an infrared image sensor helps to improve the clarity and contrast of the image.

[0112] In some embodiments, the at least one infrared image sensor may include one infrared image sensor, two infrared image sensors, five infrared image sensors, or more infrared image sensors. Different numbers of infrared image sensors may provide optimal coverage and performance for different vehicle types and application scenarios. Therefore, when designing a system, the type of vehicle, application scenario, safety requirements, and cost and complexity of technical implementation may be comprehensively considered to determine the appropriate number of infrared image sensor configurations.

[0113] In some embodiments, if the ambient light intensity is greater than the second light intensity threshold, and the second light intensity threshold is greater than or equal to the first light intensity threshold, the target image sensor includes at least one RGB image sensor, and the image information is image information collected by the at least one RGB image sensor.

[0114] The second light intensity threshold is also a preset ambient light intensity reference value, which is used to judge the situation where the ambient light intensity is strong. The threshold can be determined by experimental data and the actual use environment. When the ambient light intensity is strong, the RGB image sensor can capture rich color information and details, which is suitable for use during the day or under strong light intensity. Selecting an RGB image sensor can provide more realistic and clear color images.

[0115] In some embodiments, the at least one RGB image sensor may include one RGB image sensor, two RGB image sensors, five RGB image sensors, or more. Different numbers of RGB image sensors may provide optimal coverage and performance for different vehicle types and application scenarios. Therefore, when designing a system, the type of vehicle, application scenario, safety requirements, and cost and complexity of technical implementation may be comprehensively considered to determine the appropriate number of RGB image sensor configurations.

[0116] In some embodiments, the target image sensor is a plurality of infrared image sensors or a plurality of RGB image sensors, and the image information is image information obtained after screening image information collected by the plurality of infrared image sensors or the plurality of RGB image sensors.

[0117] Specifically, the system can filter out the best quality image information based on preset algorithms and conditions. This can involve evaluation and comparison of contrast, color saturation, noise level, etc. to select the image data that best suits the current environment and application requirements. Depending on the current ambient light intensity and conditions, the system can adjust the screening criteria. For example, in low light intensity conditions, image data that captures more details and low noise may be prioritized, while in strong light intensity conditions, color accuracy and dynamic range may be emphasized.

[0118] Therefore, the screening of image information can be dynamic and can adjust as environmental conditions change. The system can periodically re-evaluate and adjust image processing parameters to ensure continuous optimization of display effects and performance.

[0119] In some embodiments, if the ambient light intensity is greater than or equal to the first light intensity threshold and less than or equal to the second light intensity threshold, the image information is obtained by fusing the image information collected by the infrared image sensor and the image information collected by the RGB image sensor.

[0120] Specifically, the RGB image sensor and the infrared image sensor can simultaneously collect image information of the current environment, and then perform feature extraction on the image information collected by the RGB image sensor and the infrared image sensor. For example, for the image information collected by the RGB image sensor, color information, texture features, edge information, etc. can be extracted. For the image information collected by the infrared image sensor, thermal radiation intensity, shape features, contrast information, etc. can be extracted.

[0121] Furthermore, the extracted features are superimposed and supplemented to form a comprehensive feature map. For example, by superimposing the color information of the RGB image with the thermal radiation intensity of the infrared image, an image containing both color information and clear contours at night or under low light intensity conditions can be generated. Feature superposition can be performed in a variety of ways, such as weighted averaging, feature selection, feature splicing, etc. A new environmental image is reconstructed through the comprehensive feature map after feature superposition. The reconstruction process uses image processing algorithms, such as interpolation algorithms, deconvolution, etc., so that the fused image information retains the advantageous features of each sensor as much as possible.

[0122] Therefore, the image information collected by the infrared image sensor and the RGB image sensor is extracted for features, and then the features of the two images are fused together using appropriate algorithms (such as weighted averaging, feature cascading, etc.) to enhance the details and contrast of the image. This method can retain the unique thermal imaging information of the infrared image sensor while using the color information of the RGB image sensor to enhance the realism and visual comfort of the image.

[0123] In some embodiments, in the first display control mode, if the ambient light intensity is less than the first light intensity threshold, the target image sensor is at least one infrared image sensor. If the ambient light intensity is greater than the second light intensity threshold, the target image sensor is at least one RGB image sensor, and the second light intensity threshold is greater than the first light intensity threshold.

[0124] Among them, the first display control mode may refer to a mode in which image information is obtained by using image sensors of the same target type, and the display screen is controlled to display according to the image information, that is, through the internal logic processing method, at least one infrared image sensor or at least one RGB image sensor is selected to collect image information according to the ambient light intensity, rather than selecting both the infrared image sensor and the RGB image sensor for image acquisition and fusion processing. Therefore, according to the real-time ambient light intensity, the target image sensor matching the ambient light intensity is dynamically selected to ensure that the best image can be captured under different ambient light intensities, thereby enhancing the driver's perception of the surrounding environment.

[0125] In some embodiments, in the second display control mode, the target image sensor includes at least one infrared image sensor and at least one RGB image sensor. The second display control mode is a display control mode when the current ambient light intensity is between the first light intensity threshold and the second light intensity threshold. In this mode, the image information is obtained by image fusion of the image information collected by at least one infrared image sensor and the image information collected by at least one RGB image sensor. For example, at dawn or sunset, when the ambient light intensity is moderate, the system can combine the advantages of the infrared image sensor and the RGB image sensor to provide richer and more detailed image information.

[0126] In some embodiments, the first display control mode is a display control mode in which the display mode selection unit of the camera is in a first trigger state, and / or the second display control mode is a display control mode in which the display mode selection unit is in a second trigger state.

[0127] In some embodiments, the display mode selection unit may refer to a device or interface that controls the user to select the display control mode. It may be in various forms, such as a switch button, a knob, a touch screen interface, a voice control system, etc. The first trigger state and the second trigger state are specific settings or operation states of the display mode selection unit. By operating the display mode selection unit to put it in different trigger states, the system can switch between different display control modes to meet the user's needs for display effects in different driving environments, thereby improving driving experience and safety.

[0128] In some embodiments, the method for controlling the display of the electronic rearview mirror system further includes controlling the working state of a heating module in the camera according to the current ambient temperature, where the current ambient temperature is obtained based on image acquisition information of the infrared image sensor.

[0129] Specifically, the system uses the infrared image sensor to collect infrared image information in real time to identify the current ambient temperature, and controls the working state of the heating module in the camera according to the acquired ambient temperature information. When the ambient temperature is lower than the preset temperature threshold, the heating module starts to energize the heating wire to generate heat, and heats the surface of the camera lens to prevent frost or water mist on the lens surface, maintain a clear field of view, and ensure that the image quality is not affected by environmental conditions.

[0130] Therefore, by controlling the working state of the heating module in the camera, it is possible to effectively prevent the temperature difference between the inside and outside of the camera from being too large, eliminate the phenomenon of external water mist condensing on the wall, make the water film on the glass surface fade and evaporate, and prevent image deformation and blurring caused by the water film, thereby ensuring that the camera can capture images clearly and improve image quality.

[0131] In some embodiments, the method for controlling the display of the electronic rearview mirror system further includes: prompting the working status of multiple image sensors. For example, the working status of the image sensor can be indicated by using an LED indicator light. When the infrared image sensor is selected to detect the surrounding environment and generate an infrared image, the color of the LED indicator light is yellow. When the RGB image sensor is selected to detect the surrounding environment and generate an RGB image, the color of the LED indicator light is green. This prompt ensures that the driver can understand the operating status of each image sensor in a timely manner, thereby improving the reliability and safety of the electronic rearview mirror system.

[0132] In some embodiments, the method for controlling the display of the electronic rearview mirror system further includes: performing noise reduction processing on the image information before controlling the display screen of the electronic rearview mirror system to display.

[0133] Specifically, the ambient light intensity is detected in real time through electrochromic lenses and photosensitive resistors. When the detected ambient light intensity is less than the first light intensity threshold, the infrared image sensor is started, and the corresponding two-dimensional noise reduction algorithm is selected to perform noise reduction processing on the image information under low light intensity. When the detected ambient light intensity is greater than the second light intensity threshold, the RGB image sensor is started, and the corresponding two-dimensional noise reduction algorithm is selected to perform noise reduction processing on the image information under high light intensity. When the detected ambient light intensity is between the first light intensity threshold and the second light intensity threshold, the infrared image sensor and the RGB image sensor can be started at the same time to fuse and reduce noise on the collected image information.

[0134] Therefore, different noise reduction modules can be selected according to the type of image sensor, and the transmitted image information is subjected to bilateral two-dimensional spatial noise reduction processing through the noise reduction module to eliminate interference signals such as salt and pepper noise in the image, thereby improving the image quality. The image information after noise reduction processing is transmitted through the serial deserializer and finally displayed on the display screen of the electronic rearview mirror.

[0135] Figure 6 FIG. 1 is an overall flow chart of a method for controlling the display of an electronic rearview mirror system according to an embodiment of the present invention. Figure 6 As shown, the overall process of the method for controlling the display of the electronic rearview mirror system includes at least steps S10-S22, which are as follows:

[0136] S10, power on starts.

[0137] S11, detecting the ambient light intensity in real time through a light intensity detection module.

[0138] S12: Determine, according to the ambient light intensity, at least one target image sensor of at least one target type that matches the ambient light intensity.

[0139] S13, determine whether the ambient light intensity is greater than or equal to the first light intensity threshold and less than or equal to the second light intensity threshold. If so, proceed to step S20; if not, proceed to steps S14 and S17.

[0140] S14: When the ambient light intensity is less than a first light intensity threshold, select at least one infrared image sensor as a target image sensor.

[0141] S15, controlling the infrared image sensor to output an infrared image, and performing noise reduction processing on the infrared image through a corresponding noise reduction module in the image processing module.

[0142] S16, transmitting the processed infrared image to the display screen of the electronic rearview mirror system for display, and at the same time, the LED indicator emits yellow light.

[0143] S17: When the ambient light intensity is greater than a second light intensity threshold, select at least one RGB image sensor as a target image sensor.

[0144] S18, controlling the RGB image sensor to output an RGB image, and performing noise reduction processing on the RGB image through a corresponding noise reduction module in the image processing module.

[0145] S19, transmitting the processed RGB image to the display screen of the electronic rearview mirror system for display, and at the same time, the LED indicator emits green light.

[0146] S20, selecting at least one infrared image sensor and at least one RGB image sensor as a target image sensor.

[0147] S21, controlling the infrared image sensor to output an infrared image, and controlling the RGB image sensor to output an RGB image, and performing fusion and noise reduction processing on the infrared image and the RGB image.

[0148] S22, transmitting the processed fusion image to the display screen of the electronic rearview mirror system for display, and at the same time, the LED indicator emits green and yellow lights.

[0149] In general, by selecting different image sensors, the system can adaptively process images under different lighting conditions. The system dynamically adjusts the display content of the electronic rearview mirror system according to the image information collected by the target image sensor to ensure that the best quality and clear images are displayed under different ambient light intensities. This adaptive selection and adjustment process can significantly improve the image display effect of the electronic rearview mirror system under different ambient light intensities, enhance the driver's perception of the surrounding environment, and thus improve driving safety.

[0150] Reference below Figure 7 An electronic device according to an embodiment of the present invention is described.

[0151] Figure 7 is a block diagram of an electronic device according to an embodiment of the present invention, such as Figure 7 As shown, the electronic device 110 includes a memory and at least one processor 111 .

[0152] In some embodiments, at least one processor 111 may be one processor 111, or may be two processors 111, three processors 111, five processors 111, eight processors 111, ten processors 111, or multiple processors 111. These processors 111 may be core control units in the electronic rearview mirror system 1, such as an electronic control unit (ECU). The ECU is responsible for coordinating the work of the entire electronic rearview mirror system 1, including receiving data from the light intensity detection module 30, selecting a suitable target image sensor, processing image data, and transmitting it to the display screen 10.

[0153] Specifically, the light intensity detection module 30 detects the ambient light intensity in real time and transmits the detection signal to the ECU, which analyzes the light intensity data to determine the current ambient light conditions. Based on the analysis results, the ECU selects an image sensor (such as an RGB image sensor or an infrared image sensor) that is suitable for the current light conditions.

[0154] Furthermore, the ECU configures the register parameters of the selected image sensor through IIC (Inter-Integrated Circuit) and SPI (Serial Peripheral Interface), and initializes it to prepare for image acquisition. Among them, IIC is a serial communication protocol for short-distance communication, mainly used to connect low-speed devices. The ECU can send configuration commands to the sensor through the IIC interface to set its operating parameters. SPI is a high-speed synchronous serial communication protocol used to connect high-speed devices. The ECU can quickly transmit data and commands to the sensor through the SPI interface to achieve fast initialization and data acquisition.

[0155] Furthermore, the ECU is responsible for generating and sending control signals, which are used to activate and adjust the working state of the target image sensor. After receiving the control signal, the target image sensor collects the environment image and transmits the image data to the ECU. The ECU receives and processes the image data. Then, the ECU transmits the processed image data to the display screen 10 and adjusts the display content to ensure the best image quality. According to the display effect and light changes, the ECU adjusts the sensor selection and image processing strategy in real time.

[0156] In some embodiments, the ECU may be a microcontroller unit (MCU) or a microcontroller ARM. MCU is a type of microcomputer in an embedded system, which has a CPU, a memory, and an I / O port, and is used to control various components in the electronic system. In the electronic rearview mirror system 1, the MCU can efficiently process sensor data and respond quickly. ARM is a microprocessor based on a reduced instruction set computing (RISC) architecture. ARM is widely used in embedded systems for its high performance, low power consumption, and powerful computing capabilities. In the electronic rearview mirror system 1, the ARM microcontroller is able to handle more complex computing tasks and support more peripheral interfaces.

[0157] In some embodiments, the memory 112 may include a flash memory, a random access memory (RAM), an electronic memory, etc. The memory 112 is in communication with at least one processor 111, and the memory 112 stores a computer program executable by at least one processor 111. When the at least one processor 111 executes the computer program, the method for controlling the display of the electronic rearview mirror system described in the above embodiment is implemented.

[0158] According to the electronic device 110 of the embodiment of the present invention, the method for controlling the display of the electronic rearview mirror system of the above embodiment is executed by at least one processor 111, so that adaptive selection of image sensors under different ambient light intensities can be achieved, thereby improving the image quality and clarity displayed by the electronic rearview mirror system under different ambient light intensities, enhancing the driver's perception of the surrounding environment, and thus improving driving safety.

[0159] The embodiment of the present invention further provides a non-volatile readable storage medium on which a computer program is stored. When the computer program is executed by the processor 111, the method for controlling the display of the electronic rearview mirror system described in the above embodiment is implemented. The specific implementation process of the method for controlling the display of the electronic rearview mirror system can refer to the description of the above embodiment.

[0160] In some embodiments, computer-readable storage media may include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical or magnetic storage media, which are not listed here one by one.

[0161] According to the non-volatile readable storage medium of the embodiment of the present invention, by adopting the non-volatile readable storage medium described in the above embodiment, adaptive selection of image sensors under different ambient light intensities can be achieved, thereby improving the image quality and clarity displayed by the electronic rearview mirror system under different ambient light intensities, enhancing the driver's perception of the surrounding environment, and thus improving driving safety.

[0162] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example.

[0163] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

Claims

1. A method for controlling the display of an electronic rearview mirror system, characterized in that: The camera of the electronic rearview mirror system adopts a multispectral camera, and the multispectral camera is configured with a plurality of image sensors of different types, and the plurality of image sensors support different optical bands for imaging, and the plurality of image sensors include infrared image sensors; The camera is provided with a display mode selection unit, the display mode selection unit is used to determine the target display control mode according to the user trigger instruction, and the display mode selection unit is one of a switch button, a knob, a touch screen interface and a voice control system; The electronic rearview mirror system includes an electrochromic lens arranged in front of the lens of the camera, the electrochromic lens adopts a convex design, and the surface of the electrochromic lens is coated with a hydrophobic film and an anti-glare film, and the electrochromic lens is used to adjust the transparency according to the intensity of ambient light; The method comprises: at least one object image sensor that determines at least one object category that matches the ambient light intensity; According to the type of the at least one target image sensor, using a noise reduction module corresponding to the type of the target image sensor to perform noise reduction processing on image information obtained by the target image sensor; Controlling the display screen of the electronic rearview mirror system to display according to the image information obtained by the target image sensor; The method further comprises: obtaining the current ambient temperature according to the image acquisition information of the infrared image sensor, and controlling the working state of the heating module in the camera according to the current ambient temperature; Among them, the heating module includes a heating wire, a temperature control device and a power control unit. The heating wire is made of resistance material. The temperature control device is used to monitor and adjust the temperature of the heating wire. The power control unit is used to manage the power supply of the heating module to control the power on and off of the heating wire.

2. The method according to claim 1, characterized in that: There are multiple target image sensors, and the image information is obtained by performing image fusion on image data collected by the multiple target image sensors.

3. The method according to claim 2, characterized in that The plurality of target image sensors are image sensors of the same target type, or the plurality of target image sensors include image sensors of at least two target types.

4. The method according to claim 1, characterized in that: If the ambient light intensity is less than a first light intensity threshold, the target image sensor includes at least one infrared image sensor, and the image information is image information collected by the at least one infrared image sensor.

5. The method according to claim 4, characterized in that If the ambient light intensity is greater than a second light intensity threshold, the second light intensity threshold is greater than or equal to the first light intensity threshold, the target image sensor includes at least one RGB image sensor, and the image information is image information collected by the at least one RGB image sensor.

6. The method according to claim 5, characterized in that The target image sensor is a plurality of the infrared image sensors or a plurality of the RGB image sensors; The image information is image information obtained after screening image information collected by multiple infrared image sensors or multiple RGB image sensors.

7. The method according to claim 5, characterized in that If the ambient light intensity is greater than or equal to the first light intensity threshold and less than or equal to the second light intensity threshold, the image information is obtained by fusing the image information collected by the infrared image sensor and the image information collected by the RGB image sensor.

8. The method according to claim 1, characterized in that In the first display control mode, when the ambient light intensity is less than a first light intensity threshold, the target image sensor is at least one infrared image sensor; when the ambient light intensity is greater than a second light intensity threshold, the target image sensor is at least one RGB image sensor, and the second light intensity threshold is greater than the first light intensity threshold.

9. The method according to claim 8, characterized in that In the second display control mode, the target image sensor includes at least one infrared image sensor and at least one RGB image sensor, and the image information is obtained by image fusion of image information collected by at least one infrared image sensor and image information collected by at least one RGB image sensor.

10. The method according to claim 9, characterized in that The first display control mode is a display control mode in which the display mode selection unit of the camera is in a first trigger state; And / or, the second display control mode is a display control mode in which the display mode selection unit is in a second trigger state.

11. The method according to any one of claims 1 to 10, characterized in that: The method further includes: prompting the working status of the multiple image sensors.

12. The method according to claim 1, characterized in that The method further comprises: Before controlling the display screen of the electronic rearview mirror system to display, the image information is subjected to noise reduction processing.

13. An electronic device, characterized in that: include: at least one processor; a memory communicatively coupled to the at least one processor; The memory stores a computer program that can be executed by the at least one processor, and when the at least one processor executes the computer program, the method for controlling the display of an electronic rearview mirror system according to any one of claims 1 to 12 is implemented.

14. A non-volatile readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed, the method for controlling the display of an electronic rearview mirror system according to any one of claims 1 to 12 is implemented.

15. An electronic rearview mirror system, characterized in that: include: Display screen; A camera, wherein the camera adopts a multispectral camera, and the multispectral camera is configured with a plurality of image sensors of different types, the plurality of image sensors support different optical bands for imaging, and the plurality of image sensors include infrared image sensors; A light intensity detection module is used to detect the ambient light intensity; An electrochromic lens, wherein the electrochromic lens is disposed in front of the lens of the camera, the electrochromic lens adopts a convex design, and the surface of the electrochromic lens is coated with a hydrophobic film and an anti-glare film, and the electrochromic lens is used to adjust the transparency according to the ambient light intensity; The camera also includes a display mode selection unit, which is used to determine the target display control mode according to the user trigger instruction, and the display mode selection unit is one of a switch button, a knob, a touch screen interface and a voice control system; The camera also includes a heating module, which is used to start heating when it is determined that the current ambient temperature is lower than a temperature threshold according to the image information collected by the infrared image sensor, wherein the heating module includes a heating wire, a temperature control device and a point unit control unit, the heating wire is made of a resistance material, the temperature control device is used to monitor and adjust the temperature of the heating wire, and the power control unit is used to manage the power supply of the heating module to control the power on and off of the heating wire; The display screen is configured to display an image captured by at least one target image sensor of at least one target type matching the ambient light intensity, wherein, for the image captured by the target image sensor, a noise reduction module corresponding to the target image sensor type is used to perform noise reduction processing on the image captured by the target image sensor.

16. The electronic rearview mirror system according to claim 15, characterized in that: The electronic rearview mirror system further comprises the electronic device according to claim 13.

17. The electronic rearview mirror system according to claim 15, characterized in that: The plurality of image sensors further includes an RGB image sensor.

18. The electronic rearview mirror system according to claim 15, characterized in that: The electronic rearview mirror system also includes: A prompt module is arranged on the display screen and is used to prompt the working status of the multiple image sensors.

19. The electronic rearview mirror system according to claim 15, characterized in that: The camera also includes an image processing module, which is connected to each of the image sensors and is used for performing image processing.

20. A vehicle, characterized in that: Comprising at least one electronic rearview mirror system as described in any one of claims 15 to 19, and / or comprising the electronic device as described in claim 13.

21. The vehicle according to claim 20, characterized in that The vehicle comprises three electronic rearview mirror systems, which respectively correspond to an interior rearview mirror, a left exterior rearview mirror and a right exterior rearview mirror of the vehicle.

22. The vehicle according to claim 21, characterized in that The display screen of the electronic rearview mirror system corresponding to the interior rearview mirror is located on the front windshield; and / or The display screen of the electronic rearview mirror system corresponding to the left exterior rearview mirror is located at the A-pillar or the door of the vehicle; and / or The display screen of the electronic rearview mirror system corresponding to the right exterior rearview mirror is located at the vehicle door or the A-pillar.

Images