Night-vision display control method, electronic apparatus, night-vision system, and vehicle
By equipping vehicles with multiple night vision devices and switching the display based on image quality and environmental information, the problem of far-infrared cameras failing to work at similar temperatures has been solved, enabling adaptive switching of night vision display modes and improving nighttime driving safety.
Patent Information
- Application Number
- PCT/CN2025/088873
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-04-25
- Filing Date
- 2025-04-14
- Publication Date
- 2025-10-30
AI Technical Summary
When the ambient temperature is close to the target temperature, the far-infrared camera of the existing vehicle night vision system cannot detect the target object, resulting in a decrease in recognition performance and automatic shutdown, which affects nighttime driving safety.
Equip the vehicle with at least two night vision devices, determine the night vision device that meets the current needs based on image quality indicators and environmental information, and switch to display the corresponding imaging images, including far-infrared cameras and near-infrared cameras, to achieve adaptive switching of night vision display modes.
It reduces the occurrence of night vision function failures caused by malfunctioning night vision equipment, improves the intelligence level of night vision display control, and enhances nighttime driving safety.
Smart Images

Figure CN2025088873_30102025_PF_FP_ABST
Abstract
Description
Night vision display control methods, electronic devices, night vision systems and vehicles
[0001] This application claims priority to Chinese Application No. 202410530203.5, filed on April 25, 2024, entitled “Night Vision Display Control Method, Electronic Device, Night Vision System and Vehicle”, the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to, but is not limited to, the field of automotive technology, and particularly to a night vision display control method, electronic device, night vision system, and vehicle. Background Technology
[0003] Most existing vehicle night vision systems are typically equipped with a single dedicated night vision camera, such as an infrared camera. When the ambient temperature is close to the target temperature, the infrared camera may fail to detect the target object, resulting in a decrease in recognition performance. When the temperature reaches a certain threshold, the night vision system will automatically shut down. This means that users cannot use the night vision function in some situations, greatly reducing the safety of driving at night. Technical solutions
[0004] The technical problem to be solved by this application is to provide a night vision display control method, electronic device, night vision system and vehicle, which can equip the vehicle with at least two night vision devices, reduce the occurrence of night vision function failure due to the failure of night vision devices to work properly in some scenarios, and switch the real-time scene image collected by the night vision device to be displayed according to the current night vision needs of the vehicle, realize adaptive switching of night vision display mode, and improve the intelligence level of night vision display control.
[0005] To address the aforementioned technical problems, the first aspect of this application discloses a night vision display control method for controlling a vehicle, the method comprising: determining a first night vision device from at least two image acquisition devices of the vehicle that meets the current night vision requirements of the vehicle;
[0006] The display terminal is controlled to display the image corresponding to the first night vision device.
[0007] As an optional implementation, in the first aspect of this application, the first night vision device is determined based on the image quality index of the preprocessed images corresponding to the at least two image acquisition devices and / or the environmental information of the vehicle's current location.
[0008] As an optional implementation, in the first aspect of this application, the image quality index of the preprocessed image corresponding to only one of the image acquisition devices meets the preset image quality requirements, and the first night vision device is the image acquisition device whose image quality index of the corresponding preprocessed image meets the image quality requirements;
[0009] The response is that the image quality index of the preprocessed images corresponding to at least two of the image acquisition devices meets the image quality requirement. The first night vision device is determined from all image acquisition devices whose image quality index of the corresponding preprocessed images meets the image quality requirement based on the environmental information of the current location of the vehicle.
[0010] As an optional implementation, in the first aspect of this application, the image quality index includes one or more of the following: image sharpness, image brightness, and image contrast of the corresponding preprocessed image.
[0011] As an optional implementation, in the first aspect of this application, the environmental information of the vehicle includes one or more of the following: climate information, light intensity information, temperature information, humidity information, visibility information, and road condition information.
[0012] As an optional implementation, in the first aspect of this application, the climate information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, and climate forecast information; and / or,
[0013] The light intensity information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, and climate forecast information; and / or,
[0014] The temperature information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, and climate forecast information; and / or,
[0015] The humidity information is determined based on one or more of the following: sensor information collected by the vehicle's onboard sensors, and climate forecast information; and / or,
[0016] The visibility information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, the vehicle's control signals, and climate forecast information; and / or,
[0017] The road condition information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, vehicle positioning information, and road condition data transmitted from the outside.
[0018] As an optional implementation, in the first aspect of this application, the images acquired by the at least one image acquisition device can be used to predict a first climate prediction result, and the sensing information acquired by the vehicle's on-board sensors and / or the vehicle's control signals can be used to predict a second climate prediction result. The climate information is determined based on one or more of the first climate prediction result, the second climate prediction result, and the climate forecast information.
[0019] As an optional implementation, in the first aspect of this application, the at least two image acquisition devices include image acquisition devices adapted to at least two climate type sets; when the climate information indicates that the current climate type belongs to a certain climate type set, the first night vision device determined based on the environmental information includes an image acquisition device adapted to that climate type set.
[0020] As an optional implementation, in the first aspect of this application, the image acquisition device includes a far-infrared camera and a near-infrared camera, and the at least two climate type sets include a first climate type set and a second climate type set, wherein the visibility of the climate type in the first climate type set is lower than the visibility of the climate type in the second climate type set; when the climate information indicates that the current climate type belongs to the first climate type set, the first night vision device is the far-infrared camera, and when the environmental information indicates that the current climate type belongs to the second climate type set, the first night vision device is the near-infrared camera.
[0021] As an optional implementation, in the first aspect of this application, at least two of the image acquisition devices do not exhibit the abnormal situation, and the first night vision device is determined from the image acquisition devices that do not exhibit the abnormal situation;
[0022] The response is that only one of the image acquisition devices does not have the abnormal situation, and the first night vision device is the image acquisition device that does not have the abnormal situation.
[0023] As an optional implementation, in the first aspect of this application, the abnormal situation includes one or more of the following: the image acquisition device malfunctions, the associated device of the image acquisition device malfunctions, and the lens of the image acquisition device is blocked. The associated device includes a device for satisfying the image acquisition conditions of the corresponding image acquisition device.
[0024] The method further includes:
[0025] In response to a failure of at least two image acquisition devices or their associated devices, the system controls the vehicle's display terminal to disable its night vision display function; and / or,
[0026] In response to the obstruction of at least two image acquisition devices, the system controls the vehicle's display terminal to disable the night vision display function, or controls the vehicle's display terminal to maintain the current night vision display state.
[0027] As an optional implementation, in the first aspect of this application, the method further includes:
[0028] In response to the detection of a user-triggered night vision display control signal, the vehicle's display terminal is controlled to display an imaging image corresponding to a second night vision device that matches the night vision control signal.
[0029] As an optional implementation, in the first aspect of this application, the at least two image acquisition devices include at least two of the following: a near-infrared camera, a far-infrared camera, a low-light CCD, and a visible light camera.
[0030] A second aspect of this application discloses an electronic device for use in a vehicle, the device comprising a mode determination component and a mode switching component, wherein:
[0031] The mode determination component is used to determine a first night vision device from at least two image acquisition devices of the vehicle that meets the current night vision requirements of the vehicle.
[0032] The mode switching component is used to control the vehicle's display terminal to display the imaging image corresponding to the first night vision device.
[0033] As an optional implementation, in a second aspect of this application, the first night vision device is determined based on the image quality index of the preprocessed images corresponding to the at least two image acquisition devices and / or the environmental information of the vehicle's current location.
[0034] As an optional implementation, in the second aspect of this application, the image quality index of the preprocessed image corresponding to only one of the image acquisition devices meets the preset image quality requirements, and the first night vision device is the image acquisition device whose image quality index of the corresponding preprocessed image meets the image quality requirements;
[0035] The response is that the image quality index of the preprocessed images corresponding to at least two of the image acquisition devices meets the image quality requirement. The first night vision device is determined from all image acquisition devices whose image quality index of the corresponding preprocessed images meets the image quality requirement based on the environmental information of the current location of the vehicle.
[0036] As an optional implementation, in a second aspect of this application, the apparatus further includes an image quality evaluation component, wherein:
[0037] The image quality evaluation component is used to evaluate the image quality indicators of the preprocessed images corresponding to the at least two image acquisition devices. The evaluation content of the image quality indicators includes one or more of the following: image sharpness, image brightness, and image contrast of the corresponding preprocessed image.
[0038] As an optional implementation, in the second aspect of this application, the environmental information of the vehicle includes one or more of the following: climate information, light intensity information, temperature information, humidity information, visibility information, and road condition information.
[0039] As an optional implementation, in the second aspect of this application, the climate information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, and climate forecast information; and / or,
[0040] The light intensity information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, and climate forecast information; and / or,
[0041] The temperature information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, and climate forecast information; and / or,
[0042] The humidity information is determined based on one or more of the following: sensor information collected by the vehicle's onboard sensors, and climate forecast information; and / or,
[0043] The visibility information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, the vehicle's control signals, and climate forecast information; and / or,
[0044] The road condition information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, vehicle positioning information, and road condition data transmitted from the outside.
[0045] As an optional implementation, in a second aspect of this application, the apparatus further includes a climate identification component, the climate identification component including a first prediction subcomponent and / or a second prediction subcomponent, and the climate identification component further including a climate determination subcomponent, wherein:
[0046] The first prediction sub-component is used to predict a first climate prediction result based on images acquired by the at least one image acquisition device;
[0047] The second prediction sub-component is used to predict a second climate prediction result based on the sensing information collected by the vehicle's on-board sensors and / or the vehicle's control signals.
[0048] The climate determination sub-component is used to determine the climate information based on one or more of the first climate prediction result, the second climate prediction result, and the climate forecast information.
[0049] As an optional implementation, in the second aspect of this application, the at least two image acquisition devices include image acquisition devices adapted to at least two climate type sets; in response to the climate information indicating that the current climate type belongs to a certain climate type set, the first night vision device determined based on the environmental information includes an image acquisition device adapted to that climate type set.
[0050] As an optional implementation, in the second aspect of this application, the image acquisition device includes a far-infrared camera and a near-infrared camera, and the at least two climate type sets include a first climate type set and a second climate type set, wherein the visibility of the climate type in the first climate type set is lower than the visibility of the climate type in the second climate type set; when the climate information indicates that the current climate type belongs to the first climate type set, the first night vision device is the far-infrared camera, and when the environmental information indicates that the current climate type belongs to the second climate type set, the first night vision device is the near-infrared camera.
[0051] As an optional implementation, in the second aspect of this application, in response to at least two of the image acquisition devices not having the abnormal situation, the first night vision device is determined from the image acquisition devices that do not have the abnormal situation; in response to only one of the image acquisition devices not having the abnormal situation, the first night vision device is the image acquisition device that does not have the abnormal situation.
[0052] As an optional implementation, in the second aspect of this application, the abnormal situation includes one or more of the following: the image acquisition device malfunctions, the associated device of the image acquisition device malfunctions, and the lens of the image acquisition device is blocked. The associated device includes a device for satisfying the image acquisition conditions of the corresponding image acquisition device.
[0053] The mode switching component is further configured to control the vehicle's display terminal to turn off the night vision display function when both of the at least two image acquisition devices or their associated devices malfunction; and / or, in response to both of the at least two image acquisition devices being blocked, control the vehicle's display terminal to turn off the night vision display function, or control the vehicle's display terminal to maintain the current night vision display state.
[0054] As an optional implementation, in a second aspect of this application, the mode switching component is further configured to respond to the detection of a user-triggered night vision display control signal and control the vehicle's display terminal to display an imaging image corresponding to a second night vision device that matches the night vision control signal.
[0055] As an optional implementation, in the second aspect of this application, the at least two image acquisition devices include at least two of the following: a near-infrared camera, a far-infrared camera, a low-light CCD, and a visible light camera.
[0056] A third aspect of this application discloses another electronic device, the device including a processor connected to a memory;
[0057] The processor calls the executable program code stored in the memory to execute the night vision display control method disclosed in the first aspect of this application.
[0058] The fourth aspect of this application discloses a computer storage medium storing computer instructions, which, when invoked, are used to execute the night vision display control method disclosed in the first aspect of this application.
[0059] The fifth aspect of this application discloses a night vision system for vehicles, the night vision system including the apparatus disclosed in the second or third aspect of this application, and the night vision system further including at least two image acquisition devices.
[0060] The sixth aspect of this application discloses a vehicle that includes the device disclosed in the third or fourth aspect of this application, or the night vision system disclosed in the fifth aspect.
[0061] Compared with the prior art, the embodiments of this disclosure have the following beneficial effects:
[0062] In embodiments of this disclosure, the method is used to control a vehicle. The method includes: determining a first night vision device from at least two image acquisition devices of the vehicle that meets the vehicle's current night vision requirements; and controlling the vehicle's display terminal to display the imaging image corresponding to the first night vision device. It is evident that implementing this application can equip a vehicle with at least two night vision devices, reducing the occurrence of night vision function failures due to the malfunction of some night vision devices in certain scenarios. Furthermore, it allows for the switching of the real-time scene image acquired by the night vision device to be displayed according to the vehicle's current night vision requirements, achieving adaptive switching of the night vision display mode and improving the intelligence level of night vision display control. Attached Figure Description
[0063] To more clearly illustrate the technical solutions in the embodiments of this disclosure, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0064] Figure 1 is a schematic flowchart of a night vision display control method disclosed in an embodiment of this disclosure;
[0065] Figure 2 is a schematic flowchart of another night vision display control method disclosed in an embodiment of this disclosure;
[0066] Figure 3 is a schematic flowchart of another night vision display control method disclosed in an embodiment of this disclosure;
[0067] Figure 4 is a schematic diagram of the structure of an electronic device disclosed in an embodiment of this disclosure;
[0068] Figure 5 is a schematic diagram of the structure of another electronic device disclosed in an embodiment of this disclosure;
[0069] Figure 6 is a schematic diagram of the structure of another electronic device disclosed in an embodiment of this disclosure;
[0070] Figure 7 is a schematic diagram of the structure of another electronic device disclosed in an embodiment of this disclosure;
[0071] Figure 8 is a schematic diagram of the structure of another electronic device disclosed in an embodiment of this disclosure;
[0072] Figure 9 is a schematic diagram of the structure of a night vision system disclosed in this application;
[0073] Figure 10 is a structural schematic diagram of a vehicle disclosed in this application.
[0074] Implementation methods of this application
[0075] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.
[0076] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.
[0077] This application discloses a night vision display control method, electronic device, night vision system, and vehicle. It can equip a vehicle with at least two night vision devices, reducing the occurrence of night vision function failure due to malfunction of some devices in certain scenarios. Furthermore, it switches the real-time scene image captured by the night vision device to be displayed according to the vehicle's current night vision needs, achieving adaptive switching of the night vision display mode and improving the intelligence level of night vision display control. These will be described in detail below.
[0078] Example 1
[0079] Please refer to Figure 1, which is a schematic flowchart of a night vision display control method disclosed in an embodiment of this disclosure. The night vision display control method described in Figure 1 can be used to control a vehicle. Optionally, this night vision display control method can be applied to a vehicle-specific electronic device. This electronic device can be integrated into the vehicle, such as a vehicle control assembly, or integrated into a cloud platform, or integrated into a terminal device capable of establishing a communication connection with the vehicle. The embodiments of this disclosure do not impose limitations on this. As shown in Figure 1, the night vision display control method may include the following operations:
[0080] 101. Determine a first night vision device from at least two image acquisition devices of the vehicle that meets the vehicle's current night vision requirements.
[0081] In the embodiments of this disclosure, optionally, the at least two image acquisition devices may include, but are not limited to, at least two of near-infrared cameras, far-infrared cameras, low-light CCDs, and visible light cameras. More optionally, the at least two image acquisition devices may include at least a far-infrared camera, and at least one of a near-infrared camera, a visible light camera, and a low-light CCD. This allows for vehicle night vision functionality in low-visibility conditions using a far-infrared camera, while in warmer conditions, it can be achieved using a near-infrared camera, a visible light camera, or a low-light CCD. Preferably, the at least two image acquisition devices may include both a far-infrared camera and a near-infrared camera. It should be noted that if a near-infrared camera or a low-light CCD, which requires supplemental lighting at night, is used, the vehicle may also be equipped with a corresponding supplemental lighting. It is understood that those skilled in the art can make equivalent substitutions or modifications based on the technical solution and inventive concept of this application, such as using a mid-infrared camera instead of a far-infrared camera, and all such modifications or substitutions should fall within the protection scope of the appended claims. This increases the diversity of night vision equipment on vehicles, enabling them to handle more night vision scenarios.
[0082] 102. The display terminal controlling the vehicle displays the imaging image corresponding to the first night vision device.
[0083] In the embodiments of this disclosure, optionally, the imaging image corresponding to the first night vision device can be the original image captured by the first night vision device or the image obtained after data imaging processing of the original image captured by the first night vision device. This application embodiment does not limit this. Further optionally, the data imaging processing for the original image can include one or more of the following: denoising, image enhancement, segmentation, target feature extraction, colorization, and 3D modeling. This application embodiment does not limit this.
[0084] As an optional implementation, controlling the display terminal to display the imaging image corresponding to the first night vision device may include: outputting the imaging image corresponding to the first night vision device to the vehicle's display terminal, so that the display terminal displays the imaging image corresponding to the first night vision device; or, controlling the data transmission channel between the first night vision device and the vehicle's display terminal to open, so that the display terminal displays the imaging image corresponding to the first night vision device. This can improve the diversity of display terminal control methods.
[0085] As can be seen, the embodiments of this disclosure can equip a vehicle with at least two night vision devices, reducing the occurrence of night vision function failure due to the malfunction of night vision devices in some scenarios, and switching the real-time scene image collected by the night vision device to be displayed according to the current night vision needs of the vehicle, realizing adaptive switching of night vision display mode, and improving the intelligence level of night vision display control.
[0086] In an optional embodiment, the first night vision device can be determined based on the image quality indicators of preprocessed images corresponding to at least two image acquisition devices and / or the environmental information of the vehicle's current location. That is, the first night vision device that meets preset image quality requirements can be selected directly from the image quality indicators of the preprocessed images corresponding to at least two image acquisition devices; alternatively, the first night vision device matching the current environmental information, such as climate information, can be selected directly; or the two selection methods can be combined, for example, performing preliminary selection based on the image quality indicators of the preprocessed images, and then selecting the first night vision device based on the current environmental information of the vehicle. This improves the image quality displayed by the display terminal, and the adaptive switching of image acquisition devices based on environmental information enhances the matching degree between the first night vision device and the vehicle's location, thereby improving the imaging effect.
[0087] In this optional embodiment, optionally, when only one image acquisition device's preprocessed image meets the preset image quality requirements, the first night vision device can be any image acquisition device whose preprocessed image meets the image quality requirements; when at least two image acquisition devices' preprocessed images meet the image quality requirements, the first night vision device can be determined from all image acquisition devices whose preprocessed images meet the image quality requirements based on the vehicle's current environmental information. Therefore, by first initially screening night vision devices based on image quality indicators and then further screening them based on environmental information, the accuracy and reliability of adaptive switching of night vision display modes can be further improved, thereby enhancing the imaging effect of night vision displays.
[0088] In this optional embodiment, further optionally, when the image quality indicators of the preprocessed images corresponding to the at least two image acquisition devices do not meet the preset image quality requirements, a first night vision device that meets the current night vision requirements of the vehicle is determined from the at least two image acquisition devices based on the environmental information of the vehicle.
[0089] In this optional embodiment, the image quality indicators may include, but are not limited to, one or more of the following: image sharpness, image brightness, and image contrast of the corresponding preprocessed image. Image sharpness can be used to evaluate whether the preprocessed image is blurry; image brightness can be used to evaluate whether target features in the preprocessed image are clearly visible; and image contrast can be used to evaluate whether there is light interference in the preprocessed image. This allows for the evaluation of information such as image sharpness and brightness, quantifying the image quality indicator evaluation, and thereby improving the accuracy and reliability of adaptively switching night vision display modes based on image quality indicators.
[0090] In this optional embodiment, the image quality index of the preprocessed image corresponding to the at least two image acquisition devices is determined by the image quality evaluation model, which can improve the evaluation efficiency and accuracy of the image quality index.
[0091] In this optional embodiment, the preprocessed image corresponding to the at least two image acquisition devices is obtained by preprocessing the original images acquired by the at least two image acquisition devices and then performing data preprocessing and target feature extraction. In a specific implementation, an image recognition model can perform data preprocessing and target feature extraction on the original images acquired by the at least two image acquisition devices to obtain the corresponding preprocessed image. Optionally, the image recognition model may include a data preprocessing sub-model for performing data preprocessing and an image recognition sub-model for extracting target features. The data preprocessing may include denoising, image enhancement, segmentation, etc., and the image recognition sub-model may be a model such as YOLO or Faster R-CNN; the embodiments disclosed herein are not limited to this. Therefore, by performing data preprocessing and target feature extraction on the original images from the image acquisition devices, the impact of unnecessary interference information on image quality index evaluation can be reduced, thereby improving the accuracy of image quality index evaluation.
[0092] In this optional embodiment, the environmental information of the vehicle may include, but is not limited to, one or more of the following: climate information, light intensity information, temperature information, humidity information, visibility information, and road condition information; further optionally, the road condition information may include, but is not limited to, one or more of the following: traffic flow information, pedestrian flow information, road information, and road surface information. This enriches the types of environmental information and meets the user's night vision needs in various complex environments.
[0093] In this optional embodiment, further optionally, the climate information may be determined based on one or more of the following: images acquired by at least one image acquisition device, sensing information acquired by the vehicle's onboard sensors, vehicle control signals, and climate forecast information; and / or, the light intensity information may be determined based on one or more of the following: images acquired by at least one image acquisition device, sensing information acquired by the vehicle's onboard sensors, vehicle control signals, and climate forecast information; and / or, the temperature information may be based on one of the following: images acquired by at least one image acquisition device, sensing information acquired by the vehicle's onboard sensors, and climate forecast information. The environmental information can be determined based on one or more of the following: humidity information is determined based on sensor information collected by the vehicle's onboard sensors, climate forecast information, etc.; visibility information is determined based on one or more of the following: images acquired by at least one image acquisition device, sensor information collected by the vehicle's onboard sensors, vehicle control signals, climate forecast information, etc.; and road condition information is determined based on one or more of the following: images acquired by at least one image acquisition device, sensor information collected by the vehicle's onboard sensors, vehicle control signals, vehicle positioning information, and externally transmitted road condition data, etc. This allows environmental information to be determined based on the imaging images corresponding to the image acquisition device, sensor information, and vehicle control signals, thereby improving the accuracy and reliability of environmental information detection.
[0094] In this optional embodiment, the aforementioned vehicle-mounted sensor may include, but is not limited to, one or more of the following: temperature sensor, light sensor, rain sensor, humidity sensor, position sensor, and pose sensor; the vehicle control signal may include, but is not limited to, fog light control signal, wiper control signal, and air conditioning control signal; the sensing information of the aforementioned vehicle-mounted sensor and the vehicle control signal may be in the form of CAN signal or other signal forms, and the embodiments disclosed herein are not limited thereto.
[0095] In this optional embodiment, the images acquired by at least one image acquisition device can be used to predict a first climate prediction result, and the sensing information acquired by the vehicle's onboard sensors and / or the vehicle's control signals can be used to predict a second climate prediction result. The climate information is determined based on one or more of the first climate prediction result, the second climate prediction result, and climate forecast information. Preferably, when the vehicle's image acquisition device includes a near-infrared camera and a low-light CCD, the pre-processed images corresponding to the near-infrared camera and the low-light CCD are preferentially used to determine the scene detection result. Therefore, this allows for a comprehensive judgment of the current climate information based on the acquired images, sensing information, control signals, and weather forecasts, improving the confidence level of the determined climate information and thus improving the accuracy of switching night vision display modes.
[0096] In this optional embodiment, further optionally, the climate information can be predicted by a climate identification model. Optionally, the climate identification model includes a first prediction sub-model and / or a second prediction sub-model. The climate identification model may also include a climate determination sub-model. The first prediction sub-model can predict a first climate prediction result based on images acquired by at least one of the above-mentioned image acquisition devices. The second prediction sub-model can predict a second climate prediction result based on sensing information acquired by the vehicle's on-board sensors and / or the vehicle's control signals. The climate determination sub-model can determine the climate information based on one or more of the first climate prediction result, the second climate prediction result, and weather forecast information. In a specific implementation, optionally, the first prediction sub-model can predict the distribution probability of various climate types such as rainy, snowy, and foggy weather, obtaining a first climate prediction result; the second prediction sub-model can predict the distribution probability of various scene types such as rainy, snowy, and foggy weather based on the sensing information collected by the vehicle's onboard sensors and / or the vehicle's control signals, obtaining a second climate prediction result; the climate determination sub-model can determine the comprehensive distribution probability of various climate types such as rainy, snowy, and foggy weather based on the first climate prediction result, the second climate prediction result, and weather forecast information, and determine the climate type with the highest comprehensive distribution probability as the climate information. It is evident that the above-mentioned climate identification model can improve the accuracy and efficiency of current scene type identification.
[0097] In this optional embodiment, further optionally, in order to avoid the climate determination sub-model being unable to determine the final climate information due to conflicts between the first climate prediction result, the second climate prediction result, and the weather forecast information, confidence levels can be set in advance for the first climate prediction result, the second climate prediction result, and the weather forecast information. The climate determination sub-model then combines the set confidence levels to determine the comprehensive distribution probability of various climate types.
[0098] In this optional embodiment, it is further possible to pre-build a deep learning recognition model for determining whether the climate is a preset climate type (such as severe weather), and acquire night vision image data, sensor information, control signals, weather forecasts, etc., under different climates to construct a dataset, such as night vision image data collected by a near-infrared camera. This dataset is then provided to the deep learning recognition model for deep training to obtain the climate recognition model. In the practical application of the first prediction model, image features of the original images collected by the image acquisition device can be extracted by a feature extraction model, and the first prediction model performs detection based on the extracted image features. Therefore, this allows for adaptive switching of the night vision display mode according to the current climate type, adapting to more driving scenarios without increasing costs and improving user driving comfort.
[0099] In another optional embodiment, the aforementioned at least two image acquisition devices may include image acquisition devices adapted to at least two sets of climate types; when climate information indicates that the current climate type belongs to a certain set of climate types, the first night vision device determined based on environmental information may include an image acquisition device adapted to that set of climate types; optionally, the aforementioned at least two sets of climate types are classified based on the visibility of the corresponding scene type. This allows for adaptive switching of the night vision display mode according to the current climate type, thereby adapting to more driving scenarios and improving user driving comfort without increasing costs.
[0100] In this optional embodiment, the image acquisition device may optionally include a far-infrared camera and a near-infrared camera. At least two climate type sets may include a first climate type set and a second climate type set, where the visibility of the climate types in the first climate type set is lower than the visibility of the climate types in the second climate type set. When climate information indicates that the current climate type belongs to the first climate type set, the first night vision device is a far-infrared camera; when environmental information indicates that the current climate type belongs to the second climate type set, the first night vision device is a near-infrared camera. Optionally, the first climate type set may include, but is not limited to, rainy days, snowy days, foggy days, and sandstorms; the second climate type set may include, but is not limited to, sunny days and cloudy days. Thus, when the current climate type is determined to be rainy, snowy, foggy, or a sandstorm, a far-infrared camera can be used as the first night vision device; when the current climate type is determined to be sunny or cloudy, a near-infrared camera can be used as the first night vision device.
[0101] To better understand the embodiments of this disclosure, the following example illustrates the use of a vehicle equipped with both a far-infrared camera and a near-infrared camera:
[0102] After the far-infrared and near-infrared cameras acquire the raw images, they are first preprocessed to obtain preprocessed images. Then, the image quality indicators of the preprocessed images are evaluated. If the image quality indicators of the preprocessed image corresponding to the far-infrared camera do not meet the requirements, while those of the preprocessed image corresponding to the near-infrared camera do, the display terminal is controlled to display the image from the near-infrared camera; otherwise, the display terminal displays the image from the far-infrared camera. If the image quality indicators of the preprocessed images corresponding to both the far-infrared and near-infrared cameras meet or do not meet the requirements, a first climate prediction result can be predicted based on the image acquired by the near-infrared camera. A second climate prediction result can also be predicted based on vehicle sensor information and control signals. The final climate information is determined based on the first and second prediction results. If the climate information indicates that the current weather type is rainy, foggy, or other low-visibility weather, the display terminal can be controlled to display the image from the far-infrared camera. If the climate information indicates that the current weather type is sunny or other high-visibility weather, the display terminal can be controlled to display the image from the near-infrared camera.
[0103] Example 2
[0104] Please refer to Figure 2, which is a schematic flowchart of another night vision display control method disclosed in an embodiment of this disclosure. The night vision display control method described in Figure 2 can be used to control a vehicle. Optionally, this night vision display control method can be applied to a vehicle-specific electronic device. This electronic device can be integrated into the vehicle, such as a vehicle control component, or integrated into a cloud platform, or integrated into a terminal device capable of establishing a communication connection with the vehicle. The embodiments of this disclosure do not impose limitations on this. As shown in Figure 2, the night vision display control method may include the following operations:
[0105] 201. Determine a first night vision device from at least two image acquisition devices of the vehicle that meets the vehicle's current night vision requirements.
[0106] 202. The display terminal controlling the vehicle displays the imaging image corresponding to the first night vision device.
[0107] 203. When a user-triggered night vision display control signal is detected, the vehicle's display terminal displays the imaging image corresponding to the second night vision device that matches the night vision control signal.
[0108] In this optional embodiment, the user-triggered night vision display control signal has a higher priority than the night vision display control signal intelligently generated through the embodiments of this disclosure. That is, when the night vision device matching the user-triggered night vision display control signal is inconsistent with the second night vision device determined through the embodiments of this disclosure, the display terminal prioritizes displaying the imaging image corresponding to the night vision device matching the user-triggered night vision display control signal.
[0109] For other descriptions of steps 201 and 202 in the embodiments of this disclosure, please refer to the detailed description of steps 101 and 102 in Embodiment 1. The embodiments of this disclosure will not repeat the descriptions.
[0110] It should be noted that in other embodiments, the execution order of step 203 is not related to steps 201 and 202.
[0111] As can be seen, implementing the embodiments of this disclosure can equip a vehicle with at least two night vision devices, reducing the occurrence of night vision function failure due to the malfunction of night vision devices in some scenarios. It can also switch the real-time scene image collected by the night vision device to be displayed according to the current night vision needs of the vehicle, realize adaptive switching of night vision display mode, improve the intelligence of night vision display control, and also be compatible with the function of user manual control of night vision display mode, improve the diversity of night vision display mode switching methods, and further enhance the user experience.
[0112] In an optional embodiment, when at least two image acquisition devices are not abnormal, the first night vision device is determined from the image acquisition devices that are not abnormal; when only one image acquisition device is not abnormal, the first night vision device is the image acquisition device that is not abnormal.
[0113] In this optional embodiment, the abnormal situation may include one or more of the following: a malfunction of the image acquisition device, a malfunction of the associated device of the image acquisition device, or an obstruction of the lens of the image acquisition device. The associated device may include a device for meeting the image acquisition conditions of the corresponding image acquisition device. For example, the associated device of the near-infrared camera includes a corresponding near-infrared supplementary light. For instance, if the vehicle is equipped with a far-infrared camera and a near-infrared camera, when the far-infrared camera malfunctions or is obstructed, the system adapts to the near-infrared mode, that is, the near-infrared camera is identified as the first night vision device; when the near-infrared camera malfunctions or is obstructed, or the near-infrared supplementary light malfunctions, the system adapts to the far-infrared mode, that is, the far-infrared camera is identified as the first night vision device.
[0114] As can be seen, this optional embodiment can adaptively switch the night vision display mode according to whether there is an abnormality in the vehicle's image acquisition equipment, further reducing the occurrence of situations where the night vision display function cannot be realized due to abnormalities in the image acquisition equipment.
[0115] In another alternative embodiment, the method may further include:
[0116] When at least two image acquisition devices or their associated devices fail, the vehicle's display terminal disables the night vision display function; and / or,
[0117] When at least two image acquisition devices are blocked, the vehicle's display terminal can either disable the night vision display function or maintain the current night vision display state.
[0118] In another optional embodiment, when only one of the above-mentioned image acquisition devices is not malfunctioning but is obstructed, and all other image acquisition devices are malfunctioning, the first night vision device is the image acquisition device that is not malfunctioning.
[0119] Optionally, in a specific implementation, as shown in Figure 3, it can be first determined whether at least two of the above-mentioned image acquisition devices have malfunctioned. If all image acquisition devices have malfunctioned, the night vision display function is turned off. If at least two image acquisition devices have not malfunctioned, it can be further determined whether the malfunctioning image acquisition devices are obstructed. If they are all obstructed, the night vision display function can be turned off or the current night vision state can be maintained. If at least two image acquisition devices have not malfunctioned, the first night vision device is selected based on image quality indicators or environmental information, such as selecting the first night vision device based on climate information. If only one image acquisition device has not malfunctioned, that image acquisition device can be directly identified as the first night vision device.
[0120] It is evident that this approach enables the response to more unforeseen circumstances and allows for the development of corresponding night vision display control strategies, thereby improving the accuracy and reliability of night vision display control.
[0121] Example 3
[0122] Please refer to Figure 4, which is a schematic diagram of the structure of an electronic device disclosed in an embodiment of this disclosure. The electronic device described in Figure 4 can be used to control the night vision display mode of a vehicle. Optionally, the electronic device can be integrated into the vehicle, integrated into a cloud platform, or integrated into a terminal device that can communicate with the vehicle. This disclosure does not limit the scope of the embodiment. The vehicle includes at least two image acquisition devices. As shown in Figure 4, the electronic device may include a mode determination component 301 and a mode switching component 302, wherein:
[0123] The pattern determination component 301 is used to determine a first night vision device from at least two image acquisition devices of the vehicle that meets the current night vision requirements of the vehicle.
[0124] The mode switching component 302 is used to control the vehicle's display terminal to display the imaging image corresponding to the first night vision device.
[0125] As can be seen, implementing the electronic device described in Figure 4 can equip a vehicle with at least two night vision devices, reducing the occurrence of night vision function failure due to the malfunction of night vision devices in some scenarios. It can also switch the real-time scene image collected by the first night vision device to be displayed according to the vehicle's current night vision needs, realize adaptive switching of night vision display mode, and improve the intelligence level of night vision display control.
[0126] In an optional embodiment, the first night vision device is determined based on the image quality indicators of the preprocessed images corresponding to the at least two image acquisition devices and / or the environmental information of the vehicle's current location.
[0127] It is evident that this can improve the image quality of the display terminal, and the adaptive switching of image acquisition devices based on environmental information can improve the matching degree between the first night vision device and the scene in which the vehicle is located, thereby improving the imaging effect.
[0128] In another optional embodiment, when only one image acquisition device's preprocessed image meets the preset image quality requirements, the first night vision device is the image acquisition device whose preprocessed image meets the image quality requirements.
[0129] When the image quality index of the preprocessed image corresponding to at least two image acquisition devices meets the image quality requirements, the first night vision device is determined from all image acquisition devices whose image quality index of the corresponding preprocessed image meets the image quality requirements based on the environmental information of the vehicle's current location.
[0130] It is evident that by first screening night vision devices based on image quality indicators and then further screening them based on environmental information, the accuracy and reliability of adaptive switching of night vision display modes can be further improved, thereby enhancing the imaging effect of night vision displays.
[0131] In yet another alternative embodiment, as shown in Figures 5 and 7, the device may further include an image quality evaluation component 303, wherein:
[0132] The image quality evaluation component 303 is used to evaluate the image quality indicators of the preprocessed images corresponding to the above-mentioned at least two image acquisition devices. The evaluation content of the image quality indicators includes, but is not limited to, one or more of the following: image sharpness, image brightness, and image contrast of the corresponding preprocessed image.
[0133] It is evident that implementing this device enables the evaluation of information such as image sharpness and brightness, thereby quantifying the evaluation of image quality indicators and improving the accuracy and reliability of adaptively switching night vision display modes based on image quality indicators.
[0134] In yet another alternative embodiment, as shown in Figures 5 and 7, the device may further include an image recognition component 304, wherein:
[0135] The image recognition component 304 is used to perform data preprocessing and target feature extraction on the original images acquired by the at least two image acquisition devices to obtain preprocessed images corresponding to the at least two image acquisition devices.
[0136] In yet another optional embodiment, as shown in Figures 5 and 7, the image recognition component 304 includes a data preprocessing subcomponent 3041 and an image recognition subcomponent 3042, wherein:
[0137] The data preprocessing sub-component 3041 is used to preprocess the raw images acquired by the at least two image acquisition devices to obtain the first processing result corresponding to the at least two image acquisition devices.
[0138] The image recognition sub-component 3042 is used to extract target features from the first processing results corresponding to the at least two image acquisition devices to obtain the preprocessed image corresponding to the at least two image acquisition devices.
[0139] It is evident that implementing this device can also reduce the impact of unnecessary interference information on image quality index evaluation and improve the accuracy of image quality index evaluation by performing data preprocessing and target feature extraction on the raw images of the image acquisition device.
[0140] In another optional embodiment, the environmental information of the vehicle includes one or more of the following: climate information, light intensity information, temperature information, humidity information, visibility information, and road condition information.
[0141] In yet another alternative embodiment, the climate information is determined based on one or more of the following: images acquired by at least one image acquisition device, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, and climate forecast information; and / or,
[0142] Light intensity information is determined based on one or more of the following: images acquired by at least one image acquisition device, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, and climate forecast information; and / or,
[0143] Temperature information is determined based on one or more of the following: images acquired by at least one image acquisition device, sensor information acquired by the vehicle's onboard sensors, and climate forecast information; and / or,
[0144] Humidity information is determined based on one or more of the following: sensor information collected by the vehicle's onboard sensors, and climate forecast information; and / or,
[0145] Visibility information is determined based on one or more of the following: images acquired by at least one image acquisition device, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, and weather forecast information; and / or,
[0146] Traffic information is determined based on one or more of the following: images acquired by at least one image acquisition device, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, vehicle positioning information, and traffic data transmitted from the outside world.
[0147] In yet another alternative embodiment, as shown in Figures 6 and 7, the device may further include a weather recognition component 305, wherein:
[0148] Weather recognition component 305 is used to determine climate information based on one or more of the following: an imaging image corresponding to at least one image acquisition device, sensing information collected by the vehicle's on-board sensors, and control signals of the vehicle.
[0149] Optionally, the weather recognition component 305 may include a first prediction subcomponent 3051 and / or a second prediction subcomponent 3052, and the weather recognition component 305 may further include a weather determination subcomponent 3053, wherein:
[0150] The first prediction sub-component 3051 is used to predict a first climate prediction result based on the image acquired by at least one image acquisition device. Optionally, when the vehicle's image acquisition device includes a near-infrared camera and a low-light CCD, the imaging image corresponding to the near-infrared camera and the low-light CCD is preferentially used to determine the scene detection result.
[0151] The second prediction sub-component 3052 is used to predict a second climate prediction result based on the sensing information collected by the vehicle's on-board sensors and / or the vehicle's control signals.
[0152] Weather determination subcomponent 3053 is used to determine climate information based on one or more of the first climate prediction result, the second climate prediction result, and climate forecast information.
[0153] It is evident that implementing this device can also determine environmental information based on the imaging images corresponding to the image acquisition equipment, sensor information, and vehicle control signals, thereby improving the accuracy and reliability of environmental information detection.
[0154] It is evident that implementing this device enables the detection of the current scene type based on the imaging image, the prediction of the current scene type based on sensor information and control signals, and the comprehensive judgment of the current scene type based on the detection and prediction results. This improves the confidence in determining the current scene type and thus helps to improve the accuracy of switching night vision display modes.
[0155] In another optional embodiment, the above-mentioned at least two image acquisition devices include image acquisition devices adapted to at least two climate type sets; when the climate information indicates that the current climate type belongs to a certain climate type set, the first night vision device determined based on the environmental information includes an image acquisition device adapted to that climate type set; optionally, the above-mentioned at least two climate type sets are classified based on the visibility of the corresponding scene type.
[0156] It is evident that implementing this device, which adaptively switches night vision display modes according to the current scene type, can adapt to more driving scenarios and improve user driving comfort without increasing costs.
[0157] In another optional embodiment, the image acquisition device includes a far-infrared camera and a near-infrared camera, and the above-mentioned at least two climate type sets include a first climate type set and a second climate type set, wherein the visibility of the climate type in the first climate type set is lower than the visibility of the climate type in the second climate type set; when the climate information indicates that the current climate type belongs to the first climate type set, the first night vision device is a far-infrared camera, and when the environmental information indicates that the current climate type belongs to the second climate type set, the first night vision device is a near-infrared camera.
[0158] In another optional embodiment, when at least two image acquisition devices are not abnormal, the first night vision device is determined from the image acquisition devices that are not abnormal; when only one image acquisition device is not abnormal, the first night vision device is the image acquisition device that is not abnormal.
[0159] It is evident that implementing this device can adaptively switch the night vision display mode based on whether there is an abnormality in the vehicle's image acquisition equipment, further reducing the occurrence of situations where the night vision display function cannot be realized due to abnormalities in the image acquisition equipment.
[0160] In another alternative embodiment, the abnormal situation may include one or more of the following: a failure of the image acquisition device, a failure of the associated device of the image acquisition device, or the lens of the image acquisition device being blocked. The associated device may include a device used to meet the image acquisition conditions of the corresponding image acquisition device.
[0161] In another optional embodiment, the mode switching component 302 is further configured to control the vehicle's display terminal to turn off the night vision display function when at least two of the above-mentioned image acquisition devices or their associated devices malfunction; and / or, control the vehicle's display terminal to turn off the night vision display function when at least two of the above-mentioned image acquisition devices are blocked, or, control the vehicle's display terminal to maintain the current night vision display state.
[0162] It is evident that this approach enables the response to more unforeseen circumstances and allows for the development of corresponding night vision display control strategies, thereby improving the accuracy and reliability of night vision display control.
[0163] In another optional embodiment, the mode switching component 302 is further configured to control the vehicle's display terminal to display an imaging image corresponding to a second night vision device that matches the night vision control signal when a user-triggered night vision display control signal is detected.
[0164] It is evident that implementing this device enables users to manually control the night vision display mode, increases the diversity of night vision display mode switching methods, and further enhances the user experience.
[0165] In another optional embodiment, as shown in FIG4, the above-mentioned at least two image acquisition devices may include at least two of the following: near-infrared camera, far-infrared camera, low-light CCD, and visible light camera.
[0166] It is evident that implementing this device enables the acquisition of data from various types of cameras, thereby increasing the diversity of night vision display modes.
[0167] Example 4
[0168] Please refer to Figure 8, which is a schematic diagram of the structure of another electronic device disclosed in an embodiment of this disclosure. As shown in Figure 8, the electronic device may include a processor 401, which is connected to a memory;
[0169] The processor 401 calls the executable program code stored in the memory to execute the steps in the night vision display control method described in Embodiment 1 or Embodiment 2 of this disclosure.
[0170] Example 5
[0171] This disclosure discloses a computer storage medium storing computer instructions that, when invoked, execute steps in the night vision display control method described in Embodiment 1 or Embodiment 2 of this disclosure.
[0172] Example 6
[0173] Please refer to Figure 9, which is a schematic diagram of the structure of a night vision system disclosed in an embodiment of this disclosure. As shown in Figure 9, the night vision system includes the electronic device described in Embodiment 3 or Embodiment 4 of this disclosure.
[0174] Example 7
[0175] Please refer to Figure 10, which is a structural schematic diagram of a vehicle disclosed in an embodiment of this disclosure. As shown in Figure 10, the vehicle may include the device described in Embodiment 3 or Embodiment 4 of this disclosure, or the night vision system described in Embodiment 6 of this disclosure.
[0176] Example 8
[0177] Embodiments of this disclosure disclose a computer program product including a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform the steps in the night vision display control method described in Embodiment 1 or Embodiment 2.
[0178] The system embodiments described above are merely illustrative. The components described as separate parts may or may not be physically separate. The components shown as components may or may not be physical components; that is, they may be located in one place or distributed across multiple network components. Some or all of the components can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.
[0179] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.
[0180] Finally, it should be noted that the night vision display control method, electronic device, night vision system, and vehicle disclosed in the embodiments of this application are merely preferred embodiments of this application and are only used to illustrate the technical solutions of this application, not to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.
Claims
1. A night vision display control method, wherein, The method is used to control a vehicle, and the method includes: Determine a first night vision device from at least two image acquisition devices of the vehicle that meets the current night vision requirements of the vehicle; The vehicle's display terminal is controlled to display the imaging image corresponding to the first night vision device.
2. The night vision display control method according to claim 1, wherein, The first night vision device is determined based on the image quality index of the preprocessed images corresponding to the at least two image acquisition devices and / or the environmental information of the vehicle's current location.
3. The night vision display control method according to claim 2, wherein, When only one of the image acquisition devices has an image quality index that meets the preset image quality requirements, the first night vision device is the image acquisition device whose image quality index meets the image quality requirements for the corresponding preprocessed image. When the image quality index of the preprocessed images corresponding to at least two of the image acquisition devices meets the image quality requirements, the first night vision device is determined from all image acquisition devices whose image quality index of the corresponding preprocessed images meets the image quality requirements based on the environmental information of the current location of the vehicle.
4. The night vision display control method according to claim 2 or 3, wherein, The image quality indicators include one or more of the following: image sharpness, image brightness, and image contrast of the corresponding preprocessed image.
5. The night vision display control method according to claim 2 or 3, wherein, The environmental information of the vehicle includes one or more of the following: climate information, light intensity information, temperature information, humidity information, visibility information, and road condition information.
6. The night vision display control method according to claim 5, wherein, The climate information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, and climate forecast information; and / or, The light intensity information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, and climate forecast information; and / or, The temperature information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, and climate forecast information; and / or, The humidity information is determined based on one or more of the following: sensor information collected by the vehicle's onboard sensors, and climate forecast information; and / or, The visibility information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, the vehicle's control signals, and climate forecast information; and / or, The road condition information is determined based on one or more of the following: images acquired by at least one of the image acquisition devices, sensor information acquired by the vehicle's onboard sensors, vehicle control signals, vehicle positioning information, and road condition data transmitted from the outside.
7. The night vision display control method according to claim 6, wherein, The images acquired by the at least one image acquisition device can be used to predict a first climate prediction result, and the sensing information acquired by the vehicle's on-board sensors and / or the vehicle's control signals can be used to predict a second climate prediction result. The climate information is determined based on one or more of the first climate prediction result, the second climate prediction result, and the climate forecast information.
8. The night vision display control method according to any one of claims 5-7, wherein, The at least two image acquisition devices include image acquisition devices adapted to at least two climate type sets; when the climate information indicates that the current climate type belongs to a certain climate type set, the first night vision device determined based on the environmental information includes an image acquisition device adapted to that climate type set.
9. The night vision display control method according to claim 8, wherein, The image acquisition device includes a far-infrared camera and a near-infrared camera. The at least two climate type sets include a first climate type set and a second climate type set. The visibility of the climate type in the first climate type set is lower than that of the climate type in the second climate type set. When the climate information indicates that the current climate type belongs to the first climate type set, the first night vision device is the far-infrared camera. When the environmental information indicates that the current climate type belongs to the second climate type set, the first night vision device is the near-infrared camera.
10. The night vision display control method according to any one of claims 1-9, wherein, When at least two of the image acquisition devices do not exhibit the abnormal condition, the first night vision device is determined from the image acquisition devices that do not exhibit the abnormal condition; When only one of the image acquisition devices is free from the abnormal situation, the first night vision device is the image acquisition device that is free from the abnormal situation.
11. The night vision display control method according to claim 10, wherein, The abnormal situation includes one or more of the following: the image acquisition device malfunctions, the associated device of the image acquisition device malfunctions, and the lens of the image acquisition device is blocked. The associated device includes a device used to meet the image acquisition conditions of the corresponding image acquisition device. The method further includes: When at least two image acquisition devices or their associated devices malfunction, the vehicle's display terminal is controlled to disable its night vision display function; and / or, When both of the image acquisition devices are blocked, the vehicle's display terminal is controlled to turn off the night vision display function, or the vehicle's display terminal is controlled to maintain the current night vision display state.
12. The night vision display control method according to any one of claims 1-11, wherein, The method further includes: When a user-triggered night vision display control signal is detected, the vehicle's display terminal is controlled to display an imaging image corresponding to a second night vision device that matches the night vision control signal.
13. The night vision display control method according to any one of claims 1-12, wherein, The at least two image acquisition devices include at least two of the following: near-infrared camera, far-infrared camera, low-light CCD, and visible light camera.
14. An electronic device, wherein, The device is used in a vehicle, and the device includes a mode determination component and a mode switching component, wherein: The mode determination component is used to determine a first night vision device from at least two image acquisition devices of the vehicle that meets the current night vision requirements of the vehicle. The mode switching component is used to control the vehicle's display terminal to display the imaging image corresponding to the first night vision device.
15. An electronic device, wherein, The device includes a processor connected to a memory; the processor calls the executable program code stored in the memory to execute the night vision display control method as described in any one of claims 1-13.
16. A computer storage medium employing the night vision display control method as described in any one of claims 1-13, wherein, The computer storage medium stores computer instructions, which, when invoked, are used to execute the night vision display control method as described in any one of claims 1-13.
17. A night vision system, wherein, The night vision system is used in a vehicle, and the night vision system includes the device as described in claim 14 or 15, and the night vision system further includes at least two image acquisition devices.
18. A vehicle, wherein, The vehicle includes the device of claim 14 or 15, or the night vision system of claim 17.
Citation Information
Patent Citations
Vehicular night vision system and control method thereof
CN102658798A
System and method for driver assistance in a vehicle
CN116653776A
Control method and system of automobile electronic outside rear-view mirror and storage medium
CN117104140A
Night vision display control method, electronic device, night vision system and vehicle
CN118474489A
On-vehicle night vision device and on-vehicle night vision method
WO2008078187A2