Control method and device of vehicle electronic rearview mirror system and vehicle
The vehicle electronic rearview mirror system addresses faults in camera and screen components by switching to backup signals, ensuring safety and reliability through timely fault detection and handling.
Patent Information
- Application Number
- CN202510438189.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-08
- Publication Date
- 2025-07-15
AI Technical Summary
The existing electronic exterior mirror system has a long data transmission link. Problems in any link will affect its normal operation, resulting in a decrease in safety and reliability.
By obtaining the pending video signal, detecting whether there is a physical connection failure or a hardware failure of the camera and the screen. If there is a failure, obtain the driving camera signal for processing, and display the video signal through the central control screen if necessary to ensure driving safety.
It realizes timely fault detection and processing of the electronic exterior rearview mirror system, improves driving safety and reliability, and ensures that the video signal can still be displayed normally when the camera and screen fail.
Smart Images

Figure CN120308010A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of vehicle control, and more particularly, to a control method, device, and vehicle for a vehicle electronic rearview mirror system. Background Art
[0002] With the rapid development of automotive electronic technology, electronic rearview mirrors (Camera Monitor System, CMS) for vehicles have been gradually popularized. The electronic rearview mirror mainly uses a rearview mirror camera to capture images of the rear outside the vehicle, and after processing the images, it is displayed in real time on the display screen of the rearview mirror inside the vehicle, thus replacing the traditional rearview mirror. Compared with the traditional rearview mirror, the electronic rearview mirror can ensure driving safety to a certain extent. However, the current data transmission link of the electronic rearview mirror is relatively long, and any problem in any link will affect the normal operation of the electronic rearview mirror, thus affecting the safe use of the electronic rearview mirror. Summary of the Invention
[0003] In view of the above problems, the present application provides a control method, device, and vehicle for a vehicle electronic rearview mirror system to solve the above problems.
[0004] In a first aspect, the present application provides a control method for a vehicle electronic rearview mirror system, the method comprising: obtaining a video signal to be processed, the video signal to be processed including video signals captured by the left external rearview mirror camera and / or the right external rearview mirror camera; if the video signal to be processed does not meet a preset condition, and there is a physical connection failure or a hardware failure in the left external rearview mirror camera and / or the right external rearview mirror camera, obtaining a driving camera signal in the corresponding direction; processing the driving camera signal to obtain a video signal to be displayed; if the video signal to be displayed does not meet a preset condition, and there is a physical connection failure or a hardware failure in the left screen of the electronic rearview mirror and / or the right screen of the electronic rearview mirror, displaying the video signal to be displayed at a corresponding position on the central control screen.
[0005] Second aspect, the present application provides a control device for a vehicle electronic rearview mirror system. The device includes: a video signal to be processed acquisition module for acquiring a video signal to be processed, where the video signal to be processed includes video signals captured by the left external rearview mirror camera and / or the right external rearview mirror camera; a shooting control module for acquiring a driving camera signal in the corresponding direction if the video signal to be processed does not meet the preset conditions and there is a physical connection fault or hardware fault in the left external rearview mirror camera and / or the right external rearview mirror camera; a video signal to be displayed acquisition module for processing the driving camera signal to obtain a video signal to be displayed; a display control module for displaying the video signal to be displayed at the corresponding position of the central control screen if the video signal to be displayed does not meet the preset conditions and there is a physical connection fault or hardware fault in the left screen of the electronic rearview mirror and / or the right screen of the electronic rearview mirror.
[0006] Third aspect, the present application provides a vehicle, including one or more processors and a memory; one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the above-mentioned method.
[0007] Fourth aspect, the present application provides a computer-readable storage medium, in which program code is stored, and when the program code runs, it executes the above-mentioned method.
[0008] The control method, device, vehicle and storage medium provided by the present application, by acquiring a video signal to be processed, where the video signal to be processed includes video signals captured by the left external rearview mirror camera and / or the right external rearview mirror camera; if the video signal to be processed does not meet the preset conditions and there is a physical connection fault or hardware fault in the left external rearview mirror camera and / or the right external rearview mirror camera, acquiring a driving camera signal in the corresponding direction; processing the driving camera signal to obtain a video signal to be displayed; if the video signal to be displayed does not meet the preset conditions and there is a physical connection fault or hardware fault in the left screen of the electronic rearview mirror and / or the right screen of the electronic rearview mirror, displaying the video signal to be displayed at the corresponding position of the central control screen. Thus, by timely detecting faults in the cameras and screens of the electronic rearview mirror and performing corresponding processing when there are faults in the cameras and / or screens of the electronic rearview mirror, driving safety can be ensured, and further the safety and reliability of using the electronic rearview mirror can be improved. Description of the Drawings
[0009] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, without creative efforts, other drawings can be obtained based on these drawings.
[0010] Figure 1 The flowchart of a control method for a vehicle electronic rearview mirror system proposed in an embodiment of the present application is shown.
[0011] Figure 2 shown Figure 1 the flowchart of step S110 in
[0012] Figure 3 shown Figure 1 the flowchart of step S130 in
[0013] Figure 4 The structural block diagram of the vehicle electronic rearview mirror system provided in the embodiment of the present application is shown.
[0014] Figure 5 The flowchart of a control method for a vehicle electronic rearview mirror system proposed in another embodiment of the present application is shown.
[0015] Figure 6 The flowchart of a control method for a vehicle electronic rearview mirror system proposed in yet another embodiment of the present application is shown.
[0016] Figure 7 The structural block diagram of a control device for a vehicle electronic rearview mirror system proposed in the embodiment of the present application is shown.
[0017] Figure 8 The structural block diagram of a vehicle proposed in the present application is shown. Detailed implementation manners
[0018] The following will clearly and completely describe the technical solutions in the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present application.
[0019] In an embodiment of the present application, the inventor proposes a control method, device, and vehicle for a vehicle electronic rearview mirror system. By obtaining a video signal to be processed, the video signal to be processed includes the video signal captured by the left external rearview mirror camera and / or the right external rearview mirror camera; if the video signal to be processed does not meet the preset conditions, and there is a physical connection failure or hardware failure in the left external rearview mirror camera and / or the right external rearview mirror camera, obtain the driving camera signal in the corresponding direction; process the driving camera signal to obtain a video signal to be displayed; if the video signal to be displayed does not meet the preset conditions, and there is a physical connection failure or hardware failure in the left screen of the electronic rearview mirror and / or the right screen of the electronic rearview mirror, display the video signal to be displayed at the corresponding position of the central control screen. Thus, by timely detecting the faults of the cameras and screens of the electronic rearview mirror, and performing corresponding processing when there are faults in the cameras and / or screens of the electronic rearview mirror, driving safety can be ensured, and further the safety and reliability of using the electronic rearview mirror can be improved.
[0020] Please refer to Figure 1 , which is a control method for a vehicle electronic rearview mirror system provided by an embodiment of the present application. The vehicle electronic rearview mirror system includes a left external rearview mirror camera, a right external rearview mirror camera, a driving camera, a left screen of the electronic rearview mirror, a right screen of the electronic rearview mirror, and a central control screen. This control method of the vehicle electronic rearview mirror system can be applied to a vehicle, and specifically can be used to adjust the shooting method of the electronic rearview mirror according to the faults of the electronic rearview mirror cameras of the vehicle, and to adjust the display method of the electronic rearview mirror according to the faults of the electronic rearview mirror screens of the vehicle. The method includes:
[0021] Step S110: Obtain a video signal to be processed, where the video signal to be processed includes the video signal captured by the left external rearview mirror camera and / or the right external rearview mirror camera.
[0022] In the embodiment of the present application, the video signal to be processed can be understood as a video signal to be subjected to image processing. The video signal to be processed may include the video signal captured by the left external rearview mirror camera and / or the right external rearview mirror camera of the electronic rearview mirror from the rear outside the vehicle.
[0023] It can be understood that the video signal captured by the left external rearview mirror camera and / or the right external rearview mirror camera of the electronic rearview mirror may inevitably affect the subsequent display effect due to reasons such as light brightness, color clarity, visibility, or occlusion. Therefore, before displaying the image content corresponding to these video signals, it is necessary to perform corresponding degrees of image processing on these video signals. Thus, these video signals can be obtained as the video signal to be processed.
[0024] In the embodiments of the present application, the vehicle electronic rearview mirror system may further include a cockpit host, and the cockpit host includes a first video deserialization unit, which is communicatively connected to the left outside rearview mirror camera and the right outside rearview mirror camera of the electronic outside rearview mirror respectively. Optionally, the first video deserialization unit and the left outside rearview mirror camera of the electronic outside rearview mirror, as well as the first video deserialization unit and the right outside rearview mirror camera of the electronic outside rearview mirror, may be connected by cables.
[0025] In this way, please refer to Figure 2 , as an embodiment, step S110 may include:
[0026] Step S111: Obtain a first video signal captured by the left outside rearview mirror camera and / or the right outside rearview mirror camera, and serialize the first video signal and then input it into the first video deserialization unit.
[0027] In the process of obtaining the video signal to be processed, as an embodiment, the first video signal captured by the left outside rearview mirror camera and / or the right outside rearview mirror camera of the electronic outside rearview mirror may be obtained first. Optionally, if the left outside rearview mirror camera or the right outside rearview mirror camera captures a video signal, then the first video signal includes one type of video signal; if both the left outside rearview mirror camera and the right outside rearview mirror camera capture video signals, then the first video signal includes two types of video signals.
[0028] In order to make the first video signal transmit over a longer distance, video serialization processing may be performed on the first video signal inside the outside rearview mirror camera, and the serialized video signal is transmitted to the first video deserialization unit of the cockpit host in real time through LVDS (Low Voltage Differential Signaling, a communication method).
[0029] Step S112: Obtain the video stream output after the first video deserialization unit deserializes the serialized first video signal, as the video signal to be processed.
[0030] The first video deserialization unit will perform deserialization processing on the serialized first video signal and output a video stream. As an embodiment, the video stream output after deserialization may be used as the video signal to be processed.
[0031] Step S120: If the video signal to be processed does not meet the preset conditions, and there is a physical connection failure or a hardware failure in the left outside rearview mirror camera and / or the right outside rearview mirror camera, obtain the driving camera signal in the corresponding direction.
[0032] In this embodiment, the preset condition represents a stable high-level signal. Optionally, if the video signal to be processed meets the preset condition, it indicates that the video signal output by the first video deserializer is a stable high-level signal; if the video signal to be processed does not meet the preset condition, it indicates that the video signal output by the first video deserializer is not a stable high-level signal (for example, a low-level signal).
[0033] Among them, if the video signal to be processed does not meet the preset condition, there may be a fault in the connection link between the exterior rearview mirror camera and the cockpit host. To ensure the stable transmission of the video signal to be processed subsequently, it is possible to detect whether there is a fault in the left exterior rearview mirror camera and the right exterior rearview mirror camera of the electronic exterior rearview mirror. The specific detection method can refer to the subsequent relevant description.
[0034] As an implementation manner, if there is a physical connection fault or a hardware fault in the left exterior rearview mirror camera and / or the right exterior rearview mirror camera of the electronic exterior rearview mirror, it will affect the stability and accuracy of the transmission of the video signal to be processed. To solve this problem, it is possible to obtain the driving camera signal in the corresponding direction and use the driving camera signal as the video signal to be processed.
[0035] Among them, if there is a physical connection fault or a hardware fault in the left exterior rearview mirror camera of the electronic exterior rearview mirror, the driving camera signal in the left direction of the vehicle can be obtained. That is, the corresponding direction at this time can be understood as the left direction of the vehicle; if there is a physical connection fault or a hardware fault in the right exterior rearview mirror camera of the electronic exterior rearview mirror, the driving camera signal in the right direction of the vehicle can be obtained. That is, the corresponding direction at this time can be understood as the right direction of the vehicle. Optionally, the specific installation position of the driving camera may not be limited. It can be on the side of the vehicle (i.e., the vehicle body), or on the head or tail of the vehicle, and the specific can be not limited.
[0036] As an implementation manner, if there is a physical connection fault in the (left or right) exterior rearview mirror camera of the electronic exterior rearview mirror, it indicates that there is a fault in the connection link between the (left or right) exterior rearview mirror camera and the cockpit host. Optionally, the physical connection fault cannot be restored through software, so it is necessary to temporarily call the driving camera signal in the corresponding direction.
[0037] As an implementation manner, if there is a hardware fault in the (left or right) rearview mirror camera of the electronic exterior rearview mirror, regardless of whether the hardware fault can be restored, in order to be able to provide the driver with the exterior rearview mirror video image in a timely or real-time manner to ensure driving safety, it is possible to directly call the driving camera signal in the corresponding direction when it is detected that there is a hardware fault in the (left or right) rearview mirror camera of the electronic exterior rearview mirror.
[0038] Step S130: Process the driving camera signal to obtain the video signal to be displayed.
[0039] In the embodiments of the present application, the cockpit host may further include a cockpit SOC chip and a first video serializer chip. The cockpit SOC chip is communicatively connected to the first video serializer chip. The first video serializer chip is communicatively connected to the left screen of the electronic outside rearview mirror and the right screen of the electronic outside rearview mirror respectively. The left screen of the electronic outside rearview mirror includes a second video deserialization chip, and the right screen of the electronic outside rearview mirror includes a third video deserialization chip.
[0040] In the above manner, please refer to Figure 3 , as an implementation manner, step S130 may include:
[0041] Step S131: Perform image processing on the driving camera signal through the cockpit SOC chip, and transmit the processing result to the first video serializer chip.
[0042] In the case where the video signal to be processed does not meet the preset conditions, and there are physical connection failures or hardware failures in the left outside rearview mirror camera and / or the right outside rearview mirror camera of the electronic outside rearview mirror, the obtained driving camera signal will be sent to the cockpit SOC chip. Therefore, as an implementation manner, the cockpit SOC chip can perform image processing on the driving camera signal and transmit the processing result to the first video serializer chip.
[0043] In this embodiment, performing image processing on the driving camera signal through the cockpit SOC chip may include: performing cropping processing, dead pixel correction processing, noise reduction processing, black level correction processing, chromatic aberration correction processing, automatic white balance processing, demosaicing processing, color restoration processing, contrast correction processing, purple fringing correction processing, dehazing processing, color enhancement processing, noise processing, distortion correction processing, size adjustment, tone mapping processing, noise reduction processing, edge enhancement processing, contrast adjustment, and high brightness suppression processing on the driving camera signal through the cockpit SOC chip.
[0044] Specifically, the cockpit SOC chip can first crop the driving camera signal (which can be understood as the video signal to be processed here) to obtain the video image within the effective attention range (wherein, since some video images are wide-angle views, and the range that the driver actually needs to pay attention to may be the adjacent lanes of the current lane, the range that the driver actually needs to pay attention to is determined as the effective attention range); then correct the bad pixels of the cropped video image to eliminate some interfering video signals; then perform video noise reduction processing on the video image after bad pixel correction to filter out environmental noise; then correct the black level and color difference of the video image after noise reduction to repair the color difference; then perform automatic white balance, demosaicing, and color restoration on the video image after color difference correction to obtain a more realistic image; then perform contrast (Gamma) correction, purple fringing correction, and defogging processing on the color-restored image to obtain a clearer image; then perform color enhancement and noise processing on the defogged image to obtain a clearer image; then perform distortion correction processing, size adjustment, and tone mapping processing on the image after noise processing to better adapt to the display screen of the electronic outside rearview mirror; then perform noise reduction processing, edge enhancement processing, contrast adjustment, and high-brightness suppression processing on the image after tone mapping processing to provide a more realistic and comfortable display effect for the electronic outside rearview mirror screen. It should be noted that the implementation principles and implementation processes of the above specific processing procedures for image processing will not be elaborated here.
[0045] Step S132: Perform serialization processing on the processing result through the first video serializer chip to obtain the video stream to be displayed.
[0046] As an implementation manner, the first video serializer chip can perform serialization processing on the processing result after image processing to obtain the video stream to be displayed. Among them, the specific implementation principles and implementation processes of serialization processing will not be elaborated here.
[0047] The first video serializer chip will transmit the video stream to be displayed to the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror to implement the display of the video signal to be displayed.
[0048] Step S133: Perform deserialization processing on the video stream to be displayed through the second video deserializer and / or the third video deserializer to obtain the video signal to be displayed.
[0049] The video stream to be displayed transmitted to the left screen of the electronic outside rearview mirror will enter the second video deserializer, and the video stream to be displayed transmitted to the right screen of the electronic outside rearview mirror will enter the third video deserializer. As an implementation manner, the second video deserializer and / or the third video deserializer can perform deserialization processing on the video stream to be displayed to obtain the video signal to be displayed.
[0050] Step S140: If the video signal to be displayed does not meet the preset conditions, and there is a physical connection fault or hardware fault in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror, the video signal to be displayed is displayed at the corresponding position of the central control screen.
[0051] In this embodiment, before displaying the video signal to be displayed, it can be detected first whether the video signal to be displayed is stable. Optionally, if the video signal to be displayed meets the preset conditions, it indicates that the video signal to be displayed output by the second video deserialization unit and / or the third video deserialization unit is a stable high-level signal; if the video signal to be displayed does not meet the preset conditions, it indicates that the video signal to be displayed output by the second video deserialization unit and / or the third video deserialization unit is not a stable high-level signal.
[0052] Among them, if the video signal to be displayed does not meet the preset conditions, there may be a fault in the connection link between the electronic outside rearview mirror screen and the cockpit host. To ensure that the video signal to be displayed can be normally displayed, it can be detected first whether there is a fault in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror. The specific detection process can refer to the subsequent relevant description.
[0053] As an implementation manner, if there is a physical connection fault or hardware fault in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror, it will affect the normal display of the video signal to be displayed. To avoid this problem, the central control screen can be called, and the video signal to be displayed is displayed at the corresponding position of the central control screen. It should be noted that the corresponding position can be understood as the position corresponding to the direction where the electronic outside rearview mirror screen is located. For example, if there is a physical connection fault or hardware fault in the left screen of the electronic outside rearview mirror, the video signal to be displayed can be displayed on the left half of the central control screen. At this time, the corresponding position is the left half of the central control screen; and if there is a physical connection fault or hardware fault in the right screen of the electronic outside rearview mirror, the video signal to be displayed can be displayed on the right half of the central control screen. At this time, the corresponding position is the right half of the central control screen; optionally, if there are physical connection faults or hardware faults in both the left screen and the right screen of the electronic outside rearview mirror, the video signal to be displayed can be displayed on the entire central control screen. At this time, the corresponding position is the entire central control screen.
[0054] In a specific application scenario, please refer to Figure 4 which shows the structural block diagram of the vehicle electronic rearview mirror system provided by the embodiment of the present application. As Figure 4As shown in the figure, the vehicle electronic rearview mirror system includes components such as a cockpit host, an intelligent driving host, an electronic rearview mirror screen (left), an electronic rearview mirror screen (right), a central control screen, an instrument screen, a left outer rearview mirror camera, a right outer rearview mirror camera, a driving camera (left side), and a driving camera (right side). Among them, the driving camera is communicatively connected to the intelligent driving host and can be controlled through the intelligent driving host; the outer rearview mirror camera is communicatively connected to the cockpit host through a cable, and the outer rearview mirror camera can be controlled through the cockpit host. The intelligent driving host and the cockpit host are communicatively connected through Ethernet.
[0055] The original video signal captured by the outer rearview mirror camera can be video-encoded through the serializer in the outer rearview mirror camera and then transmitted to the video deserializer chip of the cockpit host. The video deserializer chip deserializes the original video signal and transmits it to the cockpit SOC chip. The ISP in the cockpit SOC chip performs image processing on the deserialized video signal, and after the processing is completed, it is transmitted to the video serializer chip 2 and finally transmitted to the electronic rearview mirror screen for display. Among them, the electronic rearview video screen is also connected to the cockpit host through a cable. The electronic rearview video screen includes a video deserializer and an LCD module. The video signal transmitted to the electronic rearview mirror screen will first be deserialized by the video deserializer and then displayed through the LCD module.
[0056] Among them, when it is necessary to call the video signal captured by the driving camera, the cockpit SOC chip of the cockpit host can send a driving camera signal acquisition request to the intelligent driving host to obtain the video signal captured by the driving camera. When it is necessary to call the central control screen to display the video signal to be displayed, the cockpit SOC chip can transmit the video signal to be displayed to the video serializer chip 1. The video serializer chip 1 encodes the video signal to be displayed and then transmits it to the video deserializer of the central control screen for deserialization, and then the video signal to be displayed is displayed through the LCD module of the central control screen.
[0057] A control method for a vehicle electronic rearview mirror system provided in this embodiment includes obtaining a video signal to be processed, where the video signal to be processed includes video signals captured by the left external rearview mirror camera and / or the right external rearview mirror camera; if the video signal to be processed does not meet a preset condition and there is a physical connection fault or a hardware fault in the left external rearview mirror camera and / or the right external rearview mirror camera, obtaining a driving camera signal in the corresponding direction; processing the driving camera signal to obtain a video signal to be displayed; if the video signal to be displayed does not meet a preset condition and there is a physical connection fault or a hardware fault in the left screen of the electronic rearview mirror and / or the right screen of the electronic rearview mirror, displaying the video signal to be displayed at the corresponding position of the central control screen. Thus, by timely detecting faults in the cameras and screens of the electronic rearview mirror and performing corresponding processing when there are faults in the cameras and / or screens of the electronic rearview mirror, driving safety can be ensured, and further the safety and reliability of using the electronic rearview mirror can be improved.
[0058] Please refer to Figure 5 , which is a control method for a vehicle electronic rearview mirror system provided in another embodiment of this application. This control method for the vehicle electronic rearview mirror system can be applied to a vehicle, and specifically can be used to adjust the shooting mode of the electronic rearview mirror according to the faults of the vehicle's electronic rearview mirror cameras, and to adjust the display mode of the electronic rearview mirror according to the faults of the vehicle's electronic rearview mirror screens. This embodiment mainly describes how to determine that there is a fault in the electronic rearview mirror camera and how to determine that there is a fault in the electronic rearview mirror screen. The method includes:
[0059] Step S210: Obtain a video signal to be processed, where the video signal to be processed includes video signals captured by the left external rearview mirror camera and / or the right external rearview mirror camera.
[0060] Among them, the specific implementation of step S210 can refer to the relevant description of step S110 in the foregoing embodiment, and will not be elaborated here.
[0061] Step S221: If the video signal to be processed is stable within a specified duration, determine that the video signal to be processed meets a preset condition.
[0062] As an implementation, when determining whether the video signal to be processed meets a preset condition, it can be detected whether the video signal to be processed is stable within a specified duration. Among them, the specific value of the specified duration can be not limited. For example, the specified duration can be 10 seconds, 20 seconds, or 30 seconds, etc. It can be understood that if the video signal to be processed is a high-level signal, then it can be considered that the video signal to be processed is stable and normal; and if the video signal to be processed is a low-level signal, then it can be considered that the video signal to be processed is unstable or abnormal.
[0063] Therefore, as an implementation, it is possible to continuously detect whether the video signal to be processed is a high-level signal within a specified duration. Optionally, if the video signal to be processed is a high-level signal throughout the specified duration, it can be considered that the video signal to be processed is stable within the specified duration. At this time, it can be determined that the video signal to be processed meets the preset conditions. That is to say, after step S221, the content of S231 can be executed.
[0064] Here, it should be noted that the video signal to be processed being stable within the specified duration means that the video signal to be processed is a high-level signal within the specified duration and there is no jump. At this time, it is considered that the video signal to be processed is in a stable state within the specified duration, that is, the video signal to be processed is stable within the specified duration.
[0065] Step S222: If the video signal to be processed is unstable within the specified duration, it is determined that the video signal to be processed does not meet the preset conditions.
[0066] Optionally, if the video signal to be processed is a low-level signal within the specified duration or not all high-level signals, it can be considered that the video signal to be processed is unstable or abnormal within the specified duration. At this time, it can be determined that the video signal to be processed does not meet the preset conditions.
[0067] Among them, if there is a jump in the level signal of the video signal to be processed within the specified duration, for example, it is a high-level signal at one moment and a low-level signal at another moment, it can be determined that the video signal to be processed is in an unstable state within the specified duration, that is, the video signal to be processed is unstable within the specified duration.
[0068] In this implementation, if the video signal to be processed does not meet the preset conditions, there may be a fault in the electronic outside rearview mirror camera at this time. To ensure driving safety, it is possible to start detecting the link status (LVDS) between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host.
[0069] Optionally, if the wiring harness link between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host is open or shorted, it can be determined that there is a physical connection fault with the left outside rearview mirror camera and / or the right outside rearview mirror camera. Specifically, if the wiring harness link between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host is open or shorted, to avoid misjudgment, the link status between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host can be detected at least one more time. If the result obtained is still that the wiring harness link between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host is open or shorted, it can be considered that there is a problem with the wiring harness or the connector between the cockpit host and the outside rearview mirror camera. At this time, it can be determined that there is a physical connection fault between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host.
[0070] Optionally, if the wiring harness link between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host is not open or not shorted, it may be that there is a hardware fault with the camera or a hardware fault with the cockpit host. Taking the judgment of the hardware fault of the camera as an example, at this time, at least one of the registers of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the registers of the first video deserializer, the signal quality of the transmission link of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the software of the left outside rearview mirror camera and / or the right outside rearview mirror camera, and the software of the first video deserializer can be detected. Among them, if no fault is found after detecting the registers of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the detection of subsequent other faults can be continued until all fault types are detected; if a fault is found after detecting the registers of the left outside rearview mirror camera and / or the right outside rearview mirror camera, it can be considered that there is a hardware fault with the outside rearview mirror camera. At this time, the subsequent hardware fault detection process can be ended.
[0071] Optionally, when detecting the registers of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the detected registers can be compared with the registers of the outside rearview mirror camera under normal conditions to confirm whether the registers are consistent. Optionally, if the registers are consistent, it means that there is no fault with the registers of the outside rearview mirror camera; if the registers are inconsistent, it means that there is a fault with the registers of the outside rearview mirror camera.
[0072] Optionally, the principle and implementation process of the register fault judgment of the first video deserializer are similar to the principle and judgment process of the register fault, and will not be elaborated here.
[0073] Optionally, if no fault is found in the registers of the first video deserialization device after the judgment, the signal quality of the transmission link of the left outer rearview mirror camera and / or the right outer rearview mirror camera can be further judged. Specifically, the LVDS eye diagram of the outer rearview mirror camera link can be compared with the normal eye diagram to judge the LVDS signal quality. Optionally, if the LVDS eye diagram of the outer rearview mirror camera link is not within the normal range, the spread spectrum function of the video deserialization device chip shown in Figure 4 can be turned off first to improve the signal quality of the above transmission link. Optionally, if the video signal to be processed is still unstable after being turned off, it can be determined that the signal quality of the transmission link of the left outer rearview mirror camera and / or the right outer rearview mirror camera is poor, that is, there is a hardware fault in the outer rearview mirror camera; if the video signal to be processed tends to be stable after being turned off, it can be determined that the signal quality of the transmission link of the left outer rearview mirror camera and / or the right outer rearview mirror camera is good, that is, there is no hardware fault in the outer rearview mirror camera. Optionally, if there is no hardware fault, it is necessary to continue to judge whether there is a fault in the software of the left outer rearview mirror camera and / or the right outer rearview mirror camera. If there is a hardware fault, it can be directly determined that there is a hardware fault in the camera, and the judgment process of the hardware fault can be ended at this time. Figure 4 Optionally, if the LVDS eye diagram of the outer rearview mirror camera link is within the normal range, it is necessary to continue to judge whether there is a fault in the software of the left outer rearview mirror camera and / or the right outer rearview mirror camera. At this time, the outer rearview mirror camera needs to be powered on and off again, and then it is judged whether the video signal to be processed is stable. If it is stable, it means that there is no fault in the software of the left outer rearview mirror camera and / or the right outer rearview mirror camera, and it is necessary to continue to judge whether there is a fault in the software of the first video deserialization device; if it is not stable, it means that there is a fault in the software of the left outer rearview mirror camera and / or the right outer rearview mirror camera. At this time, it can be directly considered that there is a fault in the outer rearview mirror camera, and the judgment process of the hardware fault can be ended.
[0074] Optionally, if there is a fault in the software of the first video deserialization device, it can be directly considered that there is a fault in the outer rearview mirror camera, and the judgment process of the hardware fault can be ended; if there is no fault in the software of the first video deserialization device, the first video deserialization device can be powered on and off again, and then the outer rearview mirror camera can be re-initialized, and then it is judged whether the video signal to be processed is stable. Optionally, if it is not stable, it means that there is hardware loss in the electronic outer rearview mirror camera or the first video deserialization device is hardware damaged. At this time, it can be directly considered that there is a fault in the outer rearview mirror camera, and the judgment process of the hardware fault can be ended.
[0075]
[0076] Among them, if there is a fault in the register of the left exterior rearview mirror camera and / or the right exterior rearview mirror camera, the register of the first video deserializer, the signal quality of the transmission link of the left exterior rearview mirror camera and / or the right exterior rearview mirror camera, the software of the left exterior rearview mirror camera and / or the right exterior rearview mirror camera, or the software of the first video deserializer, it can be determined that there is a hardware fault in the left exterior rearview mirror camera and / or the right exterior rearview mirror camera. That is to say, as long as there is any one of the above-mentioned faults in the exterior rearview mirror camera, it can be considered that its hardware is faulty.
[0077] In this embodiment, before determining that there is a hardware fault in the left exterior rearview mirror camera and / or the right exterior rearview mirror camera, at least one of the register of the left exterior rearview mirror camera and / or the right exterior rearview mirror camera, the register of the first video deserializer, the signal quality of the transmission link of the left exterior rearview mirror camera and / or the right exterior rearview mirror camera, the software of the left exterior rearview mirror camera and / or the right exterior rearview mirror camera, and the software of the first video deserializer can be repaired accordingly; if the result after repair still does not meet the preset conditions, it can be determined that there is a hardware fault in the left exterior rearview mirror camera and / or the right exterior rearview mirror camera.
[0078] Taking the above-mentioned fault judgment of the register of the left exterior rearview mirror camera and / or the right exterior rearview mirror camera as an example, optionally, if there is a fault in the register, the register of the exterior rearview mirror camera needs to be reconfigured. At this time, a reconfiguration attempt can be made for repair. If it is found that the video signal to be processed meets the preset conditions after configuration, it means that the register fault has been repaired. If it is found that the video signal to be processed still cannot meet the preset conditions after configuration, it means that the register fault has not been repaired. At this time, it can be directly determined that there is a hardware fault in the exterior rearview mirror camera, and the detection process of the hardware fault ends.
[0079] Step S231: Process the video signal to be processed to obtain a video signal to be displayed.
[0080] As an implementation manner, when the video signal to be processed meets the preset conditions, it means that there is no physical connection fault or hardware fault in the left exterior rearview mirror camera and / or the right exterior rearview mirror camera of the electronic rearview mirror. At this time, the video signal to be processed can be directly processed to obtain a video signal to be displayed. Among them, the specific processing process can refer to the relevant description of the foregoing embodiment and will not be elaborated here.
[0081] Step S232: If there is a physical connection fault or a hardware fault in the left exterior rearview mirror camera and / or the right exterior rearview mirror camera, obtain the driving camera signal in the corresponding direction.
[0082] Among them, the specific implementation of step S232 can refer to the relevant description of step S120 in the foregoing embodiment and will not be elaborated here.
[0083] Step S242: Process the driving camera signal to obtain a video signal to be displayed.
[0084] Among them, the specific implementation of step S242 can refer to the relevant description of step S130 in the foregoing embodiments, and will not be elaborated here.
[0085] Step S251: If the video signal to be displayed meets the preset conditions, display the video signal to be displayed through the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror.
[0086] In this embodiment, regardless of whether the driving camera signal is called before, before displaying the video signal to be displayed, in order to ensure the normal display of the video signal to be displayed, it can be determined whether there is a physical connection failure or a hardware failure in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror. Among them, the principle and process of judging whether there is a physical connection failure in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror are similar or the same as the principle and process of judging whether there is a physical connection failure in the left outside rearview mirror camera and / or the right outside rearview mirror camera; and the principle and process of judging whether there is a hardware failure in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror are similar or the same as the principle and process of judging whether there is a hardware failure in the left outside rearview mirror camera and / or the right outside rearview mirror camera, and will not be elaborated here.
[0087] As an implementation manner, if the video signal to be displayed meets the preset conditions, it can be considered that the video signal to be displayed output by the video deserializer of the electronic outside rearview mirror screen is stable. At this time, it means that there is no physical connection failure or hardware failure in the electronic outside rearview mirror screen, and the video signal to be displayed can be directly displayed through the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror.
[0088] Step S252: If the video signal to be displayed does not meet the preset conditions, and there is a physical connection failure or a hardware failure in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror, display the video signal to be displayed at the corresponding position of the center control screen.
[0089] Optionally, if the video signal to be displayed does not meet the preset conditions, it can be considered that the video signal to be displayed output by the video deserializer of the electronic outside rearview mirror screen is unstable. At this time, it means that there is a physical connection failure or a hardware failure in the electronic outside rearview mirror screen, so the center control screen needs to be called and the video signal to be displayed is displayed at the corresponding position of the center control screen.
[0090] Among them, other specific implementations of step S252 can refer to the relevant description of step S140 in the foregoing embodiments, and will not be elaborated here.
[0091] A control method for a vehicle electronic rearview mirror system provided in this embodiment can ensure driving safety and then improve the safety and reliability of using the electronic rearview mirror by timely detecting faults in the cameras and screens of the electronic outside rearview mirrors and performing corresponding processing in the case of faults in the cameras and / or screens of the electronic outside rearview mirrors.
[0092] At the same time, by making multiple judgments on whether there are physical connection faults or hardware faults in the left outside rearview mirror camera and / or the right outside rearview mirror camera of the electronic outside rearview mirror, the effectiveness of the shooting by the electronic rearview mirror camera can be ensured. Further, by making multiple judgments on whether there are physical connection faults or hardware faults in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror, the display effectiveness of the electronic rearview mirror screen can be ensured, so that the working process of the outside electronic rearview mirror can be overall controlled, the safety of the electronic rearview mirror system can be improved, and then the driving safety of the whole vehicle can be improved.
[0093] Please refer to Figure 6 , a control method for a vehicle electronic rearview mirror system provided in another embodiment of the present application. This control method for the vehicle electronic rearview mirror system can be applied to a vehicle and is specifically used to adjust the shooting mode of the electronic outside rearview mirror according to the faults of the cameras of the electronic outside rearview mirror of the vehicle, and to adjust the display mode of the electronic outside rearview mirror according to the faults of the screens of the electronic outside rearview mirror of the vehicle. The electronic rearview mirror system of the present application is integrated on the cockpit host, so this embodiment mainly describes some auxiliary functions of the electronic rearview mirror integrated on the cockpit host. The method includes:
[0094] Step S310: Obtain a video signal to be processed, where the video signal to be processed includes the video signals captured by the left outside rearview mirror camera and / or the right outside rearview mirror camera.
[0095] Among them, the specific implementation of step S310 can refer to the relevant description of step S110 in the foregoing embodiment and will not be elaborated here.
[0096] Step S320: If the video signal to be processed does not meet the preset conditions and there are physical connection faults or hardware faults in the left outside rearview mirror camera and / or the right outside rearview mirror camera, obtain the driving camera signal in the corresponding direction.
[0097] Among them, the specific implementation of step S320 can refer to the relevant description of step S120 in the foregoing embodiment and will not be elaborated here.
[0098] Step S330: Process the driving camera signal to obtain a video signal to be displayed.
[0099] Among them, the specific implementation of step S330 may refer to the relevant description of step S130 in the foregoing embodiments, and will not be elaborated here.
[0100] Step S341: If the video signal to be displayed meets a preset condition, display the video signal to be displayed through the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror.
[0101] As can be seen from the foregoing relevant description, when the video signal to be displayed meets the preset condition, the video signal to be displayed can be directly displayed through the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror.
[0102] In this embodiment, the electronic outside rearview mirror can provide different field of views according to different scenarios.
[0103] For example, when the vehicle is in a normal driving state (for example, driving on a straight road), the electronic outside rearview mirror can provide a default field of view. Correspondingly, the electronic outside rearview mirror screen can also display the video signal to be displayed in a normal view. Optionally, the field of view at this time can include the adjacent lanes of the lane where the vehicle is driving, so as to facilitate checking for oncoming vehicles from behind and ensure driving safety.
[0104] When the vehicle is in a turning state, a door-opening state, or a field-of-view switching state (optionally, as Figure 4 shown, the cockpit host can obtain the state of the whole vehicle through a CAN (Controller Area Network, a communication protocol) signal, including turning, door opening, reverse gear, etc.), the electronic outside rearview mirror can provide a wide-angle field of view. In this way, the video signal to be displayed can be displayed in a wide-angle view through the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror.
[0105] When the vehicle is in a reverse gear state, the electronic outside rearview mirror camera and radar can identify oncoming vehicles or obstacles from the side of the vehicle; or, the intelligent driving host collects the information of the intelligent driving camera (i.e., the driving camera) and radar information, identifies the vehicles, pedestrians, objects, etc. behind the vehicle, and transmits the recognition result to the cockpit host through Ethernet. In this way, the electronic outside rearview mirror screen can display reminder icons for oncoming vehicles or obstacles behind the vehicle to prompt the driver to pay attention to driving safety, and at the same time, overtaking warning and lane-changing warning can be realized.
[0106] Optionally, the cockpit host in this embodiment can run on the Android system, while the electronic rearview mirror system can run on the QNX system (a commercial POSIX-compliant Unix-like real-time operating system), so that the electronic outside rearview mirror application can be run through an independent system, which can achieve a fast startup of the electronic outside rearview mirror and improve the user experience.
[0107] Step S342: If the video signal to be displayed does not meet the preset conditions, and there is a physical connection failure or hardware failure in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror, display the video signal to be displayed at the corresponding position of the central control screen.
[0108] Among them, for the specific implementation of step S342, reference can be made to the relevant description of step S140 in the foregoing embodiments, which will not be elaborated here.
[0109] Optionally, the central control screen in this embodiment may also have the function of displaying a wide-angle view.
[0110] Optionally, in order to improve the safety warning effect of the electronic outside rearview mirror, when the video signal to be displayed is displayed through the central control screen, a voice prompt for the screen failure of the electronic outside rearview mirror may also be given, and a pop-up alarm message may be displayed on the central control screen. The specific display style and content of the pop-up alarm message may not be limited.
[0111] A control method for a vehicle electronic rearview mirror system provided in this embodiment includes obtaining a video signal to be processed, where the video signal to be processed includes the video signals captured by the left outside rearview mirror camera and / or the right outside rearview mirror camera; if the video signal to be processed does not meet the preset conditions, and there is a physical connection failure or hardware failure in the left outside rearview mirror camera and / or the right outside rearview mirror camera, obtaining the driving camera signal in the corresponding direction; processing the driving camera signal to obtain a video signal to be displayed; if the video signal to be displayed meets the preset conditions, displaying the video signal to be displayed through the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror; if the video signal to be displayed does not meet the preset conditions, and there is a physical connection failure or hardware failure in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror, displaying the video signal to be displayed at the corresponding position of the central control screen. Therefore, by timely detecting the faults of the cameras and screens of the electronic outside rearview mirror and performing corresponding processing when there are faults in the cameras and / or screens of the electronic outside rearview mirror, driving safety can be ensured, and the safety and reliability of using the electronic outside rearview mirror can be improved.
[0112] At the same time, by providing different fields of view according to different usage scenarios through the electronic outside rearview mirror, it can make it more convenient for the driver to view the electronic outside rearview mirror, thereby improving the user experience.
[0113] Please refer to Figure 7, a control device 400 of a vehicle electronic rearview mirror system provided by the present application. The control device of the vehicle electronic rearview mirror system can operate in a vehicle and is specifically used to adjust the shooting mode of the electronic rearview mirror according to the failure of the electronic external rearview mirror camera of the vehicle, and adjust the display mode of the electronic rearview mirror according to the failure of the electronic rearview mirror screen of the vehicle. The device 400 includes:
[0114] A video signal to be processed acquisition module 410, configured to acquire a video signal to be processed, where the video signal to be processed includes video signals captured by the left external rearview mirror camera and / or the right external rearview mirror camera.
[0115] In this embodiment, the vehicle electronic rearview mirror system further includes a cockpit host, and the cockpit host includes a first video deserialization device, and the first video deserialization device is respectively communicatively connected to the left external rearview mirror camera and the right external rearview mirror camera.
[0116] As an implementation manner, the video signal to be processed acquisition module 410 can specifically be configured to acquire a first video signal captured by the left external rearview mirror camera and / or the right external rearview mirror camera, serialize the first video signal, and input the serialized first video signal into the first video deserialization device; acquire the video stream output by the first video deserialization device after deserializing the serialized first video signal as the video signal to be processed.
[0117] Optionally, the device 400 may further include a video signal to be processed detection module, configured to, after acquiring the video signal to be processed, determine that the video signal to be processed meets a preset condition if the video signal to be processed is stable within a specified duration; and determine that the video signal to be processed does not meet the preset condition if the video signal to be processed is unstable within the specified duration.
[0118] Optionally, the video signal to be processed detection module may further be configured to, if the video signal to be processed does not meet the preset condition, detect the link status between the left external rearview mirror camera and / or the right external rearview mirror camera and the cockpit host; and determine that there is a physical connection failure in the left external rearview mirror camera and / or the right external rearview mirror camera if the wire harness link between the left external rearview mirror camera and / or the right external rearview mirror camera and the cockpit host is open or short-circuited.
[0119] If the wire harness link between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host is not open or short-circuited, at least one of the registers of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the registers of the first video deserializers, the signal quality of the transmission link of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the software of the left outside rearview mirror camera and / or the right outside rearview mirror camera, and the software of the first video deserializers is detected; if there is a fault in the registers of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the registers of the first video deserializers, the signal quality of the transmission link of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the software of the left outside rearview mirror camera and / or the right outside rearview mirror camera, or the software of the first video deserializers, it is determined that the left outside rearview mirror camera and / or the right outside rearview mirror camera has a hardware fault.
[0120] Optionally, the device 400 may further include a fault repair module, configured to perform corresponding repairs on at least one of the registers of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the registers of the first video deserializers, the signal quality of the transmission link of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the software of the left outside rearview mirror camera and / or the right outside rearview mirror camera, and the software of the first video deserializers before determining that the left outside rearview mirror camera and / or the right outside rearview mirror camera has a hardware fault. In this way, the video signal to be processed detection module may be used to determine that the left outside rearview mirror camera and / or the right outside rearview mirror camera has a hardware fault if the result after repair still does not meet the preset conditions.
[0121] The shooting control module 420 is configured to obtain the driving camera signal in the corresponding direction if the video signal to be processed does not meet the preset conditions and the left outside rearview mirror camera and / or the right outside rearview mirror camera has a physical connection fault or a hardware fault.
[0122] The video signal to be displayed acquisition module 430 is configured to process the driving camera signal to obtain the video signal to be displayed.
[0123] In this embodiment, the cockpit host further includes a cockpit SOC chip and a first video serializer chip. The first video serializer chip is respectively communicatively connected to the left screen of the electronic outside rearview mirror and the right screen of the electronic outside rearview mirror. The left screen of the electronic outside rearview mirror includes a second video deserializer, and the right screen of the electronic outside rearview mirror includes a third video deserializer.
[0124] As an implementation manner, the video signal acquisition module 430 to be displayed can be used to perform image processing on the driving camera signal through the cockpit SOC chip, and transmit the processing result to the first video serializer chip; perform serialization processing on the processing result through the first video serializer chip to obtain the video stream to be displayed; perform deserialization processing on the video stream to be displayed through the second video deserializer and / or the third video deserializer to obtain the video signal to be displayed.
[0125] Among them, the video signal acquisition module 430 to be displayed can specifically be used to perform cropping processing, dead pixel correction processing, noise reduction processing, black level correction processing, chromatic aberration correction processing, automatic white balance processing, demosaicing processing, color restoration processing, contrast correction processing, purple fringing correction processing, defogging processing, color enhancement processing, noise processing, distortion correction processing, size adjustment, tone mapping processing, noise reduction processing, edge enhancement processing, contrast adjustment, and high brightness suppression processing on the driving camera signal through the cockpit SOC chip.
[0126] The display control module 440 is used to display the video signal to be displayed at the corresponding position of the central control screen if the video signal to be displayed does not meet the preset conditions, and there are physical connection failures or hardware failures in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror.
[0127] In this implementation manner, the display control module 440 can also be used to display the video signal to be displayed through the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror if the video signal to be displayed meets the preset conditions.
[0128] Among them, the step of displaying the video signal to be displayed through the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror can specifically include: when the vehicle is in a turning state, a door opening state, or a field of view switching state, displaying the video signal to be displayed in a wide-angle view through the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror.
[0129] Next, a vehicle provided by the present application will be described in conjunction with Figure 8 the following.
[0130] Please refer to Figure 8 , based on the above control method and device for a vehicle electronic outside rearview mirror system, another vehicle 100 provided in an embodiment of the present application that can execute the foregoing control method for a vehicle electronic outside rearview mirror system. The vehicle 100 includes one or more (only one is shown in the figure) processors 102, a memory 104, and a data acquisition module 106 that are coupled to each other. Among them, a program that can execute the content in the foregoing embodiments is stored in the memory 104, and the processor 102 can execute the program stored in the memory 104.
[0131] Among them, the processor 102 may include one or more processing cores. The processor 102 is connected to various parts within the entire vehicle 100 through various interfaces and lines. By running or executing instructions, programs, code sets, or instruction sets stored in the memory 104, and by calling data stored in the memory 104, it executes various functions of the vehicle 100 and processes data. Optionally, the processor 102 may be implemented in at least one hardware form of a neural network processing unit (NPU), a digital signal processing (DSP), a field-programmable gate array (FPGA), or a programmable logic array (PLA). The processor 102 may integrate a combination of one or several of a central processing unit (CPU), a graphics processing unit (GPU), a neural network processing unit (NPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, application programs, etc.; the GPU is responsible for rendering and drawing display content; the NPU is responsible for processing multimedia data such as videos and images; the modem is responsible for processing wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 102 and may be implemented separately through a communication chip.
[0132] The memory 104 may include a random access memory (RAM) and may also include a read-only memory. The memory 104 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 104 may include a program storage area and a data storage area. Among them, the program storage area may store instructions for implementing the operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data created during the use of the vehicle 100 (such as a phone book, audio and video data, chat record data, etc.).
[0133] The data acquisition module 106 can be used to obtain the driving state information of the vehicle 100. The data acquisition module 106 can be a lidar, a camera, a sensor, a GPS (Global Positioning System) navigation, etc.
[0134] A computer-readable storage medium provided by an embodiment of the present application. Program code is stored in the computer-readable storage medium, and the program code can be called by a processor to execute the method described in the above method embodiment.
[0135] The computer-readable storage medium can be an electronic memory such as a flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium includes a non-transitory computer-readable storage medium. The computer-readable storage medium has a storage space for program code for executing any method step in the above method. These program codes can be read from or written into one or more computer program products. The program codes can be compressed in an appropriate form, for example.
[0136] In summary, a control method, device, and vehicle for a vehicle electronic rearview mirror system provided by the present application obtain a video signal to be processed, where the video signal to be processed includes video signals captured by the left external rearview mirror camera and / or the right external rearview mirror camera; if the video signal to be processed does not meet a preset condition, and there is a physical connection failure or hardware failure in the left external rearview mirror camera and / or the right external rearview mirror camera, obtain a driving camera signal in the corresponding direction; process the driving camera signal to obtain a video signal to be displayed; if the video signal to be displayed does not meet a preset condition, and there is a physical connection failure or hardware failure in the left screen of the electronic rearview mirror and / or the right screen of the electronic rearview mirror, display the video signal to be displayed at a corresponding position on the central control screen. Thus, by timely detecting faults in the cameras and screens of the electronic rearview mirror and performing corresponding processing when there are faults in the cameras and / or screens of the electronic rearview mirror, driving safety can be ensured, and further, the safety and reliability of using the electronic rearview mirror can be improved.
[0137] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A control method for a vehicle electronic rearview mirror system, characterized in that, The vehicle electronic rearview mirror system includes a left outside rearview mirror camera, a right outside rearview mirror camera, a driving camera, a left electronic outside rearview mirror screen, a right electronic outside rearview mirror screen, and a central control screen. The method includes: Obtain a video signal to be processed, where the video signal to be processed includes the video signal captured by the left outside rearview mirror camera and / or the right outside rearview mirror camera; If the video signal to be processed does not meet the preset conditions, and there is a physical connection failure or hardware failure in the left outside rearview mirror camera and / or the right outside rearview mirror camera, obtain the driving camera signal in the corresponding direction; Process the driving camera signal to obtain a video signal to be displayed; If the video signal to be displayed does not meet the preset conditions, and there is a physical connection failure or hardware failure in the left electronic outside rearview mirror screen and / or the right electronic outside rearview mirror screen, display the video signal to be displayed at the corresponding position of the central control screen.
2. The method according to claim 1, wherein The vehicle electronic rearview mirror system further includes a cockpit host, and the cockpit host includes a first video deserialization device. The first video deserialization device is communicatively connected to the left outside rearview mirror camera and the right outside rearview mirror camera respectively. The obtaining of the video signal to be processed includes: Obtain a first video signal captured by the left outside rearview mirror camera and / or the right outside rearview mirror camera, and serialize the first video signal and then input it into the first video deserialization device; Obtain the video stream output after the first video deserialization device deserializes the serialized first video signal as the video signal to be processed.
3. The method according to claim 2, wherein After obtaining the video signal to be processed, the method further includes: If the video signal to be processed is stable within a specified duration, determine that the video signal to be processed meets the preset conditions; If the video signal to be processed is unstable within a specified duration, determine that the video signal to be processed does not meet the preset conditions.
4. The method according to claim 2, wherein If the video signal to be processed does not meet the preset conditions, the method further includes: Detect the link status between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host; If the wire harness link between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host is open or short-circuited, determine that there is a physical connection failure in the left outside rearview mirror camera and / or the right outside rearview mirror camera.
5. The method according to claim 4, wherein The method further includes: If the wire harness link between the left outside rearview mirror camera and / or the right outside rearview mirror camera and the cockpit host is not open or not short-circuited, detect at least one of the registers of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the registers of the first video deserialization device, the signal quality of the transmission link of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the software of the left outside rearview mirror camera and / or the right outside rearview mirror camera, and the software of the first video deserialization device; If there is a fault in the registers of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the registers of the first video deserializer, the signal quality of the transmission link of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the software of the left outside rearview mirror camera and / or the right outside rearview mirror camera, or the software of the first video deserializer, it is determined that there is a hardware fault in the left outside rearview mirror camera and / or the right outside rearview mirror camera.
6. The method according to claim 5, wherein Before determining that there is a hardware fault in the left outside rearview mirror camera and / or the right outside rearview mirror camera, the method further includes: Performing corresponding repairs on at least one of the registers of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the registers of the first video deserializer, the signal quality of the transmission link of the left outside rearview mirror camera and / or the right outside rearview mirror camera, the software of the left outside rearview mirror camera and / or the right outside rearview mirror camera, and the software of the first video deserializer; If the result after repair still does not meet the preset conditions, it is determined that there is a hardware fault in the left outside rearview mirror camera and / or the right outside rearview mirror camera.
7. The method according to any one of claims 2-6, characterized in that, The cockpit host further includes a cockpit SOC chip and a first video serializer chip. The first video serializer chip is communicatively connected to the left electronic outside rearview mirror screen and the right electronic outside rearview mirror screen respectively. The left electronic outside rearview mirror screen includes a second video deserializer, and the right electronic outside rearview mirror screen includes a third video deserializer. Processing the driving camera signal to obtain a video signal to be displayed includes: Performing image processing on the driving camera signal through the cockpit SOC chip and transmitting the processing result to the first video serializer chip; Performing serialization processing on the processing result through the first video serializer chip to obtain a video stream to be displayed; Performing deserialization processing on the video stream to be displayed through the second video deserializer and / or the third video deserializer to obtain a video signal to be displayed.
8. The method according to claim 1, characterized in that, The method further includes: If the video signal to be displayed meets the preset conditions, displaying the video signal to be displayed through the left electronic outside rearview mirror screen and / or the right electronic outside rearview mirror screen; The displaying the video signal to be displayed through the left electronic outside rearview mirror screen and / or the right electronic outside rearview mirror screen includes: When the vehicle is in a turning state, a door opening state, or a field of view switching state, displaying the video signal to be displayed through the left electronic outside rearview mirror screen and / or the right electronic outside rearview mirror screen in a wide-angle view.
9. A control device for a vehicle electronic rearview mirror system, characterized in that, The vehicle electronic rearview mirror system includes a left outside rearview mirror camera, a right outside rearview mirror camera, a driving camera, a left electronic outside rearview mirror screen, a right electronic outside rearview mirror screen, and a central control screen. The device includes: A video signal to be processed acquisition module, configured to acquire a video signal to be processed, where the video signal to be processed includes the video signal captured by the left outside rearview mirror camera and / or the right outside rearview mirror camera; A shooting control module, configured to obtain a driving camera signal in a corresponding direction if the to-be-processed video signal does not meet a preset condition and there is a physical connection failure or a hardware failure in the left outside rearview mirror camera and / or the right outside rearview mirror camera; A to-be-displayed video signal acquisition module, configured to process the driving camera signal to obtain a to-be-displayed video signal; A display control module, configured to display the to-be-displayed video signal at a corresponding position of the central control screen if the to-be-displayed video signal does not meet a preset condition and there is a physical connection failure or a hardware failure in the left screen of the electronic outside rearview mirror and / or the right screen of the electronic outside rearview mirror.
10. A vehicle, characterized in that, It includes one or more processors and a memory; One or more programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs are configured to execute the method according to any one of claims 1-8.
Citation Information
Cited By
Reversing image display method and device, vehicle-mounted terminal and vehicle
CN121062597A