Electronic rearview mirror system and vehicle

Abstract

This application provides an electronic rearview mirror system and a vehicle, relating to the field of vehicle technology. The electronic rearview mirror system includes multiple cameras, multiple displays, a first controller, and a second controller. The multiple cameras are configured to capture images from the left and right rearview angles of the vehicle's exterior. The first and second controllers are configured to acquire image information from the multiple cameras and perform image processing on this information. The first and second controllers are also configured to function as controllers for an in-vehicle system different from the electronic rearview mirror system. The multiple displays are configured to display the image-processed images. By reusing the controllers of other in-vehicle systems, the function of the electronic rearview mirror is achieved, eliminating the need for a separate electronic rearview mirror ECU and saving the cost of the ECU, thereby reducing the cost of deploying the electronic rearview mirror system in the vehicle.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and more particularly to electronic rearview mirror systems and vehicles. Background Technology

[0002] With the continuous development of vehicle technology, some countries have now allowed the use of electronic rearview mirror systems to replace mirror-mounted rearview mirrors.

[0003] Currently known stand-alone electronic rearview mirror systems include a left-side camera, a right-side camera, an electronic control unit (ECU), a left-side field-of-view display, and a right-side field-of-view display. However, deploying such a stand-alone electronic rearview mirror system in a vehicle is costly. Summary of the Invention

[0004] This application provides an electronic rearview mirror system and vehicle with the aim of integrating electronic rearview mirror functionality into other in-vehicle systems to reduce the cost of deploying electronic rearview mirrors.

[0005] This application provides an electronic rearview mirror system, which includes multiple cameras, multiple displays, and at least one controller. The multiple cameras are configured to capture images of the left and right rearview angles outside the vehicle. The at least one controller is configured to acquire image information from the multiple cameras and perform image processing on this information. The at least one controller is also configured to function as a controller for an in-vehicle system different from the electronic rearview mirror system. The multiple displays are configured to display the image-processed images.

[0006] In a first aspect, this application provides an electronic rearview mirror system, which includes multiple cameras, multiple displays, a first controller, and a second controller. The multiple cameras are configured to capture images of the left and right rearview angles outside the vehicle. The first and second controllers are configured to acquire image information from the multiple cameras and perform image processing on this information. The first and second controllers are also configured to function as controllers for an in-vehicle system different from the electronic rearview mirror system. The multiple displays are configured to display the image-processed images.

[0007] Based on the above solution, the function of the electronic rearview mirror is realized by reusing the controller of other vehicle systems, eliminating the need for a separate electronic rearview mirror ECU and saving the cost of the electronic rearview mirror ECU, thereby reducing the cost of deploying the electronic rearview mirror system in the vehicle. Furthermore, reusing two controllers from other vehicle systems ensures that if one controller fails, the other controller can still process the image information from the camera, which can enhance the reliability of the electronic rearview mirror system while reducing costs.

[0008] In conjunction with the first aspect, in some possible designs, the first controller and the second controller are also configured to function as controllers for an in-vehicle system different from the electronic rearview mirror system, including: the first controller and the second controller are also configured to function as controllers for advanced driver assistance systems (ADAS); or, the first controller is also configured to function as a controller for ADAS, and the second controller is also configured to function as a controller for an in-vehicle infotainment (IVI) system.

[0009] In conjunction with the first aspect, in some possible designs, the multiple cameras include at least one left-side camera and at least one right-side camera, the at least one left-side camera being configured to capture images from a left rear-view angle, and the at least one right-side camera being configured to capture images from a right rear-view angle; and the multiple displays include a left-side field-of-view display, a right-side field-of-view display, and a human-machine interaction (HMI) display, the left-side field-of-view display being configured to display an image processed from information of the left rear-view angle image, the right-side field-of-view display being configured to display an image processed from information of the right rear-view angle image, the HMI display being configured to display the image processed from information of the left rear-view angle image in the event of a failure of the left-side field-of-view display, and / or, to display the image processed from information of the right rear-view angle image in the event of a failure of the right-side field-of-view display; wherein the left-side field-of-view display and the right-side field-of-view display are both connected to a first controller, and the HMI display is connected to a second controller.

[0010] This design approach further enhances the reliability of the electronic rearview mirror system by reusing the HMI display screens of other in-vehicle systems.

[0011] Optionally, both the at least left-side camera and the at least right-side camera are connected to the first controller and the second controller.

[0012] Optionally, the at least one left-side camera includes a first left-side camera and a second left-side camera, and the at least one right-side camera includes a first right-side camera and a second right-side camera. The first left-side camera is used to capture images from the left rear-view angle, and the second left-side camera is used to capture images from the left rear-view angle in the event of a malfunction of the first left-side camera or the left field of view display. The first right-side camera is used to capture images from the right rear-view angle, and the second right-side camera is used to capture images from the right rear-view angle in the event of a malfunction of the first right-side camera or the right field of view display. The first left-side camera and the first right-side camera are both connected to a first controller, and the second left-side camera and the second right-side camera are both connected to a second controller.

[0013] Optionally, the first controller and the second controller can be packaged in different boxes, or in the same box.

[0014] By way of example and not limitation, when the first controller is a multiplexed ADAS controller and the second controller is a multiplexed IVI system controller, the first and second controllers can be packaged in different boxes. When the first and second controllers are multiplexed ADAS controllers, they can be packaged in different boxes, or they can be packaged in the same box. This application does not limit this aspect.

[0015] Optionally, the second controller is also used for fault detection to determine that at least one of the following has failed: one or more of the multiple cameras, the first controller, the left field of view display, or the right field of view display.

[0016] The first controller can serve as the main controller in the electronic rearview mirror system, and the second controller can serve as the backup controller in the electronic rearview mirror system. The second controller can periodically or in real time perform fault detection on one or more cameras among the multiple cameras, the first controller, the left field of view display, or the right field of view display, to ensure that when it is determined that one or more cameras among the multiple cameras, the first controller, the left field of view display, or the right field of view display has failed, the backup component is activated to replace the failed component to perform the corresponding work, thereby improving the reliability of the electronic rearview mirror system.

[0017] Secondly, this application provides an electronic rearview mirror system, which includes multiple cameras, multiple displays, and a first controller. The multiple cameras are configured to capture images of the left and right rearview angles outside the vehicle. The first controller is configured to acquire image information from the multiple cameras and perform image processing on this information. The first controller is also configured to function as a controller for an in-vehicle system different from the electronic rearview mirror system. The multiple displays are configured to display the image-processed images.

[0018] Based on the above solution, the function of the electronic rearview mirror is realized by reusing the controller of other vehicle systems. This eliminates the need for a separate electronic rearview mirror ECU, saving on its cost and thus reducing the overall cost of deploying an electronic rearview mirror system in the vehicle.

[0019] In conjunction with the second aspect, in some possible designs, the first controller is also configured to function as a controller for an in-vehicle system different from the electronic rearview mirror system, including: the first controller is also configured to function as a controller for ADAS; or, the first controller is also configured to function as a controller for an IVI system.

[0020] In conjunction with the second aspect, in some possible designs, the multiple cameras include at least one left-side camera and at least one right-side camera, the at least one left-side camera configured to capture images from a left rear-view angle, and the at least one right-side camera configured to capture images from a right rear-view angle; and the multiple displays include a left-side field-of-view display, a right-side field-of-view display, and an HMI display, wherein the left-side field-of-view display is configured to display an image processed from information of the left rear-view angle; the right-side field-of-view display is configured to display an image processed from information of the right rear-view angle; the HMI display is configured to display the image processed from information of the left rear-view angle in the event of a failure of the left-side field-of-view display, and / or, configured to display the image processed from information of the right rear-view angle in the event of a failure of the right-side field-of-view display; wherein the left-side field-of-view display, the right-side field-of-view display, and the HMI display are all connected to a first controller.

[0021] This design approach further enhances the reliability of the electronic rearview mirror system by reusing the HMI display screens of other in-vehicle systems.

[0022] Optionally, the first controller is also configured for fault detection to determine that at least one of the following has failed: one or more of the multiple cameras, the left field of view display, or the right field of view display.

[0023] The first controller can periodically, or in real time, detect faults in one or more of the multiple cameras, the left-side view display, or the right-side view display to ensure that when a fault is detected in one or more of the multiple cameras, the left-side view display, or the right-side view display, a backup component is activated to perform the corresponding work in place of the faulty component, thereby improving the reliability of the electronic rearview mirror system.

[0024] Thirdly, this application provides a vehicle that includes an electronic rearview mirror system as described in the first aspect and any one of the first aspects, or the vehicle includes an electronic rearview mirror system as described in the second aspect and any one of the second aspects.

[0025] Optionally, the vehicle is used to determine the user's steering intention based on the user's operation, and to display an image at a rearview angle corresponding to the steering intention based on the electronic rearview mirror system; wherein the user's steering intention includes turning right or turning left, and the user's operation includes toggling the left / right turn signal control lever, operating on the HMI display screen, issuing a predefined control voice, or making a predefined control gesture.

[0026] The image displayed corresponds to the steering intention. This can be understood as follows: if the user's steering intention is to turn right, the image of the right rear view is displayed; if the user's steering intention is to turn left, the image of the left rear view is displayed.

[0027] It should be understood that the third aspect of this application corresponds to the technical solutions of the first and second aspects of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, so they will not be repeated here. Attached Figure Description

[0028] Figure 1 This is a schematic block diagram of an electronic rearview mirror system;

[0029] Figure 2 This is a schematic block diagram of an electronic rearview mirror system provided in an embodiment of this application;

[0030] Figure 3 This is a schematic block diagram of an electronic rearview mirror system provided in an embodiment of this application, including two cameras;

[0031] Figure 4 and Figure 5 These are two more detailed schematic block diagrams of the electronic rearview mirror system provided in the embodiments of this application, which includes two cameras;

[0032] Figure 6 This is a schematic block diagram of an electronic rearview mirror system including four cameras provided in an embodiment of this application;

[0033] Figure 7 and Figure 8 These are two more detailed schematic block diagrams of the electronic rearview mirror system provided in the embodiments of this application, which includes four cameras;

[0034] Figure 9 This is another schematic block diagram of the electronic rearview mirror system provided in the embodiments of this application, which includes four cameras;

[0035] Figure 10 and Figure 11 The electronic rearview mirror system provided in this application includes four cameras, and two more schematic block diagrams are shown in greater detail.

[0036] Figure 12 This is another schematic block diagram of the electronic rearview mirror system provided in the embodiments of this application;

[0037] Figure 13 This is another schematic block diagram of the electronic rearview mirror system provided in the embodiments of this application, which includes two cameras;

[0038] Figure 14 This is a more detailed schematic block diagram of the electronic rearview mirror system provided in this application embodiment, which includes two cameras;

[0039] Figure 15 This is another schematic block diagram of the electronic rearview mirror system provided in the embodiments of this application, which includes four cameras;

[0040] Figure 16 This is a more detailed schematic block diagram of the electronic rearview mirror system provided in this application embodiment, which includes four cameras;

[0041] Figure 17 and Figure 18 These are two schematic diagrams of the vehicle provided in the embodiments of this application. Detailed Implementation

[0042] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0043] To facilitate a clear description of the technical solutions in the embodiments of this application, the following explanation is provided first.

[0044] First, in the embodiments of this application, the terms "first" and "second" are used to distinguish identical or similar items with substantially the same function and purpose. For example, "first controller" and "second controller" are used to distinguish different controllers; "first left camera" and "second left camera" are used to distinguish different left cameras; "first right camera" and "second right camera" are used to distinguish different right cameras; "first deserializer" and "second deserializer" are used to distinguish different deserializers; "first serializer" and "second serializer" are used to distinguish different serializers; "first system-on-a-chip" and "second system-on-a-chip" are used to distinguish different system-on-a-chip, etc., without limiting their order. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that "first" and "second" do not necessarily imply that they are different.

[0045] Second, in the embodiments of this application, "at least one" refers to one or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates an "or" relationship between the preceding and following related objects, but it does not exclude the possibility of indicating an "and" relationship. The specific meaning can be understood in conjunction with the context.

[0046] Third, in the embodiments of this application, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion, for example, an apparatus, system, product or device that includes a series of modules, units or units is not necessarily limited to those modules, units or units that are explicitly listed, but may include other modules, units or units that are not explicitly listed or that are inherent to such apparatus, system, product or device.

[0047] First, a brief explanation of the terminology used in this application will be provided.

[0048] 1. Electronic rearview mirror: Composed of a camera and a display, it captures real-time images through the camera and transmits them to the display inside the vehicle for display. The benefits of using an electronic rearview mirror include: a wider field of view (FOV) and an extended effective distance; it is not affected by light conditions, rain, or snow; and it is not affected by the high beams of vehicles behind.

[0049] 2. Electronic rearview mirror system: also known as a camera monitor system (CMS). It uses cameras on both sides of the vehicle to provide the driver with images of the left and right rearward angles on the outside of the vehicle through an in-vehicle display, replacing the traditional mirror-type rearview mirror.

[0050] 3. Serializer and Deserializer: These are interface circuits used in high-speed data communication. For example, the serializer and deserializer in Video Serial Communication III (FPD-Link III) are interfaces used in the field of vehicle technology for point-to-point video transmission. The FPD-Link III serializer and deserializer are optimized for links between the processor and the display, or between the processor and the camera (camera), enabling high-speed data communication. It should be understood that serializers and deserializers are used in pairs.

[0051] With the continuous development of vehicle technology, some countries have now allowed the use of electronic rearview mirror systems to replace mirror-mounted rearview mirrors.

[0052] Figure 1 This is a schematic block diagram of an electronic rearview mirror system. Currently known stand-alone electronic rearview mirror systems include... Figure 1 As shown, it includes a left-side camera, a right-side camera, an electronic rearview mirror ECU, a left-side field-of-view display, and a right-side field-of-view display. However, deploying such a separate electronic rearview mirror system in a vehicle is costly.

[0053] To address the aforementioned issues, this application provides an electronic rearview mirror system and vehicle that reuses the controllers of other onboard systems to achieve the functionality of the electronic rearview mirror. This eliminates the need for a separate electronic rearview mirror ECU, saving on its cost and thus reducing the overall cost of deploying the electronic rearview mirror system in the vehicle.

[0054] To better understand the electronic rearview mirror system and vehicle proposed in the embodiments of this application, the technical solutions in this application will be described below in conjunction with the accompanying drawings.

[0055] This application provides an electronic rearview mirror system, which may include: multiple cameras, a first controller, a second controller, and multiple displays; wherein, the multiple cameras are configured to acquire images from the left and right rearview angles of the vehicle's exterior; the first and second controllers are configured to acquire image information from the multiple cameras and perform image processing on the information, and the first and second controllers are also configured to function as controllers for an in-vehicle system different from the electronic rearview mirror system; the multiple displays are configured to display the image-processed images.

[0056] Figure 2 This is a schematic block diagram of an electronic rearview mirror system provided in an embodiment of this application.

[0057] like Figure 2As shown, the electronic rearview mirror system includes multiple cameras: camera 1, camera 2, ..., camera n, where n is a positive integer and n≥2. These multiple cameras can be used to capture images of the left and right rearview angles of the vehicle's exterior. The electronic rearview mirror system includes a first controller and a second controller. The first controller and the second controller can be used to acquire information about the images of the left and right rearview angles of the vehicle's exterior captured by the multiple cameras, and can perform image processing on this image information using image processing technology. The electronic rearview mirror system includes multiple displays: display 1, display 2, ..., display m, where m is a positive integer and m≥2. These multiple displays can be used to display images after image processing of the images captured by the multiple cameras by the first controller and / or the second controller.

[0058] It should be noted that the first controller and the second controller are not separately deployed electronic rearview mirror ECUs, but rather reused controllers from other vehicle-mounted systems different from the electronic rearview mirror system. It should also be noted that the other vehicle-mounted systems may include at least one system; that is, the first controller and the second controller may be reused controllers of the same other vehicle-mounted system, or they may be reused controllers of two different other vehicle-mounted systems. This application embodiment does not impose any limitations on this.

[0059] Alternatively, the HMI display can also reuse the HMI display of other in-vehicle systems.

[0060] In one possible design, the first controller and the second controller are further configured as controllers for an in-vehicle system different from the electronic rearview mirror system, including: the first controller and the second controller are further configured as controllers for ADAS.

[0061] In other words, the first controller and the second controller can be reused ADAS controllers. In this implementation, the ADAS can include two controllers, one of which can be the main controller and the other can be the backup controller. The backup controller of the ADAS can be reused as the first controller in the electronic rearview mirror system, and the main controller of the ADAS can be reused as the second controller in the electronic rearview mirror system. This application embodiment does not impose any limitations on this.

[0062] In another possible design, the first controller and the second controller are also configured to function as controllers for an in-vehicle system different from the electronic rearview mirror system, including: the first controller is also configured to function as an ADAS controller, and the second controller is also configured to function as an IVI system controller.

[0063] In other words, the first controller can be a reused ADAS controller, and the second controller can be a reused IVI system controller. In this implementation, if the ADAS includes two controllers, one of which can be the main controller and the other can be the backup controller, then the first controller can be either the main controller of the reused ADAS or the backup controller of the reused ADAS. This application embodiment does not impose any limitations on this.

[0064] Optionally, the first controller and the second controller can be packaged in different boxes, or in the same box.

[0065] For example, when the first controller is a multiplexed ADAS controller and the second controller is a multiplexed IVI system controller, the first and second controllers can be packaged in different boxes. When the first and second controllers are multiplexed ADAS controllers, they can be packaged in different boxes, or they can be packaged in the same box. This application does not limit this to any particular case.

[0066] It should be noted that the box can be understood as an outer shell used to encapsulate the controller's circuit board, or as a protective shell for the controller's circuit board. If the first controller and the second controller are encapsulated in different boxes, the first controller and its encapsulated box can form one controller product, and the second controller and its encapsulated box can form another controller product; if the first controller and the second controller are encapsulated in the same box, the first controller, the second controller, and the boxes encapsulated in these two controllers can form one controller product.

[0067] Optionally, the second controller is also used for fault detection to determine that at least one of the following has failed: one or more of the multiple cameras, the first controller, the left field of view display, or the right field of view display.

[0068] The first controller can serve as the main controller in the electronic rearview mirror system, and the second controller can serve as the backup controller in the electronic rearview mirror system. The second controller can periodically or in real time perform fault detection on one or more cameras among the multiple cameras, the first controller, the left field of view display, or the right field of view display, to ensure that when it is determined that one or more cameras among the multiple cameras, the first controller, the left field of view display, or the right field of view display has failed, the backup component is activated to replace the failed component to perform the corresponding work, thereby improving the reliability of the electronic rearview mirror system.

[0069] By way of example and not limitation, in cases where the second controller is a reused ADAS main controller, or in cases where the second controller is a reused IVI system controller, the second controller can also be used for fault detection. The second controller can perform fault detection on multiple cameras, the first controller, the left field of view display, or the right field of view display to determine whether multiple cameras, the first controller, the left field of view display, or the right field of view display have malfunctioned. This application does not limit this aspect.

[0070] In one possible design, the plurality of cameras includes: at least one left-side camera and at least one right-side camera, the at least one left-side camera configured to capture images from the aforementioned left rear-view angle, and the at least one right-side camera configured to capture images from the aforementioned right rear-view angle; and a plurality of displays including: a left-side field-of-view display, a right-side field-of-view display, and an HMI display, the left-side field-of-view display configured to display an image processed from the information of the aforementioned left rear-view angle image, the right-side field-of-view display configured to display an image processed from the information of the aforementioned right rear-view angle image; the HMI display configured to display the image processed from the information of the aforementioned left rear-view angle image in the event of a malfunction of the left-side field-of-view display, and / or, to display the image processed from the information of the aforementioned right rear-view angle image in the event of a malfunction of the right-side field-of-view display. The left-side field-of-view display and the right-side field-of-view display are both connected to a first controller, the HMI display is connected to a second controller, and the first controller is connected to the second controller.

[0071] It should be noted that the connection between the first controller and the second controller can be understood as the first controller and the second controller communicating through an in-vehicle communication link. For example, the first controller and the second controller can communicate through a controller area network (CAN) bus or a wireless communication system (e.g., StarFlash Alliance's short-range communication technology, Bluetooth communication technology, wireless fidelity (Wi-Fi) and other communication technologies), or they can communicate through an in-vehicle Ethernet. This application embodiment does not limit this.

[0072] In other words, the electronic rearview mirror system may include at least one left-side camera and at least one right-side camera. The at least one left-side camera can be used to capture images from the left rear-view angle outside the vehicle, and the at least one right-side camera can be used to capture images from the right rear-view angle outside the vehicle. The electronic rearview mirror system may also include a left-side field-of-view display, a right-side field-of-view display, and an HMI display screen. The left-side field-of-view display can be used to display an image processed from the captured information of the left rear-view angle outside the vehicle, and the right-side field-of-view display can be used to display an image processed from the captured information of the right rear-view angle outside the vehicle. The HMI display screen can be used to display the image processed from the left rear-view angle image when the left-side field-of-view display malfunctions, and / or can be used to display the image processed from the right rear-view angle image when the right-side field-of-view display malfunctions.

[0073] It should be understood that the HMI display is a reused in-vehicle display that is different from the left-side and right-side viewing displays. For example, the HMI display can be the HMI display of an IVI system (i.e., the commonly referred to in-vehicle central control display), or the HMI display can be the HMI display of other in-vehicle systems different from the IVI system. This application embodiment does not limit this.

[0074] Furthermore, it should be noted that this HMI display is not limited to displaying an image processed from information about the left rear-view angle when the left-side view monitor malfunctions, and / or displaying an image processed from information about the right rear-view angle when the right-side view monitor malfunctions. It can also display an image processed from information about the left rear-view angle, and / or an image processed from information about the right rear-view angle, based on driver operation or preset settings. This application does not impose any limitations on this.

[0075] In one possible design, both the at least one left-side camera and the at least one right-side camera are connected to the first controller and the second controller.

[0076] Optionally, the aforementioned plurality of cameras may include two cameras: a left-side camera and a right-side camera. In this possible design, the left-side camera is connected to both the first controller and the second controller, and the right-side camera is connected to both the first controller and the second controller.

[0077] Figure 3This is a schematic block diagram of an electronic rearview mirror system provided in an embodiment of this application, which includes two cameras.

[0078] like Figure 3 As shown, the electronic rearview mirror system includes a left-side camera, a right-side camera, a first controller, a second controller, a left-side field-of-view display, a right-side field-of-view display, and an HMI display screen. The left-side camera is connected to both the first and second controllers, the right-side camera is connected to both the first and second controllers, the left-side and right-side field-of-view displays are both connected to the first controller, and the HMI display screen is connected to the second controller.

[0079] Figure 4 and Figure 5 These are two more detailed schematic block diagrams of the electronic rearview mirror system provided in this application embodiment, which includes two cameras.

[0080] Figure 4 The illustration shows a scenario where the first and second controllers are encapsulated in two different boxes.

[0081] like Figure 4 As shown, both the left and right cameras can be configured with dual-interface serializers. In this case, both the first and second controllers need to be configured with deserializers. For example, the first controller can be configured with a dual-interface first deserializer, and the second controller can be configured with a dual-interface second deserializer. The left camera can transmit the captured image information to the first system-on-chip (SoC) in the first controller via the serializer, or to the second SoC in the second controller via the second deserializer. Similarly, the right camera can transmit the captured image information to the first SoC in the first controller via the serializer, or to the second SoC in the second controller via the second deserializer. The first or second SoC then performs image processing on the image information.

[0082] After image processing is completed, the processed information can be transmitted to the display. For example, if both the left and right view displays are equipped with deserializers, the first controller can transmit the image information of the processed left rear-view angle to the left view display and the image information of the processed right rear-view angle to the right view display through a first serializer with dual interfaces.

[0083] In the event that the left-side display malfunctions (including the case where the deserializer configured in the left-side display malfunctions), but the first controller does not malfunction (the case where the first deserializer, the first on-chip system, and the first serializer in the first controller all do not malfunction), the following implementation methods are possible, and the embodiments of this application do not limit them in any way.

[0084] Implementation Method 1: After the first on-chip system in the first controller processes the image information captured by the left camera, the first on-chip system transmits the processed information to the second on-chip system in the second controller. The second on-chip system can transmit the information to the HMI display screen through the second serializer or vehicle Ethernet.

[0085] Method 2: The second on-chip system in the second controller processes the image information captured by the left camera, and then transmits it to the HMI display screen through the second serializer.

[0086] In the event that the right-side display malfunctions (including the case where the deserializer configured in the right-side display malfunctions), but the first controller does not malfunction (the case where the first deserializer, the first on-chip system, and the first serializer in the first controller all do not malfunction), the following implementation methods are also possible, and the embodiments of this application do not limit them in any way.

[0087] Implementation Method 1: After the first on-chip system in the first controller processes the image information captured by the right-side camera, the first on-chip system transmits the processed information to the second on-chip system in the second controller. The second on-chip system can then transmit the information to the HMI display screen through the second serializer.

[0088] Method 2: The second on-chip system in the second controller processes the image information captured by the right-side camera, and then transmits it to the HMI display screen through the second serializer.

[0089] In the event of a malfunction in the first controller—that is, a malfunction in any component of the first controller, such as the first deserializer, the first on-chip system, or the first serializer—the second on-chip system in the second controller directly processes the image information captured by the left camera and then transmits it to the HMI display via the second serializer. Similarly, the second on-chip system in the second controller directly processes the image information captured by the right camera and then transmits it to the HMI display via the second serializer. In other words, depending on the driver's operation or preset settings, the HMI display may show only the image from the left rear-view angle, only the image from the right rear-view angle, or both images from the left and right rear-view angles simultaneously. This embodiment does not limit the specific display options.

[0090] It should be understood that the second on-chip system transmits the image-processed information to the HMI display via the second serializer, which is only an example.

[0091] As an example and not a limitation, in practical application scenarios, when the first controller is a multiplexed ADAS controller and the second controller is a multiplexed IVI system controller, the second system-on-a-chip (SoC) can directly transmit the image-processed information to the IVI system's HMI display via the second serializer. When both the first and second controllers are multiplexed ADAS controllers, the second SoC can transmit the image-processed information to the IVI system via the second serializer, and then the IVI system's HMI display will show it. Alternatively, the second SoC can also forward the image-processed information to the IVI system via automotive Ethernet, and then the IVI system's HMI display will show it. This application's embodiments do not impose any limitations on this.

[0092] Figure 5 The illustration shows the first and second controllers packaged in the same box.

[0093] like Figure 5As shown, both the left and right cameras can be configured with dual-interface serializers. In this case, deserializers are required in both the first and second controllers. Since the first and second controllers are packaged in the same box, as shown in the figure, they can share a single dual-interface deserializer. The left camera can transmit the captured image information through the serializer to the first on-chip system in the first controller, or to the second on-chip system in the second controller. Similarly, the right camera can transmit the captured image information through the serializer to the first on-chip system in the first controller, or to the second on-chip system in the second controller. The first or second on-chip system then performs image processing on the image information.

[0094] After image processing is completed, the processed information can be transmitted to the display. For example, if both the left and right view displays are equipped with deserializers, the first controller can transmit the image information of the processed left rear-view angle to the left view display and the image information of the processed right rear-view angle to the right view display through a first serializer with dual interfaces.

[0095] As mentioned above, in this implementation, the first controller and the second controller are multiplexed ADAS controllers. In the event of a failure of the first controller (either the first on-chip system in the first controller or the first serializer in the first controller), the second on-chip system can transmit the image-processed information to the IVI system through the second serializer, and then the IVI system's HMI display screen will display it. Alternatively, the second on-chip system can also forward the image-processed information to the IVI system through the vehicle Ethernet, and then the IVI system's HMI display screen will display it.

[0096] In one possible design, the at least one left-side camera includes a first left-side camera and a second left-side camera, and the at least one right-side camera includes a first right-side camera and a second right-side camera. The first left-side camera is used to capture images from a left rear-view angle; the second left-side camera is used to capture images from a left rear-view angle in the event of a malfunction of the first left-side camera or the left field of view display; the first right-side camera is used to capture images from a right rear-view angle; the second right-side camera is used to capture images from a right rear-view angle in the event of a malfunction of the first right-side camera or the right field of view display; wherein the first left-side camera and the first right-side camera are both connected to a first controller, and the second left-side camera and the second right-side camera are both connected to a second controller.

[0097] In other words, the aforementioned multiple cameras may include four cameras: a first left-side camera, a second left-side camera, a first right-side camera, and a second right-side camera. The first left-side camera and the first right-side camera are both connected to the first controller, and the second left-side camera and the second right-side camera are both connected to the second controller.

[0098] It should be noted that the second left-side camera is used to capture images from the left rear-view angle when the first left-side camera or the left-side field-of-view display malfunctions. In other words, the second left-side camera can be used to capture images from the left rear-view angle when the first left-side camera malfunctions, or it can be used to capture images from the left rear-view angle when the left-side field-of-view display malfunctions. When the first left-side camera is not malfunctioning, but the left-side field-of-view display malfunctions, one implementation is that the first left-side camera captures the images from the left rear-view angle; another implementation is that the second left-side camera captures the images from the left rear-view angle. A detailed description can be found in the relevant descriptions below.

[0099] In addition, the description of the second right-side camera is the same as that of the second left-side camera. For a detailed description of the second right-side camera, please refer to the detailed description of the second left-side camera.

[0100] Figure 6 This is a schematic block diagram of an electronic rearview mirror system including four cameras provided in an embodiment of this application.

[0101] like Figure 6 As shown, the electronic rearview mirror system includes a first left-side camera, a second left-side camera, a first right-side camera, a second right-side camera, a first controller, a second controller, a left-side field-of-view display, a right-side field-of-view display, and an HMI display screen. The first left-side camera and the first right-side camera are both connected to the first controller, the second left-side camera and the second right-side camera are both connected to the second controller, the left-side field-of-view display and the right-side field-of-view display are both connected to the first controller, and the HMI display screen is connected to the second controller.

[0102] Figure 7 and Figure 8 These are two more detailed schematic block diagrams of the electronic rearview mirror system provided in this application embodiment, which includes four cameras.

[0103] Figure 7 The illustration shows a scenario where the first and second controllers are encapsulated in two different boxes.

[0104] like Figure 7As shown, the first left camera, second left camera, first right camera, and second right camera can all be configured with single-interface serializers. In this case, the first controller and the second controller need to be configured with dual-interface deserializers. For example, the first controller is configured with a dual-interface first deserializer, and the second controller is configured with a dual-interface second deserializer. The first left camera can transmit the captured image information to the first on-chip system in the first controller through its built-in serializer and the first deserializer. Similarly, the second left camera can transmit the captured image information to the second on-chip system in the second controller through its built-in serializer and the second deserializer. Likewise, the first right camera can transmit the captured image information to the first on-chip system in the first controller through its built-in serializer and the first deserializer, and the second right camera can transmit the captured image information to the second on-chip system in the second controller through its built-in serializer and the second deserializer. The first or second on-chip system then performs image processing on the image information.

[0105] After image processing is completed, the processed information can be transmitted to the display. For example, if both the left and right view displays are equipped with deserializers, the first controller can transmit the image information of the processed left rear-view angle to the left view display and the image information of the processed right rear-view angle to the right view display through a first serializer with dual interfaces.

[0106] In the event that the left-side field-of-view display malfunctions (including the case where the deserializer configured in the left-side field-of-view display malfunctions), but the first controller does not malfunction (the case where the first deserializer, the first on-chip system, and the first serializer in the first controller do not malfunction) and the first left-side camera does not malfunction (including the case where the serializer in the first left-side camera does not malfunction), the following implementation methods are possible, and the embodiments of this application do not limit them in any way.

[0107] Implementation Method 1: The first left-side camera captures the image of the left rear-view angle of the vehicle's exterior. The first on-chip system in the first controller processes the image information captured by the first left-side camera, and then transmits the processed information to the second on-chip system in the second controller. The second on-chip system can then transmit the information to the HMI display screen through the second serializer.

[0108] Method 2: The first left-side camera captures the image of the left rear-view angle outside the vehicle. The first on-chip system in the first controller forwards the image information of the left rear-view angle to the second on-chip system in the second controller through the in-vehicle communication link. After the second on-chip system processes the image information captured by the first left-side camera, the second on-chip system can transmit it to the HMI display screen through the second serializer.

[0109] It is understandable that the above implementation methods one and two are two ways to acquire images from the left rear view angle using the first left camera when the first left camera is not malfunctioning, but the left field of view display is malfunctioning. In other words, as long as the first left camera is not malfunctioning, it can still be used to acquire images from the left rear view angle.

[0110] Method 3: The second left-side camera captures the image of the left rear-view angle of the vehicle's exterior. The second on-chip system in the second controller processes the image information captured by the second left-side camera, and then transmits it to the HMI display screen through the second serializer.

[0111] It is understandable that the above-described implementation method three is a method of acquiring images from the left rear view angle using the second left camera when the first left-side camera is functioning correctly but the left-side view display is malfunctioning. In other words, even when the first left-side camera is functioning correctly, the second left-side camera can still be used to acquire images from the left rear view angle.

[0112] In the event that the right-side field-of-view display malfunctions (including the case where the deserializer configured in the right-side field-of-view display malfunctions), but the first controller does not malfunction (the case where the first deserializer, the first on-chip system, and the first serializer in the first controller do not malfunction) and the first right-side camera does not malfunction (including the case where the serializer in the first right-side camera does not malfunction), the following implementation methods are also possible, and the embodiments of this application do not limit them in any way.

[0113] Implementation Method 1: The first right-side camera captures an image of the right rear-view angle of the vehicle's exterior. The first on-chip system in the first controller processes the image information captured by the first right-side camera, and then transmits the processed information to the second on-chip system in the second controller. The second on-chip system can then transmit the information to the HMI display screen via the second serializer.

[0114] Method 2: The first right-side camera captures the image of the right rear-view angle outside the vehicle. The first on-chip system in the first controller forwards the image information of the right rear-view angle to the second on-chip system in the second controller through the in-vehicle communication link. After the second on-chip system processes the image information captured by the first right-side camera, the second on-chip system can transmit it to the HMI display screen through the second serializer.

[0115] It is understandable that the above implementation methods one and two are two ways to acquire images from the right rear view angle using the first right camera when the first right camera is not malfunctioning, but the right-side view display is malfunctioning. In other words, as long as the first right camera is not malfunctioning, it can still be used to acquire images from the right rear view angle.

[0116] Method 3: The second right-side camera captures the image from the right rear-view angle of the vehicle's exterior. The second on-chip system in the second controller processes the image information captured by the second right-side camera, and then transmits it to the HMI display screen through the second serializer.

[0117] It is understandable that the above-described implementation method three is a method of acquiring the image of the right rear view angle using the second right camera when the first right-side camera is not malfunctioning, but the right-side view display is malfunctioning. In other words, even when the first right-side camera is not malfunctioning, the second right-side camera can still be used to acquire the image of the right rear view angle.

[0118] In the event that the first left-side camera malfunctions (including the case where the serializer in the first left-side camera malfunctions), and the left-side field-of-view display does not malfunction (including the case where the deserializer configured in the left-side field-of-view display does not malfunction) and the first controller does not malfunction (the case where the first deserializer, the first on-chip system, and the first serializer in the first controller all do not malfunction), the following implementation methods are possible, and the embodiments of this application do not limit them in any way.

[0119] Implementation Method 1: The second left-side camera captures the image of the left rear-view angle outside the vehicle. The second on-chip system in the second controller forwards the image information of the left rear-view angle to the first on-chip system in the first controller through the in-vehicle communication link. After the first on-chip system processes the image information captured by the second left-side camera, the first on-chip system can transmit it to the left field of view display through the first serializer.

[0120] Method 2: The second left-side camera captures the image of the left rear-view angle outside the vehicle. The second on-chip system in the second controller processes the image information captured by the second left-side camera and forwards it to the first on-chip system in the first controller through the in-vehicle communication link. The first on-chip system can then transmit the image to the left-side field of view display through the first serializer.

[0121] Method 3: The second left-side camera captures the image of the left rear-view angle of the vehicle's exterior. The second on-chip system in the second controller processes the image information captured by the second left-side camera, and then transmits it to the HMI display screen through the second serializer.

[0122] In the event that the first right-side camera malfunctions (including the case where the serializer in the first right-side camera malfunctions), and the right-side field-of-view display does not malfunction (including the case where the deserializer configured in the right-side field-of-view display does not malfunction) and the first controller does not malfunction (the case where the first deserializer, the first on-chip system, and the first serializer in the first controller all do not malfunction), the following implementation methods are possible, and the embodiments of this application do not limit them in any way.

[0123] Implementation Method 1: The second right-side camera captures the image of the right rear-view angle outside the vehicle. The second on-chip system in the second controller forwards the image information of the right rear-view angle to the first on-chip system in the first controller through the in-vehicle communication link. After the first on-chip system processes the image information captured by the second right-side camera, the first on-chip system can transmit it to the right field of view display through the first serializer.

[0124] Method 2: The second right-side camera captures the image of the right rear-view angle outside the vehicle. The second on-chip system in the second controller processes the image information captured by the second right-side camera and forwards it to the first on-chip system in the first controller through the in-vehicle communication link. The first on-chip system can then transmit the image to the right-side field of view display through the first serializer.

[0125] Method 3: The second right-side camera captures the image from the right rear-view angle of the vehicle's exterior. The second on-chip system in the second controller processes the image information captured by the second right-side camera, and then transmits it to the HMI display screen through the second serializer.

[0126] In the event of a malfunction in the first controller—that is, a malfunction in any component of the first controller, such as the first deserializer, the first on-chip system, or the first serializer—the second left and second right cameras capture images. The second on-chip system in the second controller processes the image information from the second left and second right cameras, and then transmits the data to the HMI display via the second serializer. In other words, depending on the driver's operation or preset settings, the HMI display may show only the left rear-view image, only the right rear-view image, or both images simultaneously. This embodiment does not limit the display to these options.

[0127] Additionally, it should be noted that, as an example and not a limitation, in practical application scenarios, when the first controller is a multiplexed ADAS controller and the second controller is a multiplexed IVI system controller, the second system-on-chip can directly transmit the image-processed information to the IVI system's HMI display via the second serializer; when both the first and second controllers are multiplexed ADAS controllers, the second system-on-chip can transmit the image-processed information to the IVI system via the second serializer, and then the IVI system's HMI display will show it. Alternatively, the second system-on-chip can also forward the image-processed information to the IVI system via the vehicle Ethernet, and then the IVI system's HMI display will show it. This application's embodiments do not impose any limitations on this.

[0128] Figure 8 The illustration shows the first and second controllers packaged in the same box.

[0129] It should be understood that Figure 8 and Figure 7 The difference lies in whether the first controller and the second controller are packaged in the same box. Figure 8 In this design, the first and second controllers can be reused ADAS controllers. In the event of a failure in the first controller (either the first on-chip system and / or the first serializer in the first controller), the second on-chip system can transmit the processed image information to the IVI system via the second serializer, which is then displayed on the IVI system's HMI screen. Alternatively, the second on-chip system can also forward the processed image information to the IVI system via the vehicle Ethernet, which is then displayed on the IVI system's HMI screen. Regarding... Figure 8 For further descriptions, please refer to the above text. Figure 7 For the sake of brevity, the relevant descriptions will not be repeated here.

[0130] Optionally, the aforementioned multiple cameras may include four cameras: a first left-side camera, a second left-side camera, a first right-side camera, and a second right-side camera, all of which are connected to the first controller and the second controller.

[0131] Figure 9 This is another schematic block diagram of the electronic rearview mirror system provided in the embodiments of this application, which includes four cameras.

[0132] like Figure 9 As shown, the electronic rearview mirror system includes a first left-side camera, a second left-side camera, a first right-side camera, a second right-side camera, a first controller, a second controller, a left-side field-of-view display, a right-side field-of-view display, and an HMI display screen. The first left-side camera, the second left-side camera, the first right-side camera, and the second right-side camera are all connected to the first controller and the second controller, respectively. The left-side field-of-view display and the right-side field-of-view display are both connected to the first controller, and the HMI display screen is connected to the second controller. In this implementation, if the first left-side camera malfunctions, the second left-side camera can replace the first left-side camera to capture images of the left rear-view angle outside the vehicle; similarly, if the first right-side camera malfunctions, the second right-side camera can replace the first right-side camera to capture images of the right rear-view angle outside the vehicle, thereby enhancing the reliability of the electronic rearview mirror system.

[0133] Figure 10 and Figure 11 These are two more detailed schematic block diagrams of the electronic rearview mirror system provided in this application embodiment, which includes four cameras.

[0134] Figure 10 The illustration shows a scenario where the first and second controllers are encapsulated in two different boxes.

[0135] like Figure 10As shown, the first left camera, second left camera, first right camera, and second right camera can all be configured with dual-interface serializers. In this case, the first controller and the second controller need to be configured with dual-interface deserializers. For example, the first controller is configured with a dual-interface first deserializer and a dual-interface second deserializer, and the second controller is configured with a dual-interface third deserializer and a dual-interface fourth deserializer. The first left camera can transmit the captured image information to the first on-chip system in the first controller through its built-in serializer, and the first right camera can transmit the captured image information to the first on-chip system in the first controller through its built-in serializer, and the second left camera can transmit the captured image information to the first on-chip system in the first controller through its built-in serializer, and the second right camera can transmit the captured image information to the first on-chip system in the first controller through its built-in serializer, and the second right camera can transmit the captured image information to the first on-chip system in the first controller through its built-in serializer, and the second right camera can transmit the captured image information to the first on-chip system in the first controller through its built-in serializer, and the second deserializer. The first left-side camera, via its built-in serializer, transmits the captured image information to the second on-chip system in the second controller via a third deserializer. Similarly, the first right-side camera, via its built-in serializer, transmits the captured image information to the second on-chip system in the second controller via a third deserializer. The second left-side camera, via its built-in serializer, transmits the captured image information to the second on-chip system in the second controller via a fourth deserializer. The first or second on-chip system then performs image processing on the captured image information.

[0136] After image processing is completed, the processed information can be transmitted to the display. For example, if both the left and right view displays are equipped with deserializers, the first controller can transmit the image information of the processed left rear-view angle to the left view display and the image information of the processed right rear-view angle to the right view display through a first serializer with dual interfaces.

[0137] In the event that the left-side view display malfunctions (including the case where the deserializer configured in the left-side view display malfunctions), but the first deserializer, the first on-chip system, the first serializer, and the first left-side camera in the first controller do not malfunction (including the case where the serializer in the first left-side camera does not malfunction), the following implementation methods are possible, and the embodiments of this application do not limit them in any way.

[0138] Implementation Method 1: The first left-side camera captures the image of the left rear-view angle of the vehicle's exterior. The first on-chip system in the first controller processes the image information captured by the first left-side camera, and then transmits the processed information to the second on-chip system in the second controller. The second on-chip system can then transmit the information to the HMI display screen through the second serializer.

[0139] Method 2: The first left-side camera captures the image of the left rear-view angle outside the vehicle. The first on-chip system in the first controller forwards the image information of the left rear-view angle to the second on-chip system in the second controller through the in-vehicle communication link. After the second on-chip system processes the image information captured by the first left-side camera, the second on-chip system can transmit it to the HMI display screen through the second serializer.

[0140] It is understandable that the above implementation methods one and two are two ways to acquire images from the left rear view angle using the first left camera when the first left camera is not malfunctioning, but the left field of view display is malfunctioning. In other words, as long as the first left camera is not malfunctioning, it can still be used to acquire images from the left rear view angle.

[0141] Method 3: The second left-side camera captures the image of the left rear-view angle of the vehicle's exterior. The second on-chip system in the second controller processes the image information captured by the second left-side camera, and then transmits it to the HMI display screen through the second serializer.

[0142] It is understandable that the above-described implementation method three is a method of acquiring images from the left rear view angle using the second left camera when the first left-side camera is functioning correctly but the left-side view display is malfunctioning. In other words, even when the first left-side camera is functioning correctly, the second left-side camera can still be used to acquire images from the left rear view angle.

[0143] In the event that the right-side field-of-view display malfunctions (including the case where the deserializer configured in the right-side field-of-view display malfunctions), but the first deserializer, the first on-chip system, the first serializer, and the first right-side camera in the first controller do not malfunction (including the case where the serializer in the first right-side camera does not malfunction), the following implementation methods are possible, and the embodiments of this application do not limit them in any way.

[0144] Implementation Method 1: The first right-side camera captures an image of the right rear-view angle of the vehicle's exterior. The first on-chip system in the first controller processes the image information captured by the first right-side camera, and then transmits the processed information to the second on-chip system in the second controller. The second on-chip system can then transmit the information to the HMI display screen via the second serializer.

[0145] Method 2: The first right-side camera captures the image of the right rear-view angle outside the vehicle. The first on-chip system in the first controller forwards the image information of the right rear-view angle to the second on-chip system in the second controller through the in-vehicle communication link. After the second on-chip system processes the image information captured by the first right-side camera, the second on-chip system can transmit it to the HMI display screen through the second serializer.

[0146] It is understandable that the above implementation methods one and two are two ways to acquire images from the right rear view angle using the first right camera when the first right camera is not malfunctioning, but the right-side view display is malfunctioning. In other words, as long as the first right camera is not malfunctioning, it can still be used to acquire images from the right rear view angle.

[0147] Method 3: The second right-side camera captures the image from the right rear-view angle of the vehicle's exterior. The second on-chip system in the second controller processes the image information captured by the second right-side camera, and then transmits it to the HMI display screen through the second serializer.

[0148] It is understandable that the above-described implementation method three is a method of acquiring the image of the right rear view angle using the second right camera when the first right-side camera is not malfunctioning, but the right-side view display is malfunctioning. In other words, even when the first right-side camera is not malfunctioning, the second right-side camera can still be used to acquire the image of the right rear view angle.

[0149] In the event that the first left-side camera malfunctions (including the case where the serializer in the first left-side camera malfunctions), and the left-side field-of-view display does not malfunction (including the case where the deserializer configured in the left-side field-of-view display does not malfunction) and the first controller does not malfunction (the case where the first deserializer, the second deserializer, the first on-chip system, and the first serializer in the first controller all do not malfunction), the following implementation methods are possible, and the embodiments of this application do not limit them in any way.

[0150] Implementation Method 1: The second left-side camera captures the image of the left rear-view angle outside the vehicle. The second left-side camera transmits the image information of the left rear-view angle to the first on-chip system in the first controller through the second deserializer via its built-in serializer. After the first on-chip system processes the image information captured by the second left-side camera, it can transmit it to the left field of view display through the first serializer.

[0151] Method 2: The second left-side camera captures the image of the left rear-view angle outside the vehicle. The second left-side camera transmits the image information of the left rear-view angle to the second on-chip system in the second controller through the fourth deserializer via its built-in serializer. The second on-chip system in the second controller processes the image information captured by the second left-side camera and forwards it to the first on-chip system in the first controller through the in-vehicle communication link. The first on-chip system can transmit it to the left field of view display through the first serializer.

[0152] Implementation Method 3: The second left-side camera captures the image of the left rear-view angle outside the vehicle. The second left-side camera transmits the image information of the left rear-view angle to the second on-chip system in the second controller through the fourth deserializer via its built-in serializer. The second on-chip system in the second controller forwards the image to the first on-chip system in the first controller through the in-vehicle communication link. After the first on-chip system in the first controller processes the image information captured by the second left-side camera, it can transmit the image to the left field of view display through the first serializer.

[0153] Implementation Method 4: The second left-side camera captures the image of the left rear-view angle outside the vehicle. The second left-side camera transmits the image information of the left rear-view angle to the second system on-chip in the second controller through the fourth deserializer via its built-in serializer. The second system on-chip in the second controller performs image processing on the image information captured by the second left-side camera, and then transmits it to the HMI display screen through the second serializer.

[0154] In the event that the first right-side camera malfunctions (including the case where the serializer in the first right-side camera malfunctions), and the right-side field-of-view display does not malfunction (including the case where the deserializer configured in the right-side field-of-view display does not malfunction) and the first controller does not malfunction (the case where the first deserializer, the second deserializer, the first on-chip system, and the first serializer in the first controller all do not malfunction), the following implementation methods are possible, and the embodiments of this application do not limit them in any way.

[0155] Implementation Method 1: The second right-side camera captures the image of the right rear-view angle outside the vehicle. The second right-side camera transmits the image information of the right rear-view angle to the first on-chip system in the first controller through the second deserializer via its built-in serializer. After the first on-chip system processes the image information captured by the second right-side camera, it can transmit it to the right field of view display through the first serializer.

[0156] Method 2: The second right-side camera captures the image of the right rear-view angle outside the vehicle. The second right-side camera transmits the image information of the right rear-view angle to the second on-chip system in the second controller through the fourth deserializer via its built-in serializer. The second on-chip system in the second controller processes the image information captured by the second right-side camera and forwards it to the first on-chip system in the first controller through the in-vehicle communication link. The first on-chip system can transmit it to the right-side field of view display through the first serializer.

[0157] Method 3: The second right-side camera captures the image of the right rear-view angle outside the vehicle. The second right-side camera transmits the image information of the right rear-view angle to the second on-chip system in the second controller through the fourth deserializer via its built-in serializer. The second on-chip system in the second controller forwards the image to the first on-chip system in the first controller through the in-vehicle communication link. After the first on-chip system in the first controller processes the image information captured by the second right-side camera, it can transmit the image to the right-side field of view display through the first serializer.

[0158] Implementation Method 4: The second right-side camera captures the image of the right rear-view angle outside the vehicle. The second right-side camera transmits the image information of the right rear-view angle to the second system-on-a-chip in the second controller through the fourth deserializer via its built-in serializer. The second system-on-a-chip in the second controller performs image processing on the image information captured by the second right-side camera, and then transmits it to the HMI display screen through the second serializer.

[0159] In the event of a malfunction in the first on-chip system or the first serializer of the first controller, images are captured by the second left and second right cameras. The second on-chip system in the second controller processes the image information from these images and then transmits it to the HMI display via the second serializer or the vehicle Ethernet. In other words, depending on the driver's operation or preset settings, the HMI display may show only the left rear-view image, only the right rear-view image, or both images simultaneously. This embodiment does not limit the specific display options.

[0160] Additionally, it should be noted that, as an example and not a limitation, in practical application scenarios, when the first controller is a multiplexed ADAS controller and the second controller is a multiplexed IVI system controller, the second system-on-chip can directly transmit the image-processed information to the IVI system's HMI display via the second serializer; when both the first and second controllers are multiplexed ADAS controllers, the second system-on-chip can transmit the image-processed information to the IVI system via the second serializer, and then the IVI system's HMI display will show it. Alternatively, the second system-on-chip can also forward the image-processed information to the IVI system via the vehicle Ethernet, and then the IVI system's HMI display will show it. This application's embodiments do not impose any limitations on this.

[0161] Figure 11 The illustration shows the first and second controllers packaged in the same box.

[0162] It should be understood that Figure 11 and Figure 10 The difference lies in whether the first controller and the second controller are packaged in the same box. Figure 11 In this design, the first and second controllers can be reused ADAS controllers. In the event of a failure in the first controller (either the first on-chip system and / or the first serializer in the first controller), the second on-chip system can transmit the processed image information to the IVI system via the second serializer, which is then displayed on the IVI system's HMI screen. Alternatively, the second on-chip system can also forward the processed image information to the IVI system via the vehicle Ethernet, which is then displayed on the IVI system's HMI screen. Regarding... Figure 11 For further descriptions, please refer to the above text. Figure 10 For the sake of brevity, the relevant descriptions will not be repeated here.

[0163] It should be noted that if at least one component of the aforementioned electronic rearview mirror system malfunctions, causing the left / right view display to fail to show the images of the left / right rearview angles outside the vehicle, the driver can use the left / right turn signal control lever (or operate it on the HMI interface such as the central control screen or instrument panel) to inform the first controller or the second controller of the steering intention. After the first controller or the second controller processes the image information of the left / right rearview angles outside the vehicle, it can be displayed on the HMI display screen such as the central control screen or instrument panel. This application embodiment does not impose any limitations on this.

[0164] Based on the above solution, firstly, by reusing the controllers of other vehicle-mounted systems, the function of the electronic rearview mirror can be realized, eliminating the need for a separate electronic rearview mirror ECU and saving the cost of the ECU, thereby reducing the cost of deploying the electronic rearview mirror system in the vehicle; secondly, by reusing two controllers from other vehicle-mounted systems, the other controller can still process the image information from the camera even if one controller fails, thus enhancing the reliability of the electronic rearview mirror system; thirdly, by reusing the HMI display screen from other vehicle-mounted systems, the reliability of the electronic rearview mirror system is further improved.

[0165] This application provides another electronic rearview mirror system, which may include: multiple cameras, a first controller, and multiple displays. The multiple cameras are configured to capture images of the left and right rearview angles outside the vehicle. The first controller is configured to acquire image information from the multiple cameras and perform image processing on the information. The first controller is also configured to function as a controller for an in-vehicle system different from the electronic rearview mirror system. The multiple displays are configured to display the image-processed images.

[0166] Figure 12 This is another schematic block diagram of the electronic rearview mirror system provided in the embodiments of this application.

[0167] like Figure 12As shown, the electronic rearview mirror system includes multiple cameras: camera 1, camera 2, ..., camera n, where n is a positive integer and n≥2. These multiple cameras can be used to capture images of the left and right rearview angles of the vehicle's exterior. The electronic rearview mirror system includes a first controller, which can acquire information about the images of the left and right rearview angles of the vehicle's exterior captured by the multiple cameras, and can perform image processing on this information using image processing technology. The electronic rearview mirror system includes multiple displays: display 1, display 2, ..., display m, where m is a positive integer and m≥2. These multiple displays can be used to display images after image processing of the images captured by the multiple cameras by the first controller and / or the second controller.

[0168] It should be noted that the first controller is not a separately deployed electronic rearview mirror ECU, but rather a reused controller from another in-vehicle system different from the electronic rearview mirror system. Additionally, the HMI display is also a reused HMI display from another in-vehicle system.

[0169] In one possible design, the first controller is also configured to function as a controller for an in-vehicle system different from the electronic rearview mirror system, including: the first controller is also configured to function as a controller for ADAS.

[0170] In other words, the first controller can be a reused ADAS controller.

[0171] It should be noted that when the ADAS includes two controllers (one of which can be the main controller and the other can be the backup controller), the backup controller of the ADAS can be reused as the first controller of the electronic rearview mirror system, or the main controller of the ADAS can be reused as the first controller of the electronic rearview mirror system. This application embodiment does not limit this in any way.

[0172] In another possible design, the first controller is also configured as a controller for an in-vehicle system different from the electronic rearview mirror system, including: the first controller is also configured as a controller for an IVI system.

[0173] In other words, the first controller can be a controller from a reused IVI system.

[0174] Optionally, the first controller is also configured for fault detection to determine that at least one of the following has failed: one or more of the multiple cameras, the left field of view display, or the right field of view display.

[0175] The first controller can also be used for fault detection. The first controller can perform fault detection on one or more cameras among a plurality of cameras, the left field-of-view display, or the right field-of-view display to determine whether one or more cameras among a plurality of cameras, the left field-of-view display, or the right field-of-view display has malfunctioned. This application embodiment does not limit this aspect.

[0176] In one possible design, the multiple cameras include at least one left-side camera and at least one right-side camera. The at least one left-side camera is configured to capture images from a left rear-view angle; the at least one right-side camera is configured to capture images from a right rear-view angle; and the multiple displays include a left-side field-of-view display, a right-side field-of-view display, and an HMI display. The left-side field-of-view display is configured to display an image processed from information of the left rear-view angle image; the right-side field-of-view display is configured to display an image processed from information of the right rear-view angle image; the HMI display is configured to display the image processed from information of the left rear-view angle image in the event of a failure of the left-side field-of-view display, and / or to display the image processed from information of the right rear-view angle image in the event of a failure of the right-side field-of-view display; wherein the left-side field-of-view display, the right-side field-of-view display, and the HMI display are all connected to a first controller.

[0177] Figure 13 This is another schematic block diagram of the electronic rearview mirror system provided in the embodiments of this application, which includes two cameras.

[0178] An example, such as Figure 13 As shown, the electronic rearview mirror system includes a left-side camera, a right-side camera, a left-side field-of-view display, a right-side field-of-view display, an HMI display, and a first controller, wherein the left-side camera, the right-side camera, the left-side field-of-view display, the right-side field-of-view display, and the HMI display are all connected to the first controller.

[0179] Figure 14 This is a more detailed schematic block diagram of the electronic rearview mirror system provided in this application embodiment, which includes two cameras.

[0180] like Figure 14 As shown, both the left and right cameras can be configured with single-interface serializers. In this case, the first controller can be configured with a dual-interface deserializer. The left camera can transmit the captured image information to the on-chip system in the first controller via its built-in serializer and deserializer. Similarly, the right camera can transmit the captured image information to the on-chip system in the first controller via its built-in serializer and deserializer. The on-chip system then performs image processing on the image information.

[0181] After image processing is completed, the processed information can be transmitted to the display. For example, if both the left and right view displays are equipped with deserializers, the first controller can transmit the image information of the processed left rear-view angle to the left view display and the image information of the processed right rear-view angle to the right view display through a first serializer with dual interfaces.

[0182] In the event of a malfunction in the left-side view display (including a malfunction in the deserializer configured in the left-side view display) or a malfunction in the first serializer of the first controller, the left-side camera can capture an image of the left rear-view angle outside the vehicle. The on-chip system in the first controller processes the image information captured by the left-side camera, and then transmits it to the HMI display screen through the second serializer.

[0183] In the event of a malfunction in the right-side view display (including a malfunction in the deserializer configured in the right-side view display) or a malfunction in the first serializer of the first controller, the right-side camera can capture an image of the right rear-view angle outside the vehicle. The on-chip system in the first controller processes the image information captured by the right-side camera, and then transmits it to the HMI display screen through the second serializer.

[0184] As an example and not a limitation, in practical applications, when the first controller is a controller for a multiplexed IVI system, the on-chip system in the first controller can directly transmit the image-processed information to the HMI display of the IVI system via the second serializer; when the first controller is a controller for a multiplexed ADAS system, the on-chip system in the first controller can transmit the image-processed information to the IVI system via the second serializer, and then the IVI system's HMI display will show it. Alternatively, the on-chip system in the first controller can also forward the image-processed information to the IVI system via the vehicle Ethernet, and then the IVI system's HMI display will show it. This application's embodiments do not impose any limitations on these aspects.

[0185] Figure 15 This is another schematic block diagram of the electronic rearview mirror system provided in the embodiments of this application, which includes four cameras.

[0186] Another example, such as Figure 15As shown, the electronic rearview mirror system includes a first left-side camera, a second left-side camera, a first right-side camera, a second right-side camera, a left-side field-of-view display, a right-side field-of-view display, an HMI display screen, and a first controller. The first left-side camera, the second left-side camera, the first right-side camera, the second right-side camera, the left-side field-of-view display, the right-side field-of-view display screen, and the HMI display screen are all connected to the first controller.

[0187] Figure 16 This is a more detailed schematic block diagram of the electronic rearview mirror system provided in this application embodiment, which includes four cameras.

[0188] like Figure 16 As shown, the first left camera, second left camera, first right camera, and second right camera can all be configured with single-interface serializers. In this case, the first controller can be configured with two dual-interface deserializers, such as the first and second deserializers shown in the figure. The first left camera can transmit the captured image information to the on-chip system in the first controller via its built-in serializer and the first deserializer. Similarly, the second left camera can transmit the captured image information to the on-chip system in the first controller via its built-in serializer and the second deserializer. Likewise, the first right camera can transmit the captured image information to the on-chip system in the first controller via its built-in serializer and the second right camera can transmit the captured image information to the on-chip system in the second controller via its built-in serializer and the second deserializer. The on-chip system in the first controller then performs image processing on the image information.

[0189] After image processing is completed, the processed information can be transmitted to the display. For example, if both the left and right view displays are equipped with deserializers, the first controller can transmit the image information of the processed left rear-view angle to the left view display and the image information of the processed right rear-view angle to the right view display through a first serializer with dual interfaces.

[0190] In the event of a malfunction in the first left-side camera (including a malfunction in the encoder configured in the first left-side camera), the second left-side camera can be used to capture images of the left rear-view angle of the vehicle's exterior. In the event of a malfunction in the first right-side camera (including a malfunction in the encoder configured in the first right-side camera), the right left-side camera can be used to capture images of the right rear-view angle of the vehicle's exterior.

[0191] In the event of a malfunction in the first decoder in the first controller, the second left-side camera can replace the first left-side camera to capture images of the left rear-view angle of the vehicle's exterior, and the right left-side camera can replace the first right-side camera to capture images of the right rear-view angle of the vehicle's exterior.

[0192] In the event of a malfunction in the left-side view display (including a malfunction in the deserializer configured in the left-side view display) or a malfunction in the first serializer of the first controller, the on-chip system in the first controller can perform image processing on the information of the image of the left-side rear-view angle outside the vehicle, and then the on-chip system can transmit it to the HMI display screen through the second serializer.

[0193] In the event of a malfunction in the right-side view display (including a malfunction in the deserializer configured in the right-side view display) or a malfunction in the first serializer of the first controller, the on-chip system in the first controller can perform image processing on the image information of the right-side rear-view angle outside the vehicle, and then the on-chip system can transmit it to the HMI display screen through the second serializer.

[0194] Additionally, it should be noted that, as an example and not a limitation, in practical application scenarios, when the first controller is a controller for a multiplexed IVI system, the on-chip system in the first controller can directly transmit the image-processed information to the HMI display of the IVI system via the second serializer; when the first controller is a controller for a multiplexed ADAS system, the on-chip system in the first controller can transmit the image-processed information to the IVI system via the second serializer, and then the IVI system's HMI display will show it. Alternatively, the on-chip system in the first controller can also forward the image-processed information to the IVI system via the vehicle Ethernet, and then the IVI system's HMI display will show it. This application's embodiments do not impose any limitations on this.

[0195] Based on the above solution, the electronic rearview mirror function is achieved by reusing the controllers of other in-vehicle systems. This eliminates the need for a separate electronic rearview mirror ECU, saving on its cost and thus reducing the overall cost of deploying the electronic rearview mirror system in the vehicle. Furthermore, reusing the HMI display screen from other in-vehicle systems improves the reliability of the electronic rearview mirror system.

[0196] It should be understood that Figures 2 to 16For illustrative purposes only, the arrows in the diagram may indicate the flow of data or information, and do not limit the circuit connections between the electronic rearview mirror system and other in-vehicle systems (e.g., ADAS, IVI systems) in actual application scenarios. Furthermore, the data or information flow shown in the diagram for the electronic rearview mirror system does not limit the flow of data or information in other in-vehicle systems (e.g., ADAS, IVI systems) in actual application scenarios.

[0197] This application also provides a vehicle that includes the electronic rearview mirror system described above.

[0198] Optionally, the vehicle is used to determine the user's steering intention based on the user's operation, and to display an image at a rearview angle corresponding to the steering intention based on the electronic rearview mirror system.

[0199] It should be understood that a user's steering intention may include turning right or turning left. Displaying the image at the rearview angle corresponding to the steering intention can be understood as follows: if the user's steering intention is to turn right, then the image at the right rearview angle is displayed; if the user's steering intention is to turn left, then the image at the left rearview angle is displayed.

[0200] It should be noted that user operations may include toggling the left / right turn signal control lever, operating on the HMI display, issuing predefined control voice commands, or making predefined control gestures, etc., and this application embodiment does not impose any limitations on these operations.

[0201] It should also be noted that in some possible implementations, the images of the corresponding rear-view angles may not be displayed according to the user's turning intention, but rather the images of the left rear-view angle and the right rear-view angle may be displayed together. This application embodiment does not impose any limitations on this.

[0202] Figure 17 and Figure 18 These are two schematic diagrams of the vehicle provided in the embodiments of this application.

[0203] As an example rather than a limitation, such as Figure 17 As shown, the vehicle provided in this application embodiment may include Figure 2 The electronic rearview mirror system shown.

[0204] For example, if at least one component of the electronic rearview mirror system deployed on the vehicle malfunctions, causing the left / right view display to fail to show the images of the left / right rearview angles outside the vehicle, the driver can inform the first controller or the second controller of the steering intention through the left / right turn signal control lever (or through operation on the HMI display screen such as the central control screen or instrument panel, or through predefined control voice, predefined control gestures, etc.). After image processing, the first controller or the second controller can display the information of the images of the left / right rearview angles outside the vehicle on the HMI display screen such as the central control screen or instrument panel to ensure the reliability of the electronic rearview mirror system.

[0205] As an example rather than a limitation, such as Figure 18 As shown, the vehicle provided in this application embodiment may include Figure 12 The electronic rearview mirror system shown.

[0206] For example, if at least one component of the electronic rearview mirror system deployed on the vehicle malfunctions, causing the left / right view display to fail to show the images of the left / right rearview angles outside the vehicle, the driver can inform the first controller of the steering intention through the left / right turn signal control lever (or by operating it on the HMI display screen such as the central control screen or instrument panel, or by using predefined control voice, predefined control gestures, or other control methods). After image processing, the first controller can display the information of the images of the left / right rearview angles outside the vehicle on the central control screen or instrument panel, etc., to ensure the reliability of the electronic rearview mirror system.

[0207] Those skilled in the art will recognize that the various illustrative logical blocks and circuits described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application. In the several embodiments provided in this application, it should be understood that the disclosed apparatus, devices, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, and in actual implementation, there may be other divisions, such as multiple units or components being combined or integrated into another system, or some features being ignored or not performed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interface, and the indirect coupling or communication connection of apparatus or units may be electrical, mechanical, or other forms.

[0208] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0209] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0210] In the above embodiments, the functions of each functional unit can be implemented entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions (programs). When the computer program instructions (programs) are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital video discs, DVDs), or semiconductor media (e.g., solid-state disks, SSDs), etc.

[0211] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0212] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An electronic rearview mirror system, characterized by, The system includes: Multiple cameras are configured to capture images from the left and right rear-view angles of the vehicle's exterior. A first controller and a second controller connected to each other are configured to acquire information from the images from the plurality of cameras and perform image processing on the information; wherein the first controller and the second controller are respectively the first controller and the second controller of the advanced driver assistance system (ADAS). Multiple displays are configured to display images processed by the image processing; the multiple displays include a left field-of-view display configured to display an image processed from information of the image at the left rear-view angle, and a right field-of-view display configured to display an image processed from information of the image at the right rear-view angle; both the left field-of-view display and the right field-of-view display are connected to the first controller. The plurality of cameras includes at least one left-side camera and at least one right-side camera, wherein the at least one left-side camera includes a first left-side camera and a second left-side camera, the first left-side camera being used to capture images of the left rear-view angle; the second left-side camera being used to capture images of the left rear-view angle in the event of a malfunction of the first left-side camera or the left-side field-of-view display; the at least one right-side camera is configured to capture images of the right rear-view angle; both the at least one left-side camera and the at least one right-side camera are connected to the first controller and the second controller; The second controller is configured to, in the event of a malfunction in the left-side view display and / or the right-side view display, control the in-vehicle infotainment (IVI) system to display an image after image processing of information on the left-side rearview angle and / or the right-side rearview angle through the human-machine interface (HMI) display screen.

2. The system of claim 1, wherein, The second controller includes a second system-on-chip and a second serializer; specifically, the second system-on-chip transmits the image after image processing to the IVI system for display on the HMI display screen via the second serializer. The image processed includes an image processed from the information of the image from the left rear-view angle and / or an image processed from the information of the image from the right rear-view angle.

3. The system of claim 2, wherein, The at least one right-side camera includes a first right-side camera and a second right-side camera. The first right-side camera is used to capture images of the right rear-view angle. The second right-side camera is used to capture images of the right rear-view angle in the event of a malfunction of the first right-side camera or the right-side field of view display. The first left camera and the first right camera are both connected to the first controller, and the second left camera and the second right camera are both connected to the second controller.

4. The system as described in any one of claims 1 to 3, characterized in that, The first controller and the second controller are packaged in different boxes, or in the same box.

5. The system of any one of claims 2 to 4, wherein, The second controller is also used for fault detection to determine that at least one of the following has failed: one or more of the plurality of cameras, the first controller, the left field of view display, or the right field of view display.

6. An electronic rearview mirror system, characterized by The system includes: Multiple cameras are configured to capture images from the left and right rear-view angles of the vehicle's exterior. A first controller is configured to acquire information from the plurality of cameras and perform image processing on the information, wherein the first controller is a controller for an advanced driver assistance system (ADAS). Multiple displays are configured to display the image processed by the image processing, including a left field of view display configured to display the image processed from the information of the image at the left rear-view angle, and a right field of view display configured to display the image processed from the information of the image at the right rear-view angle; both the left field of view display and the right field of view display are connected to the first controller. The plurality of cameras includes at least one left-side camera and at least one right-side camera, wherein the at least one left-side camera includes a first left-side camera and a second left-side camera; the first left-side camera is used to capture images of the left rear-view angle; the second left-side camera is used to capture images of the left rear-view angle in the event of a malfunction of the first left-side camera or the left field of view display; the at least one right-side camera is configured to capture images of the right rear-view angle; both the at least one left-side camera and the at least one right-side camera are connected to the first controller; The first controller is used, in the event of a malfunction of the left-side view display and / or the right-side view display, to control the display of the image processed from the information of the left-side rearview angle and / or the right-side rearview angle by the in-vehicle infotainment (IVI) system through the human-machine interface (HMI) display screen.

7. The system as described in claim 6, characterized in that, The at least one right-side camera includes a first right-side camera and a second right-side camera, wherein the second right-side camera is used to capture images of the right rear-view angle in the event of a malfunction of the first right-side camera or the right-side field of view display. The first left-side camera and the first right-side camera are connected to the first controller via a first deserializer, and the second left-side camera and the second right-side camera are connected to the first controller via a second deserializer.

8. The system of claim 7, wherein, The first controller includes a first system-on-a-chip and a first serializer; The first controller is specifically configured to transmit the image-processed image to the left field-view display and / or the right field-view display via the first serializer, so that the left field-view display displays the image after image processing of the information of the image from the right rear-view angle, and the right field-view display displays the image after image processing of the information of the image from the right rear-view angle.

9. The system of claim 8, wherein, The first controller also includes a second serializer; Specifically, the first controller is used to transmit the image after image processing to the IVI system for display on the HMI display screen in the event of a failure of the first serializer; The image processed includes an image processed from the information of the image from the left rear-view angle and / or an image processed from the information of the image from the right rear-view angle.

10. The system of claim 7, wherein, The first controller is also configured for fault detection to determine that at least one of the following has failed: one or more of the plurality of cameras, the left field-of-view display, or the right field-of-view display.

11. A vehicle characterized by comprising: The vehicle includes an electronic rearview mirror system as claimed in any one of claims 1 to 5, or the vehicle includes an electronic rearview mirror system as claimed in any one of claims 6 to 10.

Images