Multi-dimensional cooperative control system of automobile electronic rearview mirror and rearview mirror

Abstract

The invention discloses a multi-dimensional cooperative control system of an automobile electronic rearview mirror and the rearview mirror, and relates to the technical field of rearview mirror control, a main control module can monitor a fault of a multi-source sensing unit, and when the fault occurs, a user interaction terminal is notified to display a standby mode key; after a user triggers, the main control module instructs the bionic display unit to perform emergency display through a standby transmission line, the multi-source sensing unit collects and fuses millimeter wave radar, event camera and LiDAR data in a normal mode, the data is displayed by the bionic display unit after being subjected to space-time alignment processing, and the bionic display unit simulates a human eye retina structure and a light adaptation mechanism. The system can dynamically optimize the display effect, supports the establishment of stable communication through an Internet of Vehicles cloud platform or low-power-consumption Bluetooth, and is also provided with a display state monitoring module for feeding back the display state to confirm the emergency display effect. The system solves the problems of low multi-source sensing data fusion precision, poor display effect dynamic adaptability, unstable communication and imperfect fault handling mechanism in the prior art.

Description

Technical Field

[0001] This invention relates to the field of rearview mirror control technology, and more specifically, to a multi-dimensional collaborative control system and rearview mirror for automotive electronic rearview mirrors. Background Technology

[0002] With the continuous development of automotive electronics technology, electronic rearview mirrors, as an important component of vehicles, play a crucial role in improving driving experience and safety through technological iteration. Traditional electronic rearview mirrors mainly rely on a single camera to collect image information behind the vehicle. However, this design has many shortcomings and is difficult to adapt to the complex and ever-changing modern traffic environment and driving needs.

[0003] In terms of perception accuracy, a single camera performs poorly in adverse weather conditions. For example, in heavy rain, raindrops adhering to the camera lens or increased moisture density in the air can cause blurred images and severely reduced contrast, making it difficult for drivers to discern details of vehicles, pedestrians, and other objects behind them. In dense fog, light scattering significantly reduces the quality of images captured by the camera and shortens visibility, making it difficult for drivers to accurately judge the distance and speed of objects behind them. At night in low light conditions, images captured by the camera have increased noise and insufficient brightness, affecting the driver's clear observation of the environment behind them. In addition, when there are large trucks, parked vehicles, or other obstructions behind the driver, a single camera cannot obtain key information about the obstructed area, creating blind spots and hindering safe driving decisions.

[0004] From the perspective of system synergy, traditional electronic rearview mirrors typically operate independently, lacking effective data interaction and communication mechanisms with other intelligent systems in the vehicle, such as vehicle-to-everything (V2X) cloud platforms and in-vehicle communication gateways. This isolated operating mode prevents them from integrating into the vehicle's intelligent connected ecosystem, limiting the coordinated optimization of intelligent vehicle functions. For example, they cannot share rear road condition information with the V2X cloud platform, nor can they interact with other vehicles, making it difficult to leverage the overall advantages of intelligent connected vehicles. In terms of reliability, if the sensing unit (camera) of a traditional electronic rearview mirror malfunctions, the entire rearview mirror system may not function properly. Lacking an effective emergency backup mechanism, it cannot provide reliable rear environment information to the driver during critical moments such as reversing or changing lanes, posing a serious safety hazard.

[0005] Therefore, the limitations of existing electronic rearview mirrors in complex weather, obstructed conditions, and communication coordination mean that they cannot meet the safety and intelligence needs of modern car driving. Summary of the Invention

[0006] In order to overcome the limitations of electronic rearview mirrors in complex weather, obstructed conditions, and communication coordination, this invention discloses a multi-dimensional collaborative control system for automotive electronic rearview mirrors and a rearview mirror that can effectively solve the above-mentioned technical problems.

[0007] To solve the above-mentioned technical problems, the technical solution of the present invention is as follows:

[0008] A multi-dimensional collaborative control system for an automotive electronic rearview mirror includes a main control module, a backup transmission line, a multi-source sensing unit, a bionic display unit, and a user interaction terminal that establishes a communication connection with the main control module, all installed in the vehicle.

[0009] The main control module is used to determine whether the multi-source sensing unit has malfunctioned. If so, it sends sensing unit malfunction information to the user interaction terminal.

[0010] The user interaction terminal is used to display a backup mode button on the rearview mirror operation interface in response to receiving fault information from the sensing unit.

[0011] The user interaction terminal is also used to generate a backup mode instruction in response to the user clicking the backup mode button, and send the backup mode instruction to the main control module;

[0012] The main control module is also configured to, in response to receiving the backup mode instruction, forward the backup mode instruction to the bionic display unit through the backup transmission line, so as to control the bionic display unit to perform emergency display operations.

[0013] Preferably, the user interaction terminal is further configured to generate a normal mode command in response to the user clicking the preset normal mode button on the rearview mirror operation interface, and send the normal mode command to the main control module;

[0014] The main control module is specifically used to: in response to receiving the normal mode instruction, determine whether the multi-source sensing unit has malfunctioned; if so, send sensing unit malfunction information to the user interaction terminal; if not, forward the normal mode instruction to the multi-source sensing unit.

[0015] The multi-source sensing unit is used to collect environmental data and transmit it to the bionic display unit for display in response to receiving the normal mode command;

[0016] The multi-source sensing unit includes a millimeter-wave radar subunit, an event camera subunit, and a LiDAR subunit.

[0017] The millimeter-wave radar subunit is used to collect millimeter-wave radar point cloud data behind the vehicle.

[0018] The event camera subunit is used to acquire dynamic image data streams from behind the vehicle;

[0019] The LiDAR subunit is used to collect point cloud data of the lidar behind the vehicle;

[0020] The multi-source sensing unit is also used to perform spatiotemporal alignment processing on the millimeter-wave radar point cloud data, dynamic image data stream, and lidar point cloud data.

[0021] Preferably, the system further includes a vehicle-to-everything (V2X) cloud platform;

[0022] The user interaction terminal establishes a communication connection with the main control module in the following way: by connecting to the vehicle network cloud platform via a wireless network;

[0023] An identity authentication code is sent to the vehicle network cloud platform, which then verifies the identity authentication code. Upon successful verification, a communication connection is established between the main control module and the user interaction terminal based on the vehicle network cloud platform.

[0024] Preferably, the user interaction terminal establishes a communication connection with the main control module in the following way: by connecting to the main control module via Bluetooth Low Energy;

[0025] A Bluetooth pairing key is sent to the main control module, enabling the main control module to verify the Bluetooth pairing key. Upon successful verification, a communication connection is established between the main control module and the user interaction terminal.

[0026] Preferably, the control system further includes an on-board communication gateway;

[0027] The vehicle-mounted communication gateway is used to establish a communication connection between the main control module, the backup transmission line, and the multi-source sensing unit after passing the communication security authentication of the main control module.

[0028] The control system also includes an in-vehicle Ethernet bus; the main control module is connected to the in-vehicle communication gateway through the in-vehicle Ethernet bus, the in-vehicle communication gateway is connected to the multi-source sensing unit through the in-vehicle Ethernet bus, and the multi-source sensing unit is connected to the bionic display unit through the backup transmission line.

[0029] Preferably, the main control module determines whether the multi-source sensing unit has malfunctioned by performing the following steps: generating a data request instruction; wherein the data request instruction is used to instruct the multi-source sensing unit to return environmental data;

[0030] The data request instruction is sent to the multi-source sensing unit;

[0031] If no environmental data is received from the multi-source sensing unit within a first preset time period after the data request instruction is sent, the multi-source sensing unit is determined to have malfunctioned; otherwise, the multi-source sensing unit is determined not to have malfunctioned.

[0032] Preferably, the backup transmission line is a FlexRay bus.

[0033] Preferably, the control system further includes a status monitoring module;

[0034] The display status monitoring module is used to detect the display status of the bionic display unit;

[0035] The bionic display unit is used to obtain the current display status through the display status monitoring module after performing an emergency display operation, and to feed back the current display status to the main control module through the backup transmission line;

[0036] The main control module is also configured to respond to receiving the current display status within a second preset time period after forwarding the backup mode instruction to the bionic display unit, determine whether the emergency display is successful based on the current display status, and send the determination result to the user interaction terminal;

[0037] The user interaction terminal is also used to display the judgment result in response to receiving the judgment result;

[0038] The main control module is also configured to generate display failure information and send the display failure information to the user interaction terminal if it does not receive the current display state within the second preset time period after forwarding the backup mode instruction to the bionic display unit;

[0039] The user interaction terminal is also used to display the display failure information in response to receiving the display failure information.

[0040] Preferably, the bionic display unit includes a curved display substrate, a light field modulation layer, and a neuromorphic driving chip;

[0041] The curved display substrate is used to simulate the curved structure of the human eye's retina;

[0042] The light field adjustment layer is used to adjust the display brightness and contrast according to the ambient light intensity;

[0043] The neuromorphic driver chip is used to simulate the retinal light adaptation mechanism to achieve dynamic image display optimization.

[0044] Preferably, an automotive electronic rearview mirror is controlled by the aforementioned multi-dimensional collaborative control system for automotive electronic rearview mirrors.

[0045] Compared with existing technologies, the beneficial effects of this invention are as follows: The multi-dimensional collaborative control system of the automotive electronic rearview mirror of this invention solves the limitations of existing electronic rearview mirrors in complex weather, obstruction situations, and communication collaboration, thereby improving safety and intelligence. In complex weather conditions, the millimeter-wave radar subunit can penetrate media such as rain and fog to collect millimeter-wave radar point cloud data behind the vehicle; the event camera subunit can capture dynamic image data streams even in interference scenarios such as rain and snow; the LiDAR subunit can acquire high-precision lidar point cloud data. After spatiotemporal alignment processing, this data provides the rearview mirror with comprehensive and accurate environmental perception information, avoiding the perception failure problem that may occur with a single sensor in adverse weather conditions, thus providing the driver with a reliable display of the rear road conditions and enhancing driving safety. In the face of obstruction, the multi-source perception unit can collect data from different angles and dimensions. Even if some sensors are obstructed, other sensors can still work normally and provide data, ensuring the integrity of environmental data. At the same time, the bionic display unit also has... To help cope with obstructions, its curved display substrate can simulate the curved structure of the human retina, the light field adjustment layer can adjust the display brightness and contrast according to the ambient light intensity, and the neuromorphic driver chip can simulate the retinal light adaptation mechanism to optimize image display, so that even in obstructed conditions, the driver can clearly see important information in the rearview mirror. In terms of communication and coordination, the system has multiple communication connection methods. The user interaction terminal can connect to the vehicle network cloud platform via wireless network to achieve long-distance communication and data transmission, and can also establish a short-range communication connection with the main control module via Bluetooth Low Energy, ensuring the stability and flexibility of communication. In addition, after the vehicle communication gateway passes the communication security authentication of the main control module, it establishes a communication connection between the main control module and the backup transmission line and multi-source sensing unit, forming a reliable communication network. The main control module can also determine whether the multi-source sensing unit has failed through data request commands, and when a failure occurs, control the bionic display unit to switch to emergency display operation, further enhancing the system's coordination and reliability. Attached Figure Description

[0046] To more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are merely exemplary. For those skilled in the art, other embodiments can be derived from the provided drawings without creative effort.

[0047] Figure 1 This is a system architecture diagram of the present invention;

[0048] Figure 2 This is a flowchart of the fault handling process of the present invention;

[0049] Figure 3 This is a structural diagram of the display unit of the present invention. Detailed Implementation

[0050] The accompanying drawings are for illustrative purposes only and should not be construed as limiting the scope of this patent.

[0051] To better illustrate this embodiment, some parts in the accompanying drawings may be omitted, enlarged, or reduced, and do not represent the actual product dimensions;

[0052] It will be understood by those skilled in the art that certain well-known structures and their descriptions may be omitted in the accompanying drawings.

[0053] The technical solution of the present invention will be further described below with reference to the accompanying drawings and embodiments.

[0054] Example

[0055] Please see Figure 1-3 A multi-dimensional collaborative control system for an automotive electronic rearview mirror includes a main control module, a backup transmission line, a multi-source sensing unit, a bionic display unit, and a user interaction terminal that establishes a communication connection with the main control module, all installed in the vehicle.

[0056] The main control module is used to determine whether the multi-source sensing unit has malfunctioned. If so, it sends sensing unit malfunction information to the user interaction terminal.

[0057] The user interaction terminal is used to display a backup mode button on the rearview mirror operation interface in response to receiving fault information from the sensing unit.

[0058] The user interaction terminal is also used to generate a backup mode instruction in response to the user clicking the backup mode button, and send the backup mode instruction to the main control module;

[0059] The main control module is also configured to, in response to receiving the backup mode instruction, forward the backup mode instruction to the bionic display unit through the backup transmission line, so as to control the bionic display unit to perform emergency display operations.

[0060] The user interaction terminal is also used to respond to the user's click on the preset normal mode button on the rearview mirror operation interface, generate a normal mode command, and send the normal mode command to the main control module.

[0061] The main control module is specifically used to: in response to receiving the normal mode instruction, determine whether the multi-source sensing unit has malfunctioned; if so, send sensing unit malfunction information to the user interaction terminal; if not, forward the normal mode instruction to the multi-source sensing unit.

[0062] The multi-source sensing unit is used to collect environmental data and transmit it to the bionic display unit for display in response to receiving the normal mode command;

[0063] The multi-source sensing unit includes a millimeter-wave radar subunit, an event camera subunit, and a LiDAR subunit.

[0064] The millimeter-wave radar subunit is used to collect millimeter-wave radar point cloud data behind the vehicle.

[0065] The event camera subunit is used to acquire dynamic image data streams from behind the vehicle;

[0066] The LiDAR subunit is used to collect point cloud data of the lidar behind the vehicle;

[0067] The multi-source sensing unit is also used to perform spatiotemporal alignment processing on the millimeter-wave radar point cloud data, dynamic image data stream, and lidar point cloud data.

[0068] The system also includes a vehicle-to-everything (V2X) cloud platform;

[0069] The user interaction terminal establishes a communication connection with the main control module in the following way: by connecting to the vehicle network cloud platform via a wireless network;

[0070] An identity authentication code is sent to the vehicle network cloud platform, which then verifies the identity authentication code. Upon successful verification, a communication connection is established between the main control module and the user interaction terminal based on the vehicle network cloud platform.

[0071] The user interaction terminal establishes a communication connection with the main control module in the following way: by connecting to the main control module via Bluetooth Low Energy.

[0072] A Bluetooth pairing key is sent to the main control module, enabling the main control module to verify the Bluetooth pairing key. Upon successful verification, a communication connection is established between the main control module and the user interaction terminal.

[0073] The control system also includes an on-board communication gateway;

[0074] The vehicle-mounted communication gateway is used to establish a communication connection between the main control module, the backup transmission line, and the multi-source sensing unit after passing the communication security authentication of the main control module.

[0075] The control system also includes an in-vehicle Ethernet bus; the main control module is connected to the in-vehicle communication gateway through the in-vehicle Ethernet bus, the in-vehicle communication gateway is connected to the multi-source sensing unit through the in-vehicle Ethernet bus, and the multi-source sensing unit is connected to the bionic display unit through the backup transmission line.

[0076] The main control module determines whether the multi-source sensing unit has malfunctioned by performing the following steps: generating a data request command; wherein, the data request command is used to instruct the multi-source sensing unit to return environmental data;

[0077] The data request instruction is sent to the multi-source sensing unit;

[0078] If no environmental data is received from the multi-source sensing unit within a first preset time period after the data request instruction is sent, the multi-source sensing unit is determined to have malfunctioned; otherwise, the multi-source sensing unit is determined not to have malfunctioned.

[0079] The backup transmission line is a FlexRay bus.

[0080] The control system also includes a status monitoring module;

[0081] The display status monitoring module is used to detect the display status of the bionic display unit;

[0082] The bionic display unit is used to obtain the current display status through the display status monitoring module after performing an emergency display operation, and to feed back the current display status to the main control module through the backup transmission line;

[0083] The main control module is also configured to respond to receiving the current display status within a second preset time period after forwarding the backup mode instruction to the bionic display unit, determine whether the emergency display is successful based on the current display status, and send the determination result to the user interaction terminal;

[0084] The user interaction terminal is also used to display the judgment result in response to receiving the judgment result;

[0085] The main control module is also configured to generate display failure information and send the display failure information to the user interaction terminal if it does not receive the current display state within the second preset time period after forwarding the backup mode instruction to the bionic display unit;

[0086] The user interaction terminal is also used to display the display failure information in response to receiving the display failure information.

[0087] The biomimetic display unit includes a curved display substrate, a light field modulation layer, and a neuromorphic driving chip;

[0088] The curved display substrate is used to simulate the curved structure of the human eye's retina;

[0089] The light field adjustment layer is used to adjust the display brightness and contrast according to the ambient light intensity;

[0090] The neuromorphic driver chip is used to simulate the retinal light adaptation mechanism to achieve dynamic image display optimization.

[0091] An automotive electronic rearview mirror is controlled by the aforementioned multi-dimensional collaborative control system for automotive electronic rearview mirrors.

[0092] The main control module uses a high-performance multi-core embedded processor and is installed in a dedicated control box under the car dashboard. It is equipped with a metal shield to resist electromagnetic interference and is used for critical tasks such as data processing, command forwarding, and fault detection.

[0093] The backup transmission line uses shielded twisted-pair cable, which is routed along the inside of the car door and the A-pillar to ensure the stability and anti-interference of signal transmission. In the event of a failure in the main communication line, it can serve as a backup channel to transmit critical commands and data.

[0094] The multi-source sensing unit integrates a millimeter-wave radar subunit, an event camera subunit, and a LiDAR subunit, and is concealed within the rear bumper of the vehicle.

[0095] Millimeter-wave radar subunit: Utilizing millimeter-wave radar technology, it monitors vehicles, pedestrians, and obstacles behind the vehicle in real time, generating millimeter-wave radar point cloud data.

[0096] Event camera subunit: Based on the principle of event-driven visual sensing, it only collects data when the scene changes, reducing the amount of data and power consumption, and capturing dynamic image data streams behind the vehicle at a high frame rate.

[0097] LiDAR subunit: Adopting a solid-state LiDAR design, it has a detection range of up to 200 meters and generates high-precision lidar point cloud data.

[0098] The multi-source sensing unit has a built-in data processing module that performs spatiotemporal alignment processing on the collected data to ensure the accuracy and consistency of the data.

[0099] The bionic display unit is installed inside the car's A-pillar to ensure the driver has a good field of vision. Its structural design includes the following key components:

[0100] Curved display substrate: Using flexible OLED materials, it simulates the curved structure of the human eye's retina, providing an immersive visual experience, expanding the field of vision and reducing blind spots.

[0101] Light field adjustment layer: Composed of a smart LCD panel and an ambient light sensor, it automatically adjusts the brightness and contrast of the displayed image according to the ambient light intensity to ensure that the displayed content is clearly visible under different lighting conditions.

[0102] Neuromorphic driver chip: Based on a brain-like computing architecture, it simulates the light adaptation mechanism of the retina to perform real-time dynamic optimization processing on images, enhances the edge details and color reproduction of images, and makes the displayed picture more natural and realistic.

[0103] The display status monitoring module is integrated inside the bionic display unit. It is equipped with a brightness sensor, a refresh rate detection circuit, and a contrast detection circuit. It monitors key parameters such as the brightness, contrast, and refresh rate of the display unit in real time and feeds this data back to the main control module in a timely manner through a backup transmission line.

[0104] The vehicle communication gateway, installed in the control module box in the engine compartment of the car, is responsible for coordinating the communication between the main control module, the multi-source sensing unit, and the bionic display unit. It has a built-in hardware encryption chip to fully encrypt the communication data and ensure the security of data transmission.

[0105] The vehicle-mounted Ethernet bus uses shielded twisted-pair cable as the transmission medium and is routed along the vehicle body frame to provide a high-speed and reliable data transmission channel between the main control module, the vehicle-mounted communication gateway, and the multi-source sensing unit.

[0106] The vehicle-to-everything (V2X) cloud platform is deployed in a cloud data center and has data storage and computing capabilities. It communicates with user interaction terminals through 4G / 5G wireless networks, providing users with a convenient remote control and management platform.

[0107] The user interaction terminal is equipped with a 10.1-inch capacitive touchscreen, which is installed in the center of the car's dashboard. The interface design follows ergonomic principles, and the operation is simple and intuitive. Users can easily switch between normal mode and standby mode through the touchscreen and view the system's operating status and fault information in real time.

[0108] In practical implementation, the main control module generates data request commands 10 times per second and sends them to the multi-source sensing unit via the vehicle Ethernet bus. After receiving the commands, the multi-source sensing unit synchronously starts data acquisition in three sub-units: the millimeter-wave radar sub-unit transmits and receives millimeter-wave signals to generate millimeter-wave radar point cloud data; the event camera sub-unit captures the dynamic changes of the scene behind the vehicle in real time to generate dynamic image data streams; and the LiDAR sub-unit transmits laser pulses and receives reflected signals to generate LiDAR point cloud data. The built-in data processing module performs spatiotemporal alignment processing on the three types of data. Using LiDAR data as a reference, it uses a timestamp and spatial coordinate transformation algorithm to map the millimeter-wave radar data and event camera data to the same spatiotemporal coordinate system. Then, it uses a Kalman filter algorithm to filter the fused data to remove noise and interference information.

[0109] After fusion processing, the environmental data is transmitted at high speed to the main control module via the vehicle Ethernet bus. The main control module quickly analyzes and processes the received data, extracting key information such as the distance to vehicles behind the vehicle, relative speed, and pedestrian positions. The main control module then sends the processed data to the bionic display unit. The neuromorphic driver chip generates an image based on the received data and performs optimization processing. Utilizing the synergistic effect of the curved display substrate and the light field adjustment layer, a clear and natural image of the rear scene is presented to the driver. The displayed image features high resolution, high contrast, and a wide color gamut.

[0110] The display status monitoring module monitors key parameters of the bionic display unit in real time, such as brightness, contrast ratio, and refresh rate. It uses a high-precision photoresistor to measure the brightness of the display screen, accurately measures the refresh rate by monitoring the frequency changes of the display signal, and calculates the contrast ratio based on the difference between bright and dark areas of the display screen. The monitored parameter data is promptly fed back to the main control module through a backup transmission line. The main control module performs in-depth analysis and evaluation of this data to determine whether the display status meets the preset standard range. If insufficient brightness or abnormal contrast is detected, the main control module will automatically adjust the parameters of the light field adjustment layer to optimize the display effect.

[0111] Alternate working mode

[0112] After sending a data request command, if the main control module does not receive environmental data returned by the multi-source sensing unit within a first preset time of 500 milliseconds, it immediately starts a fault detection program to conduct a comprehensive and rapid investigation of the communication link and sensor status of the multi-source sensing unit. After confirming that the fault source is the multi-source sensing unit, the main control module sends the sensing unit fault information to the user interaction terminal through an encrypted communication protocol. Within 200 milliseconds of receiving the fault information, the user interaction terminal displays a prominent standby mode button on the rearview mirror operation interface. The button has a red background and a flashing animation effect to ensure that the driver can notice the fault prompt immediately.

[0113] After the driver presses the standby mode button, the user interface terminal immediately generates a standby mode command and sends it to the main control module through an encrypted communication channel. The main control module quickly verifies and parses the received command. After confirming that it is correct, it forwards the standby mode command to the bionic display unit through the standby transmission line (FlexRay bus). Upon receiving the standby mode command, the bionic display unit immediately starts the emergency display operation, switches to the pre-stored standby display mode, and displays static images such as a wide-angle view of the rear of the vehicle or safety warning information, or a low-frequency updated image sequence. At the same time, the bionic display unit obtains the current display status through the display status monitoring module and promptly feeds back the display status data to the main control module through the standby transmission line.

[0114] Within a second preset time period of 800 milliseconds after forwarding the backup mode command to the bionic display unit, the main control module receives the current display status data. Based on a preset evaluation algorithm, it comprehensively considers multiple key indicators such as display brightness, contrast, and image integrity to accurately judge the emergency display effect. If the emergency display is successful, the main control module sends the judgment result (success information) to the user interaction terminal. The user interaction terminal displays "Emergency display has been activated" in green text on the operation interface, showing a normal prompt. If the main control module does not receive the current display status data within the specified time, or judges that the emergency display has failed based on the received data, it immediately generates a display failure message and sends it to the user interaction terminal. The user interaction terminal displays "Emergency display activation failed" in red text on the operation interface along with an audible alarm, suggesting that the driver pull over and take safety measures.

[0115] The user interface terminal has a built-in 4G / 5G wireless communication module, which connects to the operator's base station via a wireless network to stably access the vehicle-to-everything (V2X) cloud platform. During the establishment of the communication connection, the user interface terminal sends an authentication code generated using a 256-bit encryption algorithm to the V2X cloud platform. This authentication code contains key information such as the device's unique identifier and security key. The V2X cloud platform rigorously verifies the received authentication code, including checking its legality and accurately comparing it with the platform's registration information. If the authentication code is successfully verified, the V2X cloud platform establishes a secure and reliable communication tunnel between the user interface terminal and the main control module, using VPN technology for encryption to ensure the confidentiality and integrity of data transmission.

[0116] The user interface terminal scans for available Bluetooth devices in the vicinity via its built-in Bluetooth module. Upon detecting the Bluetooth signal of the main control module, it sends a pairing request. The pairing request includes a Bluetooth pairing key automatically generated by the user interface terminal during the initial pairing and stored using a secure encryption algorithm. After receiving the pairing request, the main control module rigorously verifies the Bluetooth pairing key. The verification process includes checking the key format and accurately comparing it with a pre-stored key. If the Bluetooth pairing key verification is successful, the main control module and the user interface terminal will quickly establish a low-power Bluetooth connection, enabling short-range command transmission and data interaction.

[0117] The main control module establishes a stable connection with the vehicle communication gateway through the vehicle Ethernet bus interface (using an RJ45 connector). The vehicle communication gateway has a built-in firewall and intrusion detection module to perform a comprehensive security check on the data from the main control module, preventing malicious data from entering the multi-source sensing unit.

[0118] The vehicle communication gateway is connected to the multi-source sensing unit through another vehicle Ethernet bus interface. During data transmission, the vehicle communication gateway is responsible for protocol conversion and routing forwarding of the data to ensure that the data can be transmitted accurately and efficiently between the main control module and the multi-source sensing unit. At the same time, the vehicle communication gateway regularly sends communication status reports to the main control module, covering important information such as network connection status and data transmission rate, so that the main control module can keep abreast of the operation status of the communication system.

[0119] In summary, this multi-dimensional collaborative control system for automotive electronic rearview mirrors deeply integrates sensing technology, display technology, communication technology, and fault protection mechanisms, creating a comprehensive and highly reliable rear view monitoring solution for drivers. It not only enhances driving safety and comfort but also meets the high expectations and stringent requirements of modern users for automotive electronic products through intelligent and convenient operation, demonstrating broad market application prospects and promotional value. In practical applications, relevant parameters can be flexibly adjusted and optimized according to the specific configurations of different vehicle models and personalized user needs, and manufacturing can be carried out in accordance with automotive electronics standards and specifications to ensure system stability and reliability.

[0120] The same or similar labels correspond to the same or similar parts;

[0121] The terms used to describe positional relationships in the accompanying drawings are for illustrative purposes only and should not be construed as limiting this patent.

[0122] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the implementation of the present invention. For those skilled in the art, other variations or modifications can be made based on the above description. It is neither necessary nor possible to exhaustively list all implementation methods here. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope of the claims of the present invention.

Claims

1. A multi-dimensional collaborative control system for an automotive electronic rearview mirror, characterized in that, It includes a main control module, a backup transmission line, a multi-source sensing unit, a bionic display unit, and a user interaction terminal that establishes a communication connection with the main control module, all installed in the vehicle. The main control module is used to determine whether the multi-source sensing unit has malfunctioned. If so, it sends sensing unit malfunction information to the user interaction terminal. The user interaction terminal is used to display a backup mode button on the rearview mirror operation interface in response to receiving fault information from the sensing unit. The user interaction terminal is also used to generate a backup mode instruction in response to the user clicking the backup mode button, and send the backup mode instruction to the main control module; The main control module is also configured to, in response to receiving the backup mode instruction, forward the backup mode instruction to the bionic display unit through the backup transmission line, so as to control the bionic display unit to perform emergency display operations.

2. The multi-dimensional collaborative control system for automotive electronic rearview mirrors according to claim 1, characterized in that, The user interaction terminal is also used to respond to the user's click on the preset normal mode button on the rearview mirror operation interface, generate a normal mode command, and send the normal mode command to the main control module. The main control module is specifically used to: in response to receiving the normal mode instruction, determine whether the multi-source sensing unit has malfunctioned; if so, send sensing unit malfunction information to the user interaction terminal; if not, forward the normal mode instruction to the multi-source sensing unit. The multi-source sensing unit is used to collect environmental data and transmit it to the bionic display unit for display in response to receiving the normal mode command; The multi-source sensing unit includes a millimeter-wave radar subunit, an event camera subunit, and a LiDAR subunit. The millimeter-wave radar subunit is used to collect millimeter-wave radar point cloud data behind the vehicle. The event camera subunit is used to acquire dynamic image data streams from behind the vehicle; The LiDAR subunit is used to collect point cloud data of the lidar behind the vehicle; The multi-source sensing unit is also used to perform spatiotemporal alignment processing on the millimeter-wave radar point cloud data, dynamic image data stream, and lidar point cloud data.

3. The multi-dimensional collaborative control system for automotive electronic rearview mirrors according to claim 1, characterized in that, The system also includes a vehicle-to-everything (V2X) cloud platform; The user interaction terminal establishes a communication connection with the main control module in the following way: by connecting to the vehicle network cloud platform via a wireless network; An identity authentication code is sent to the vehicle network cloud platform, which then verifies the identity authentication code. Upon successful verification, a communication connection is established between the main control module and the user interaction terminal based on the vehicle network cloud platform.

4. The multi-dimensional collaborative control system for automotive electronic rearview mirrors according to claim 1, characterized in that, The user interaction terminal establishes a communication connection with the main control module in the following way: by connecting to the main control module via Bluetooth Low Energy. A Bluetooth pairing key is sent to the main control module, enabling the main control module to verify the Bluetooth pairing key. Upon successful verification, a communication connection is established between the main control module and the user interaction terminal.

5. The multi-dimensional collaborative control system for automotive electronic rearview mirrors according to claim 1, characterized in that, The control system also includes an on-board communication gateway; The vehicle-mounted communication gateway is used to establish a communication connection between the main control module, the backup transmission line, and the multi-source sensing unit after passing the communication security authentication of the main control module. The control system also includes an on-board Ethernet bus; The main control module is connected to the vehicle communication gateway via the vehicle Ethernet bus, the vehicle communication gateway is connected to the multi-source sensing unit via the vehicle Ethernet bus, and the multi-source sensing unit is connected to the bionic display unit via the backup transmission line.

6. The multi-dimensional collaborative control system for automotive electronic rearview mirrors according to claim 1, characterized in that, The main control module determines whether the multi-source sensing unit has malfunctioned by performing the following steps: generating a data request command; wherein, the data request command is used to instruct the multi-source sensing unit to return environmental data; The data request instruction is sent to the multi-source sensing unit; If no environmental data is received from the multi-source sensing unit within a first preset time period after sending the data request instruction, the multi-source sensing unit is determined to have malfunctioned; otherwise, the multi-source sensing unit is determined not to have malfunctioned.

7. The multi-dimensional collaborative control system for automotive electronic rearview mirrors according to claim 1, characterized in that, The backup transmission line is a FlexRay bus.

8. The multi-dimensional collaborative control system for automotive electronic rearview mirrors according to claim 1, characterized in that, The control system also includes a status monitoring module; The display status monitoring module is used to detect the display status of the bionic display unit; The bionic display unit is used to obtain the current display status through the display status monitoring module after performing an emergency display operation, and to feed back the current display status to the main control module through the backup transmission line; The main control module is also configured to respond to receiving the current display status within a second preset time period after forwarding the backup mode instruction to the bionic display unit, determine whether the emergency display is successful based on the current display status, and send the determination result to the user interaction terminal; The user interaction terminal is also used to display the judgment result in response to receiving the judgment result; The main control module is also configured to generate display failure information and send the display failure information to the user interaction terminal if it does not receive the current display state within the second preset time period after forwarding the backup mode instruction to the bionic display unit; The user interaction terminal is also used to display the display failure information in response to receiving the display failure information.

9. The multi-dimensional collaborative control system for automotive electronic rearview mirrors according to claim 1, characterized in that, The biomimetic display unit includes a curved display substrate, a light field modulation layer, and a neuromorphic driving chip; The curved display substrate is used to simulate the curved structure of the human eye's retina; The light field adjustment layer is used to adjust the display brightness and contrast according to the ambient light intensity; The neuromorphic driver chip is used to simulate the retinal light adaptation mechanism to achieve dynamic image display optimization.

10. An electronic rearview mirror for automobiles, characterized in that, The multi-dimensional collaborative control system of the automotive electronic rearview mirror as described in any one of claims 1-9 is used for control.

Images