Automobile external display communication system

Abstract

The invention provides an automobile external display communication system, and relates to the field of automobile accessories, and the system comprises a data collection module which is used for collecting multi-source heterogeneous data through an in-vehicle network and a physical perception way; the data processing module is connected to the data acquisition module and is configured to be used for operating a data fusion algorithm, performing cleaning fusion processing on the acquired multi-source heterogeneous data and generating visual display data; the external display module is connected to the data processing module and is used for performing external visual display on the visual display data through a display device arranged on a vehicle window, a vehicle body or a vehicle roof; and the communication module is connected to the data processing module and is used for sending the visual display data to an external receiving device through the Internet of Vehicles or a wireless broadcast mode. The method is used for overcoming the defects that in the prior art, warning information priority is high, the real-time response requirement is high, and warning polling or sudden traffic congestion retransmission of an in-vehicle network application layer is prone to mistaken events, and in the other aspect, a mode of communication between vehicle external display and other vehicle cameras is used for forming a vehicle-to-vehicle communication mode with low cost. The invention discloses a semantic communication system for vehicles and roads without worries of network attacks.

Description

Technical Field

[0001] This invention relates to the field of automotive parts technology, and in particular to an automotive external communication system. Background Technology

[0002] Currently, the backbone bus of the in-vehicle network in intelligent electric vehicles is still mainly CAN / CAN-FD, but some high-end models have adopted 100 / 1000Mbps in-vehicle Ethernet as the backbone, forming a domain-centralized architecture of "Ethernet + CAN-FD + LIN"; key indicators: CAN-FD message 64byte → 8kbyte, Ethernet latency <1ms, which can basically meet the 100Mbps bit rate requirements of ADAS cameras. Intelligent electric vehicles will also face network congestion problems similar to those encountered in other industries (such as smart cities). Current communication networks are essentially best-effort networks. Although the in-vehicle network of an intelligent electric vehicle may seem small in scale, it is a complete system with various sensor and control components developed by different suppliers. Car manufacturers perform network engineering configuration. However, the dynamic nature of data makes the in-vehicle network, like that of a smart city, prone to congestion. Current communication protocols such as Time-Sensitive Networking (TSN) and RDMA are powerless to handle the many-to-many cumulative communication traffic between the two ends. Typical examples of this type of network traffic include alarms from various components in the in-vehicle network. Alarm storms cannot be handled by network engineering alone. The large alarm traffic from various components inside the car may put pressure on the in-vehicle network and even form so-called "alarm storms," ​​affecting the normal operation of the network.

[0003] Because the integration and communication process between automakers and component manufacturers is quite lengthy, existing countermeasures are currently piecemeal and reactive. However, alarm information has high priority and requires real-time response, and polling and retransmission at the in-vehicle network application level can easily cause problems. Therefore, the automotive industry urgently needs preventative measures to ensure the safe operation of the alarm system. Summary of the Invention

[0004] This invention provides an automotive external display communication system to address the shortcomings of existing technologies, such as high priority of alarm information, high real-time response requirements, and the potential for errors in alarm polling or retransmission due to sudden traffic congestion at the in-vehicle network application level. On the other hand, it uses the automotive external display and other vehicles' cameras to form a low-cost semantic communication system between vehicles and between vehicles and roads without concerns about network attacks.

[0005] On one hand, the present invention provides an automotive external communication system, comprising: The data acquisition module is used to collect multi-source heterogeneous data through in-vehicle network and physical sensing methods. The data includes alarm information from various in-vehicle components, software and hardware systems and networks, alarm information from vehicles ahead and road facilities, the vehicle's working mode data and response strategy data, as well as billing data and driving mode conversion record data that need to be disclosed to the public. The data processing module is connected to the data acquisition module and is configured to run a data fusion algorithm to clean and fuse the acquired multi-source heterogeneous data to generate visual display data. An external display module, connected to the data processing module, is used to display the visual display data externally through a display device installed on the vehicle window, body, or roof. A communication module, connected to the data processing module, is used to send the visual display data to an external receiving device via vehicle networking or wireless broadcasting.

[0006] Furthermore, the physical sensing method in the data acquisition module includes recognizing warning indicator lights, icons, or text information displayed on the dashboard or central control screen through an optical camera deployed in the vehicle, and collecting warning buzzer or voice prompt signals in the vehicle through a built-in microphone array. The sensing data recognition algorithm is then used to perform pattern recognition and analysis on the optical and acoustic signals, converting them into standardized alarm information that can be processed by the data fusion algorithm.

[0007] Furthermore, the data fusion algorithm running in the data processing module includes a health status assessment algorithm, which is used to perform weighted calculations based on the type, quantity, frequency and severity level of the alarm information to generate graded data representing the health status of the vehicle, road or other vehicles, and map the graded data into a continuous spectrum visual signal of red-yellow-green, where red represents extremely poor health status and danger, yellow represents problems that require caution, and green represents normal.

[0008] Furthermore, the graded data output by the health status assessment algorithm is further processed by an icon mapping algorithm to dynamically map the vehicle's operating mode data to the corresponding vehicle status icon, and to map the vehicle's response strategy data to an arrow icon representing the vehicle's subsequent driving mode.

[0009] Furthermore, the data processing module also runs a data priority scheduling algorithm, which analyzes the billing data and driving mode conversion record data that need to be displayed externally, dynamically prioritizes the data according to its importance, urgency and freshness, and controls the external display module to display the data in the order of the scheduling results and the display duration.

[0010] Furthermore, the external display module and the communication module work together to form a saturated external communication mode, enabling continuous and synchronous information supply to surrounding vehicles, pedestrians, roadside equipment, aerial drones, and low-orbit satellites.

[0011] Furthermore, the system is equipped with a communication status monitoring unit for real-time monitoring of the quality and security status of the vehicle network link. When the vehicle network communication is interrupted, the bandwidth is severely insufficient, or the signature verification fails due to a network attack, the system automatically switches to a pure visual display mode that relies on the external display module to transmit information to the outside world, and can simultaneously prompt the communication failure status on the display device.

[0012] Furthermore, the external receiving device includes the vehicle external display communication system of other vehicles; the system is also configured to receive and process visual display data sent by other vehicles, and use the data as one of the input data sources of the data acquisition module to assist in the health status assessment and decision-making of the vehicle.

[0013] Furthermore, when the system receives a spectral signal or response strategy data indicating a dangerous health condition from a vehicle ahead, it can trigger the vehicle's assisted driving or autonomous driving system to execute a predetermined avoidance strategy and broadcast the vehicle's response strategy data to the outside world through the external display module and the communication module.

[0014] Furthermore, the display device is a visual information display unit integrated into the vehicle glass or body surface, which is configured to display external visual information with high contrast without affecting the normal field of vision and lighting of the occupants; the display content can automatically adjust the brightness according to the ambient light intensity.

[0015] The automotive external communication system provided by this invention enables physical-level information communication at the perception level to prevent congestion of the in-vehicle network for vehicle alarms and other data. In addition to vehicle-to-everything (V2X) communication, the system also includes visual displays on the windows, body, and roof, providing communication channels for all parties when the V2X is attacked. Other vehicles can report suspicious vehicles ahead to roadside cameras and drones, enabling group defense and control. This minimizes the risk of individual loss of control of high-speed moving objects in the era of automation, achieving collective safety. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0017] Fig. 1 This is a schematic diagram of an automotive external communication system provided in an embodiment of the present invention; Fig. 2 This is a schematic diagram of the automotive external communication system provided in an embodiment of the present invention. Detailed Implementation

[0018] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0019] like Figs. 1-2 As shown, the automotive external communication system provided in this embodiment of the invention includes: The data acquisition module is used to collect multi-source heterogeneous data through in-vehicle network and physical sensing methods. The data includes alarm information from various in-vehicle components, software and hardware systems and networks, alarm information from vehicles ahead and road facilities, the vehicle's working mode data and response strategy data, as well as billing data and driving mode conversion record data that need to be disclosed to the public. The data processing module is connected to the data acquisition module and is configured to run a data fusion algorithm to clean and fuse the acquired multi-source heterogeneous data to generate visual display data. An external display module, connected to the data processing module, is used to display the visual display data externally through a display device installed on the vehicle window, body, or roof. A communication module, connected to the data processing module, is used to send the visual display data to an external receiving device via vehicle networking or wireless broadcasting.

[0020] In this embodiment of the invention, the transparency and reliability of vehicle status are greatly enhanced. The system transforms complex data such as fault codes, network status, and driving strategies hidden inside the vehicle into intuitive and standardized visual signals (such as red, yellow, and green spectra, icons, and arrows). This allows other vehicles, pedestrians, and traffic management departments in the vicinity to instantly understand the vehicle's health status and driving intentions simply by visual observation, without the need for professional decoding equipment or the establishment of dedicated communication links. This "what you see is what you get" communication method transcends the limitations of language and communication protocols, and constructs the most direct and reliable communication channel. To ensure that information is not lost in extreme situations, redundant communication links are constructed. The system adopts two independent external information dissemination channels in parallel: "visual display" and "wireless communication". When the vehicle-to-everything (V2X) connection fails due to network attacks, signal interference, or hardware failure, the system can automatically degrade to a pure visual display mode and continue to transmit key information to the outside world through the vehicle's screen. This redundancy design ensures that the vehicle's most important safety information (such as "fault, please give way") can still be perceived by the surrounding environment in extreme faults or malicious network environments, which greatly improves the system's robustness and survivability. To effectively address in-vehicle network congestion and solve the "alarm storm" problem, the data acquisition module innovatively introduces a "physical sensing approach" (using a camera to view the dashboard and a microphone to listen to alarm sounds) as a supplement and backup to in-vehicle network data collection. When the in-vehicle network becomes congested or interrupted due to a large number of simultaneous alarms from components (i.e., an "alarm storm"), traditional systems may become "blind" due to network paralysis. This system, however, can capture key visual and auditory alarm signals through this last physical defense line, thereby preventing the loss of core fault information due to network problems at the most dangerous moment and achieving true fail-safe design. Empowering collaborative safety and forming a smart transportation ecosystem of "collective prevention and control," the system is not only a sender of information but also a receiver. It can receive and process status information broadcast by other vehicles and trigger the vehicle's own driver assistance system to coordinate risk avoidance. This makes each vehicle equipped with the system an intelligent node in the traffic network. When a vehicle malfunctions (displays a red light), its warning information can be received by vehicles behind it. These vehicles can automatically maintain a safe distance, change lanes, and continue to transmit the warning information. At the same time, the information can also be captured by roadside units, drones, etc., forming a global safety monitoring network. This minimizes the risk of single-vehicle malfunctions and achieves an evolution from "fighting alone" to herd immunity. To enhance trust in autonomous driving and promote its commercialization, the system publicly discloses data such as driving mode switching records, making the behavior of autonomous vehicles traceable and verifiable. In the event of disputes or accidents, the information displayed on the vehicle body recorded by external devices can serve as an important basis for determining liability. This transparency helps to solve the ethical and legal challenges facing autonomous driving, enhances public trust in autonomous driving technology, and removes obstacles to the large-scale commercial application of the technology.

[0021] like Figs. 1-2As shown, the physical sensing approach in the data acquisition module includes identifying warning indicator lights, icons, or text information displayed on the dashboard or central control screen through an optical camera deployed in the vehicle, and collecting warning buzzer or voice prompt signals in the vehicle through a built-in microphone array. The sensing data recognition algorithm is then used to perform pattern recognition and analysis on the optical and acoustic signals, converting them into standardized alarm information that can be processed by the data fusion algorithm.

[0022] In this embodiment of the invention, network dependence is eliminated, providing ultimate redundancy protection through digital communication that is completely independent of the vehicle's in-vehicle bus (such as CAN or Ethernet). When the in-vehicle network is paralyzed due to an "alarm storm," node failure, or severe congestion, traditional data collection methods based on network communication will fail. However, this system can still continue to operate through physical sensing as the "last line of defense." This ensures that even in the most severe vehicle network failure, the system can still "see" the warning lights on the dashboard and "hear" the alarm sound from the buzzer, and generate standardized alarm information accordingly. This achieves true fail-safe design, preventing the vehicle from "going silent" due to network problems during major emergencies. Enhanced anti-interference and anti-attack capabilities: Network attacks (such as hacking) typically target digital communication protocols and can forge, tamper with, or drown out digital alarm signals. However, it is difficult for attackers to remotely physically tamper with the sounds emitted by traditional dashboard indicator lights or in-vehicle speakers. As an asymmetric defense method, the signal source (light and sound) of physical sensing is difficult to be maliciously tampered with remotely. Therefore, the system can effectively identify and resist spoofing attacks against the vehicle network through cross-verification (such as receiving network digital alarms and visual alarms simultaneously), significantly improving the system's security and reliability. Achieving cross-generational and cross-supplier compatibility, regardless of which supplier the vehicle's internal components come from or what communication protocol (CAN / LIN / Ethernet) is used, the final fault status will mostly be presented to the driver through the most traditional dashboard indicator lights and warning sounds; this makes it unnecessary for the system to perform complex protocol adaptations for different models or suppliers. It only needs to train the perception algorithm to recognize common indicator light icons and sound patterns to cover the vast majority of fault scenarios, possessing strong universality and compatibility, and reducing development and deployment costs; To provide multimodal verification for data fusion and improve decision-making accuracy, the system can simultaneously obtain alarm information for the same event from two independent channels: network packets and physical sensing (for example, receiving a "brake system failure" code in the network packet while the camera also recognizes the brake malfunction light icon on the dashboard). Cross-verification of multi-source information can greatly reduce the false alarm rate (such as network packet errors) and the false alarm rate (such as a damaged light bulb but a correct packet), providing a more accurate and reliable basis for subsequent data fusion and health status assessment, thereby generating more credible external display information.

[0023] like Figs. 1-2 As shown, the data fusion algorithm running in the data processing module includes a health status assessment algorithm, which is used to perform weighted calculations based on the type, quantity, frequency and severity level of the alarm information to generate graded data representing the health status of the vehicle, road or other vehicles, and map the graded data into a continuous spectrum visual signal of red-yellow-green, where red represents extremely poor health status and danger, yellow represents problems that require caution, and green represents normal.

[0024] In this embodiment of the invention, hundreds of different fault codes, network status, external risks and other complex technical information are fused and compressed into an extremely simple red-yellow-green three-color status signal, which realizes the ultimate simplification of information, enabling drivers, pedestrians and even roadside cameras behind to understand the core status of the vehicle in front within 0.1 seconds, greatly shortening the information understanding and reaction time; Red represents danger, yellow represents warning, and green represents safety. This is a globally universal visual semantic system that transcends the barriers of text and language, enabling the system to work seamlessly in any country or region. It is the cornerstone for realizing vehicle-to-everything (V2X) communication. The generated health status is not a simple judgment, but a continuous spectrum based on weighted calculation. This means that the system can express intermediate states such as "yellowish red" or "greenish yellow", providing more refined and forward-looking decision-making basis for the advanced driver assistance system (ADAS) or autonomous driving system of the vehicle, rather than just a binary command of "stop" or "go". By integrating multiple information sources (vehicle sensors, signals from the vehicle ahead, and signals from road infrastructure) and performing weighted calculations, false alarms from a single sensor (such as a momentary false detection by a radar) can be effectively filtered out, avoiding excessive alarms from the entire system due to errors in individual data, and improving the accuracy and reliability of the output. The instantaneous health score is calculated as follows: A weighted summation model is used to integrate all alarm information to calculate a comprehensive health score at time point t, as shown in the following formula: ; Where n is the total number of active alarm messages at the current moment. To represent the "threat value" of the i-th alarm at the current moment, ∑ is the sum of the "threat values" of all independent alarms to obtain the total threat value. To map the total threat value to a health score, The theoretical range of values ​​is [-∞, 1]. The closer the value is to 1, the healthier the system is; the lower the value, the more serious the problem is.

[0025] like Figs. 1-2As shown, the graded data output by the health status assessment algorithm is further processed by the icon mapping algorithm to dynamically map the vehicle's working mode data to the corresponding vehicle status icon, and to map the vehicle's response strategy data to arrow icons representing the vehicle's subsequent driving mode.

[0026] In this embodiment of the invention, explicit behavioral expectations are provided, eliminating interaction uncertainty. The health spectrum (red, yellow, green) answers the question "What's wrong with me?", while status icons and arrow icons explicitly answer the question "What am I going to do?". For example, a vehicle not only displays a yellow light (warning status) but also a wrench icon (representing "fault mode") and a right-pointing arrow (representing "about to move to the right"). The driver behind can instantly understand: "The vehicle in front has a fault; it may need to pull over to the right, and I need to change lanes to the left to avoid it." This advance disclosure of intent breaks the "information black box" between vehicles, giving the surrounding environment ample reaction time and fundamentally avoiding rear-end collisions or accidents caused by unpredictable behavior of the vehicle in front. The algorithm maps working modes and strategies into highly standardized pictograms, which are designed according to international standards (such as ISO standards) or widely recognized semantics. Regardless of the driver's language and cultural background, they can understand that a "wrench" represents a malfunction, a "steering wheel" represents manual driving, "Auto A" represents autonomous driving, and a "blinking exclamation mark" represents an emergency. The direction of the arrows is also universally understood. This forms a visual language that surpasses any human language and has the lowest communication cost. It is the infrastructure for realizing global autonomous driving collaboration. To provide a structured data interface for collaborative driving, icons and arrows are not only for human eyes but also for machine eyes. Other vehicles' autonomous driving systems can visually recognize these icons through cameras or directly receive these structured data packets through V2X communication. When the ADAS system of a vehicle behind recognizes the combination of "fault icon + right arrow" of the vehicle in front, it can automatically trigger collaborative risk avoidance strategies, such as: 1. automatically calculating the safe distance; 2. initiating a lane change planning to the left; 3. issuing a prompt to the driver or automatically executing the lane change. This upgrades single-vehicle intelligent decision-making to vehicle-group collaborative decision-making, directly transforming the vehicle's response strategy into the control input of other vehicles, greatly improving the overall efficiency and safety of traffic flow. Enhancing system redundancy is a key element of saturated communication. Behavioral intent information is simultaneously released to the outside world through both visual icons and wireless communication. Even if vehicle-to-everything (V2X) communication is completely interrupted, vehicles and pedestrians behind can still understand the intention of the vehicle in front by visually observing the icons on the vehicle. Information transmission based on physical optics without relying on any communication protocol is the core embodiment of the system's "saturated communication" concept, ensuring that the most critical behavioral intent information can still be transmitted without loss even in the most extreme circumstances.

[0027] like Figs. 1-2 As shown, the data processing module also runs a data priority scheduling algorithm, which is used to analyze the billing data and driving mode conversion record data that need to be displayed externally, dynamically prioritize the data according to its importance, urgency and freshness, and control the external display module to display the data according to the order of the scheduling results and the display duration.

[0028] In this embodiment of the invention, safety information is given absolute priority to maximize safety benefits. The algorithm can identify and prioritize the display of information directly related to driving safety (such as emergency faults and collision warnings) in real time. This ensures that the information can immediately interrupt the current display content and occupy the core position of the screen, thus avoiding entertainment or commercial information (such as billing) from "sweeping" the screen at critical moments and covering up the danger warnings, thereby directly ensuring driving safety. Optimizing limited display resources and improving information transmission efficiency: The display area outside the vehicle and the attention resources of bystanders are both limited. By dynamically queuing and scheduling information, it is determined "who displays when, for what duration, and in what location", so that the limited display space can be maximized and the right information is delivered to the right audience at the right time, which significantly improves the efficiency and accuracy of communication. To enhance the predictability and credibility of system behavior, a set of open and transparent priority rules (e.g., emergency braking warnings always take precedence over software update notifications) makes the system's behavior more reliable and predictable. Traffic participants can gradually trust the system's output because they know that the highest priority information displayed must be the most important thing to pay attention to at the moment. To achieve a harmonious coexistence of commercial and security functions, the algorithm does not simply block all non-security information. It allows the display of commercial or witness information such as billing and mode conversion records during safe intervals (such as when the vehicle is parked smoothly and in normal condition). This enables a single hardware system to serve both security and new business model needs, achieving functional integration and complementarity and enhancing the overall value of the system.

[0029] like Figs. 1-2As shown, the external display module and the communication module work together to form a saturated external communication mode, enabling continuous and synchronous information supply to surrounding vehicles, pedestrians, roadside equipment, aerial drones and low-orbit satellites.

[0030] In this embodiment of the invention, ubiquitous and reliable communication is achieved, eliminating information silos. The "saturation" is reflected in multi-channel parallelism (visual + radio), multi-coverage dimensions (ground + air), and multiple receiving objects (vehicles / people / roads / cloud). For near-range objects (vehicles, pedestrians): even if the other vehicle is not equipped with a V2X communication module, information can be obtained by directly observing the visual signals (spectrum, icons) displayed on the vehicle body, solving the problems of equipment compatibility and popularity. For medium- and long-range and airborne objects (roadside units, drones, low-orbit satellites): information transmission beyond line of sight is achieved through radio waves (V2X, broadcast), integrating the status information of a single vehicle into the "cloud brain" of the entire transportation network to achieve global monitoring and scheduling. It ensures that the status and intention information of the vehicle can always be received by at least one relevant traffic participant or system through at least one means, completely avoiding the possibility of the vehicle becoming an "information island" for any reason. By constructing extreme redundancy to resist extreme failures and malicious attacks, the visual display and wireless communication are completely independent at the physical level and do not depend on each other. It is extremely difficult for attackers to interfere with all channels at the same time. When the vehicle-to-everything (V2X) network is attacked by hackers (such as interference, spoofing, denial-of-service attacks), the system can seamlessly switch to pure visual communication mode and continue to "broadcast" to the outside world through light signals. The communication link cannot be remotely cut off. When the external display module fails due to hardware damage (such as screen breakage), the wireless communication module can still continue to broadcast data, which is received by the systems of surrounding vehicles and used for decision-making or display. In tunnels and canyons with poor radio signals, visual display dominates communication. In rainy, foggy weather or at night with poor visual visibility, radio communication dominates communication. The system no longer has a "single point of failure". Its communication capabilities have extremely high resilience and survivability, which meet the highest level of functional safety (ISO26262) and cybersecurity (ISO / SAE21434) design concepts. Empowering collective collaboration and building a "social-level" safety network, the continuous and synchronized supply of multimodal information creates a rich "information field" around vehicles. A vehicle's hazard warning (red light + emergency stop icon) can be disseminated in milliseconds through V2X within the vehicle group, and can also be captured by roadside RSUs and aerial drones and uploaded to the cloud-based traffic management platform. Drones or roadside cameras can visually confirm that the vehicle in front has indeed turned on its red light and begun to slow down, thereby verifying the reliability of the V2X signal and preventing malicious deception of alarms. After receiving multi-source alarms from vehicles (V2X), roadside (RSU), and aerial (drones), the traffic management center can comprehensively judge the severity and scope of the event and issue global optimization instructions (such as remotely controlling the speed limit of vehicles behind and switching traffic light phases). This elevates the safety issue of a single vehicle to a public safety event that is collaboratively perceived, verified, and responded to by numerous traffic participants, achieving a leap from "individual immunity" to "herd immunity" and minimizing the spread of local risks into global congestion or accidents. Laying the data foundation for future smart transportation, low-orbit satellites, as receiving terminals, mean that vehicle dynamic information has the potential for global coverage. Vehicle status data can be continuously synchronized to the cloud-based digital twin platform, providing an unprecedented real-time, high-quality data source for macro-level traffic flow optimization, road planning, and insurance model reconstruction, making every vehicle a mobile sensor for smart cities.

[0031] like Figs. 1-2 As shown, the system is equipped with a communication status monitoring unit, which is used to monitor the quality and security status of the vehicle network link in real time. When the vehicle network communication is interrupted, the bandwidth is severely insufficient, or the signature verification fails due to a network attack, the system automatically switches to a pure visual display mode that relies on the external display module to transmit information to the outside world, and can simultaneously prompt the communication failure status on the display device.

[0032] In this embodiment of the invention, seamless degradation of the communication link is achieved, ensuring that information transmission is never interrupted. The system is equipped with the capabilities of "communication interruption perception" and "autonomous degradation decision-making". When the main communication channel (vehicle network) fails for any reason, the system will not fall silent or wait for user intervention, but will automatically activate the backup channel (visual display) like an organism. This ensures that when the vehicle needs to communicate with the outside world most urgently (for example, when it has a serious malfunction and is in high-speed traffic), the transmission of its most important safety information (such as "malfunction, pull over") will never be interrupted due to a single failure of the communication module, firmly safeguarding the bottom line of safety. Proactive defense against cyberattacks enhances system resilience. The primary goal of cyberattacks (such as interference and spoofing attacks) is to disrupt the vehicle's communication capabilities. Traditional vehicles would "lose connection" under such attacks. However, when this system detects security anomalies such as signature verification failure, it can immediately determine that the communication channel is untrusted and proactively cut off the channel, switching to a pure visual mode. This is an "asymmetric defense." Attackers can interfere with radio waves, but it is extremely difficult to remotely prevent the vehicle from lighting up its own screen, rendering the attacker's main methods ineffective. This greatly increases the difficulty and cost of the attack, thereby significantly improving the system's network security protection level and survivability in adversarial environments. Providing state transparency and proactively managing external expectations, the system simultaneously displays a "communication failure" status on the display device when switching to pure vision mode (e.g., displaying a red malfunction indicator light while showing a "signal jamming" icon in the corner). It proactively informs surrounding vehicles and infrastructure: "It's not that I'm not sending V2X signals, but that my communication system may be malfunctioning. Please observe me visually." This avoids misjudgments by vehicles behind equipped with V2X systems due to not receiving the expected signals (e.g., mistakenly believing that the V2X system of the vehicle in front is normal and safe), thereby preventing secondary accidents caused by communication failures and demonstrating a high degree of intelligence and responsibility. Optimizing system resources provides conditions for fault recovery. When bandwidth is severely insufficient, the system proactively degrades, ceasing attempts to send non-critical large amounts of information (such as log records), and only visually displays the most critical safety information. This reduces the load on its own communication module and the entire local vehicle network, avoiding ineffective attempts and resource contention in resource-scarce situations, creating conditions for the network environment to recover on its own, and at the same time, freeing up valuable communication bandwidth for other vehicles that may need it more.

[0033] like Figs. 1-2 As shown, the external receiving device includes the vehicle external display communication system of other vehicles; the system is also configured to receive and process visual display data sent by other vehicles, and use the data as one of the input data sources of the data acquisition module to assist in the health status assessment and decision-making of the vehicle.

[0034] In this embodiment of the invention, beyond-line-of-sight perception is achieved, overcoming the limitations of physical sensors. The vehicle system can receive and analyze the health status spectrum and intent icons directly broadcast by the vehicle in front (or even the vehicle before that), which is equivalent to installing a "X-ray vision" on the vehicle. It can detect dangers beyond the line of sight or that the vehicle's sensors cannot directly detect (e.g., a vehicle with a red light due to a malfunction two kilometers ahead, or a tendency for traffic congestion ahead). This greatly expands the vehicle's environmental perception range and time margin. Traditional radar and cameras can only detect objects within the visible range, while this system enables the vehicle to "see" potential risks behind curves, behind large vehicles, or at greater distances, providing valuable lead time for decision-making and response. It is an effective means of preventing major accidents such as chain-reaction rear-end collisions. Cross-validation of information greatly enhances the reliability and security of decision-making. The system can compare and verify the received V2X data (digital signal) from the preceding vehicle with the observation results of the actual visual display of the preceding vehicle by the vehicle's physical sensors (cameras, radar). This constitutes a powerful redundant verification mechanism. If a hacker forges a V2X signal to send a false "faulting vehicle" alarm, but the vehicle's camera observes that the preceding vehicle is actually displaying a green light (normal), the system can determine that the V2X signal is unreliable, thus effectively preventing network attacks. If the vehicle's camera cannot clearly identify the preceding vehicle's taillights due to severe weather such as heavy rain or dense fog, but the V2X channel is still stably transmitting the preceding vehicle's status data, the system can prioritize adopting the V2X information, enhancing the system's robustness. This cross-validation makes the final decision basis more sufficient and reliable, significantly reducing the risk of misjudgment caused by errors from a single information source. Empowering collaborative decision-making and forming a chain reaction and collective safety, after receiving warning information from the vehicle ahead, this vehicle can not only use it for its own decision-making, but also use this information as an input source for its own data acquisition module. After processing, it is broadcast again through its own display and communication modules, giving rise to a chain propagation effect of safety information. For example, if the lead vehicle triggers emergency braking (displaying a red + brake icon), the following vehicles can brake in advance and continue to transmit the "danger ahead" status backward, spreading rapidly backward like a wave, effectively avoiding chain collisions caused by the following vehicles not being able to react in time. This achieves active safety through "collective prevention and control," and the entire traffic flow exhibits a highly collaborative "swarm intelligence," greatly improving the overall safety of high-speed moving vehicle groups.

[0035] like Figs. 1-2 As shown, when the system receives a spectral signal or response strategy data indicating a dangerous health condition from a vehicle ahead, it can trigger the vehicle's assisted driving or autonomous driving system to execute a predetermined avoidance strategy and broadcast the vehicle's response strategy data to the outside world through the external display module and the communication module.

[0036] In this embodiment of the invention, millisecond-level collaborative risk avoidance is achieved, greatly shortening the danger response chain. After receiving a danger signal from the vehicle ahead (such as a red spectrum + emergency braking icon), the system can directly trigger the vehicle's assisted driving or autonomous driving system to execute the predetermined risk avoidance strategy (such as automatically maintaining a safe distance, actively decelerating, and planning lane change paths) without waiting for the human driver's understanding and reaction. The closed loop of "perception-decision-execution" is changed from "human-led" to "machine-led", and the reaction time is shortened from the second level (1-2 seconds of human reaction time) to the millisecond level. In high-speed scenarios, this short time difference is enough to avoid a rear-end collision. It is equivalent to installing a vehicle-to-vehicle communication-based cooperative active braking system (Cooperative AEB) on the vehicle, raising safety to a whole new level. By achieving intention coordination and behavior prediction, chaos is transformed into order. While executing the avoidance strategy, the vehicle immediately broadcasts its own response strategy (such as "this vehicle will change lanes to the left") through the display module and communication module. This transforms the avoidance behaviors of a series of vehicles from disorderly and potentially conflicting individual behaviors into orderly and coordinated group behaviors, greatly reducing the risk of secondary accidents or traffic chaos caused by multiple layers of following vehicles reacting too late or too much. By constructing a distributed safety network to achieve herd immunity, each vehicle, while responding to a hazard from the vehicle ahead, also becomes a relay node and decision-making node in the information chain. It receives, processes, decides on, and rebroadcasts the information, enabling hazard warnings and collaborative strategies to propagate rapidly and reliably backward through the traffic flow in a wave-like manner, forming a distributed "herd immunity" mechanism. Risk is no longer borne by a single vehicle, but rather digested and addressed collaboratively by the entire traffic flow. Each vehicle is both a beneficiary of protection and a contributor to providing protection. This mechanism maximizes the controllability of localized failures at individual nodes, preventing them from escalating into systemic risks leading to large-scale traffic paralysis or accidents.

[0037] like Figs. 1-2 Figs. 1-2 As shown, the display device is a visual information display unit integrated into the vehicle glass or body surface. It is configured to display external visual information with high contrast without affecting the normal field of vision and lighting of the occupants. The brightness of the displayed content can be automatically adjusted according to the ambient light intensity.

[0038] In this embodiment of the invention, the display device is preferably a transparent LED screen, but it can also be any other display technology solution that can achieve similar functions, such as, but not limited to, projection display devices, transparent OLED screens, Micro-LED screens, or electronic ink screens; its core lies in its integration into the vehicle glass or body surface, and in meeting the functional requirements of not affecting the field of vision, high contrast and automatic dimming. Achieving full visual information coverage without intrusion into the field of vision, the display device is integrated into the front and rear windshields, side windows, and roof. This means that all major exterior surfaces of the vehicle become information displays, allowing the vehicle to show relevant information to traffic participants (vehicles in front, vehicles behind, pedestrians to the side, and drones in the air) from any direction within 360 degrees. Compared with traditional solutions (such as adding a separate screen to the roof or using horizontal LED light strips), this design does not require additional space in the vehicle body, maintains the original design aesthetics and aerodynamic performance of the vehicle, avoids the obstruction of the occupants' view by traditional additional screens, and safeguards the bottom line of driving safety. It is a truly engineering solution that can be used in mass-produced vehicles. To ensure driving safety and comfort, the technology achieves "invisible" information expression. When not in use, its transparency is no different from ordinary glass, without affecting the normal vision and lighting of the occupants. It ensures that the driver's attention will not be distracted or their vision obstructed by a constantly lit screen when observing the external environment, fundamentally eliminating new safety risks introduced by displayed information. Passengers can still enjoy a bright and airy interior space and natural light, avoiding a feeling of oppression in the cabin and minimizing the presence of technology, which is only displayed when needed. Ensuring clear visibility in any environment, "high-contrast display" and "automatic brightness adjustment based on ambient light intensity" are two complementary key technical features. This ensures that the displayed red, yellow, and green spectrum, icons, and text are visually striking and sharp enough for rapid recognition. The system intelligently adapts to various complex lighting environments, automatically increasing brightness to maximum under bright sunlight to guarantee visibility; automatically reducing brightness at dusk or night to avoid glare, becoming a "polite communicator"; and instantly switching brightness upon entering a tunnel, ensuring that communication is always effective and appropriate, avoiding communication failures or new safety hazards caused by unclear displays or glare interference.

[0039] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0040] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0041] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A vehicle external communication system, characterized in that, include: The data acquisition module is used to collect multi-source heterogeneous data through in-vehicle network and physical sensing methods. The data includes alarm information from various in-vehicle components, software and hardware systems and networks, alarm information from vehicles ahead and road facilities, the vehicle's working mode data and response strategy data, as well as billing data and driving mode conversion record data that need to be disclosed to the public. The data processing module is connected to the data acquisition module and is configured to run a data fusion algorithm to clean and fuse the acquired multi-source heterogeneous data to generate visual display data. An external display module, connected to the data processing module, is used to display the visual display data externally through a display device installed on the vehicle window, body, or roof. A communication module, connected to the data processing module, is used to send the visual display data to an external receiving device via vehicle networking or wireless broadcasting.

2. The automotive external communication system according to claim 1, characterized in that, The physical sensing approach in the data acquisition module includes identifying warning indicator lights, icons, or text information displayed on the dashboard or central control screen using an optical camera deployed inside the vehicle, and collecting warning buzzer or voice prompt signals from the vehicle using a built-in microphone array. The sensor data recognition algorithm is then used to perform pattern recognition and analysis on the optical and acoustic signals, converting them into standardized warning information that can be processed by the data fusion algorithm.

3. The automotive external communication system according to claim 2, characterized in that, The data fusion algorithm running in the data processing module includes a health status assessment algorithm, which is used to perform weighted calculations based on the type, quantity, frequency and severity level of the alarm information to generate graded data representing the health status of the vehicle, road or other vehicles, and map the graded data into a continuous spectrum visual signal of red-yellow-green, where red represents extremely poor health status and danger, yellow represents problems that require caution, and green represents normal.

4. The automotive external communication system according to claim 3, characterized in that, The graded data output by the health status assessment algorithm is further processed by the icon mapping algorithm to dynamically map the vehicle's working mode data to the corresponding vehicle status icon, and to map the vehicle's response strategy data to arrow icons representing the vehicle's subsequent driving mode.

5. The automotive external communication system according to claim 4, characterized in that, The data processing module also runs a data priority scheduling algorithm, which analyzes the billing data and driving mode conversion record data that need to be displayed externally, dynamically prioritizes the data according to its importance, urgency and freshness, and controls the external display module to display the data in the order of the scheduling results and the display duration.

6. The automotive external communication system according to claim 5, characterized in that, The external display module and the communication module work together to form a saturated external communication mode, enabling continuous and synchronous information supply to surrounding vehicles, pedestrians, roadside equipment, aerial drones, and low-orbit satellites.

7. The automotive external communication system according to claim 6, characterized in that, The system is equipped with a communication status monitoring unit for real-time monitoring of the quality and security status of the vehicle network link. When the vehicle network communication is interrupted, the bandwidth is severely insufficient, or the signature verification fails due to a network attack, the system automatically switches to a pure visual display mode that relies on the external display module to transmit information to the outside world, and can simultaneously prompt the communication failure status on the display device.

8. The automotive external communication system according to claim 7, characterized in that, The external receiving device includes the vehicle external display communication system of other vehicles; the system is also configured to receive and process visual display data sent by other vehicles, and use the data as one of the input data sources of the data acquisition module to assist in the health status assessment and decision-making of the vehicle.

9. The automotive external communication system according to claim 8, characterized in that, When the system receives a spectral signal or response strategy data indicating a dangerous health condition from a vehicle ahead, it can trigger the vehicle's assisted driving or autonomous driving system to execute a predetermined avoidance strategy and broadcast the vehicle's response strategy data to the outside world through the external display module and the communication module.

10. The automotive external communication system according to claim 9, characterized in that, The display device is a visual information display unit integrated into the vehicle glass or body surface, which is configured to display external visual information with high contrast without affecting the normal field of vision and lighting of the occupants. The displayed content can automatically adjust its brightness according to the ambient light intensity.

Images