An interactive system for the display of an intelligent cockpit electronic rearview mirror screen and a central control screen in cooperation

Abstract

The application discloses an interactive system for collaborative display of an intelligent cabin electronic rearview mirror screen and a central control screen, and relates to the technical field of intelligent networked vehicles.The system comprises a user interaction module, a scene perception module, a cabin domain controller, a communication interaction module, an electronic rearview mirror screen module and a central control screen module.The user interaction module acquires rear or side camera video stream data output by the electronic rearview mirror screen and interface display data corresponding to the central control screen, and simultaneously receives collaborative display control instructions from touch control operations, voice instructions or steering wheel key input of the central control screen.The application realizes collaborative display and linkage control of the electronic rearview mirror screen and the central control screen, supports dynamic allocation of display resources in multiple scenes, improves information utilization efficiency and driving safety, realizes resource reuse through picture migration, enriches display content, and simplifies operation procedures, reduces attention distraction and improves human-computer interaction experience of the intelligent cabin through multi-modal interaction modes such as touch control and voice.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent connected vehicles, and particularly to an interactive system for collaborative display between an electronic rearview mirror screen and a central control screen in an intelligent cockpit. Background Art

[0002] With the continuous development of intelligent connected vehicle technology, intelligent cockpits are gradually evolving towards multi-screen, information integration, and human-machine interaction intelligence. As a new in-vehicle display device replacing traditional optical rearview mirrors, electronic rearview mirrors collect environmental information behind and on the sides of the vehicle through cameras and present it in real time on the in-vehicle display screen, which has become an important technical means to improve vehicle safety and aerodynamic performance. At the same time, as the in-vehicle information entertainment and control center, the central control screen undertakes various functions such as navigation, multimedia, and vehicle status management. In the existing intelligent cockpit architecture, the electronic rearview mirror screen and the central control screen usually operate as relatively independent display units respectively, and there is only basic data communication ability between systems, lacking a unified display collaboration and interaction control mechanism, making it difficult to achieve deep integration and linked display between multiple screens.

[0003] However, there is a common problem of interactive fragmentation between the electronic rearview mirror screen and the central control screen in the prior art: the electronic rearview mirror screen is usually only used for fixedly displaying the camera video stream, lacking the ability of screen transfer, content sharing, and display control with the central control screen, and the central control screen cannot flexibly call the rearview mirror image or schedule its display mode, resulting in low utilization rate of multi-screen resources. At the same time, during actual driving, when the driver needs to view the details behind or switch the perspective, it is often necessary to complete it by independently operating different screens, with a complex operation path, which is easy to distract the driver's attention and there are certain safety hazards. In addition, the existing system lacks a dynamic display strategy based on driving scenarios (such as reversing, lane changing, high-speed driving, etc.), and cannot intelligently adjust the multi-screen display content and priority according to real-time vehicle conditions and environmental information, nor does it support users to customize collaborative display rules and multi-modal interaction methods, making it difficult to meet the requirements of intelligent cockpits for personalized, intelligent, and efficient interaction experiences.

[0004] The above information disclosed in the background art section is only used to strengthen the understanding of the background of the present disclosure, and therefore it may include information that does not constitute the prior art known to those of ordinary skill in the art. Summary of the Invention

[0005] The purpose of the present invention is to provide an interactive system for collaborative display between an electronic rearview mirror screen and a central control screen in an intelligent cockpit to solve the problems in the above background art.

[0006] To achieve the above objectives, the present invention provides the following technical solution: an interactive system for the collaborative display of an electronic rearview mirror screen and a central control screen in an intelligent cockpit, comprising a user interaction module, a scene perception module, a cockpit domain controller, a communication interaction module, an electronic rearview mirror screen module, and a central control screen module: The user interaction module acquires video stream data from the rear or side cameras output by the electronic rearview mirror screen and corresponding interface display data from the central control screen. It also receives collaborative display control commands from touch operation of the central control screen, voice commands, or input from steering wheel buttons. The scene perception module identifies the current driving scene based on the received collaborative display control commands and combined with vehicle operating status information and environmental perception information, and obtains the corresponding target driving scene type. The cockpit domain controller processes video stream data and interface display data according to the target driving scenario type, and generates target display strategy information for multi-screen collaboration. The target display strategy information includes at least the screen allocation method, display layout form and display priority. The communication and interaction module performs format conversion and image reconstruction processing on the video stream data according to the target display strategy information, and simultaneously generates rearview mirror image data adapted to the central control screen display. The electronic rearview mirror screen module dynamically adjusts the display content between the electronic rearview mirror screen and the central control screen while performing screen reconstruction processing, including video screen migration, display area switching and auxiliary information overlay. The central control screen module outputs the processed rearview mirror image data and interface display data to the electronic rearview mirror screen and the central control screen respectively through data transmission and interaction, realizing collaborative display and interactive control between the two screens.

[0007] Preferably, the process revolves around a unified handling of various interactive inputs, aiming to transform different input formats into consistent control data to improve interaction consistency and execution accuracy. The steps are as follows: It receives touch operation information, voice recognition results, and steering wheel button input signals, identifies and distinguishes inputs from different sources, and establishes corresponding data record entries according to the input source to form a multi-source input data set; The operation content in the multi-source input data set is parsed to extract the operation type parameters, target control object and operation triggering conditions, and generate the corresponding control instruction type information. Encode information for different control command types, map operation type parameters uniformly, and standardize the format of the target control object to obtain standardized control command data; Standardized control command data is written into the command cache queue, sorted according to the command triggering order, and then passed to the display strategy generation process.

[0008] Preferably, the focus is on information fusion analysis during the driving scenario determination process, taking the comprehensive judgment of multi-source state information as the processing object to enhance scenario matching capabilities. The steps are as follows: Collect vehicle operating status information and environmental perception data, classify and store vehicle speed, gear, turn signal, radar, camera and navigation data to form a multi-dimensional information set; Key feature parameters are extracted from the multidimensional information set, including driving state parameters, environmental target information and road type identification, and a set of corresponding parameter relationships is established. The parameter relationship set is matched and analyzed by combining driving state parameters with environmental target information to obtain the scene judgment condition set; A driving scenario type identifier is generated based on the scenario determination condition set and output to the display strategy generation process.

[0009] Preferably, for the process of organizing and allocating content in multi-screen displays, the core processing is the division and layout generation of display content, which improves display coordination. The steps are as follows: Acquire control command data and driving scenario type information, and perform correlation processing on the two types of data to form strategy input data; The display requirements in the strategy input data are analyzed, and the display object category, display priority parameter and display area requirement information are extracted to generate a target display content set. The target display content set is allocated and processed, the display objects are sorted according to the display priority parameter, the area position corresponding to each display object is determined, and the display area layout information is generated. The display area layout information is structured to form complete display strategy data, which is then output to the display scheduling process.

[0010] Preferably, the adaptation processing of video stream data across different display terminals aims to ensure display consistency by focusing on image transformation and data structure matching. The steps are as follows: Receive video stream data from electronic rearview mirrors, continuously acquire video frame data, and establish an image data buffer sequence to form a raw image data set; The original image data set is processed in a format, including resolution matching and data encoding conversion, to generate a data structure adapted for display. The adapted image data is reconstructed by re-dividing the image area and adjusting the image display ratio to obtain image data for different display terminals. The processed image data is categorized and output according to terminal type, and then transmitted to the display scheduling process.

[0011] Preferably, during the image reconstruction process, a screen area priority identifier is introduced to mark key areas in the image data and maintain the integrity of key areas when adjusting the image display ratio. At the same time, non-key areas are compressed in combination with the terminal display area size to ensure that the image data structure is consistent between different display terminals and to meet the display scheduling process requirements.

[0012] Preferably, in combination with the changing needs of multi-screen display, the screen migration and area switching are processed to improve display flexibility and content scheduling capabilities. The steps are as follows: Obtain display strategy data, parse the current display content configuration, and identify the display objects and their corresponding area information; The system detects adjustment requirements in the display strategy data, identifies the display objects that need to be migrated, and determines the target display area. Perform screen migration processing, remap the position of the displayed object, and complete the display area switching processing to generate new display configuration data; The new display configuration data is updated and output to the display terminal to adjust the display content.

[0013] Preferably, focusing on the transmission organization of multiple data types during the display process, unified scheduling of video streams, control information, and status data is performed to enhance data consistency. The steps are as follows: It receives video stream data, control command data, and status information data, identifies and classifies different data types, and forms a transmission data set. The transmitted data set is grouped and processed to divide video stream data, control command data, and status information data into different data transmission units; The system schedules and processes various data transmission units, generating a unified transmission sequence according to data type and priority. The unified transmission sequence is sent to the display terminal interface, and the data is output synchronously.

[0014] Preferably, based on the multi-screen display resource allocation process, display permission adjustments and resource reconstruction are performed to improve display utilization. The steps are as follows: Obtain current display status information, record the content displayed in the electronic rearview mirror and the central control screen, and form a display status set; The control requirements in the display strategy data are analyzed to identify the display objects involved in screen migration and determine the target display terminal. Perform display permission adjustment processing, reallocate display objects, update display resource allocation relationships, and generate new display resource allocation results; The resource allocation results will be written to the display control queue, and the display content configuration of each display terminal will be updated synchronously.

[0015] The technical effects and advantages provided by the present invention in the above technical solution are as follows: This invention establishes a collaborative display and interaction mechanism between the electronic rearview mirror screen and the central control screen, enabling information exchange and operational linkage among multiple screens. This transforms previously independent display units into a unified interactive system. Drivers can centrally view, switch, and control the rearview mirror display via the central control screen, eliminating the need for frequent switching between different display devices and significantly reducing operational steps. Simultaneously, the interconnected information display across multiple screens helps reduce the frequency of eye movement while driving, thereby minimizing distraction, improving operational consistency and response efficiency, and enhancing overall driving safety while improving information accessibility.

[0016] This invention, based on a driving scenario recognition mechanism, dynamically allocates display resources between the electronic rearview mirror screen and the central control screen. It automatically matches corresponding display strategies according to different driving scenarios such as reversing, lane changing, and highway cruising, making the displayed content more aligned with actual driving needs. In different scenarios, it can adaptively adjust the image viewing angle, display area, and information priority, thereby achieving targeted optimization of information presentation. This scenario-driven display method can highlight important information at critical moments, assisting drivers in judgment and decision-making, thus effectively improving driving safety and environmental perception.

[0017] This invention supports flexible migration of electronic rearview mirror images between different display terminals. When needed, the rearview mirror image can be transferred to the central control screen for centralized display, while simultaneously freeing up the display resources of the electronic rearview mirror screen to display other vehicle-related information. This dynamic adjustment mechanism breaks the limitation of fixed single-screen functions, enabling flexible reuse of display resources and avoiding idle or underutilized display resources in certain driving scenarios. This approach not only improves the overall utilization efficiency of multi-screen systems but also enriches the information displayed, giving the smart cockpit a stronger information carrying capacity.

[0018] This invention supports multiple interaction methods, including touch operation, voice commands, and steering wheel buttons, forming a multimodal collaborative human-machine interaction system. This allows drivers to select the appropriate operation method based on the actual driving environment. During driving, operations can be completed quickly via voice or buttons, reducing interference from manual operation; when stationary or at low speeds, fine adjustments can be made via touch. These complementary interaction methods make the operation process more intuitive and convenient, reducing learning costs while improving the system's intelligence and user comfort, thereby enhancing the overall human-machine interaction experience. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this invention. For those skilled in the art, other drawings can be obtained based on these drawings.

[0020] Figure 1 This is a schematic diagram of the module of the present invention.

[0021] Figure 2 This is the core flowchart of the present invention. Detailed Implementation

[0022] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, they are provided so that the description of this disclosure will be more complete and fully convey the concept of the exemplary embodiments to those skilled in the art.

[0023] This invention provides, for example Figure 1 and Figure 2 The interactive system shown, which integrates the smart cockpit electronic rearview mirror screen and the central control screen, operates as follows: In the multi-screen collaborative interaction process of the intelligent cockpit, the user interaction link serves as the entry point for the entire collaborative display system. Its main function is to receive the driver's operational intentions in actual driving scenarios and transform these intentions into control information that can be recognized and executed by the system. In practice, the driver can initiate collaborative display requests through various human-machine interaction methods, including but not limited to touch operation of the central control screen, voice command input, and steering wheel shortcut button operation, thereby achieving flexible control over the electronic rearview mirror image and the content displayed on the central control screen.

[0024] Among these, the central control screen touch operation is one of the most intuitive interaction methods. Drivers can directly control the rearview mirror image by clicking, swiping, and dragging on the central control screen interface. For example, a dedicated rearview mirror control area or floating window can be set up on the central control screen interface. When the driver clicks the corresponding icon, a view switching request can be triggered, allowing switching between rear, side, or wide-angle views. Dragging can move the electronic rearview mirror image from the electronic rearview mirror display area to a designated area on the central control screen, or adjust the image display position and size within the central control screen. Gestures such as two-finger zoom can also zoom in and out to meet the driver's needs for viewing detailed information. In addition, the central control screen interface can provide multiple layout options. By clicking different layout modes, drivers can quickly switch the display mode, such as full-screen display, split-screen display, or picture-in-picture display, thereby achieving dynamic adjustment of the display layout.

[0025] In terms of voice interaction, drivers can directly initiate collaborative display control requests via voice commands, eliminating the need for manual operation and effectively reducing operational complexity during driving. Voice commands can include controlling perspective switching, such as issuing commands to switch the right-side rearview mirror view or view the rear view; they can also include controlling image migration, such as moving the rearview mirror image to the central control screen or closing the rearview mirror window on the central control screen; and they can also include adjusting the display layout, such as displaying the rearview mirror image in full screen or enabling split-screen mode. Voice interaction can be combined with the vehicle's voice recognition function to parse voice content into specific control commands and transmit them to subsequent processing stages, thereby achieving rapid response and adjustment of multi-screen display content.

[0026] Steering wheel shortcut buttons, as a convenient physical input method, are primarily used for quick and low-interference operation control while driving. By setting dedicated function buttons or combination buttons on the steering wheel, drivers can quickly trigger collaborative display requests without leaving the driving position. For example, a single button press can quickly switch the rearview mirror view, while a long press or combination of buttons can trigger screen migration or layout switching operations, thereby improving operational efficiency and reducing driver distraction. This interaction method is particularly suitable for high-speed driving or complex road conditions, ensuring both operational convenience and driving safety.

[0027] Building upon the aforementioned input methods, different interaction methods can complement each other to form a complete user interaction system. Drivers can flexibly choose the appropriate interaction method to initiate control requests based on the current driving environment, operating habits, and usage preferences. For example, in stationary or low-speed scenarios, drivers can prioritize touch controls for fine-tuning; while driving, they can prioritize voice or steering wheel button controls for quick control. The collaborative application of multiple interaction methods helps improve overall interaction efficiency and reduce operational complexity.

[0028] When a driver initiates a collaborative display request through any interaction method, the system processes the input uniformly, transforming operational information from different sources into standardized control commands, which are then used for subsequent display scheduling and strategy generation. These control commands typically include operation type information, target display content information, and desired display method information, such as viewpoint switching type, target location for screen migration, and display layout mode. By structuring the control commands, consistency and compatibility between different interaction methods can be achieved, thereby ensuring the stability and reliability of subsequent processing flows.

[0029] Furthermore, in practical applications, it can also support the recording and learning of user operating habits. By analyzing historical operation data, it can optimize commonly used collaborative display operations. For example, it can prioritize recommending commonly used display modes in specific scenarios, or automatically match the most likely operation intent when the user issues a vague command, thereby further improving the level of intelligence in the interaction. Without changing the original technical architecture, this optimization method can enhance the system's adaptability to user needs, making the interaction process more natural and efficient.

[0030] In summary, by combining various interaction methods such as central control screen touch, voice commands, and steering wheel shortcut buttons, flexible control of the electronic rearview mirror image and the content displayed on the central control screen can be achieved, covering various operation types such as perspective switching, image migration, and layout adjustment. This provides a unified, standardized, and efficient input foundation for subsequent multi-screen collaborative display, while also providing strong support for improving driving safety and user experience.

[0031] In a multi-screen collaborative display system for intelligent cockpits, real-time collection and analysis of vehicle operating status and external environmental information are fundamental for subsequent display scheduling and interactive control. By continuously acquiring and processing vehicle status information such as speed, gear position, and turn signals, as well as environmental information from radar, cameras, and navigation data, a complete perception capability of driving behavior and the driving environment can be built, providing reliable data support for accurate identification of driving scenarios. In specific implementation, vehicle status information typically originates from the vehicle control network. Collecting vehicle speed signals reflects the current vehicle speed and its dynamic changes; acquiring gear position information determines whether the vehicle is in forward, reverse, or neutral mode; monitoring turn signal signals identifies the driver's steering intentions, such as lane changes or turns. This basic status information is characterized by high real-time performance and frequent updates, directly reflecting the vehicle's current operating behavior and serving as a crucial basis for judging driving scenarios.

[0032] Meanwhile, the acquisition of environmental information primarily relies on onboard sensors and navigation systems. Radar data is used to perceive the distribution of obstacles around the vehicle, target distances, and relative speeds, helping to assess the complexity of the surrounding traffic environment. Camera data acquires real-time images from the rear or sides of the vehicle, which can be used not only for rearview mirror displays but also to provide visual evidence for scene recognition, such as determining if there are oncoming vehicles or targets in blind spots. Navigation data provides information such as road type, lane information, and driving routes, helping to determine whether the vehicle is currently on a highway, in a city, or in a congested area, further enriching the dimensions of scene recognition. By fusing multi-source environmental data, the accuracy of external environment perception can be improved, enabling the system to more comprehensively understand the current driving situation.

[0033] After collecting vehicle status and environmental information, the multi-source data needs to be comprehensively analyzed and processed to identify the current driving scenario. Driving scenarios typically include reversing, lane changing, high-speed driving, and low-speed congestion. For example, in a reversing scenario, when the gear is detected to be in reverse and the vehicle speed is relatively low, it can be determined that the vehicle has entered reversing mode. In a lane changing scenario, when the turn signal is detected, combined with vehicle speed and surrounding target information, it can be determined that the driver intends to change lanes. In a high-speed driving scenario, navigation data indicates the current road type is a highway, and combined with a relatively high speed range, it can be identified as high-speed cruising. In a congestion scenario, the persistently low speed and frequent stop-and-go characteristics indicate traffic congestion. Different scenarios have clear criteria for judgment; by combining and analyzing various types of information, a relatively accurate scenario classification can be achieved.

[0034] In scene recognition, different types of data need to be processed collaboratively. For example, relying on a single data source may lead to misjudgment, while jointly analyzing vehicle speed, gear position, and navigation information can improve accuracy. Simultaneously, supplementing this with radar and camera data can further confirm the surrounding environment, thus avoiding recognition errors caused by changes in a single condition. This multi-dimensional information fusion approach enhances the stability and reliability of scene recognition, making the generation of subsequent display strategies more rational.

[0035] Furthermore, scene recognition results are dynamically updated. As the vehicle's operating status and external environment change, the scene type will also switch accordingly. For example, when gradually decelerating after entering a ramp from a high-speed vehicle, the scene may transition from a high-speed state to an urban road state; in urban roads, when traffic flow increases and vehicle speed decreases, it may further transition to a congested state. Therefore, in practical applications, it is necessary to continuously monitor vehicle status and environmental information and update scene recognition results in real time to ensure that the system always performs subsequent processing based on the latest driving context.

[0036] By employing the methods described above, real-time collection of vehicle status and environmental information, along with accurate identification of driving scenarios, can provide a clear context for subsequent multi-screen collaborative displays. Different driving scenarios correspond to different information display needs. By identifying the current scenario in advance, it provides a foundation for content allocation, screen layout adjustments, and interactive control, thereby improving the overall system's response efficiency and interactive rationality. Simultaneously, this scenario recognition method based on multi-source information fusion also helps improve the targeting of driver assistance functions, making information presentation more aligned with actual driving needs.

[0037] In the process of multi-screen collaborative display in intelligent cockpits, the comprehensive processing of user input information and driving scenario information is the core link in achieving dynamic display scheduling. By uniformly receiving and fusing the control commands generated by user interaction and the scene recognition results, display control logic tailored to the current driving situation can be formed, thereby achieving collaborative display scheduling between the electronic rearview mirror screen and the central control screen. In specific implementation, user input information typically comes from touch operations, voice commands, or steering wheel buttons. The control content generated by these input methods directly reflects the driver's current operational intent, such as switching perspectives, performing screen migrations, or adjusting the display layout. At the same time, the driving scenario type output by the scene recognition stage reflects the actual operating state and environmental conditions of the vehicle, such as reversing, changing lanes, high-speed driving, or congested conditions. By uniformly processing these two types of information, more reasonable display control decisions can be formed by considering both the user's subjective operational intent and the objective driving environment.

[0038] In the specific processing, user input information is first parsed, transforming operations from different sources into structured control data, such as operation type, target display object, and desired display method. Simultaneously, scene recognition results are acquired, and feature information corresponding to the current scene is extracted, such as priority display area, information importance, and safety-related prompts. By fusing and analyzing these two types of information, a basic framework for display strategies tailored to the current driving situation can be formed. Based on this, the priority allocation of the current control logic can be determined by judging the matching relationship between user operation intentions and scene features. For example, in safety-related scenarios such as reversing or changing lanes, priority can be given to highlighting rearview mirror image information; while in high-speed cruising or stable driving conditions, the main functional interface of the central control screen can be appropriately retained while ensuring the display of basic safety information.

[0039] Furthermore, the generation of display strategies requires comprehensive consideration of various control factors, including the allocation of display content, the layout of display areas, and the presentation format of information. Content allocation primarily determines the display relationship between the electronic rearview mirror image and the central control interface information on different screens. For example, it may be necessary to migrate the rearview mirror image to the central control screen for auxiliary display, or embed relevant images as windows on the central control screen. The display area layout determines the specific location and size ratio of various types of information on the screen, such as using full-screen display, split-screen display, or partial overlay display. The presentation format determines whether to overlay auxiliary information, such as trajectory lines, warning prompts, or status indicators, onto the image. By comprehensively processing these multi-dimensional factors, complete collaborative display strategy information can be generated.

[0040] After the strategy is generated, it needs to be further translated into specific display scheduling instructions to control the changes in the displayed content on the electronic rearview mirror screen and the central control screen. In this process, display scheduling includes not only adjusting the position and display method of the video image, but also dynamically allocating display priorities. For example, in some scenarios, it is necessary to temporarily increase the display priority of the rearview mirror image on the central control screen, allowing it to occupy a larger display area or a more prominent position; in other scenarios, its display priority can be reduced, presenting it only as supplementary information. Through this dynamic adjustment method, display resources can be rationally allocated in different driving situations, thereby improving the overall effectiveness of information display.

[0041] Furthermore, the synchronization between different displayed content needs to be considered during the display scheduling process. For example, when the electronic rearview mirror image is embedded in the central control screen, its time synchronization with the original displayed content must be ensured to avoid affecting driving judgment due to delay differences. At the same time, when performing screen migration or layout adjustment operations, the continuity and smoothness of the display process must be ensured to avoid abrupt changes or flickering, thereby improving the stability of the user experience.

[0042] In multi-screen collaborative scheduling, user input information and scene information do not exist in isolation, but rather interact with each other. On one hand, user actions can directly trigger adjustments to display strategies, such as changing the screen layout or switching perspectives via manual commands. On the other hand, scene recognition results can also constrain or optimize user actions. For example, in safety-priority scenarios, some non-critical operations can be restricted or delayed to avoid affecting driving safety. Through this two-way interaction mechanism, both system responsiveness and safety / stability can be ensured.

[0043] By comprehensively processing user commands and scene data, a collaborative display strategy is generated and the content displayed on both screens is dynamically scheduled, enabling information collaboration and functional linkage between the electronic rearview mirror screen and the central control screen. This process not only improves the utilization efficiency of multi-screen resources but also optimizes information display based on actual driving needs, making the displayed content more suitable for the driving context, thereby enhancing the overall interactive experience while ensuring safety.

[0044] In the multi-screen collaborative display process of intelligent cockpits, the data interaction capability between the central control screen and the electronic rearview mirror screen directly determines the real-time performance and stability of the collaborative display effect. To meet the needs of real-time display of rearview mirror video streams and multi-screen interactive control, an efficient data transmission mechanism needs to be established to support the rapid exchange of video stream data, control commands, and status information between the two. In actual operation, video stream data typically has the characteristics of large data volume and high update frequency, while control commands and status information have high requirements for transmission latency and response speed. Therefore, unified scheduling and transmission management of different types of data are necessary to ensure the overall system's coordinated operation.

[0045] During data transmission, the video stream data first needs to be structured for adaptation and scheduling across different display terminals. The video stream data load can be defined as: in, It represents the video data load per unit period, reflecting the video stream transmission pressure; This indicates the video frame refresh rate, used to describe the number of image frames generated per unit time. This represents the pixel size of a single frame of an image, reflecting the image resolution. This represents the amount of data channel information corresponding to each pixel, used to describe the color or encoding complexity of image data. This formula is used to evaluate the data size of a video stream during transmission, providing a basis for subsequent transmission resource allocation.

[0046] After obtaining the video stream load, it is necessary to further determine the matching relationship between data transmission capacity and load. A data transmission efficiency function can be constructed as follows: in, It represents data transmission efficiency and is used to measure how well the transmission capacity supports the video stream load. It represents the bandwidth of the data transmission channel, reflecting the amount of data that can be transmitted per unit of time; This represents the data synchronization coefficient, used to describe the intensity of synchronization requirements during the transmission of multi-source data. This formula is used to determine whether the current transmission capacity meets the requirements for real-time video stream transmission; when this value is within a reasonable range, it indicates that the video stream can be transmitted stably.

[0047] Simultaneously with video streaming, control command data also needs to be processed. Control commands typically have small data volumes but high real-time requirements; therefore, a control response strength function can be defined: in, It indicates the control response strength and is used to measure the response priority of control commands in the system; Indicates the number of control commands per unit cycle; This indicates the importance weight of the control command. Different types of commands correspond to different weight values. For example, the view switching command and the layout adjustment command can have different weights. The aforementioned data transmission efficiency is used to reflect the impact of video stream resource consumption on control command response. This formula is used to coordinate the resource allocation relationship between the video stream and control commands.

[0048] Furthermore, when video stream data and control commands are transmitted together, a comprehensive evaluation of the overall data transmission status is needed, which can be achieved by constructing a data collaborative transmission factor: in, This represents the data coordination transmission factor, used to reflect the degree of coordination in overall data interaction; This represents the multimodal interaction coefficient, used to describe the impact of different input methods (touch, voice, buttons) on system load. This formula provides a unified description of video stream load and control response capability, evaluating the system transmission status from an overall perspective.

[0049] Building upon this, the role of state synchronization data during transmission also needs to be considered. State synchronization primarily ensures display consistency between the central control screen and the electronic rearview mirror screen, such as display mode, viewing angle, and prompt information. A state synchronization stability function can be defined as follows: in, It represents the stability of state synchronization and is used to measure the ability to maintain information consistency between two screens; This represents the data update fluctuation factor, used to describe the instability caused by the frequency of data changes; This represents the transmission delay impact factor, used to reflect the degree of data lag during transmission. This formula is used to determine whether state synchronization is stable; a higher value indicates better consistency of information between the two screens.

[0050] After completing the aforementioned data processing, a unified data scheduling mechanism can be established to integrate and transmit video stream data, control commands, and status synchronization information. Through comprehensive analysis of multi-dimensional parameters such as video stream load, transmission efficiency, control response, and synchronization stability, dynamic optimization of the data transmission process can be achieved, enabling different types of data to operate in a coordinated manner within the same transmission system.

[0051] The above methods enable efficient data transmission between the central control screen and the electronic rearview mirror screen, ensuring stable video streaming, rapid response to control commands, and real-time synchronization of status information, thus providing a reliable data foundation for multi-screen collaborative display. With multiple data types involved, constructing a unified data evaluation and scheduling model can improve the overall system's operational efficiency and interactive performance, making multi-screen collaborative display smoother and more stable.

[0052] In the multi-screen collaborative display system of the intelligent cockpit, the electronic rearview mirror screen plays a crucial role in presenting information about the environment behind and to the sides of the vehicle. Its core task is to stably display real-time images captured by cameras, while simultaneously cooperating with upper-level control logic to achieve perspective switching, information enhancement, and flexible allocation of display resources. During actual operation, the electronic rearview mirror screen continuously presents the environment behind and to the sides of the vehicle by receiving image data from the onboard cameras, enabling the driver to have a real-time understanding of the surrounding traffic conditions. These images typically include vehicles traveling behind, blind spots to the sides and rear, and road edge information. By continuously refreshing the screen, it provides intuitive information for driving decisions.

[0053] During image display, the electronic rearview mirror screen does not present a fixed single perspective, but can dynamically switch between multiple perspectives based on control commands. Perspective switching mainly manifests in the transition between images captured by different cameras, such as switching between the main rear view and the auxiliary side-rear view, or switching to a wide-angle view in specific scenarios to expand the observation range. Upon receiving corresponding control information, the electronic rearview mirror screen can reselect the currently displayed image data source and complete the image switching process, thereby meeting the driver's needs for field of vision in different driving situations. This process not only relies on real-time acquisition of camera data but also needs to ensure the continuity of the switching process, avoiding image interruptions or abrupt changes, thus maintaining a stable visual experience.

[0054] In addition to basic image display and perspective switching functions, the electronic rearview mirror screen also supports overlaying auxiliary information onto the original image to enhance its ability to convey environmental information. This auxiliary information can include graphic symbols or prompts to assist driving judgment, such as guide lines to indicate the driving trajectory or signs to warn of potential risks. By overlaying relevant information onto the video image, drivers can obtain more valuable information while observing the image, thereby improving their understanding of the surrounding environment. During the information overlay process, the image content and auxiliary information need to be coordinated to ensure that the overlaid content does not obscure key areas while maintaining the overall clarity and readability of the display.

[0055] In a multi-screen collaborative display system, the electronic rearview mirror screen not only serves as an information display device but also participates in the dynamic allocation of display resources. Under certain driving scenarios or user-triggered operations, the displayed content can be adjusted, changing the display permissions of the electronic rearview mirror screen. For example, when it's necessary to migrate the rearview mirror image to the central control screen for centralized display, the electronic rearview mirror screen's image occupancy can be reduced or eliminated, allowing it to display other types of information, such as vehicle status or auxiliary prompts. This approach enables flexible utilization of display resources, allowing limited screen space to accommodate more information types, thereby improving overall information display efficiency.

[0056] When adjusting display permissions, the current display state needs to be managed, including recording the current image source, display mode, and information overlay status. Upon receiving new control commands, adjustments can be made based on the current state, such as migrating the image or synchronizing information before releasing display permissions, thus ensuring the continuity of displayed content across different screens. Furthermore, the impact of driving scenarios on displayed content must be considered during permission adjustments. For example, critical image information should be prioritized in safety-related scenarios, while the types of displayed content can be appropriately expanded in non-critical scenarios, thereby achieving a more rational allocation of resources.

[0057] During overall operation, the electronic rearview mirror screen's image display, viewing angle switching, information overlay, and display permission adjustment functions are not isolated but rather form an interconnected and collaborative relationship. Image display is a basic function, viewing angle switching expands the observation range, information overlay enhances the image's expressiveness, and display permission adjustment optimizes resource utilization. These functions are coordinated through a unified control logic, enabling the electronic rearview mirror screen to provide appropriate display content in different driving scenarios, thereby improving the overall interactive experience while ensuring driving safety.

[0058] Through the above mechanism, the electronic rearview mirror screen can be transformed from a single display device into a multi-functional collaborative display terminal, enabling it not only to stably display environmental images, but also to dynamically adjust according to control needs, playing a more flexible and efficient role in the multi-screen collaborative system.

[0059] In the multi-screen collaborative display system of the intelligent cockpit, the central control screen, as the core display terminal for information interaction and function integration, undertakes the task of presenting the main functional interface, while also possessing the ability to dynamically embed and integrate information from the electronic rearview mirror images. In actual operation, the central control screen is typically used to display basic functional interfaces such as navigation information, multimedia content, and vehicle status. Its interface structure is relatively stable, and the information layout is clear, meeting the driver's main information acquisition needs in daily driving. Building upon this, by introducing a rearview mirror image embedding mechanism, the integrated display of multi-source information can be achieved without affecting the integrity of the main functional interface.

[0060] During image embedding, the central control screen can reserve or dynamically generate an area within the current interface to display the rearview mirror image based on control commands. This area can exist as a window, for example, located on the side or in a corner of the interface, thus introducing real-time rear or side image information while ensuring the normal display of the main interface functions. The size and position of the embedded area can be adjusted according to display needs. For example, when focusing on observing the rear environment, the image area can be appropriately enlarged; in scenarios primarily for navigation or multimedia use, a smaller window format can be maintained to reduce interference with the main interface. Through this flexible embedding method, different information can be rationally allocated, allowing the driver to obtain multi-dimensional information on the same interface.

[0061] Alongside the embedded image, the central control screen also provides interactive controls for manipulating the rearview mirror display. These controls are typically presented as graphical buttons or operation areas, allowing the driver to switch viewing angles or adjust display modes. For example, a viewing angle switching button near the embedded image allows for quick switching between rear and side views; layout switching controls allow the screen to change from a windowed display to a larger area or revert to its original state. These controls are usually associated with the image area, enabling the driver to perform related operations while observing the screen, thereby reducing the operation path and improving interaction efficiency.

[0062] In addition, the central control screen also serves to synchronously display the rearview mirror's status information. During multi-screen collaboration, the rearview mirror not only outputs image content but also includes certain status information, such as the current viewing mode, display status, or related prompts. By synchronously presenting this status information on the central control screen interface, the driver can understand the rearview mirror's operating status while viewing the main interface, thus avoiding frequent switching of gaze to other display areas. In practical implementation, status information can be integrated into the interface in the form of icons or text prompts, such as displaying a current viewing indicator around the image window or displaying relevant prompts in the interface status bar. This approach enhances the consistency of information display and keeps information synchronized across different display terminals.

[0063] In a multi-screen collaborative environment, the central control screen's embedded display of the rearview mirror image and its synchronized status display work in tandem. The embedded image provides real-time environmental information, the control controls support interactive operations, and the status information reflects the current system operation; these three elements together constitute a complete display and interaction system. In practical applications, the above content can be dynamically adjusted according to changes in the driving scenario. For example, in scenarios requiring a focus on the surrounding environment, the image display and related control functions can be enhanced; in scenarios primarily using infotainment or navigation, the image display can be de-emphasized, highlighting the main interface functions, thus achieving a reasonable allocation of displayed content.

[0064] During operation, it is also necessary to ensure the coordination between the embedded images and the main interface, including the stability of the interface layout and the clarity of information presentation. When embedding or removing images, the interface transition should be smooth to avoid abrupt changes or obscuring important information. At the same time, a reasonable visual hierarchy should be maintained between the image display area and the main interface so that the driver can quickly distinguish different types of information, thereby improving information acquisition efficiency.

[0065] In this way, the central control screen can not only display the main function interface, but also flexibly embed the electronic rearview mirror image, interactively control it, and synchronously display its status information, enabling it to play a more comprehensive role in the multi-screen collaborative system. This multi-functional integrated display method helps improve information integration capabilities, allowing drivers to obtain more comprehensive information on a single interface, thereby optimizing the overall user experience while ensuring driving safety.

[0066] Application scenario example: Scenario 1: Reversing Assist In reversing assistance scenarios, once the vehicle enters reverse gear, the system determines that it is currently in low-speed reversing mode by real-time recognition of the gear position signal. At this time, the display strategy prioritizes a clear presentation of the rear environment to assist the driver in completing safe reversing operations. The electronic rearview mirror switches to a wide-angle reversing view in this scenario, expanding the camera's capture range to fully display environmental information from a larger area behind the vehicle, thereby reducing the impact of blind spots on driving judgment.

[0067] During the image presentation, the central control screen simultaneously participates in the collaborative display, dynamically generating an image display window on the right side of its interface to show a rear overhead view. This overhead view supplements the spatial relationship information behind the vehicle from another perspective, allowing the driver to more intuitively judge the positional relationship between the vehicle and obstacles. In terms of display layout, the main interface and the auxiliary image maintain a reasonable proportion, ensuring that the basic functions of the main interface are not affected while effectively acquiring rear information.

[0068] Simultaneously, reversing trajectory lines are overlaid on the video feed. By mapping the vehicle's current steering state to its driving direction, possible driving paths are presented graphically on the screen. These trajectory lines dynamically change with steering wheel rotation, helping the driver predict the vehicle's movement and improving the accuracy of reversing maneuvers. During the overlay process, the trajectory information remains spatially aligned with the video feed to avoid obstructing key visual areas.

[0069] Throughout the process, the electronic rearview mirror screen and the central control screen maintain information synchronization. When the rear environment changes, the content displayed on both screens can be updated synchronously, thus ensuring information consistency. Through this dual-screen collaboration, information from a single perspective can be expanded into a multi-perspective fusion display, allowing the driver to simultaneously obtain information about the rear environment and spatial relationships while reversing, thereby improving judgment and reducing operational risks.

[0070] Scenario 2: Lane Change Assist In lane change assist scenarios, when the turn signal is activated, the system determines that the driver intends to change lanes. At this point, the display strategy shifts its focus to presenting environmental information in the blind spot area to the opposite side and rear. The electronic rearview mirror screen highlights targets in the blind spot in this scenario, enhancing the images captured by the camera to make vehicles or targets in the blind spot more clearly visible, thereby helping the driver identify potential risks.

[0071] During image display, localized enhancement of brightness or contrast can clearly distinguish targets in blind spots from the background environment, thereby improving target recognition efficiency. Furthermore, when necessary, risk warnings can be further strengthened by overlaying additional information, enabling drivers to quickly notice potentially hazardous areas.

[0072] In this scenario, the central control screen simultaneously provides auxiliary information display functions, popping up blind spot warning messages to remind the driver of potential lane change risks. These messages are typically presented in graphic or text form and complement the video information, allowing the driver to receive risk alerts without directly observing the rearview mirror.

[0073] In addition, the central control screen also displays real-time images of the side and rear, integrating the rearview mirror images into the main interface through an embedded window, allowing the driver to obtain more information within a single visual focus. During this process, the position and size of the image window are rationally arranged according to the interface layout to ensure that blind spot information is clearly displayed without affecting the normal use of the main interface content.

[0074] By working together with the electronic rearview mirror screen and the central control screen, a comprehensive auxiliary mechanism can be formed, which includes image enhancement, information prompts, and multi-screen display. This allows drivers to have a full grasp of the surrounding environment during lane changes, thereby reducing lane change risks and improving driving safety.

[0075] Scenario 3: High-speed cruising In high-speed cruising scenarios, vehicles are typically in a stable driving state with high speeds and relatively continuous driving environments. In this case, the display strategy focuses on maintaining the integrity of the main interface of the central control screen while ensuring rear environmental awareness. The electronic rearview mirror screen switches to a standard rear view in this scenario to continuously provide traffic information behind the vehicle, allowing the driver to monitor the distance to vehicles behind and follow the vehicle at any time.

[0076] From this perspective, the image output remains stable without frequent switching to reduce visual interference. Simultaneously, by optimizing the image display, information about vehicles and roads behind the vehicle remains clear, thus supporting the driver's judgment of traffic flow behind.

[0077] In this scenario, the central control screen is primarily used to display navigation information or multimedia content, maintaining the functionality of the main interface. Without affecting the main interface, rear vehicle distance warning information is simultaneously displayed in the status bar area at the bottom of the screen. This information is used to indicate changes in the distance between the vehicle behind and the vehicle itself; when the following vehicle is too close or there is a potential risk, a prompt can be made to alert the driver.

[0078] This status information is typically presented in a concise format, such as icons or short text prompts, to avoid interfering with the main interface. Simultaneously, this information complements the electronic rearview mirror image, allowing the driver to both visually observe the situation behind them through the image and quickly obtain key status changes through the prompts.

[0079] In this way, a balance is achieved in information display during high-speed cruising. On the one hand, it ensures the continuous acquisition of information about the rear environment, and on the other hand, it maintains the use of the main functions of the central control screen, thereby improving the efficiency of information acquisition without increasing the driving burden.

[0080] Scenario 4: Custom Mode. In custom mode, drivers can flexibly configure the multi-screen display according to their personal usage habits and current needs. Through the settings function provided by the central control screen interface, the electronic rearview mirror image can be moved from its original display position to the central control screen for full-screen display, thereby achieving a wider field of view.

[0081] After the image migration operation is performed, the central control screen displays the rearview mirror image as the primary content, providing a larger display area so that the driver can more clearly observe the details of the rear or side environment. This mode is suitable for specific scenarios where it is necessary to focus on observing the rear situation, such as complex road conditions or special driving needs.

[0082] Meanwhile, after the electronic rearview mirror screen completes the image migration, its display resources are released and can be used to display other types of information, such as vehicle operating status. In this way, the originally single-purpose display device can be transformed into a multi-functional information display terminal, thereby improving the overall utilization rate of display resources.

[0083] During the customization process, drivers can choose different display combinations as needed, such as adjusting the screen display position, switching display content, or restoring the default state, thereby achieving a personalized display experience. This mode emphasizes flexibility and adjustability, enabling the multi-screen collaboration system to adapt to the usage preferences of different users.

[0084] Enhanced voice interaction In multi-screen collaborative display systems, voice interaction serves as an important human-computer interaction method, providing drivers with a more convenient means of operation. Through voice input, drivers can directly issue control commands without manual operation, thereby enabling rapid adjustments to the displayed content.

[0085] In practical applications, voice commands can cover various operation types, such as perspective switching, screen migration, and display mode adjustment. When the driver issues a relevant command, the system recognizes and parses the voice content, converts it into corresponding control information, and triggers the corresponding display adjustment operation.

[0086] For example, when it's necessary to observe the environment to the side and rear, the corresponding viewpoint can be switched directly via voice command; when the display layout needs to be adjusted, screen migration or mode switching can be completed via voice. This interaction method can significantly reduce manual intervention by the driver during operation, thereby reducing the risk of distraction.

[0087] In addition, voice interaction can complement touch and button operations, providing diverse operation options in different driving scenarios, enabling drivers to choose the most suitable interaction method according to the actual situation, thereby improving overall operating efficiency and user experience.

[0088] By introducing voice interaction, the intelligence level of the multi-screen collaborative display system can be further enhanced, making information control more natural and efficient, while improving the human-computer interaction experience while ensuring driving safety.

[0089] This invention establishes a collaborative display and interaction mechanism between the electronic rearview mirror screen and the central control screen, enabling information exchange and operational linkage among multiple screens. This transforms previously independent display units into a unified interactive system. Drivers can centrally view, switch, and control the rearview mirror display via the central control screen, eliminating the need for frequent switching between different display devices and significantly reducing operational steps. Simultaneously, the interconnected information display across multiple screens helps reduce the frequency of eye movement while driving, thereby minimizing distraction, improving operational consistency and response efficiency, and enhancing overall driving safety while improving information accessibility.

[0090] This invention, based on a driving scenario recognition mechanism, dynamically allocates display resources between the electronic rearview mirror screen and the central control screen. It automatically matches corresponding display strategies according to different driving scenarios such as reversing, lane changing, and highway cruising, making the displayed content more aligned with actual driving needs. In different scenarios, it can adaptively adjust the image viewing angle, display area, and information priority, thereby achieving targeted optimization of information presentation. This scenario-driven display method can highlight important information at critical moments, assisting drivers in judgment and decision-making, thus effectively improving driving safety and environmental perception.

[0091] This invention supports flexible migration of electronic rearview mirror images between different display terminals. When needed, the rearview mirror image can be transferred to the central control screen for centralized display, while simultaneously freeing up the display resources of the electronic rearview mirror screen to display other vehicle-related information. This dynamic adjustment mechanism breaks the limitation of fixed single-screen functions, enabling flexible reuse of display resources and avoiding idle or underutilized display resources in certain driving scenarios. This approach not only improves the overall utilization efficiency of multi-screen systems but also enriches the information displayed, giving the smart cockpit a stronger information carrying capacity.

[0092] This invention supports multiple interaction methods, including touch operation, voice commands, and steering wheel buttons, forming a multimodal collaborative human-machine interaction system. This allows drivers to select the appropriate operation method based on the actual driving environment. During driving, operations can be completed quickly via voice or buttons, reducing interference from manual operation; when stationary or at low speeds, fine adjustments can be made via touch. These complementary interaction methods make the operation process more intuitive and convenient, reducing learning costs while improving the system's intelligence and user comfort, thereby enhancing the overall human-machine interaction experience.

[0093] The foregoing has only described certain exemplary embodiments of the present invention by way of illustration. Undoubtedly, those skilled in the art can modify the described embodiments in various ways without departing from the spirit and scope of the present invention. Therefore, the foregoing drawings and descriptions are illustrative in nature and should not be construed as limiting the scope of protection of the claims of the present invention.

Claims

1. An interactive system for the coordinated display of an intelligent cockpit electronic rearview mirror screen and a central control screen, characterized in that, This includes a user interaction module, a scene perception module, a cockpit domain controller, a communication interaction module, an electronic rearview mirror screen module, and a central control screen module. The user interaction module acquires video stream data from the rear or side cameras output by the electronic rearview mirror screen and corresponding interface display data from the central control screen. It also receives collaborative display control commands from touch operation of the central control screen, voice commands, or input from steering wheel buttons. The scene perception module identifies the current driving scene based on the received collaborative display control commands and combined with vehicle operating status information and environmental perception information, and obtains the corresponding target driving scene type. The cockpit domain controller processes video stream data and interface display data according to the target driving scenario type, and generates target display strategy information for multi-screen collaboration. The target display strategy information includes at least the screen allocation method, display layout form and display priority. The communication and interaction module performs format conversion and image reconstruction processing on the video stream data according to the target display strategy information, and simultaneously generates rearview mirror image data adapted to the central control screen display. The electronic rearview mirror screen module dynamically adjusts the display content between the electronic rearview mirror screen and the central control screen while performing screen reconstruction processing, including video screen migration, display area switching and auxiliary information overlay. The central control screen module outputs the processed rearview mirror image data and interface display data to the electronic rearview mirror screen and the central control screen respectively through data transmission interaction.

2. The interactive system for the coordinated display of the intelligent cockpit electronic rearview mirror screen and the central control screen according to claim 1, characterized in that, The unified processing of various interactive inputs aims to transform different input formats into consistent control data. The steps are as follows: It receives touch operation information, voice recognition results, and steering wheel button input signals, identifies and distinguishes inputs from different sources, and establishes corresponding data record entries according to the input source to form a multi-source input data set; The operation content in the multi-source input data set is parsed to extract the operation type parameters, target control object and operation triggering conditions, and generate the corresponding control instruction type information. Encode information for different control command types, map operation type parameters uniformly, and standardize the format of the target control object to obtain standardized control command data; Standardized control command data is written into the command cache queue, sorted according to the command triggering order, and then passed to the display strategy generation process.

3. The interactive system for the coordinated display of the intelligent cockpit electronic rearview mirror screen and the central control screen according to claim 2, characterized in that, Focusing on information fusion analysis in the driving scenario determination process, and taking the comprehensive judgment of multi-source state information as the processing object, the scenario matching capability is enhanced. The steps are as follows: Collect vehicle operating status information and environmental perception data, classify and store vehicle speed, gear, turn signal, radar, camera and navigation data to form a multi-dimensional information set; Key feature parameters are extracted from the multidimensional information set, including driving state parameters, environmental target information and road type identification, and a set of corresponding parameter relationships is established. The parameter relationship set is matched and analyzed by combining driving state parameters with environmental target information to obtain the scene judgment condition set; A driving scenario type identifier is generated based on the scenario determination condition set and output to the display strategy generation process.

4. The interactive system for the coordinated display of the intelligent cockpit electronic rearview mirror screen and the central control screen according to claim 3, characterized in that, For the organization and allocation of content in multi-screen displays, the core process is content division and layout generation to improve display coordination. The steps are as follows: Acquire control command data and driving scenario type information, and perform correlation processing on the two types of data to form strategy input data; The display requirements in the strategy input data are analyzed, and the display object category, display priority parameter and display area requirement information are extracted to generate a target display content set. The target display content set is allocated and processed, the display objects are sorted according to the display priority parameter, the area position corresponding to each display object is determined, and the display area layout information is generated. The display area layout information is structured to form complete display strategy data, which is then output to the display scheduling process.

5. The interactive system for the coordinated display of the intelligent cockpit electronic rearview mirror screen and the central control screen according to claim 4, characterized in that, The adaptation of video stream data across different display terminals, with the goal of image transformation and data structure matching, involves the following steps: Receive video stream data from electronic rearview mirrors, continuously acquire video frame data, and establish an image data buffer sequence to form a raw image data set; The original image data set is processed in a format, including resolution matching and data encoding conversion, to generate a data structure adapted for display. The adapted image data is reconstructed by re-dividing the image area and adjusting the image display ratio to obtain image data for different display terminals. The processed image data is categorized and output according to terminal type, and then transmitted to the display scheduling process.

6. The interactive system for the coordinated display of the intelligent cockpit electronic rearview mirror screen and the central control screen according to claim 5, characterized in that, During the image reconstruction process, a priority identifier for the image area is introduced to mark key areas in the image data. The integrity of key areas is maintained when the image display ratio is adjusted. At the same time, non-critical areas are compressed in combination with the terminal display area size to ensure that the image data structure is consistent between different display terminals and to meet the display scheduling process requirements.

7. The interactive system for the coordinated display of the intelligent cockpit electronic rearview mirror screen and the central control screen according to claim 5, characterized in that, To address the changing needs of multi-screen displays, the following steps are taken to handle screen migration and area switching: Obtain display strategy data, parse the current display content configuration, and identify the display objects and their corresponding area information; The system detects adjustment requirements in the display strategy data, identifies the display objects that need to be migrated, and determines the target display area. Perform screen migration processing, remap the position of the displayed object, and complete the display area switching processing to generate new display configuration data; The new display configuration data is updated and output to the display terminal to adjust the display content.

8. The interactive system for the coordinated display of the intelligent cockpit electronic rearview mirror screen and the central control screen according to claim 7, characterized in that, To organize the transmission of various data types during the display process, and to uniformly schedule video streams, control information, and status data, the following steps are taken: It receives video stream data, control command data, and status information data, identifies and classifies different data types, and forms a transmission data set. The transmitted data set is grouped and processed to divide video stream data, control command data, and status information data into different data transmission units; The system schedules and processes various data transmission units, generating a unified transmission sequence according to data type and priority. The unified transmission sequence is sent to the display terminal interface, and the data is output synchronously.

9. The interactive system for the coordinated display of the intelligent cockpit electronic rearview mirror screen and the central control screen according to claim 8, characterized in that, Based on the multi-screen display resource allocation process, display permission adjustments and resource reconstruction are handled to improve display utilization. The steps are as follows: Obtain current display status information, record the content displayed by the electronic rearview mirror and the central control screen, and form a display status set; The control requirements in the display strategy data are analyzed to identify the display objects involved in screen migration and determine the target display terminal. Perform display permission adjustment processing, reallocate display objects, update display resource allocation relationships, and generate new display resource allocation results; The resource allocation results will be written to the display control queue, and the display content configuration of each display terminal will be updated synchronously.

Images