Display method, device and equipment of vehicle auxiliary information and medium

Abstract

This application discloses a method, apparatus, device, and medium for displaying vehicle auxiliary information. It collects left and right eye frame data for generating 3D images and 2D auxiliary information from an in-vehicle system, and prioritizes the 2D information. Based on the 3D parallax determined from the left and right eye frame data and the priority of the 2D information, the micromirror array of the DMD chip is logically partitioned into a left-eye frame display area, a right-eye frame display area, and a 2D information display area. Independent micromirror control parameters, including deflection angle, switching frequency, and reflection efficiency, are calculated for each of these three display areas. Based on these set control parameters, the left-eye frame data, right-eye frame data, and 2D auxiliary information are precisely mapped and driven to their corresponding display areas. This application can achieve separate modulation and interference-free fusion display of 3D stereoscopic images and 2D auxiliary information on the physical optical path. The technical solution of this application can be widely applied in the field of vehicle technology.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a method, apparatus, device, and medium for displaying vehicle auxiliary information. Background Technology

[0002] With the rapid development of automotive intelligence and human-machine interaction technologies, in-vehicle display systems are evolving from traditional two-dimensional information presentation to immersive interactive interfaces that integrate three-dimensional navigation, augmented reality, and multi-dimensional auxiliary information. Head-up display systems, based on digital light processing (DLP) technology, are considered a key technological path to achieving next-generation in-vehicle information fusion display due to their high brightness, high contrast, and potential spatial light modulation capabilities.

[0003] In related technologies, existing DLP-based in-vehicle display solutions face integration challenges when simultaneously presenting three-dimensional images and two-dimensional auxiliary information. This can easily lead to mutual interference of information, screen flickering, or resolution loss, making it difficult to provide drivers with an immersive, intuitive, clear, and safe integrated visual experience in complex and ever-changing driving environments. Summary of the Invention

[0004] This application provides a method, apparatus, device, and medium for displaying vehicle auxiliary information.

[0005] One aspect of this application provides a method for displaying vehicle assistance information, the method comprising: Acquire left-eye and right-eye frame data of 3D images, as well as 2D auxiliary information from the vehicle's in-vehicle system, and prioritize the 2D auxiliary information. Based on the left-eye frame data and the right-eye frame data, determine the disparity corresponding to the 3D image; Based on the parallax and the priority of the 2D auxiliary information, the DMD chip micromirror array of the target vehicle is divided into a left eye frame display area, a right eye frame display area, and a 2D information display area. Calculate the control parameters corresponding to the left eye frame display area, the right eye frame display area, and the 2D information display area; wherein, the control parameters include deflection angle, switching frequency, and reflection efficiency; According to the control parameters, the left eye frame data is mapped to the left eye frame display area, the right eye frame data is mapped to the right eye frame display area, and the 2D auxiliary information is mapped to the 2D information display area.

[0006] For example, in some embodiments, the acquisition of 2D assistance information from the on-board system of the target vehicle includes: Vehicle speed information and warning sign information, which characterize the real-time operating status of the vehicle, are obtained from the controller local area network bus interface of the target vehicle. Obtain navigation guidance information representing the driving route from the navigation module interconnected with the vehicle system; The 2D auxiliary information is obtained based on the vehicle speed information, the warning sign information, and the navigation guidance information.

[0007] For example, in some embodiments, prioritizing the 2D auxiliary information includes: Detect the source type and content identifier of the 2D auxiliary information; According to the preset priority mapping rules, determine the initial priority corresponding to the source type; Based on the content identifier, determine the security correlation degree corresponding to the 2D auxiliary information; Based on the initial priority and the security correlation, the target priority of the 2D auxiliary information is determined through a preset comprehensive evaluation model.

[0008] For example, in some embodiments, dividing the DMD chip micromirror array of the target vehicle into a left-eye frame display area, a right-eye frame display area, and a 2D information display area according to the parallax amount and the priority of the 2D auxiliary information includes: Based on the disparity amount and the preset disparity-resource relationship model, the total amount of micromirror resources required to render the 3D image is calculated; Based on the priority of the 2D auxiliary information, the minimum number of micromirror resources required to present the 2D auxiliary information is calculated using a priority weighting algorithm. Based on the total number of micromirror resources and the minimum number of micromirror resources, the proportion of micromirror numbers occupied by the left eye frame display area, the right eye frame display area, and the 2D information display area is determined. Based on the ratio of the number of micromirrors, consecutive micromirror blocks are allocated in the address space of the DMD chip micromirror array for the left eye frame display area, the right eye frame display area, and the 2D information display area, respectively.

[0009] For example, in some embodiments, calculating the control parameters corresponding to the left-eye frame display area, the right-eye frame display area, and the 2D information display area includes: Obtain the ambient light intensity and road condition type of the current driving scenario; Based on the parallax, determine the deflection angle of the micromirrors in the left eye frame display area and the right eye frame display area; Based on the road condition type, determine the switching frequency of the micromirrors between the left eye frame display area and the right eye frame display area; The brightness gain coefficient of the micromirrors in the 2D information display area is determined based on the priority of the 2D auxiliary information. The reflection efficiency of the micromirrors in the left eye frame display area, the right eye frame display area, and the 2D information display area is determined based on the ambient light intensity.

[0010] Exemplarily, in some embodiments, the method further includes: Identify the boundary positions of the left eye frame display area, the right eye frame display area, and the 2D information display area on the DMD chip micromirror array; At the boundary location, a transition region composed of adjacent micromirrors is generated; Within the transition region, the deflection angle of the micromirror is controlled to gradually transition from a set angle value in the first display area to a set angle value in the adjacent second display area in a direction away from the boundary; wherein, the first display area and the second display area are any one of the left eye frame display area, the right eye frame display area and the 2D information display area.

[0011] Exemplarily, in some embodiments, the method further includes: Collect visual feedback data on the current merged display screen; Based on the visual feedback data, the control parameters of the left eye frame display area, the right eye frame display area, and the 2D information display area are corrected through a progressive iterative algorithm.

[0012] On the other hand, embodiments of this application provide a vehicle assistance information display device, the device comprising: The acquisition unit is used to acquire left-eye frame data and right-eye frame data of 3D images, as well as acquire 2D auxiliary information from the vehicle's in-vehicle system, and classify the 2D auxiliary information by priority. The processing unit is configured to determine the disparity amount corresponding to the 3D image based on the left-eye frame data and the right-eye frame data. The partitioning unit is used to divide the DMD chip micromirror array of the target vehicle into a left eye frame display area, a right eye frame display area, and a 2D information display area according to the parallax amount and the priority of the 2D auxiliary information. The calculation unit is used to calculate the control parameters corresponding to the left eye frame display area, the right eye frame display area, and the 2D information display area; wherein, the control parameters include deflection angle, switching frequency, and reflection efficiency; An execution unit is configured to map the left-eye frame data to the left-eye frame display area, the right-eye frame data to the right-eye frame display area, and the 2D auxiliary information to the 2D information display area according to the control parameters.

[0013] On the other hand, embodiments of this application provide an electronic device, including a processor and a memory; The memory is used to store computer programs; The processor executes the computer program to implement the aforementioned method for displaying vehicle auxiliary information.

[0014] On the other hand, embodiments of this application provide a computer-readable storage medium storing a computer program, which is executed by a processor to implement the aforementioned method for displaying vehicle auxiliary information.

[0015] On the other hand, embodiments of this application also provide a computer program product, which includes a computer program stored in a computer-readable storage medium. The processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the aforementioned method for displaying vehicle auxiliary information.

[0016] The embodiments of this application include at least the following beneficial effects: This application provides a method, apparatus, device, and medium for displaying vehicle auxiliary information. It collects left and right eye frame data for generating 3D images and 2D auxiliary information from an in-vehicle system, and prioritizes the 2D information. Based on the 3D parallax determined from the left and right eye frame data and the priority of the 2D information, the micromirror array of the DMD chip is dynamically logically partitioned into a left-eye frame display area, a right-eye frame display area, and a 2D information display area. Furthermore, independent micromirror control parameters, including deflection angle, switching frequency, and reflection efficiency, are calculated for each of these three display areas. Based on these separately set control parameters, the left-eye frame data, right-eye frame data, and 2D auxiliary information are accurately mapped and driven to their corresponding display areas. This application, through a dynamic partitioning and independent parameter control mechanism based on information characteristics (parallax and priority), achieves separate modulation and interference-free fusion display of 3D stereoscopic images and 2D auxiliary information on the physical optical path, thus balancing an immersive 3D experience with clear and stable 2D information presentation on a single screen. Attached Figure Description

[0017] The accompanying drawings are used to provide a further understanding of the technical solutions of this application and constitute a part of the specification. They are used together with the embodiments of this application to explain the technical solutions of this application and do not constitute a limitation on the technical solutions of this application.

[0018] Figure 1 This is a system architecture diagram of an in-vehicle DLP display system provided in the embodiments of this application; Figure 2 This is a flowchart illustrating a method for displaying vehicle auxiliary information provided in an embodiment of this application; Figure 3 This is a structural block diagram of a vehicle auxiliary information display device provided in the embodiments of this application; Figure 4 This is a structural block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0019] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0020] It is understood that the terms “first,” “second,” etc., used in this application may be used to describe various concepts herein, but unless otherwise stated, these concepts are not limited by these terms. These terms are used only to distinguish one concept from another.

[0021] As used in this application, the terms "at least one", "multiple", "each", "any", etc., "at least one" includes one, two or more, "multiple" includes two or more, "each" refers to each of the corresponding multiples, and "any" refers to any one of the multiples.

[0022] With the rapid development of automotive intelligence and human-machine interaction technologies, in-vehicle display systems are evolving from traditional two-dimensional information presentation to immersive interactive interfaces that integrate three-dimensional navigation, augmented reality, and multi-dimensional auxiliary information. Head-up display systems, based on digital light processing (DLP) technology, are considered a key technological path to achieving next-generation in-vehicle information fusion display due to their high brightness, high contrast, and potential spatial light modulation capabilities.

[0023] In related technologies, existing DLP-based in-vehicle display solutions face integration challenges when simultaneously presenting three-dimensional images and two-dimensional auxiliary information. This can easily lead to mutual interference of information, screen flickering, or resolution loss, making it difficult to provide drivers with an immersive, intuitive, clear, and safe integrated visual experience in complex and ever-changing driving environments.

[0024] In view of this, this application provides a method, apparatus, device, and medium for displaying vehicle auxiliary information. First, left and right eye frame data for generating 3D images and 2D auxiliary information from the vehicle system are collected, and the 2D information is prioritized. Based on the 3D parallax determined from the left and right eye frame data and the priority of the 2D information, the micromirror array of the DMD chip is dynamically logically partitioned into a left-eye frame display area, a right-eye frame display area, and a 2D information display area. Then, independent micromirror control parameters, including deflection angle, switching frequency, and reflection efficiency, are calculated for each of these three display areas. Based on these separately set control parameters, the left-eye frame data, right-eye frame data, and 2D auxiliary information are accurately mapped and driven to their corresponding display areas. This application, through a dynamic partitioning and independent parameter control mechanism based on information characteristics (parallax and priority), achieves separate modulation and interference-free fusion display of 3D stereoscopic images and 2D auxiliary information on the physical optical path, thus achieving both an immersive 3D experience and clear, stable 2D information presentation on a single screen.

[0025] System architecture and scenario description used in the embodiments of this application Please refer to Figure 1 , Figure 1 This diagram illustrates a system architecture of an in-vehicle DLP display system according to an embodiment of this application. It is used to control an in-vehicle head-up display system to generate high-quality 3D / 2D images. The system mainly includes an information acquisition and processing module, a DMD drive control module, and an optical projection imaging module. The information acquisition and processing module collects raw data from in-vehicle sensors, navigation units, and the vehicle network, and generates left-eye and right-eye 3D parallax image data, as well as 2D auxiliary information data that has been classified and prioritized. The partition management unit within the DMD drive control module dynamically calculates the resource proportions of the left-eye, right-eye, and 2D information areas in the DMD chip micromirror array based on the 3D parallax and 2D information priorities, and performs logical partitioning. The parameter control unit independently calculates micromirror control parameters, including deflection angle, switching frequency, and reflection efficiency, for each partition and generates drive signals. The optical projection imaging module receives the partitioned image data and drive signals, precisely controls the deflection state of each partition micromirror on the DMD chip, and projects the modulated light through the projection lens onto the windshield or a dedicated combiner, ultimately merging them in the driver's field of vision to form an interference-free 3D / 2D superimposed image.

[0026] In addition, the system may also include circuits, interfaces and necessary software logic for connecting and driving the above-mentioned components, which are not limited in this application.

[0027] General Description of Embodiments in this Application Please refer to Figure 2 , Figure 2A flowchart illustrating a method for displaying vehicle assistance information provided in an embodiment of this application is shown. Figure 2 As shown, a method for displaying vehicle assistance information according to an embodiment of this application includes, but is not limited to, the following steps: Step 210: Collect left-eye frame data and right-eye frame data of 3D image, and collect 2D auxiliary information from the vehicle system of the target vehicle, and classify the 2D auxiliary information by priority. Step 220: Determine the disparity amount corresponding to the 3D image based on the left eye frame data and the right eye frame data; Step 230: Based on the parallax amount and the priority of the 2D auxiliary information, divide the DMD chip micromirror array of the target vehicle into a left eye frame display area, a right eye frame display area, and a 2D information display area; Step 240: Calculate the control parameters corresponding to the left eye frame display area, the right eye frame display area, and the 2D information display area; wherein, the control parameters include deflection angle, switching frequency, and reflection efficiency; Step 250: According to the control parameters, map the left eye frame data to the left eye frame display area, map the right eye frame data to the right eye frame display area, and map the 2D auxiliary information to the 2D information display area.

[0028] In this application embodiment, a method for displaying vehicle auxiliary information is provided. This method aims to improve the defects in related technologies where 3D stereoscopic images and 2D planar information are easily interfered with each other, screen flickering and resolution loss when fused on a single display interface. By dynamically partitioning and independently controlling the micromirror array of the DMD chip based on information characteristics, interference-free and high-quality co-screen display of the two types of information on the same optical path can be achieved.

[0029] Specifically, this method first acquires the left-eye and right-eye frame data required for generating 3D images, as well as 2D auxiliary information from the vehicle system, and prioritizes the 2D information according to its importance. Next, it calculates the disparity of the 3D image based on the left and right-eye frame data, and dynamically divides the micromirror array of the DMD chip logically into a left-eye frame display area, a right-eye frame display area, and a 2D information display area based on this disparity and the priority of the 2D information. Subsequently, it calculates independent control parameters for each display area, including micromirror deflection angle, switching frequency, and reflection efficiency. Based on these control parameters for each area, the left-eye frame data, right-eye frame data, and 2D auxiliary information are mapped and driven to their respective display areas. This method, through refined and differentiated control of the display core DMD micromirror array, achieves decoupling and spatial reuse of 3D content and 2D information in the physical optical path, thus ensuring both a deep immersive experience in 3D display and clear, stable, and prominent presentation of key 2D information, significantly improving the intuitiveness and safety of the human-machine interface in complex driving environments.

[0030] Below, in conjunction with Figure 2 The present application describes and explains each step of the method for displaying vehicle auxiliary information in the embodiments.

[0031] In step 210, information acquisition and processing are first performed. In this embodiment, the acquired data is mainly divided into two categories. The first category is 3D image data used to generate three-dimensional stereoscopic images, specifically including left-eye frame data generated for the left-eye view and right-eye frame data generated for the right-eye view. This data is usually provided by the vehicle's 3D modeling module or AR-HUD graphics engine. The second category is two-dimensional auxiliary information (i.e., 2D auxiliary information). This type of information is acquired in real time from various sensors, instrument units, and navigation systems of the vehicle through the vehicle's in-vehicle network, such as the controller area network. Its content may include various driving information important to the driver, such as vehicle speed, navigation guide arrows, collision warning icons, and lane departure warnings. After acquiring this 2D auxiliary information, it can be prioritized according to preset classification rules, such as the urgency of the information, the level of impact on driving safety, or user-defined preferences. This classification lays the foundation for the differentiated allocation of subsequent display resources.

[0032] In step 220, the system processes the left-eye and right-eye frame data obtained in step 210 to determine the disparity corresponding to the current 3D image. Here, disparity is a stereoscopic vision parameter that quantifies the pixel offset of the same spatial point in the horizontal position of the two images (left and right eyes). This offset directly determines the perceived depth and stereoscopic strength of the object by the observer. In this embodiment, through specific image processing algorithms, such as feature point matching and disparity map calculation, the system can extract the disparity representing scene depth information from two frames of images. This disparity is not only the core of generating stereoscopic vision but will also serve as an important basis for dynamically allocating display resources in subsequent steps, because a larger disparity usually means more display resources are needed to process and present more significant depth information.

[0033] In step 230, the micromirror array of the DMD chip is dynamically logically partitioned. Here, the DMD digital micromirror device is the core of DLP display technology, and its surface is composed of millions of independently controllable micromirrors. In this embodiment, based on the needs of the current display content, these micromirrors are logically divided into different groups. The specific partitioning scheme can be determined by the 3D parallax calculated in step 220 and the priority of the 2D auxiliary information determined in step 210.

[0034] Specifically, in this embodiment, the proportion of micromirror resources to be allocated to the left-eye and right-eye frame display areas can be dynamically calculated based on the magnitude of the parallax. The greater the parallax, the higher the proportion of micromirror resources allocated, ensuring sufficient presentation space and accuracy for the stereoscopic image. Simultaneously, the system dynamically allocates a dedicated 2D information display area based on the priority and data volume of the 2D auxiliary information. This area is used to centrally and clearly display this planar information, ensuring that high-priority information receives sufficient display space. Through this content-feature-based adaptive partitioning mechanism, the system reserves independent, adjustable-size optical modulation channels for both 3D stereoscopic images and 2D planar information at the hardware level.

[0035] In step 240, the corresponding micromirror control parameters are calculated for the three independent display zones defined in step 230: the left eye frame display zone, the right eye frame display zone, and the 2D information display zone.

[0036] In this embodiment, the control parameters are the main instructions driving the micromirrors, primarily including deflection angle, switching frequency, and reflection efficiency. The deflection angle determines the direction in which the micromirrors reflect light to the projection lens or light absorber, thus affecting pixel brightness. The switching frequency determines the speed at which the micromirrors switch between on and off states, affecting the image refresh rate and dynamic performance. Reflection efficiency is related to the reflectivity of the micromirrors, affecting the overall brightness of the area. In this embodiment, these three sets of parameters set for the three zones can be different. For example, to optimize the 3D stereoscopic effect, the micromirror deflection angles of the left and right eye display areas may be set with specific differences; to ensure the clarity and stability of 2D information, the micromirror switching frequency of its area may be set lower than that of the 3D area to avoid text flickering. This refined parameter control strategy, independently optimized for different information types, provides a precise control basis for the final high-quality fused display.

[0037] In step 250, the final mapping and display driving of the execution information is performed. Specifically, the system sends the left-eye frame image data to the micromirror control unit corresponding to the left-eye frame display area, sends the right-eye frame image data to the micromirror control unit corresponding to the right-eye frame display area, and sends the classified 2D auxiliary information to the micromirror control unit corresponding to the 2D information display area.

[0038] When driving these micromirrors, the independent control parameters calculated for each region in step 240 are strictly followed. This means that the micromirrors in different regions will operate according to their customized deflection angles, switching frequencies, and reflection efficiencies.

[0039] It is understood that, in this embodiment of the application, 3D stereoscopic images and 2D planar information are decoupled in the physical optical path. They are each independently modulated on the DMD chip by spatially isolated micromirror arrays, and then integrated and projected onto the same display plane through the same projection optics system. Thus, in the driver's field of vision, high-quality, deeply immersive 3D navigation or AR guidance can be seamlessly integrated with clear, prominent, and stable 2D driving information (such as vehicle speed and warnings), presented simultaneously without interference. This provides both intuitive stereoscopic environmental perception and ensures the safe acquisition of critical driving information.

[0040] Specifically, in some embodiments, the acquisition of 2D auxiliary information from the target vehicle's onboard system includes: Vehicle speed information and warning sign information, which characterize the real-time operating status of the vehicle, are obtained from the controller local area network bus interface of the target vehicle. Obtain navigation guidance information representing the driving route from the navigation module interconnected with the vehicle system; The 2D auxiliary information is obtained based on the vehicle speed information, the warning sign information, and the navigation guidance information.

[0041] In this embodiment of the application, the process of collecting 2D auxiliary information involves the targeted extraction and structured integration of heterogeneous vehicle network data to ensure the real-time nature, accuracy and completeness of the information.

[0042] Specifically, firstly, the system monitors and extracts data characterizing the core operating status of the vehicle in real time from the controller area network bus interface deployed inside the target vehicle. This data mainly includes frequently updated current vehicle speed information and various warning signs actively issued by the vehicle's electronic control unit, such as engine malfunction indicator lights, anti-lock braking system warnings, and airbag warnings. This information directly reflects the vehicle's instantaneous dynamics and safety status. Simultaneously, the method obtains data from the navigation module, which is deeply interconnected with the in-vehicle system, specifically navigation guidance information characterizing the planned driving route, such as forward turn prompts, lane guidance arrows, and points of interest markers. Furthermore, the system aggregates and unifies the format of vehicle speed information, warning sign information, and navigation guidance information from different sources, collectively forming the 2D auxiliary information dataset used for subsequent processing.

[0043] In this embodiment, by directly and in parallel acquiring information from the vehicle's core data highway and key functional modules, the 2D auxiliary information is ensured to have low latency and high reliability. This method of directly acquiring information from the controller area network bus and functional modules avoids data packet loss, parsing errors, or timeliness losses that may be introduced through intermediate layers, providing a high-quality data input foundation for subsequent priority classification and dynamic display decisions based on real-time vehicle and road conditions.

[0044] Specifically, in some embodiments, prioritizing the 2D auxiliary information includes: Detect the source type and content identifier of the 2D auxiliary information; According to the preset priority mapping rules, determine the initial priority corresponding to the source type; Based on the content identifier, determine the security correlation degree corresponding to the 2D auxiliary information; Based on the initial priority and the security correlation, the target priority of the 2D auxiliary information is determined through a preset comprehensive evaluation model.

[0045] In this embodiment, prioritizing 2D auxiliary information can be achieved through a quantitative decision-making process that comprehensively evaluates multiple factors, thereby improving the rationality of the classification and its adaptability to different scenarios.

[0046] Specifically, each piece of 2D auxiliary information is first analyzed for features, simultaneously detecting its source type and content identifier. The source type distinguishes the underlying system module from which the information originates, such as the powertrain, chassis, body, or infotainment system; the content identifier precisely identifies the specific semantics of the information, such as "vehicle speed: 80km / h," "forward collision warning," or "turn right 300 meters ahead." Then, based on a preset priority mapping rule, different source types are assigned an initial priority. For example, information from modules directly related to vehicle active safety may be preset to have a higher initial priority.

[0047] In this embodiment, a preset rule base is queried based on the content identifier to determine the security relevance corresponding to the information. This is a parameter used to quantify the immediate impact of the information on driving safety. Thus, the initial priority and security relevance can be used as inputs and calculated through a preset comprehensive evaluation model. This model can be a weighted summation, fuzzy logic, or other decision-making algorithm, and its output is the final target priority determined for the 2D auxiliary information.

[0048] In this embodiment of the application, by introducing a dual evaluation mechanism that combines information source (system importance) and information content (immediate security impact), and by using a comprehensive evaluation model for quantitative decision-making, the priority classification process becomes more refined and objective.

[0049] Specifically, in some embodiments, dividing the DMD chip micromirror array of the target vehicle into a left-eye frame display area, a right-eye frame display area, and a 2D information display area according to the parallax amount and the priority of the 2D auxiliary information includes: Based on the disparity amount and the preset disparity-resource relationship model, the total amount of micromirror resources required to render the 3D image is calculated; Based on the priority of the 2D auxiliary information, the minimum number of micromirror resources required to present the 2D auxiliary information is calculated using a priority weighting algorithm. Based on the total number of micromirror resources and the minimum number of micromirror resources, the proportion of micromirror numbers occupied by the left eye frame display area, the right eye frame display area, and the 2D information display area is determined. Based on the ratio of the number of micromirrors, consecutive micromirror blocks are allocated in the address space of the DMD chip micromirror array for the left eye frame display area, the right eye frame display area, and the 2D information display area, respectively.

[0050] In this embodiment of the application, when logically partitioning the DMD chip micromirror array, the optimal resource ratio of each functional area can be dynamically determined through a set of quantitative calculation models based on the inherent requirements of the current display content, thereby achieving refined and adaptive configuration of display resources.

[0051] Specifically, the method inputs the 3D disparity calculated in step 220 into a preset disparity-resource relationship model. This model defines the functional relationship between the disparity magnitude and the number of micromirrors required to clearly and accurately present the 3D stereoscopic effect. The larger the disparity, the richer the scene depth information or the stronger the stereoscopic effect. The model will calculate a larger total amount of micromirror resources to ensure that the 3D image has sufficient spatial resolution to represent its depth details.

[0052] Meanwhile, based on the 2D auxiliary information that has been prioritized, a priority-weighted algorithm is used to calculate the minimum micromirror resource base required to present this information. This algorithm assigns different weights to information of different priorities, with higher priority information receiving higher resource weights due to its importance. After summarizing the weighted requirements of all information, the system arrives at a minimum micromirror resource base necessary to ensure that all 2D information, especially high-priority information, is displayed clearly and completely.

[0053] Subsequently, based on the calculated total number of micromirror resources and the minimum base number of micromirror resources, and combined with the total number of micromirrors in the DMD chip, the system uses a resource allocation algorithm to determine the proportion of micromirrors that should be occupied by the left-eye frame display area, the right-eye frame display area, and the 2D information display area. According to this proportion, the system allocates contiguous micromirror blocks for these three functional display areas in the physical address space of the DMD chip, completing the logical partitioning mapping.

[0054] In this embodiment, by introducing a parallax-resource relationship model and a priority weighting algorithm, the basis for partitioning is transformed from empirical setting to quantitative calculation based on content characteristics. This ensures that the allocation of display resources is closely related to the complexity of the current 3D content (parallax) and the importance of 2D information (priority), thereby optimizing resource allocation.

[0055] Specifically, in some embodiments, calculating the control parameters corresponding to the left-eye frame display area, the right-eye frame display area, and the 2D information display area includes: Obtain the ambient light intensity and road condition type of the current driving scenario; Based on the parallax, determine the deflection angle of the micromirrors in the left eye frame display area and the right eye frame display area; Based on the road condition type, determine the switching frequency of the micromirrors between the left eye frame display area and the right eye frame display area; The brightness gain coefficient of the micromirrors in the 2D information display area is determined based on the priority of the 2D auxiliary information. The reflection efficiency of the micromirrors in the left eye frame display area, the right eye frame display area, and the 2D information display area is determined based on the ambient light intensity.

[0056] In this embodiment of the application, the process of calculating control parameters for different functional display areas aims to set optimal working parameters for 3D stereoscopic display and 2D information presentation respectively, so as to achieve the overall optimal fusion effect.

[0057] Specifically, the system first acquires real-time information about the current driving environment, primarily including ambient light intensity and road condition type. Ambient light intensity is measured by an onboard light sensor, while road condition type can be provided by the vehicle's sensor fusion module or navigation system. The system then enters a targeted parameter calculation phase: for the left and right eye frame display areas, the deflection angle of the micromirrors is calculated based on the disparity determined in step 220. The system dynamically adjusts the micromirror deflection angle settings for the left and right eye regions according to the magnitude of the disparity to achieve the best optical modulation effect that matches the depth of the current stereoscopic scene.

[0058] Meanwhile, the micromirror switching frequency between these two 3D areas will be determined based on road conditions. For example, in dynamic road conditions such as highways or curves, the system will increase the switching frequency to ensure smooth and stable 3D motion images; in static road conditions such as congestion or parking, the frequency can be appropriately reduced to optimize system energy efficiency. For the 2D information display area, the core control lies in brightness adjustment. The system will determine a brightness gain coefficient based on the priority of 2D auxiliary information, assigning a higher gain coefficient to higher priority information to make it more visually prominent. In addition, the micromirror reflection efficiency parameters of all display areas will be uniformly determined based on the ambient light intensity. In strong light environments, the system will set a higher reflection efficiency to improve the overall screen brightness and ensure visibility; in low light environments, the reflection efficiency can be reduced to avoid excessive brightness and glare.

[0059] In this embodiment, by binding the setting of control parameters with specific environmental information, content features (parallax, priority), and road condition depth, the parameter strategy is contextualized and refined. This not only ensures that the 3D display can dynamically adjust its core stereoscopic and smoothness parameters according to the scene, but also enables 2D information to achieve adaptive brightness and contrast optimization based on its importance and ambient lighting. This differentiated collaborative control strategy achieves a good balance between 3D immersion, 2D information clarity, and overall image visibility in different environments, ultimately providing users with a clear, comfortable, and hierarchically structured integrated visual experience under various complex driving conditions.

[0060] Specifically, in some embodiments, the method further includes: Identify the boundary positions of the left eye frame display area, the right eye frame display area, and the 2D information display area on the DMD chip micromirror array; At the boundary location, a transition region composed of adjacent micromirrors is generated; Within the transition region, the deflection angle of the micromirror is controlled to gradually transition from a set angle value in the first display area to a set angle value in the adjacent second display area in a direction away from the boundary; wherein, the first display area and the second display area are any one of the left eye frame display area, the right eye frame display area and the 2D information display area.

[0061] In this embodiment of the application, an active optical boundary smoothing mechanism is proposed to address the screen fragmentation problem that may be caused by partitioned display. The mechanism aims to eliminate the visual jump between different functional display areas from the hardware modulation level and achieve seamless connection of the merged screen.

[0062] Specifically, after completing the logical partitioning of the micromirror array in the DMD chip, the system further identifies and locates the physical address boundaries between the left-eye frame display area, the right-eye frame display area, and the 2D information display area. These boundaries are typically formed by the adjacent micromirror blocks of different functional areas. Subsequently, at each identified boundary location, the system generates a transition region consisting of several rows of adjacent micromirrors on both sides of the boundary. The width of this transition region can be configured according to a preset strategy, for example, fixed at the width of 5 micromirrors.

[0063] In this embodiment, the system precisely controls the deflection angle of each micromirror within the transition area, ensuring that its value follows a direction perpendicular to and away from the boundary. Starting from a set angle value in one display area (e.g., a 2D information display area), the transition gradually and continuously shifts to a set angle value in an adjacent display area (e.g., a left-eye frame display area). This transition can follow preset transition algorithms such as linear gradation or non-linear smoothing functions. Here, the two display areas undergoing the transition, namely the first display area and the second display area, can be any two adjacent areas among the three functional display areas mentioned above.

[0064] It is understood that, in the embodiments of this application, by setting an optical transition region directly modulated by hardware, a smooth and gradual change in light intensity modulation characteristics between different display areas is achieved, rather than producing abrupt, step-like changes at the boundaries.

[0065] Specifically, in some embodiments, the method further includes: Collect visual feedback data on the current merged display screen; Based on the visual feedback data, the control parameters of the left eye frame display area, the right eye frame display area, and the 2D information display area are corrected through a progressive iterative algorithm.

[0066] In this embodiment of the application, a feedback-based closed-loop optimization mechanism is provided, which enables the display system to adaptively adjust its operating parameters in order to continuously approach and maintain the optimal display state under specific user or environmental conditions.

[0067] Specifically, while the system is running and generating the merged display, visual feedback data for the current image is collected via a specific device. This feedback data can come from various sensing methods, such as capturing the driver's gaze behavior (e.g., focus and duration of gaze) on the display area using an integrated camera, measuring the local brightness and contrast of the actual projection surface using a built-in light sensor, or even obtaining a subjective comfort score through a simplified user interface. This feedback data constitutes a direct or indirect quantitative evaluation of the current display effect. The system compares this visual feedback data with a preset ideal display effect target value and calculates the deviation between the current effect and the target. Based on this deviation, the system uses a progressive iterative algorithm to make small, targeted corrections to the control parameters (such as deflection angle, switching frequency, and reflection efficiency) allocated to the left-eye frame display area, right-eye frame display area, and 2D information display area. This algorithm ensures that the adjustment step of each parameter is small and controlled, for example, adjusting only by a fixed small percentage or a small increment each time, to prevent drastic and uncomfortable abrupt changes in the image.

[0068] In this embodiment, by introducing a closed-loop process, the system is upgraded from an open-loop, preset-parameter-driven operating mode to an intelligent mode with online self-learning and adaptive capabilities. It does not rely on unchanging preset parameters but can automatically and smoothly optimize itself based on actual display output effects and real-time user (or environmental) feedback. This effectively compensates for uncertainties caused by individual hardware differences, long-term environmental changes, and varying user preferences, enabling the system to dynamically adapt to various non-ideal operating conditions.

[0069] Reference Figure 3 In this embodiment of the application, a vehicle assistance information display device is also provided, which includes: The acquisition unit 310 is used to acquire left-eye frame data and right-eye frame data of 3D images, as well as acquire 2D auxiliary information from the vehicle's in-vehicle system, and classify the 2D auxiliary information by priority. Processing unit 320 is used to determine the disparity amount corresponding to the 3D image based on the left eye frame data and the right eye frame data; The partitioning unit 330 is used to divide the DMD chip micromirror array of the target vehicle into a left eye frame display area, a right eye frame display area, and a 2D information display area according to the parallax amount and the priority of the 2D auxiliary information. The calculation unit 340 is used to calculate the control parameters corresponding to the left eye frame display area, the right eye frame display area, and the 2D information display area; wherein, the control parameters include deflection angle, switching frequency, and reflection efficiency. The execution unit 350 is configured to map the left-eye frame data to the left-eye frame display area, the right-eye frame data to the right-eye frame display area, and the 2D auxiliary information to the 2D information display area according to the control parameters.

[0070] It is understandable that, such as Figure 2 The content of the vehicle assistance information display method embodiment shown is applicable to the vehicle assistance information display device embodiment. The specific functions implemented by the vehicle assistance information display device embodiment are the same as those shown. Figure 2 The method for displaying vehicle assistance information shown is the same as in the embodiment described above, and the beneficial effects achieved are the same as those described above. Figure 2 The beneficial effects achieved by the embodiment of the vehicle assistance information display method shown are also the same.

[0071] Reference Figure 4 This application also discloses an electronic device, including: At least one processor 410; At least one memory 420 is used to store at least one program; When at least one program is executed by at least one processor 410, such that at least one processor 410 performs as follows: Figure 2 The illustrated embodiment of the method for displaying vehicle auxiliary information.

[0072] The electronic device in the embodiments of this application may be a terminal device, a computer device, or a server device.

[0073] Understandable, Figure 2 The content of the vehicle assistance information display method embodiment shown is applicable to the embodiment of this electronic device, and the specific functions implemented by the embodiment of this electronic device are the same as those shown in the previous embodiment. Figure 2 The method for displaying vehicle assistance information shown is the same as the embodiment, and the beneficial effects achieved are the same. Figure 2 The beneficial effects achieved by the embodiment of the vehicle assistance information display method shown are also the same.

[0074] This application also discloses a computer-readable storage medium storing a processor-executable program, which, when executed by a processor, is used to implement, for example... Figure 2 The illustrated embodiment of the method for displaying vehicle auxiliary information.

[0075] Understandable, Figure 2The content of the vehicle auxiliary information display method embodiments shown herein is applicable to the embodiments of this computer-readable storage medium, and the specific functions implemented by the embodiments of this computer-readable storage medium are the same as those in the embodiments of this computer-readable storage medium. Figure 2 The method for displaying vehicle assistance information shown is the same as the embodiment, and the beneficial effects achieved are the same. Figure 2 The beneficial effects achieved by the embodiment of the vehicle assistance information display method shown are also the same.

[0076] This application also discloses a computer program product or computer program, which includes computer instructions stored in the aforementioned computer-readable storage medium. Figure 4 The processor of the illustrated electronic device can read the computer instructions from the aforementioned computer-readable storage medium, and the processor executes the computer instructions, causing the computer device to perform... Figure 2 The illustrated embodiment of the method for displaying vehicle auxiliary information.

[0077] Understandable, Figure 2 The content of the vehicle assistance information display method embodiments shown herein is applicable to this computer program product or computer program embodiment, and the specific functions implemented by this computer program product or computer program embodiment are the same as those described above. Figure 2 The method for displaying vehicle assistance information shown is the same as the embodiment, and the beneficial effects achieved are the same. Figure 2 The beneficial effects achieved by the embodiment of the vehicle assistance information display method shown are also the same.

[0078] In some alternative embodiments, the functions / operations mentioned in the block diagrams may not occur in the order shown in the operation diagrams. For example, depending on the functions / operations involved, two consecutively shown blocks may actually be executed substantially simultaneously, or the blocks may sometimes be executed in reverse order. Furthermore, the embodiments presented and described in the flowcharts of this application are provided by way of example to provide a more comprehensive understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed and sub-operations described as part of a larger operation are executed independently.

[0079] Furthermore, although this application is described in the context of functional modules, it should be understood that, unless otherwise stated to the contrary, one or more of the functions and / or features may be integrated into a single physical device and / or software module, or one or more functions and / or features may be implemented in a separate physical device or software module. It is also understood that a detailed discussion of the actual implementation of each module is unnecessary for understanding this application. Rather, given the properties, functions, and internal relationships of the various functional modules in the apparatus disclosed herein, the actual implementation of the module will be understood within the scope of conventional technology for an engineer. Therefore, those skilled in the art can implement the application set forth in the claims using ordinary techniques without excessive experimentation. It is also understood that the specific concepts disclosed are merely illustrative and not intended to limit the scope of this application, which is determined by the full scope of the appended claims and their equivalents.

[0080] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0081] In the embodiments of this application, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0082] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable storage medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable storage medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0083] It should be understood that various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0084] In the foregoing description of this specification, the references to terms such as "one embodiment," "another embodiment," or "some embodiments," etc., indicate that a specific feature, structure, material, or characteristic described in connection with an embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0085] Although embodiments of this application have been shown and described, those skilled in the art will understand that various changes, modifications, substitutions and variations can be made to these embodiments without departing from the principles and spirit of this application, the scope of which is defined by the claims and their equivalents.

[0086] The above is a detailed description of the preferred embodiments of this application, but this application is not limited to the embodiments. Those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of this application, and these equivalent modifications or substitutions are all included within the scope defined by the claims of this application.

Claims

1. A method for displaying vehicle auxiliary information, characterized in that, The method includes: Acquire left-eye and right-eye frame data of 3D images, as well as 2D auxiliary information from the vehicle's in-vehicle system, and prioritize the 2D auxiliary information. Based on the left-eye frame data and the right-eye frame data, determine the disparity corresponding to the 3D image; Based on the parallax and the priority of the 2D auxiliary information, the DMD chip micromirror array of the target vehicle is divided into a left eye frame display area, a right eye frame display area, and a 2D information display area. Calculate the control parameters corresponding to the left eye frame display area, the right eye frame display area, and the 2D information display area; wherein, the control parameters include deflection angle, switching frequency, and reflection efficiency; According to the control parameters, the left eye frame data is mapped to the left eye frame display area, the right eye frame data is mapped to the right eye frame display area, and the 2D auxiliary information is mapped to the 2D information display area.

2. The method for displaying vehicle auxiliary information according to claim 1, characterized in that, The acquisition of 2D auxiliary information from the target vehicle's onboard system includes: Vehicle speed information and warning sign information, which characterize the real-time operating status of the vehicle, are obtained from the controller local area network bus interface of the target vehicle. Obtain navigation guidance information representing the driving route from the navigation module interconnected with the vehicle system; The 2D auxiliary information is obtained based on the vehicle speed information, the warning sign information, and the navigation guidance information.

3. The method for displaying vehicle auxiliary information according to claim 1, characterized in that, The priority classification of the 2D auxiliary information includes: Detect the source type and content identifier of the 2D auxiliary information; According to the preset priority mapping rules, determine the initial priority corresponding to the source type; Based on the content identifier, determine the security correlation degree corresponding to the 2D auxiliary information; Based on the initial priority and the security correlation, the target priority of the 2D auxiliary information is determined through a preset comprehensive evaluation model.

4. The method for displaying vehicle auxiliary information according to any one of claims 1-3, characterized in that, The step of dividing the DMD chip micromirror array of the target vehicle into a left-eye frame display area, a right-eye frame display area, and a 2D information display area based on the parallax value and the priority of the 2D auxiliary information includes: Based on the disparity amount and the preset disparity-resource relationship model, the total amount of micromirror resources required to render the 3D image is calculated; Based on the priority of the 2D auxiliary information, the minimum number of micromirror resources required to present the 2D auxiliary information is calculated using a priority weighting algorithm. Based on the total number of micromirror resources and the minimum number of micromirror resources, the proportion of micromirror numbers occupied by the left eye frame display area, the right eye frame display area, and the 2D information display area is determined. Based on the ratio of the number of micromirrors, consecutive micromirror blocks are allocated in the address space of the DMD chip micromirror array for the left eye frame display area, the right eye frame display area, and the 2D information display area, respectively.

5. The method for displaying vehicle auxiliary information according to claim 1, characterized in that, The calculation of control parameters corresponding to the left eye frame display area, the right eye frame display area, and the 2D information display area includes: Obtain the ambient light intensity and road condition type of the current driving scenario; Based on the parallax, determine the deflection angle of the micromirrors in the left eye frame display area and the right eye frame display area; Based on the road condition type, determine the switching frequency of the micromirrors between the left eye frame display area and the right eye frame display area; The brightness gain coefficient of the micromirrors in the 2D information display area is determined based on the priority of the 2D auxiliary information. The reflection efficiency of the micromirrors in the left eye frame display area, the right eye frame display area, and the 2D information display area is determined based on the ambient light intensity.

6. The method for displaying vehicle auxiliary information according to claim 1, characterized in that, The method further includes: Identify the boundary positions of the left eye frame display area, the right eye frame display area, and the 2D information display area on the DMD chip micromirror array; At the boundary location, a transition region composed of adjacent micromirrors is generated; Within the transition region, the deflection angle of the micromirror is controlled to gradually transition from a set angle value in the first display area to a set angle value in the adjacent second display area in a direction away from the boundary; wherein, the first display area and the second display area are any one of the left eye frame display area, the right eye frame display area and the 2D information display area.

7. The method for displaying vehicle auxiliary information according to claim 6, characterized in that, The method further includes: Collect visual feedback data on the current merged display screen; Based on the visual feedback data, the control parameters of the left eye frame display area, the right eye frame display area, and the 2D information display area are corrected through a progressive iterative algorithm.

8. A display device for vehicle auxiliary information, characterized in that, The device includes: The acquisition unit is used to acquire left-eye frame data and right-eye frame data of 3D images, as well as acquire 2D auxiliary information from the vehicle's in-vehicle system, and classify the 2D auxiliary information by priority. The processing unit is configured to determine the disparity amount corresponding to the 3D image based on the left-eye frame data and the right-eye frame data. The partitioning unit is used to divide the DMD chip micromirror array of the target vehicle into a left eye frame display area, a right eye frame display area, and a 2D information display area according to the parallax amount and the priority of the 2D auxiliary information. The calculation unit is used to calculate the control parameters corresponding to the left eye frame display area, the right eye frame display area, and the 2D information display area; wherein, the control parameters include deflection angle, switching frequency, and reflection efficiency; An execution unit is configured to map the left-eye frame data to the left-eye frame display area, the right-eye frame data to the right-eye frame display area, and the 2D auxiliary information to the 2D information display area according to the control parameters.

9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the method for displaying vehicle auxiliary information as described in any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the method for displaying vehicle auxiliary information as described in any one of claims 1 to 7.

Images