A display control method and device of in-vehicle intelligent glass and medium

Abstract

The application discloses a display control method and device of vehicle-mounted intelligent glass, and a medium. The method comprises the following steps: mapping an outdoor image to an intelligent glass display coordinate system, and dividing a display area into a plurality of local areas; extracting background texture density, background main direction, background motion direction and brightness change trend for each local area, and combining a skeleton main direction, a content line width, an element category, a priority label and a position constraint label of to-be-displayed content to generate a competition score; performing content layering based on the element category, and combining the competition score to perform detail layer compression, anchor point layer migration or anchor point layer in-place enhancement; generating a local visual contrast budget according to the competition score and the priority label, and distributing the budget between a pixel display channel and a glass dimming channel to generate a display control instruction and a dimming control instruction. The application can improve the recognizability and display control stability of key display content under complex outdoor conditions.

Description

Technical Field

[0001] This application relates to the field of display control technology for automotive smart glass, and more specifically, to a display control method, device, and medium for automotive smart glass. Background Technology

[0002] As in-vehicle display systems evolve towards transparent and integrated designs, intelligent automotive glass with display and dimming capabilities is increasingly being applied to windshields, side windows, and sunroofs to display navigation prompts, safety warnings, and interactive guidance. Existing technologies primarily focus on overlaying text and graphics onto the glass area, or improving visibility by increasing brightness, thickening outlines, or darkening the glass overall.

[0003] However, during vehicle operation, the smart glass exhibits significant dynamic changes in the surrounding environment. Local areas may simultaneously experience dense textures, similar orientations, moving objects, and rapid changes in brightness, resulting in varying degrees of background interference affecting the displayed content at different locations. For fine lines or outlines such as text, icons, and arrows, if their shape and orientation are similar to the background structure, or if they are in reflective, shadowy, or tunnel-entry / exit scenarios, issues such as decreased recognizability, blurred boundaries, and momentary submersion may occur.

[0004] Existing solutions typically employ a uniform enhancement or fixed layout display method across the entire screen, lacking the ability to differentiate based on local background competition and struggling to coordinate control between the display channel and the glass dimming channel. Therefore, under complex outdoor conditions, the stable visibility of key display content remains insufficient, and issues such as adjustment lag, frequent fluctuations, or over-enhancing of non-critical content are prone to occur, impacting the presentation of driving information and the user experience. Summary of the Invention

[0005] This application provides a display control method, device, and medium for automotive smart glass, which at least solves some of the technical problems existing in the related technologies described above.

[0006] According to a first aspect of the embodiments of this application, a display control method for automotive smart glass is provided, comprising: Obtain a structured description of the content to be displayed and an exterior image; map the exterior image onto the smart glass display coordinate system, and divide the display area into multiple local areas; For each local area, background information and brightness change trends are extracted based on the mapped exterior image. The main direction of the content skeleton, content line width, element category, priority label, and position constraint label are extracted based on the structured description. A competitive score is generated based on the background information, the brightness change trend, and the main direction and content line width of the content skeleton. The background information includes background texture density, background main direction, and background motion direction. Based on the element category, the content to be displayed is divided into an anchor layer and a detail layer, and detail layer compression and / or anchor layer migration and / or anchor layer in-situ enhancement are performed based on the competition score and the position constraint label. A local visual contrast budget is generated based on the competition score and the priority label. Each local area is divided into rapid short-term changes, rapid continuous changes, or slow changes based on the brightness change trend. The local visual contrast budget is then allocated to the pixel display channel and the glass dimming channel. Based on the allocation results, display control commands and dimming control commands are generated, and the enhancement state of the corresponding local area is revoked after the competition score falls back to the exit threshold corresponding to the current enhancement state.

[0007] As an optional approach, the extraction of background information and brightness change trends, and the generation of competitive scores, includes: extracting edge responses from the mapped exterior images of each local region to obtain background texture density and background main direction; performing local optical flow estimation on the mapped exterior images at adjacent time points to obtain the background motion direction; performing trend estimation on the average brightness of each local region to obtain the brightness change trend; extracting the main direction of the content skeleton and the content line width corresponding to each local region from the structured description; and calculating the competitive score for each local region based on the background texture density, background main direction, background motion direction, brightness change trend, main direction of the content skeleton, and content line width.

[0008] As an optional approach, the division of the content to be displayed into an anchor layer and a detail layer based on the element category includes: dividing security warning elements, main navigation information elements, and key interactive elements into an anchor layer, and dividing auxiliary explanatory elements, secondary label elements, and decorative elements into a detail layer; the compression of the detail layer includes hiding at least some elements in the detail layer or reducing the display intensity of at least some elements in the detail layer.

[0009] As an optional approach, the step of performing detail layer compression, anchor layer migration, or in-situ anchor layer enhancement based on the competition score and the position constraint label includes: performing detail layer compression and in-situ anchor layer enhancement when the competition score is between a first threshold and a second threshold; performing anchor layer migration when the competition score is not less than the second threshold and the position constraint label indicates that the corresponding anchor layer is allowed to migrate; and performing in-situ anchor layer enhancement when the competition score is not less than the second threshold and the position constraint label indicates that the corresponding anchor layer is prohibited from migrating; wherein, the first threshold is less than the second threshold.

[0010] As an optional approach, the anchor layer migration includes: generating multiple candidate locations around the current location of the target anchor layer; for each candidate location, obtaining the competition score corresponding to the candidate location and the displacement distance between the candidate location and the current location, and calculating the candidate cost based on the competition score and the displacement distance; selecting the candidate location with the minimum candidate cost from the multiple candidate locations as the target location; and moving the target anchor layer from the current location to the target location.

[0011] As an optional solution, the in-situ enhancement of the anchor layer includes: adjusting the outline line width of the target anchor layer that is smaller than the preset minimum line width to not less than the preset minimum line width; converting the hollow outline into a solid shape; generating a local carrier layer corresponding to the outer envelope of the target anchor layer behind the target anchor layer, and using the local carrier layer as the execution object for subsequent local visual contrast budget allocation to the pixel display channel.

[0012] As an optional approach, the step of generating a local visual contrast budget based on the competition score and the priority label, and dividing each local area into rapid short-term change, rapid continuous change, or slow change based on the brightness change trend, includes: calculating the local visual contrast budget of each local area based on the competition score of each local area and the priority label of the corresponding displayed content; and dividing each local area into rapid short-term change, rapid continuous change, or slow change according to mutual exclusion conditions based on the brightness change rate, net brightness change amount, and brightness change direction consistency of each local area.

[0013] As an optional approach, allocating the local visual contrast budget to the pixel display channel and the glass dimming channel includes: under rapid and short-lived changes, allocating the entire local visual contrast budget for the corresponding local area to the pixel display channel; under rapid and continuous changes, first allocating the entire local visual contrast budget for the corresponding local area to the pixel display channel, and then, based on the current status of the glass dimming channel, transferring a portion of the local visual contrast budget to the glass dimming channel; under slow changes, allocating the main portion of the local visual contrast budget for the corresponding local area to the glass dimming channel, and allocating the remaining portion to the pixel display channel.

[0014] According to a second aspect of the embodiments of this application, an electronic device is provided, including: a processor; a memory for storing a computer program executable by the processor; wherein the processor is configured to execute the computer program in the memory to implement the method described in the first aspect.

[0015] According to a third aspect of the embodiments of this application, a computer-readable storage medium is provided, which, when an executable computer program in the storage medium is executed by a processor, enables the implementation of the method described in the first aspect.

[0016] This application maps outdoor images to the smart glass display coordinate system and combines information such as background texture density, background main direction, background movement direction, brightness change trend, and the skeleton main direction, line width, element category, priority, and position constraints of the displayed content to establish a competitive evaluation mechanism for each local area. This enables more accurate identification of the degree of interference between the displayed content and the transparent background. For different competitive states, detail layer compression, anchor point layer migration, or in-situ anchor point layer enhancement are performed respectively. Based on the type of brightness change, local visual contrast compensation is collaboratively allocated between the pixel display channel and the glass dimming channel, so that key content still maintains good recognizability in scenes with complex textures, dynamic motion, and sudden changes in brightness. At the same time, by setting entry and exit thresholds and combining them with an enhancement state cancellation mechanism, the display jitter and dimming fluctuations caused by frequent control switching can be reduced, improving the stability, adaptability, and overall visual consistency of display control.

[0017] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Furthermore, no embodiment in this disclosure is required to achieve all the effects described above. Attached Figure Description

[0018] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0019] Figure 1This is a schematic diagram of a display control method for in-vehicle smart glass provided in an embodiment of this disclosure.

[0020] Figure 2 This is a schematic diagram of the competition score generation process provided in an embodiment of the present disclosure.

[0021] Figure 3 This is a schematic diagram illustrating the process of generating and allocating a local visual contrast budget as provided in an embodiment of this disclosure.

[0022] Figure 4 This is a schematic diagram of the structure of a display control system for an in-vehicle smart glass provided in an embodiment of this disclosure.

[0023] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0024] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0025] This embodiment is applicable to vehicles equipped with automotive smart glass. The automotive smart glass has pixel-based light-emitting display capabilities and zone-controlled glass dimming capabilities, with the transmittance or fogging degree of each dimming zone adjustable independently. The system acquires exterior images from existing in-vehicle image acquisition channels, obtains a structured description of the content to be displayed from the interface synthesis end, and acquires vehicle speed, attitude changes, and scene recognition-related status information from the vehicle control network. The method can run on an in-vehicle computing platform or a domain controller.

[0026] In some embodiments, the system executes this method at time steps corresponding to the display refresh cycle. Within each time step, the system first completes the external image mapping and local area state update, then completes the competition score generation, followed by content layering and local spatial processing, and allocates local visual contrast budgets based on these, finally outputting display control instructions and dimming control instructions. If the competition score of a certain local area has fallen below the exit threshold in the current cycle, then that local area enters the enhancement state cancellation process.

[0027] The implementation process of the method described in this application will be described in detail below with reference to specific embodiments. It should be noted that this embodiment is only used to explain this application and is not intended to limit the scope of protection of this application. Conventional adjustments or substitutions of each step by those skilled in the art without departing from the concept of this application should be included in the scope of protection of this application.

[0028] Please see Figure 1 , Figure 1 This is a flowchart of a display control method for in-vehicle smart glass according to an embodiment of the present invention, such as... Figure 1 As shown, the method includes steps S1-S5: In step S1, a structured description of the content to be displayed and an exterior image are obtained; the exterior image is mapped to the smart glass display coordinate system, and the display area is divided into multiple local areas.

[0029] In some embodiments, the content to be displayed is input in the form of a structured description. This structured description includes at least the geometric position, outline shape, element category, priority label, position constraint label, and refresh timeliness requirements of the content elements. The geometric position is used to determine which local areas the content element covers; the outline shape is used to extract the main direction of the content skeleton and the content line width; the element category is used to classify the content element into the anchor layer or the detail layer; the priority label is used to generate a local visual contrast budget; and the position constraint label is used to determine whether to use anchor layer migration or in-situ anchor layer enhancement in highly competitive areas.

[0030] The exterior image is provided by an image acquisition channel that is aligned with or approximately aligned with the orientation of the target vehicle-mounted smart glass. If an image acquisition channel is found that is strictly aligned with the target vehicle-mounted smart glass, the exterior image output from that channel is directly selected. If no such channel exists, the image acquisition channel with the closest orientation is selected, and orientation compensation is performed on the exterior image based on the conversion relationship between the channel and the installation orientation of the target vehicle-mounted smart glass. The purpose of orientation compensation is to ensure that subsequent calculations of background texture density, background main direction, background movement direction, and brightness variation trends all fall within the display range of the target vehicle-mounted smart glass. The orientation compensation relationship used here can be obtained from factory calibration or written into the vehicle parameter table during final assembly calibration and directly called during runtime, without being arbitrarily changed during driving.

[0031] After acquiring the exterior image, the system first maps the exterior image to the display coordinate system of the vehicle-mounted smart glass. Specifically, the system performs perspective transformation and region cropping based on the installation position of the target vehicle-mounted smart glass in the vehicle coordinate system, the intrinsic and extrinsic parameters of the image acquisition channel, and the current vehicle posture. Perspective transformation is used to establish the correspondence between the image plane and the display plane, and region cropping is used to retain the image portion corresponding to the actual displayable area of ​​the target vehicle-mounted smart glass. If the current vehicle has significant pitch or yaw changes, the system first corrects the projection matrix according to the current posture information before perspective transformation. This avoids systematic offset of the mapped boundary, which could affect the subsequent competitive evaluation of local areas.

[0032] After mapping is complete, the system divides the display area into multiple local regions according to a preset grid. The size of the local regions needs to balance both display granularity and dimming granularity. Avoid overly large sizes, as background texture density and brightness variation trends will be excessively averaged within the local region, leading to blurred boundaries in highly competitive areas; conversely, sizes cannot be too small, as state fluctuations will become faster, and a stable correspondence with the glass dimming zones will be difficult to establish.

[0033] In some embodiments, the width and height of a local area are jointly determined by the display resolution of the automotive smart glass, the height of commonly used text, and the projection size of a single glass dimming zone. After the local area is divided, the system maintains background state variables, content state variables, and control state variables for each local area. The background state variables include background texture density, background main direction, background motion direction, and brightness change trend. The content state variables include the main direction of the content skeleton, content line width, element category, priority label, and position constraint label. The control state variables include competition score, local visual contrast budget, pixel display channel load, glass dimming channel load, and whether it is in a frozen state.

[0034] In step S2, for each local region, background information and brightness change trends are extracted based on the mapped exterior image. The main direction of the content skeleton, content line width, element category, priority label, and position constraint label are extracted based on the structured description. A competitive score is generated based on the background information, the brightness change trend, and the main direction and content line width of the content skeleton. The background information includes background texture density, background main direction, and background motion direction.

[0035] Please see Figure 2 , Figure 2 A schematic diagram of the competition score generation process provided in an embodiment of this disclosure is shown. For example... Figure 2 As shown, in step S201, for each local area, background information and brightness change trends are extracted based on the mapped exterior image.

[0036] For a new processing cycle, the system first updates the background state variables of each local region. The background texture density and principal orientation are obtained from the currently mapped exterior image. Specifically, the system performs Sobel operator processing on the image patch corresponding to each local region to calculate the horizontal gradient. and vertical gradient Based on this, the background edge intensity is calculated. and background main direction :

[0037] in, and Gray-level gradient response from the same image patch; Used to characterize edge strength Used to characterize the dominant direction of edges. The percentage of pixels with edge intensity exceeding a preset edge threshold within a local area is statistically analyzed, and this percentage is recorded as the background texture density. The preset edge threshold can be obtained through offline sample calibration, using typical background samples such as guardrails, tree shadows, building lines, and the sky as the calibration objects. This ensures that the background texture density can distinguish between smooth and complex backgrounds without being overly sensitive to image noise.

[0038] The background motion direction is obtained from the mapped exterior images of two or more consecutive frames. The system performs Lucas-Kennard optical flow calculations on feature points within the same local region to obtain the displacement vectors of each feature point. Then, outlier removal and averaging are performed on the displacement vectors to generate the background motion vector for that local region. The direction of the background motion vector is defined as the background motion direction, and the displacement magnitude is normalized to obtain the background motion amount. Outlier removal uses a median deviation filtering method, that is, first calculating the median of the displacement vector set, then removing displacement vectors whose deviation from the median exceeds a preset deviation limit, and retaining the remaining displacement vectors for averaging. After this processing, water droplet reflections, occasional occlusions, or local noise will not significantly change the background motion direction.

[0039] The brightness variation trend is obtained from the brightness mean sequence of each local region. In each processing cycle, the system calculates the current brightness mean of the local region and sends it to the trend estimation unit. The trend estimation unit can use an alpha-beta filter or a first-order Kalman filter. In one implementation, the system uses an alpha-beta filter to update the brightness mean, generating the current brightness estimate and the brightness change rate.

[0040] The rate of change of brightness indicates how quickly the current brightness changes over time; the net change of brightness represents the absolute value of the difference between the current estimated brightness and the initial estimated brightness of the window; and the consistency of the direction of brightness change indicates the proportion of samples within the window whose direction of brightness change remains consistent. The rate of change of brightness, the net change of brightness, and the consistency of the direction of brightness change are introduced here because the current brightness level alone cannot distinguish between three situations: continuous brightening, continuous dimming, and high-frequency fluctuations. The subsequent allocation of the local visual contrast budget relies on a combination of these three factors.

[0041] In step S202, the main direction of the content skeleton, content line width, element category, priority label, and position constraint label are extracted based on the structured description. For each content element, the system extracts its geometric contour and then performs skeleton extraction. Skeleton extraction can employ a morphological thinning algorithm or directly use the vector contour centerline output from the interface compositing end. The system determines the main direction of the content skeleton from the skeleton result and determines the content line width from the narrowest point of the contour or the thinnest point of the stroke. For text elements, the main direction of the content skeleton is determined by the direction of the main stroke arrangement and the overall text direction; for arrow elements, the main direction of the content skeleton is determined by the direction of the arrow's main axis; for icon elements, the main direction of the content skeleton is determined by the main direction of the largest continuous contour. The content line width is in pixels, directly corresponding to the display resolution. The priority label and position constraint label directly use the results already defined in the structured description and will not be elaborated further.

[0042] In some embodiments, the system performs discrete mapping of priority labels. Safety alarm elements are mapped to the highest level, followed by main navigation information elements, then key interactive elements, and finally auxiliary explanatory elements and decorative elements in descending order. This mapping relationship is defined during the vehicle interface design phase and written into the interface resource file. The mapped levels serve as input for subsequent local visual comparison budget generation.

[0043] Position constraint labels use a binary format to distinguish between allowed and prohibited migration. Allowed migration typically corresponds to elements such as hover tools, auxiliary floating layers, and temporary stripes that do not have a fixed pointing relationship with the external object; prohibited migration corresponds to identifiers, fixed fields, or main elements that have a corresponding relationship with the external target.

[0044] In step S203, a competitive score is generated based on the background information, the brightness change trend, the main direction of the content skeleton, and the content line width.

[0045] The competition score is determined by the background texture density, background main direction, background motion direction, brightness variation trend, content skeleton main direction, and content linewidth. In one embodiment, the system first calculates the directional proximity between the background main direction and the content skeleton main direction, and the motion proximity between the background motion direction and the content skeleton main direction, and then combines the brightness variation trend and content linewidth to form a comprehensive score.

[0046] in, Indicates the first The competitive score for each local region This indicates the background texture density of the local area. Indicates the main direction of the background in this local area. This indicates the main direction of the content skeleton of this local area. This represents the normalized value of the background motion in that local area. This indicates the background motion direction of the local area. This represents the trend of brightness change, derived from a combination of the rate of change of brightness, the net change in brightness, and the consistency of the direction of brightness change. This represents the linewidth sensitivity value calculated from the content linewidth, and the brightness change trend value. and linewidth sensitivity All are normalized values, ranging from 0 to 1; among them, The brightness is determined by looking up a table or by a piecewise linear method based on the consistency of the rate of change of brightness, the net change of brightness, and the direction of change of brightness. The content linewidth is obtained by normalizing it using a preset linewidth sensitivity mapping relationship.

[0047] to All weighting coefficients are preset parameters, ranging from 0 to 1, with a total sum of 1, determined by offline readability calibration. During readability calibration, different backgrounds and interface styles are combined and manually scored, and then regression fitting is used to obtain the weighting coefficients. In actual operation, if the vehicle configuration or the glass display medium changes, the weighting coefficients can be updated overall, but the weighting coefficients remain unchanged within a single running cycle.

[0048] For the trend of brightness change Before calculating the competition score, a trend value is first constructed from the brightness change rate, net brightness change, and consistency of brightness change direction. This trend value can be generated using a lookup table or a piecewise linear method. For example, when the brightness change rate is high and the brightness change direction consistency is high, the trend value is larger; when the brightness change rate is high but the brightness change direction consistency is low, the trend value is medium; and when the brightness change rate is low, the trend value is smaller.

[0049] In step S3, the content to be displayed is divided into an anchor layer and a detail layer based on the element category, and detail layer compression and / or anchor layer migration and / or anchor layer in-situ enhancement are performed based on the competition score and the position constraint label.

[0050] Content layering employs rules determined by element categories. Specifically, the system categorizes security alert elements, main navigation information elements, and key interactive elements into the anchor layer, while auxiliary explanatory elements, secondary label elements, and decorative elements are categorized into the detail layer. The anchor layer handles direct visual recognition, while the detail layer provides supplementary explanations and visual organization. The system registers the anchor and detail layers within each local area separately, allowing for different processing actions to be taken for different layers within the same area during subsequent competitive scoring.

[0051] The conditions for triggering detail layer compression and anchor layer enhancement are determined by the relationship between the competition score and the threshold. Specifically, the system presets a first threshold, a second threshold, and a corresponding exit threshold, with the exit threshold being lower than the corresponding entry threshold. This avoids repeatedly triggering and deactivating the same state when the competition score fluctuates slightly around the threshold. If the competition score of a local area is lower than the first threshold, that local area maintains normal display; if the competition score is not lower than the first threshold but lower than the second threshold, the system performs detail layer compression on that local area and simultaneously performs in-situ anchor layer enhancement; if the competition score is not lower than the second threshold, the system chooses between anchor layer migration and in-situ anchor layer enhancement based on the position constraint label.

[0052] For local areas determined to be in a light to moderate competition state, the interface composition module first filters the content elements belonging to the detail layer within that local area, and then performs at least one of the following processing methods on these content elements: hiding, weakening, or pausing updates. Hiding is suitable for purely decorative elements and explanatory elements that are not necessary for a short time; weakening is suitable for secondary borders and shadows that still need to be retained but do not need to appear with high contrast; pausing updates is suitable for information whose values ​​change frequently but are not currently the core of the identification. After performing detail layer compression, the local area releases more local contrast resources, which is convenient for anchor layer enhancement. The detail layer compression here does not change the geometric position and business semantics of the anchor layer, so it will not affect the subsequent migration judgment and local visual contrast budget generation of the anchor layer.

[0053] In-situ enhancement of the anchor point layer is jointly performed by the interface compositing module and the carrier layer generation module. The interface compositing module first checks whether the content line width of the anchor point layer in the local area is less than the preset minimum line width. The preset minimum line width is determined by the display resolution, viewing distance, and glass medium contrast, and is written into the configuration file as a vehicle model parameter during deployment. If the content line width is less than the preset minimum line width, the interface compositing module widens the corresponding outline to be no less than the preset minimum line width; if the anchor point layer uses a hollow outline, the interface compositing module converts it into a solid or semi-solid shape to reduce the damage to the outline boundary caused by background texture penetration.

[0054] The carrier layer generation module generates a local carrier layer based on the outer envelope of the anchor point layer. The local carrier layer is located behind the anchor point layer, and its extent is formed by extending outwards from the outer envelope of the anchor point layer. The extension distance is determined based on the average linewidth and minimum side length of the anchor point layer to avoid the carrier layer becoming too large and obscuring irrelevant scenery. The local carrier layer only determines its geometric extent at this stage, without immediately determining its transparency. Transparency will be determined based on the pixel display channel load during the local visible contrast budget allocation.

[0055] For anchor layer elements whose position constraint labels indicate that migration is allowed, the system performs anchor layer migration under high contention conditions. The migration is collaboratively completed by the position search module and the interface composition module. The position search module generates multiple candidate positions within a preset search radius, starting from the center point of the current anchor layer element. The generation of candidate positions must meet two conditions: first, the candidate position must not exceed the display area boundary; second, the candidate position should satisfy the display position constraint corresponding to the position constraint label. For each candidate position, the system reads the contention score of the local area covered by the candidate position, calculates the displacement distance between the candidate position and the current position, and then forms the candidate cost.

[0056] in, Indicates the first The anchor layer element in the first Candidate cost at each candidate position This indicates the competition score corresponding to the candidate position. This indicates the displacement distance between the candidate position and the current position. This indicates the maximum allowed migration distance for this anchor layer element. This represents the distance penalty coefficient. The distance penalty coefficient is determined by the element type; the more sensitive the location, the larger the distance penalty coefficient. The location search module selects the candidate location with the lowest candidate cost as the target location, and the interface composition module then smoothly moves the anchor layer element to the target location. The smooth movement is accomplished using a limited-rate interpolation method to avoid abrupt changes perceived by the user.

[0057] In some embodiments, a local carrier layer may still be needed after the anchor layer migration. The system rereads the local region competition score around the target location. If the competition score corresponding to the target location is still higher than the second threshold, a new local carrier layer is generated at the target location, and this local carrier layer is included in the pixel display channel control object. Thus, migration and carrier layering are superimposed according to the degree of competition. Correspondingly, the original carrier layer at the current location enters a cancellation state after the migration begins, and the carrier layer generation module reduces its transparency at a set rate until it is cleared to zero, avoiding leaving obvious base plate marks on the same anchor layer element in both the old and new locations.

[0058] In step S4, a local visual contrast budget is generated based on the competition score and the priority label. Based on the brightness change trend, each local area is divided into rapid short-term change, rapid continuous change, or slow change. The local visual contrast budget is then allocated to the pixel display channel and the glass dimming channel.

[0059] Please see Figure 3 , Figure 3 A schematic diagram illustrating the process of generating and allocating a local visual contrast budget according to an embodiment of this disclosure is shown. Figure 3 As shown, in step S301, a local visual contrast budget is generated based on the competition score and the priority label.

[0060] The local visual contrast budget specifies the compensation amount required for a local area under the current background and content conditions, which is subsequently shared by the pixel display channel and the glass dimming channel. The local visual contrast budget is determined by both the competition score and the priority label. To ensure higher compensation for security alarm elements under equal competition conditions, the system first maps the priority label to a priority value, and then combines it with the competition score. In one implementation, the local visual contrast budget is generated using a linear combination:

[0061] in, Indicates the first Local visual contrast budget for a specific area This represents the competition score for that local area. The priority value is obtained by mapping the priority label. and This is the budget generation coefficient. The budget generation coefficient is determined by offline reading experiments, and the sum of the two can be set to 1. If a local area only contains the detail layer and not the anchor layer, its priority value is set to a low value, thus obtaining a lower local visual contrast budget, which can avoid the system allocating a large amount of compensation to non-critical areas.

[0062] In step S302, the change type of each local area is divided according to the brightness change rate, net brightness change amount, and consistency of brightness change direction.

[0063] The change types are categorized into rapid, short-lived changes, rapid, continuous changes, and slow changes. Specifically, the system first checks whether the brightness change rate is lower than a first rate threshold; if it is, the local area is classified as a slow change. If it is higher than the first rate threshold, the system continues to check whether the consistency of the brightness change direction is higher than a consistency threshold and whether the net brightness change is higher than a net change threshold; if both conditions are met, it is classified as a rapid, continuous change; otherwise, it is classified as a rapid, short-lived change.

[0064] In step S303, the local visual contrast budget is allocated to the pixel display channel and the glass dimming channel. In one embodiment, rapid and short changes correspond to scenarios such as a tree shadow sweeping by, instantaneous reflection, and short-term occlusion. In this case, if the glass dimming channel follows the action, the external brightness often changes in the opposite direction before it arrives, easily causing back-and-forth following. To address this, the system allocates the entire local visual contrast budget of the local area to the pixel display channel, while the glass dimming channel remains unchanged. The amount of data handled by the pixel display channel is directly mapped to the anchor layer brightness increment, contour enhancement intensity, and local carrier layer transparency. If there is currently no local carrier layer in the local area, but the in-situ enhancement state of the anchor layer has been established, the system generates a local carrier layer in this branch and increases its transparency to the target value according to the amount of data handled by the pixel display channel.

[0065] Rapid and continuous changes correspond to scenarios such as entering or exiting a tunnel, encountering a large area of ​​highly reflective background from the side, or moving from a shadowy area into a bright, open area. If the pixel display channel continues to bear all the compensation in these situations, the anchor layer and the local support layer will remain at high intensity for an extended period, affecting the overall visual balance. Therefore, the system employs a two-stage allocation method. Specifically, in the first stage, the pixel display channel initially bears the entire local visible contrast budget to ensure the anchor layer is immediately discernible when the change begins. In the second stage, after the glass dimming channel is activated, a portion of the local visible contrast budget is gradually transferred to the glass dimming channel based on its current status. The target value of the glass dimming channel is obtained by mapping the current transmittance to the budget amount; this mapping relationship can be achieved using a lookup table or a piecewise linear approach. As the glass dimming channel becomes more established, the workload of the pixel display channel decreases synchronously, but a minimum workload is maintained until the glass dimming channel stabilizes to prevent a further decrease in the visibility of the anchor layer.

[0066] Slow changes correspond to scenarios such as gradual changes in sunlight angle, changes in cloud cover, or slow transitions in background brightness. The system allocates the primary local visual contrast budget for this area to the glass dimming channel, which gradually corrects transmittance or fogging levels. The pixel display channel only undertakes a small proportion of compensation and maintains the anchor layer outline and local load-bearing layer at a low level. Thus, slow changes are handled by the glass dimming channel, which has a slower response but is more suitable for long-term load bearing, while the pixel display channel will not be continuously in a high-intensity state.

[0067] In some embodiments, the budget allocation for the glass dimming channel is also determined in conjunction with a brightness sliding window to determine whether to enter a frozen state. Specifically, each local area maintains a brightness sliding window, the length of which is determined by the display refresh cycle and the switching speed of typical vehicle scenes. The system calculates the brightness range and net brightness change within the brightness sliding window. If the brightness range is greater than a first brightness threshold, while the net brightness change is less than a second brightness threshold, it indicates that the brightness of the local area fluctuates significantly within the window period, but the overall brightness does not continuously move in a certain direction. This type of scene is usually a high-frequency oscillation scene. At this time, the system sets the local area to a frozen state, the glass dimming channel maintains its current state, and the local visible contrast budget is still entirely or mainly borne by the pixel display channel.

[0068] The system continuously monitors the net change in brightness and the consistency of the direction of brightness change in the same local area in subsequent cycles. When the net change in brightness exceeds the third brightness threshold, and the consistency of the direction of brightness change exceeds the consistency threshold during the continuous observation period, the system unfreezes and re-executes the budget allocation according to the current change type. The second brightness threshold is lower than the third brightness threshold, and the first brightness threshold is higher than the second brightness threshold. This separates the freezing entry and release conditions, preventing both freezing and release from being met within a single cycle. The continuous observation period can be configured as several consecutive processing cycles, calibrated by testing before vehicle delivery.

[0069] In step S5, display control instructions and dimming control instructions are generated based on the allocation results, and the enhancement state of the corresponding local area is revoked after the competition score falls back to the exit threshold corresponding to the current enhancement state.

[0070] In some embodiments, the display control instructions include at least the target brightness of the anchor layer, the target linewidth of the anchor layer, the target shape of the anchor layer, the display switch of the detail layer, and the transparency of the local carrier layer. The dimming control instructions include at least the target transmittance or target haze degree of each glass dimming zone. If the local area and the glass dimming zone do not correspond one-to-one, the system calculates the glass dimming requirements of multiple local areas to the same glass dimming zone according to the coverage area or a weighted average relationship, or distributes the requirements of the same local area to multiple glass dimming zones. The weight used in the calculation is determined by the overlapping area of ​​the local area and the glass dimming zone, thus ensuring a correspondence between the local visible contrast budget on the display plane and the actual execution unit on the glass dimming plane.

[0071] Display control commands can be executed by the interface composition module, while dimming control commands are sent to the glass controller for execution. The interface composition module and the glass controller can respond in parallel, but the calculation order of control values ​​remains consistent—calculation always precedes sending. For the pixel display channel, the interface composition module completes the update within the same display refresh cycle or the next display refresh cycle; for the glass dimming channel, the glass controller gradually approximates the target value based on its own response model. The glass controller sends back its current state in each cycle, and the system then updates the budget allocation for the next cycle based on this state. Therefore, the current state of the glass dimming channel has a clear source, and its use is limited to budget transfer; it will not directly replace the background state quantity as a new competitive evaluation input.

[0072] When the competition score drops, the system enters the enhanced state cancellation process. The cancellation process is triggered when the competition score of a local area falls below the corresponding exit threshold, and this state persists for a preset duration. The preset duration is set to avoid frequent starts and stops of the enhanced state caused by a local area briefly dropping and then immediately rebounding. After entering the cancellation process, the system first reduces the pixel display channel load, then cancels the local load layer transparency at a fixed slope, and restores the detail layer display. If the local area has previously undergone anchor layer migration, the system will smoothly migrate the anchor layer back to its original position after confirming that the competition score of the area corresponding to the original position is also below the exit threshold. This is because if the detail layer is restored first or migrated back to its original position first, while the pixel display channel and glass dimming channel have not yet exited the high-intensity state, a short-term conflict will occur in the interface.

[0073] For localized areas where the glass dimming channel already bears the majority of the budget, the target value of the glass dimming channel must be simultaneously reduced during the withdrawal process. The system will not directly switch the glass dimming channel from a high-intensity state back to the base state within a single cycle; instead, it will gradually retreat based on the return characteristics of the glass controller. These return characteristics can be measured by the glass medium under experimental conditions and can be programmed into the controller during the factory calibration phase. If the return speed of the glass dimming channel is slower than that of the pixel display channel, the system will retain a low proportion of pixel display channel load during a certain transition period to ensure that the withdrawal rhythm of the anchor layer and the local support layer is consistent with the transmittance recovery rhythm. This prevents the anchor layer from being completely withdrawn before the glass has recovered, which could cause localized areas to appear temporarily too dark or too gray.

[0074] Therefore, in situations where the exterior texture is complex, movement is significant, or brightness changes abruptly, the system can first identify the degree of competition between the displayed content and the exterior within a local area. Then, it selects the corresponding processing path based on content level, positional constraints, and brightness change type. Simultaneously, it distributes compensation between the pixel display channel and the glass dimming channel, and cancels the enhancement state in a predetermined order after the competition weakens. This ensures high stability of key displayed content against the perspective background, and prevents the glass dimming action from being frequently affected by short-term fluctuations.

[0075] Please see Figure 4 , Figure 4 This is a schematic diagram of the display control system for an in-vehicle smart glass according to an embodiment of this application. Figure 4 As shown, the system includes: The mapping and partitioning module 401 is used to acquire a structured description and an exterior image of the content to be displayed; map the exterior image to the smart glass display coordinate system; and divide the display area into multiple local areas. The competition score generation module 402 is used to extract background information and brightness change trends from the mapped exterior image for each local region, extract the main direction of the content skeleton, content line width, element category, priority label, and position constraint label based on the structured description, and generate a competition score according to the background information, the brightness change trend, and the main direction and content line width of the content skeleton; the background information includes background texture density, background main direction, and background motion direction; The layered processing module 403 is used to divide the content to be displayed into an anchor layer and a detail layer based on the element category, and to perform detail layer compression and / or anchor layer migration and / or anchor layer in-situ enhancement based on the competition score and the position constraint label. Budget allocation module 404 is used to generate a local visual contrast budget based on the competition score and the priority label, divide each local area into rapid short change, rapid continuous change or slow change based on the brightness change trend, and allocate the local visual contrast budget to the pixel display channel and the glass dimming channel. The control output module 405 is used to generate display control instructions and dimming control instructions according to the allocation results, and to cancel the enhancement state of the corresponding local area after the competition score falls back to the exit threshold corresponding to the current enhancement state.

[0076] Each processing unit and / or module in the embodiments of this application can be implemented by an analog circuit that implements the functions described in the embodiments of this application, or by software that executes the functions described in the embodiments of this application.

[0077] Based on the same inventive concept, this application also provides an electronic device, the method corresponding to which can be the method in the foregoing embodiments, and its problem-solving principle is similar to that method. For example... Figure 5 As shown, Figure 5 This is a schematic diagram of an electronic device structure provided in an embodiment of the present disclosure. The device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the methods and / or technical solutions of the foregoing embodiments of the present application.

[0078] In particular, the methods and / or embodiments in this application can be implemented as computer software programs. For example, the embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowchart. When the computer program is executed by a processor, it performs the functions defined in the methods of this application.

[0079] Another embodiment of this application provides a storage medium storing computer program instructions thereon, which can be executed by a processor to implement the methods and / or technical solutions of any one or more embodiments of this application.

[0080] In the above embodiments, the descriptions of each embodiment have different focuses. Parts not described in detail in a certain embodiment can be referred to in the relevant descriptions of other embodiments. The above descriptions are merely preferred embodiments of this application and explanations of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to the technical solutions formed by specific combinations of the above technical features, but should also cover other technical solutions formed by arbitrary combinations of the above technical features or their equivalent features without departing from the inventive concept.

Claims

1. A display control method for automotive smart glass, characterized in that, include: Obtain a structured description and exterior image of the content to be displayed; The outdoor image is mapped onto the smart glass display coordinate system, and the display area is divided into multiple local areas; For each local area, background information and brightness change trends are extracted based on the mapped exterior image. The main direction of the content skeleton, content line width, element category, priority label, and position constraint label are extracted based on the structured description. A competitive score is generated based on the background information, the brightness change trend, and the main direction and content line width of the content skeleton. The background information includes background texture density, background main direction, and background motion direction. Based on the element category, the content to be displayed is divided into an anchor layer and a detail layer, and detail layer compression and / or anchor layer migration and / or anchor layer in-situ enhancement are performed based on the competition score and the position constraint label. A local visual contrast budget is generated based on the competition score and the priority label. Each local area is divided into rapid short-term changes, rapid continuous changes, or slow changes based on the brightness change trend. The local visual contrast budget is then allocated to the pixel display channel and the glass dimming channel. Based on the allocation results, display control commands and dimming control commands are generated, and the enhancement state of the corresponding local area is revoked after the competition score falls back to the exit threshold corresponding to the current enhancement state.

2. The method according to claim 1, characterized in that, The process of extracting background information and brightness change trends, and generating competitive scores, includes: extracting edge responses from the mapped exterior images of each local region to obtain background texture density and background main direction; performing local optical flow estimation on the mapped exterior images at adjacent time points to obtain the background motion direction; performing trend estimation on the average brightness of each local region to obtain the brightness change trend; extracting the main direction of the content skeleton and the content line width corresponding to each local region from the structured description; and calculating the competitive score for each local region based on the background texture density, background main direction, background motion direction, brightness change trend, main direction of the content skeleton, and content line width.

3. The method according to claim 1, characterized in that, The step of dividing the content to be displayed into an anchor layer and a detail layer based on the element category includes: dividing security warning elements, main navigation information elements, and key interactive elements into an anchor layer, and dividing auxiliary description elements, secondary label elements, and decorative elements into a detail layer; the detail layer compression includes hiding at least some elements in the detail layer or reducing the display intensity of at least some elements in the detail layer.

4. The method according to claim 3, characterized in that, The step of performing detail layer compression, anchor layer migration, or in-situ anchor layer enhancement based on the competition score and the position constraint label includes: performing detail layer compression and in-situ anchor layer enhancement when the competition score is between a first threshold and a second threshold; performing anchor layer migration when the competition score is not less than the second threshold and the position constraint label indicates that the corresponding anchor layer is allowed to migrate; and performing in-situ anchor layer enhancement when the competition score is not less than the second threshold and the position constraint label indicates that the corresponding anchor layer is prohibited from migrating; wherein, the first threshold is less than the second threshold.

5. The method according to claim 4, characterized in that, The anchor layer migration includes: generating multiple candidate positions around the current position of the target anchor layer; for each candidate position, obtaining the competition score corresponding to the candidate position and the displacement distance between the candidate position and the current position, and calculating the candidate cost based on the competition score and the displacement distance; selecting the candidate position with the smallest candidate cost from the multiple candidate positions as the target position; and moving the target anchor layer from the current position to the target position.

6. The method according to claim 4, characterized in that, The in-situ enhancement of the anchor point layer includes: adjusting the outline line width in the target anchor point layer that is smaller than the preset minimum line width to not less than the preset minimum line width; converting the hollow outline into a solid shape; generating a local carrier layer corresponding to the outer envelope of the target anchor point layer behind the target anchor point layer, and using the local carrier layer as the execution object for subsequent local visual contrast budget allocation to the pixel display channel.

7. The method according to claim 1, characterized in that, The step of generating a local visual contrast budget based on the competition score and the priority label, and dividing each local area into rapid short-term change, rapid continuous change, or slow change based on the brightness change trend, includes: calculating the local visual contrast budget of each local area based on the competition score of each local area and the priority label of the corresponding displayed content; and dividing each local area into rapid short-term change, rapid continuous change, or slow change according to mutual exclusion conditions based on the consistency of brightness change rate, net brightness change amount, and brightness change direction of each local area.

8. The method according to claim 7, characterized in that, The method of allocating the local visual contrast budget to the pixel display channel and the glass dimming channel includes: under rapid and short changes, allocating the local visual contrast budget of the corresponding local area to the pixel display channel; under rapid and continuous changes, first allocating the local visual contrast budget of the corresponding local area to the pixel display channel, and then, based on the current status of the glass dimming channel, transferring a portion of the local visual contrast budget to the glass dimming channel; under slow changes, allocating the main portion of the local visual contrast budget of the corresponding local area to the glass dimming channel, and allocating the remaining portion to the pixel display channel.

9. An electronic device, characterized in that, include: processor; Memory for storing computer programs executable by the processor; The processor is configured to execute a computer program in the memory to implement the method as described in any one of claims 1 to 8.

10. A storage medium, characterized in that, When the executable computer program in the storage medium is executed by a processor, it can implement the method as described in any one of claims 1 to 8.

Images