Vehicle-mounted display system, vehicle display control method, electronic equipment and vehicle
By acquiring user location and vehicle safety scores, the display parameters of the AR-HUD projection assembly are dynamically adjusted, solving the driver distraction problem caused by augmented reality head-up display systems and improving viewing comfort and driving safety.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- DEEPAL AUTOMOBILE TECH CO LTD
- Filing Date
- 2026-03-23
- Publication Date
- 2026-05-19
AI Technical Summary
Existing augmented reality head-up display systems can easily distract drivers and pose safety hazards.
By acquiring user location and vehicle safety scores, the display parameters such as the position, transparency, and virtual distance of the AR-HUD projection assembly are dynamically adjusted to ensure that the virtual image matches the user's position and reduce interference with the driver's field of vision.
It improves user viewing comfort and driving safety, and reduces the impact of unreasonable display parameters on the driver's line of sight.
Smart Images

Figure CN122058748A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of vehicle technology, specifically to an in-vehicle display system, a vehicle display control method, electronic equipment, and a vehicle. Background Technology
[0002] Augmented Reality Head-Up Display (AR-HUD) can project content to be displayed as a virtual image onto the windshield of a vehicle, allowing users to access the content without looking down, thus improving the user experience.
[0003] However, existing augmented reality head-up displays are fixed in front of the driver, which can easily distract the driver when displaying content, posing a safety hazard. Summary of the Invention
[0004] In view of the shortcomings of the prior art, the purpose of this application is to provide an in-vehicle display system, a vehicle display control method, an electronic device and a vehicle, which aims to improve the user's viewing comfort, reduce interference with the driver's field of vision and improve driving safety.
[0005] In a first aspect, embodiments of this application provide an in-vehicle display system, including: an AR-HUD projection assembly, a driving device, and a controller; the driving device is used to adjust the pose of the AR-HUD projection assembly; the controller is configured to: acquire the current user position and vehicle safety score within the vehicle, the vehicle safety score being used to characterize the risk level of the vehicle's current driving; determine a target display parameter set based on the user position and vehicle safety score; the target display parameter set includes: the target position of the AR-HUD projection assembly, the target transparency of the content to be displayed, the target virtual distance, and the target display size of the virtual image corresponding to the content to be displayed; the target virtual distance represents the distance between the virtual image of the content to be displayed after projection by the AR-HUD projection assembly and the user; control the driving device to drive the AR-HUD projection assembly to move to the target position; control the AR-HUD projection assembly to display the content to be displayed based on the target transparency, the target virtual distance, and the target display size.
[0006] Beneficial Effects: This application determines the target display parameter set based on the user's location and vehicle safety score, drives the AR-HUD projection assembly to the target position, and displays the target based on target transparency, virtual distance, and display size. The user's location directly determines their field of view. Determining the target display parameter set based on the user's location ensures that the virtual image corresponding to the content to be displayed matches the user's position. The vehicle safety score characterizes the risk level of the vehicle's current driving. Determining the target display parameter set based on the vehicle safety score enables dynamic adjustment of display parameters according to driving risk, avoiding interference with the driver's line of sight due to unreasonable display parameters. This improves user viewing comfort, reduces interference with the driver's field of vision, and enhances driving safety.
[0007] In one possible embodiment, the vehicle safety score is determined by: acquiring vehicle speed, road curvature, vehicle automation level, and driver attention score; determining an initial safety score based on vehicle speed, road curvature, and vehicle automation level; increasing the initial safety score to obtain a vehicle safety score if the driver attention score is greater than a first threshold; decreasing the initial safety score to obtain a vehicle safety score if the driver attention score is lower than a second threshold; and using the initial safety score as the vehicle safety score if the driver attention score is between the first and second thresholds.
[0008] In this embodiment, based on objective factors such as vehicle speed, road curvature, and the degree of autonomous driving, as well as subjective factors such as driver attention, this application can accurately determine the risk level of the vehicle's current driving.
[0009] In one possible embodiment, determining the target display parameter set based on the user's location within the vehicle and the vehicle safety score includes: determining multiple initial display parameter sets based on the user's location within the vehicle and the vehicle safety score; determining the location matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree corresponding to each initial display parameter set; for each initial display parameter set, performing a weighted summation of the location matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree to obtain a comprehensive matching degree for the initial display parameter set; the weights corresponding to the location matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree are determined based on the type of content to be displayed and a preset mapping relationship between the type of content to be displayed and the weights, where the types of content to be displayed include: navigation, video, and telephone; and selecting the initial display parameter set whose comprehensive matching degree satisfies a first preset condition as the target display parameter set; the first preset condition includes: the comprehensive matching degree is greater than a preset matching degree threshold, or the highest N values, where N is a positive integer.
[0010] In this embodiment, a comprehensive evaluation of the initial display parameter set is achieved by weighted summation of location matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree. Simultaneously, by dynamically assigning weights to each matching degree based on the type of content to be displayed, the calculation of the overall matching degree becomes more targeted. This allows for the selection of the target display parameter set that best suits the current user location, vehicle safety status, and content type, ensuring both the adaptability of the displayed content and viewing comfort, while reducing interference with the driver's field of vision and improving driving safety.
[0011] In one possible embodiment, multiple initial display parameter sets are determined based on the user's position inside the vehicle and the vehicle safety score, including: determining the position range of the AR-HUD projection assembly matching the user's field of vision based on the user's position; determining a candidate display parameter set based on multiple preset positions, multiple virtual distances, multiple transparency levels, and multiple display sizes within the position range; determining virtual distance constraints, transparency constraints, and display size constraints based on the vehicle safety score; and using the candidate display parameter set that satisfies the virtual distance constraints, transparency constraints, and display size constraints as multiple initial display parameter sets.
[0012] In this embodiment, the suitable AR-HUD position range is first determined based on the user's location. Then, the virtual distance, transparency, and display size are constrained and filtered using a vehicle safety score. On the one hand, limiting the position range by the user's location ensures that the projection positions in the initial display parameter set all conform to the user's field of vision, reducing invalid parameter combinations. On the other hand, multiple constraints eliminate parameter combinations that do not meet current driving safety requirements, ensuring the rationality and adaptability of the initial parameter set, improving the efficiency and accuracy of determining the target display parameter set, and simultaneously considering both user experience and driving safety.
[0013] In one possible embodiment, a candidate display parameter set is determined based on multiple preset locations, multiple virtual distances, multiple transparency levels, and multiple display sizes within a location range. This includes: generating multiple candidate parameter combinations based on the multiple preset locations and multiple virtual distances; determining a comprehensive score for each candidate parameter combination based on each candidate parameter combination, as well as multiple transparency levels and multiple display sizes; the comprehensive score is used to characterize the comprehensive matching degree corresponding to different transparency levels and different display sizes under the current candidate parameter combination; and determining the candidate display parameter set based on candidate parameter combinations whose comprehensive scores are greater than or equal to a preset comprehensive score, as well as multiple transparency levels and multiple display sizes.
[0014] In this embodiment, by first combining the location and virtual distance into candidate parameter combinations and then calculating the comprehensive score for screening, invalid combinations with low matching degree can be eliminated in advance, and only high-quality candidate solutions can be retained to participate in subsequent calculations. This not only ensures the rationality and display effect of the candidate display parameter set, but also greatly reduces the subsequent amount of computation, thereby improving the screening efficiency.
[0015] In one possible embodiment, a candidate display parameter set is determined based on multiple preset locations, multiple virtual distances, multiple transparency levels, and multiple display sizes within a location range. This includes: for each preset location, determining a sorting weight based on the desired transparency level and the maximum display size; the sorting weight is used to characterize the upper limit of the overall matching degree corresponding to the preset location under the desired transparency level and the maximum display size; sorting the multiple preset locations in descending order according to the sorting weight; and determining the candidate display parameter set based on the multiple preset locations, multiple virtual distances, multiple transparency levels, and multiple display sizes according to the descending sorted order.
[0016] In this embodiment, by first calculating the sorting weights of the preset positions according to the desired transparency and maximum display size and then arranging them in descending order, the preset positions with higher overall matching degree and better display effect can be selected first, reducing the calculation of invalid parameter combinations. While ensuring the quality of the candidate display parameter set, the amount of computing power of the controller is reduced, thereby improving the screening efficiency.
[0017] In one possible embodiment, controlling the AR-HUD projection assembly to display content to be displayed based on target transparency, target virtual distance, and target display size includes: determining the initial virtual image position corresponding to the content to be displayed based on the target position and target display size of the AR-HUD projection assembly; determining initial correction parameters for the content to be displayed based on the target position of the AR-HUD projection assembly; correcting the initial correction parameters based on the vehicle's yaw rate and pitch rate to obtain target correction parameters; correcting the initial virtual image position based on the target correction parameters to obtain the target virtual image position of the content to be displayed; and displaying the content to be displayed based on the target virtual image position of the content to be displayed.
[0018] In this embodiment, the virtual image position is dynamically corrected by fusing the vehicle's yaw rate and pitch rate in real time. This solves the problem of virtual image offset and jitter in AR-HUD projection during vehicle dynamic driving, ensuring that the virtual image can accurately fit the user's field of vision even when the vehicle is turning at high speed or driving on bumpy roads, thus improving display stability and driving safety.
[0019] In one possible embodiment, controlling the AR-HUD projection assembly to display content to be displayed based on target transparency, target virtual distance, and target display size includes: synthesizing the content to be displayed with driving information identifiers according to the target transparency of the content to be displayed to generate a composite image; and outputting the composite image to the AR-HUD projection assembly to display the composite image.
[0020] In this embodiment, by mixing the transparency of the content to be displayed with the driving information label, multimedia content and key driving safety information can be presented simultaneously. This ensures that users can view entertainment, communication and other content normally, while also ensuring that driving information such as vehicle speed, warnings, and navigation prompts are always clearly visible and prioritized for display, effectively improving driving safety and the integrity of the display experience.
[0021] In one possible embodiment, controlling the AR-HUD projection assembly to display content based on target transparency, target virtual distance, and target display size includes: determining the edge transition weight of each pixel based on the distance from each pixel within the display area to the boundary of the display area; the edge transition weight is used to characterize the degree of transparency gradient at the edge of the display area; the display area is determined based on the target position and the display size of the content to be displayed; the initial transparency of the content to be displayed and the edge transition weight are weighted to obtain the target transparency of the content to be displayed; and the content to be displayed is displayed based on the target transparency of the content to be displayed.
[0022] In this embodiment, by processing the transparency of the display area edge through edge transition weight, the displayed content can achieve a natural and smooth transparency gradient transition from the center to the edge, avoiding harsh boundaries in the display area. While ensuring that the core content is clearly visible, the virtual image edge is softly integrated with the real road conditions, reducing interference with the driver's line of sight, thereby improving the visual comfort of AR-HUD display.
[0023] Secondly, embodiments of this application provide a vehicle display control method, comprising: acquiring the current user location and vehicle safety score within the vehicle, the vehicle safety score being used to characterize the risk level of the vehicle's current driving; determining a target display parameter set based on the user location and vehicle safety score; the target display parameter set including: the target position of the AR-HUD projection assembly, the target transparency of the content to be displayed, the target virtual distance of the AR-HUD projection assembly, and the target display size of the virtual image corresponding to the content to be displayed; the target virtual distance of the AR-HUD projection assembly representing the distance between the virtual image of the content to be displayed after projection and the user; and displaying the content to be displayed based on the target display parameter set.
[0024] Thirdly, embodiments of this application provide an electronic device, including: a processor and a memory configured to store processor-executable instructions; wherein the processor is configured to execute the instructions to implement the vehicle display control method of the second aspect described above.
[0025] Fourthly, embodiments of this application provide a vehicle, including: any of the optional in-vehicle display systems in the first aspect described above, and / or the electronic devices in the third aspect described above.
[0026] Fifthly, embodiments of this application provide a computer-readable storage medium storing instructions that, when executed by a device, enable the device to perform the vehicle display control method of the second aspect described above.
[0027] Sixthly, this application provides a computer program product including computer instructions that, when executed on a device's processor, enable the device to perform the vehicle display control method as described in the second aspect above. Attached Figure Description
[0028] To more clearly illustrate the technical solutions in the embodiments of this application or the background art, the accompanying drawings used in the embodiments of this application will be described below.
[0029] Figure 1 This is a schematic diagram of the structure of an in-vehicle display system disclosed in an embodiment of this application; Figure 2 This is a schematic diagram of a vehicle-mounted display system disclosed in an embodiment of this application; Figure 3 This is a schematic diagram of another vehicle-mounted display system disclosed in an embodiment of this application; Figure 4 This is a schematic diagram illustrating the process of displaying content to be displayed in an in-vehicle display system according to an embodiment of this application; Figure 5 This is a schematic diagram illustrating a user location and a target location as disclosed in an embodiment of this application; Figure 6 This is a schematic diagram of the architecture of an in-vehicle display system disclosed in an embodiment of this application; Figure 7 This is a schematic diagram illustrating the process of displaying content to be displayed in another vehicle-mounted display system disclosed in an embodiment of this application; Figure 8 This is a schematic diagram illustrating the display of content to be displayed, as disclosed in an embodiment of this application. Figure 9 This is a schematic diagram illustrating the process of displaying content to be displayed in another vehicle-mounted display system disclosed in an embodiment of this application; Figure 10This is a schematic flowchart of a vehicle display control method disclosed in an embodiment of this application; Figure 11 This is a schematic diagram of the structure of a vehicle display control device disclosed in an embodiment of this application; Figure 12 This is a schematic diagram of the structure of an electronic device disclosed in an embodiment of this application. Detailed Implementation
[0030] The terms "first," "second," etc., are used for descriptive purposes only and have no sequential or technical meaning, nor should they be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Directional terms used in this application, such as "upper," "lower," "front," "rear," "left," "right," "inner," and "outer," are merely for reference to the orientation shown in the accompanying drawings. The use of directional terms is for better and clearer explanation and understanding of this application, and does not indicate the orientation of the referred device or component in an actual application scenario.
[0031] In the description of the embodiments of this application, unless otherwise expressly specified and limited, the terms "installation" and "connection" should be interpreted broadly. For example, "connection" can be a detachable connection or a non-detachable connection; it can be a direct connection or an indirect connection through an intermediate medium. "Fixed connection" refers to a connection where the relative positional relationship remains unchanged after connection. "Rotary connection" refers to a connection where the two parts can rotate relative to each other after connection. "Sliding connection" refers to a connection where the two parts can slide relative to each other after connection.
[0032] The embodiments of this application are described below with reference to the accompanying drawings.
[0033] In some embodiments, the following in-vehicle display system can be applied in a vehicle, wherein the vehicle can be, but is not limited to, any type of vehicle with display function such as a pure electric vehicle (PEV / BEV), a hybrid electric vehicle (HEV), a range-extended electric vehicle (REEV), a plug-in hybrid electric vehicle (PHEV), or a new energy vehicle.
[0034] Please see Figure 1 , Figure 1This is a schematic diagram of the architecture of an in-vehicle display system disclosed in an embodiment of this application. The in-vehicle display system includes: an AR-HUD projection assembly 101, a driving device 102, and a controller 103.
[0035] In some embodiments, the driving device 102 and the AR-HUD projection assembly 101 are used to adjust the attitude of the AR-HUD projection assembly 101. The control is configured to acquire the user's position and vehicle safety score and determine target display parameters, thereby controlling the driving device 102 to adjust the AR-HUD projection assembly 101 to the target attitude, and the AR-HUD projection assembly 101 to project and display content according to the target display parameters. The specific placement of the driving device 102 and the AR-HUD projection assembly 101 in the vehicle can be as follows: Figure 2 As shown, it will not be elaborated further here.
[0036] Please see Figure 3 The AR-HUD projection assembly 101 includes: an optical lens group 1011, an image generation unit 1012, an optical mirror 1013, a reflector 1014, and a housing 1015. The housing is rigidly connected to the slider 1021 via a connector. The image generation unit is used to receive image frame signals sent by the controller and convert them into light signals. The light signals are modulated by the optical lens group and the reflector and projected onto the windshield of the vehicle to form a virtual image in front of the driver.
[0037] Please refer to it again. Figure 3 The driving device includes a slider 1021, a guide rail 1022, and a drive motor 1023. The slider is fixedly connected to the AR-HUD projection assembly, and the drive motor is used to drive the slider to move on the guide rail, thereby changing the pose of the AR-HUD projection assembly. It should be noted that this application uses the movement of the slider along the vehicle width direction as an example for illustration, but this does not constitute a limitation on the solution of this application. Changes in the vehicle's forward and backward direction, vertical height direction, and angles such as pitch, rotation, and yaw are all within the protection scope of this application.
[0038] Specifically, the guide rail can have a travel of 1000mm, traversing the dashboard from the driver's side to the passenger's side. The AR-HUD projection assembly and the slider can be connected by a three-point suspension damping system to filter road excitations above 20Hz.
[0039] Please refer to it again. Figure 3 The drive device also includes a feedback unit 1024 and a locking mechanism 1025. The feedback unit 1024 is used to detect the target position of the slider and the AR-HUD projection assembly in real time, and feed the position signal back to the controller in real time to form a position closed-loop control to ensure the movement and positioning accuracy of the AR-HUD projection assembly.
[0040] The locking mechanism 1025 is used to mechanically lock the slider under the locking command of the controller, fix the AR-HUD projection assembly in the target position, prevent the vehicle from moving or deviating during driving, and ensure that the virtual image display does not shake or drift.
[0041] In some embodiments, such as Figure 4 As shown, the controller is configured as follows: S401. Obtain the current user location and vehicle safety score within the vehicle.
[0042] Among them, the vehicle safety score is used to characterize the level of risk of the vehicle's current driving.
[0043] In one possible implementation, the vehicle safety score is determined by: acquiring vehicle speed, road curvature, vehicle automation level, and driver attention score; determining an initial safety score based on vehicle speed, road curvature, and vehicle automation level; increasing the initial safety score to obtain a vehicle safety score if the driver attention score is greater than a first threshold; decreasing the initial safety score to obtain a vehicle safety score if the driver attention score is lower than a second threshold; and using the initial safety score as the vehicle safety score if the driver attention score is between the first and second thresholds.
[0044] Specifically, the initial safety score can be in the form of a grade, that is, it can be represented as a basic safety level. The process of determining the basic safety level is as follows: The controller stores a two-dimensional decision matrix generated through extensive real-vehicle testing and calibration with driving safety expert knowledge. The horizontal axis of this matrix represents the discretized autonomous driving level (L0, L1, L2, L3…), and the vertical axis represents the dynamic risk index R (R=f(V,ρ)) synthesized based on vehicle speed V and road curvature ρ. Each cell in the matrix predefines a basic safety level, including four levels: "prohibited," "strictly restricted," "generally restricted," and "permitted," corresponding to quantitative scores of 0, 1, 2, and 3, respectively. The higher the score, the lower the safety risk and the greater the likelihood of it being displayed. Based on the real-time input L and the calculated R, the controller determines the precise basic safety level through table lookup and bilinear interpolation.
[0045] The driver attention correction process is as follows: A driver attention score A (0-100 points) is obtained. S_current represents the vehicle safety level, and the correction function is S_current = f(S_base, A), implemented using a conditional offset strategy: for example, when S_base is "General Restriction" (corresponding to a score of 2.0), if A > 85 points, S_current is increased to 2.5 (between general restriction and allowable); if A < 60 points, S_current is downgraded to 1.5 (between strict restriction and general restriction). The specific mapping relationship of this function is defined through a rule engine based on safety thresholds (e.g., setting multiple sets of threshold offsets) or through a policy network trained by reinforcement learning.
[0046] In one possible implementation, the current user's location inside the vehicle is determined as follows: images of various areas inside the vehicle are collected by multiple in-vehicle cameras (corresponding to the driver's seat, passenger seat, and rear seats respectively), and human detection, contour recognition, and region matching are performed on the collected images. Combined with the pressure signals from seat pressure sensors (located in the driver's seat, passenger seat, and rear seats respectively), it is determined which seat area the detected user in the image corresponds to, thereby determining whether the user's location is in the driver's seat, passenger seat, or rear seat.
[0047] S402. Determine the target display parameter set based on the user's location and vehicle safety score.
[0048] The target display parameter set includes: the target position of the AR-HUD projection assembly, the target transparency of the content to be displayed, the target virtual distance, and the target display size of the virtual image corresponding to the content to be displayed; the target virtual distance represents the distance between the virtual image of the content to be displayed after being projected by the AR-HUD projection assembly and the user.
[0049] The target position of the AR-HUD projection assembly refers to the physical pose (including horizontal, vertical, and pitch angle) that the AR-HUD itself needs to move to, ensuring that the virtual image falls directly in front of the user's field of vision. The target transparency of the content to be displayed: the transparency of the AR virtual image (0%-100%, 0% completely opaque, 100% completely transparent), aims to balance the need to clearly see the content to be displayed with the need to avoid obstructing road conditions. Higher vehicle risk necessitates higher transparency to avoid obstructing the view ahead.
[0050] Target virtual distance: The distance between the virtual image and the user as perceived by the user's vision. Target display size of the virtual image corresponding to the content to be displayed: The visual size of the AR virtual image (e.g., 8-15 inches). The purpose is to balance the need to clearly see the content to be displayed with the need not to occupy too much of the user's field of vision. Among these, the higher the risk of vehicles, the smaller the size should be to reduce visual interference.
[0051] In one possible implementation, the target display parameter set is determined based on the user's location and vehicle safety score. This can be achieved by storing a preset parameter table in the controller, which includes basic display parameters corresponding to different locations (e.g., the basic virtual distance for the driver is 5 meters, and for the passenger is 4 meters), as well as adjustment coefficients corresponding to different safety scores. Based on the user's location, vehicle safety score, and preset parameter table, the basic display parameters and adjustment coefficients are determined. The basic display parameters are then multiplied by the adjustment coefficients to obtain the target display parameter set.
[0052] For example, such as Figure 5 As shown, the windshield can include: the driver's area, the central shared area, and the passenger / rear area, corresponding to three position ranges on the horizontal slide rail of the drive unit, namely position one, position two, and position three. When the user's position is the driver's seat, the projection area can be the driver's seat area, and the target position of the AR-HUD projection assembly can be within the range of position one.
[0053] Specifically, S_current represents the vehicle safety score, also known as the vehicle safety level mentioned above. If S_current is lower than the preset allowable threshold (for example, S_current < 1.0 is considered "prohibited"), the controller generates an instruction containing a rejection reason code and feeds it back to the user through the occupant interaction system interface.
[0054] If S_current ≥ 1.0 (i.e., in the "restricted" or "allowed" category), the process of determining display parameters begins. The system has a pre-built display strategy knowledge base, which defines multi-objective optimizations for different requester identities (driver, passenger, rear passenger) and content types (such as navigation, video, and phone calls) under different S_current levels.
[0055] S403, Control the drive device to drive the AR-HUD projection assembly to the target position.
[0056] In one possible implementation, the controller converts the target position (horizontal position, vertical position, pitch angle) into a control signal recognizable by the drive unit and sends the control signal to the drive motor and locking mechanism. Upon receiving the control signal, the drive motor outputs corresponding torque and rotational motion, which is converted into linear motion via a transmission component. This linear motion drives the AR-HUD projection assembly, which is fixed to the slider, to move along the guide rail, while simultaneously adjusting the AR-HUD's pitch angle until it approaches the target position. After the AR-HUD projection assembly reaches the target position, the controller issues a locking command, triggering the locking mechanism to mechanically lock the slider, fixing the AR-HUD projection assembly in the target position and preventing it from shifting or deviating during vehicle movement (e.g., during bumps or turns).
[0057] S404. Control the AR-HUD projection assembly to display the content to be displayed based on the target transparency, target virtual distance, and target display size.
[0058] In one possible implementation, after confirming that the AR-HUD projection assembly has reached the target position and locked, the controller sends the target transparency, target virtual distance, and target display size parameters to the image processing module and optical module of the AR-HUD projection assembly. The image generation unit of the AR-HUD projection assembly receives the rendered image frame signal (such as navigation map, incoming call information, or video footage) sent by the controller, converts the image signal into a light signal, and simultaneously, the image processing module processes the image corresponding to the light signal according to the target display size. Then, the optical lens assembly is adjusted so that the imaging distance of the virtual image reaches the target virtual distance, the transparency reaches the target transparency, and the visual size of the virtual image reaches the target display size. After adjustment, the light signal is projected onto the vehicle's windshield through the optical lens assembly, and after reflection from the windshield, a clear and stable AR virtual image is formed and presented in the user's field of vision.
[0059] Therefore, this application determines the target display parameter set based on the user's location and vehicle safety score, drives the AR-HUD projection assembly to the target location, and displays the target based on target transparency, virtual distance, and display size. The user's location directly determines their field of view. Determining the target display parameter set based on the user's location ensures the virtual image matches the user's position. The vehicle safety score characterizes the risk level of the vehicle's current driving. Determining the target display parameter set based on the vehicle safety score enables dynamic adjustment of display parameters according to driving risk, avoiding interference with the driver's line of sight due to unreasonable display parameters. This improves user viewing comfort, reduces interference with the driver's field of vision, and enhances driving safety.
[0060] like Figure 6 As shown, the working process of the in-vehicle display system is as follows: Based on vehicle network data, driver monitoring data, autonomous driving system data, and passenger interaction interface data, the target display parameters are determined. The controller is the decision-making center, receiving data and generating control commands. The control commands are divided into two paths: one path controls the drive unit to move the AR-HUD projection assembly, and the other path sends the content parameters to the AR-HUD projection assembly. After processing the video stream from the content source, the AR-HUD projection assembly also sends the processed image data to the AR-HUD projection assembly for final display.
[0061] In some embodiments, such as Figure 7 As shown, the above S402 includes the following steps: S701. Determine multiple initial display parameter sets based on the user's location inside the vehicle and the vehicle safety score.
[0062] As one possible implementation, the position range of the AR-HUD projection assembly matching the user's field of view is determined based on the user's location; a set of candidate display parameters is determined based on multiple preset positions, multiple virtual distances, multiple transparency levels, and multiple display sizes within the position range; virtual distance constraints, transparency constraints, and display size constraints are determined based on the vehicle safety score; and the set of candidate display parameters that satisfy the virtual distance constraints, transparency constraints, and display size constraints is used as multiple initial display parameter sets.
[0063] In one possible implementation, the controller stores pre-calibrated optimal user field-of-view areas for different in-vehicle positions (driver's seat, front passenger seat, rear left / right side, etc.). Combined with the motion trajectory of the AR-HUD projection assembly, it determines the range of AR-HUD projection assembly positions that will allow the virtual image to fall within the user's field of view. Within the range determined in the first step, multiple preset positions are selected, along with multiple preset virtual distances, multiple transparency levels, and multiple display sizes, generating a set of all possible candidate display parameters. Based on a preset vehicle safety score-parameter constraint mapping relationship, the controller generates corresponding virtual distance, transparency, and display size constraints according to the currently calculated vehicle safety score. It iterates through all candidate display parameter sets, eliminating combinations that do not meet the constraints; the remaining parameters constitute the initial display parameter set (only retaining parameter combinations that meet safety requirements).
[0064] The preset position can be obtained by dividing according to a fixed interval or according to the characteristics of the optical system.
[0065] In this embodiment, on the one hand, by calculating the position range, the effective position range of the AR-HUD can be accurately determined, ensuring that the virtual images corresponding to all candidate parameters fall within the user's effective field of view, avoiding problems such as blurred or out-of-line views due to positional deviations. On the other hand, constraints are determined based on vehicle safety scores to achieve precise matching between display parameters and driving risks. The higher the driving risk, the stricter the constraints, which can effectively avoid the problem of display content obstructing the road conditions ahead and interfering with the driver's attention, thus ensuring driving safety.
[0066] In one possible implementation, a candidate display parameter set is determined based on multiple preset locations, multiple virtual distances, multiple transparency levels, and multiple display sizes within a location range. This can be achieved by generating multiple candidate parameter combinations based on multiple preset locations and multiple virtual distances; determining a comprehensive score for each candidate parameter combination based on each candidate parameter combination, as well as multiple transparency levels and multiple display sizes; the comprehensive score is used to characterize the comprehensive matching degree corresponding to different transparency levels and different display sizes under the current candidate parameter combination; and determining the candidate display parameter set based on candidate parameter combinations whose comprehensive score is greater than or equal to a preset comprehensive score, as well as multiple transparency levels and multiple display sizes.
[0067] In this embodiment, by first combining the location and virtual distance into candidate parameter combinations and then calculating the comprehensive score for screening, invalid combinations with low matching degree can be eliminated in advance, and only high-quality candidate solutions can be retained to participate in subsequent calculations. This not only ensures the rationality and display effect of the candidate display parameter set, but also greatly reduces the subsequent amount of computation, thereby improving the screening efficiency.
[0068] In another possible implementation, a candidate display parameter set is determined based on multiple preset locations, multiple virtual distances, multiple transparency levels, and multiple display sizes within the location range. This can be achieved by: for each preset location, determining a sorting weight based on the desired transparency level and the maximum display size; the sorting weight is used to characterize the upper limit of the overall matching degree corresponding to the preset location under the desired transparency level and the maximum display size; sorting the multiple preset locations in descending order according to the sorting weight; and determining the candidate display parameter set based on the multiple preset locations, multiple virtual distances, multiple transparency levels, and multiple display sizes according to the descending sorted order.
[0069] In this embodiment, by first calculating the sorting weights of the preset positions according to the desired transparency and maximum display size and then arranging them in descending order, the preset positions with higher overall matching degree and better display effect can be selected first, reducing the calculation of invalid parameter combinations. While ensuring the quality of the candidate display parameter set, the amount of computing power of the controller is reduced, thereby improving the screening efficiency.
[0070] It should be noted that the two methods for determining the candidate display parameter set mentioned above can be used in combination. First, the preset positions within the position range are sorted in descending order using the second method (preset position sorting weight filtering), and high-quality preset positions with higher sorting weights are selected first. Then, these selected preset positions are combined with multiple virtual distances to generate candidate parameter combinations. Subsequently, the first method (comprehensive score filtering) is used to calculate a comprehensive score for these candidate parameter combinations, and combinations with a comprehensive score greater than or equal to the preset comprehensive score are selected. Finally, the candidate display parameter set is determined by combining multiple transparency levels and multiple display sizes.
[0071] S702. Determine the position matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree corresponding to each initial display parameter set.
[0072] As one possible implementation, based on the current position and the user's position within the vehicle, corresponding to the desired projection area, the deviation between the current position and the center of the desired area is calculated; a smaller deviation indicates a higher degree of matching. Based on the desired transparency range corresponding to the type of content to be displayed, the deviation between the current transparency and the desired transparency is calculated; a smaller deviation indicates a higher degree of matching. Based on the desired virtual distance corresponding to the type of content to be displayed, the closeness between the current virtual distance and the desired virtual distance is calculated; a closer closeness indicates a higher degree of matching. Based on the desired display size range corresponding to the type of content to be displayed, the position of the current display size within the desired display size range is calculated; a closer closeness to the desired size indicates a higher degree of matching.
[0073] S703. For each initial display parameter set, the position matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree are weighted and summed to obtain the comprehensive matching degree of the initial display parameter set.
[0074] The weights for location matching, transparency matching, virtual distance matching, and display size matching are determined based on the type of content to be displayed and the preset mapping relationship between the type of content to be displayed and the weight. The types of content to be displayed include: navigation, video, and telephone.
[0075] The requirements for navigation are clarity, accuracy, and safety. Location (whether it is in the driver's best field of vision) and display size (not obstructing road conditions) are relatively important and will have a higher weight. Transparency and virtual distance have relatively lower weight.
[0076] The requirements for videos are immersion and visual enjoyment, so transparency (whether the image is clear) and display size (screen size) are more important and have higher weights. Position and virtual distance are less important as long as they do not seriously interfere with driving.
[0077] The requirements for telephone communication are clear communication without interfering with driving. Transparency and location are relatively important, and these two indicators will have higher weighting, while virtual distance and display size have relatively lower weighting.
[0078] It should be noted that this application does not limit the type of content to be displayed, the specific values of each matching degree weight, or the allocation ratio. The weight settings for the three content types of navigation, video, and telephone are only illustrative examples. In actual applications, the weights of each matching degree can be flexibly adjusted according to security requirements, user preferences, or scenario needs.
[0079] S704. The initial set of display parameters whose overall matching degree meets the first preset condition is taken as the target set of display parameters.
[0080] The first preset condition includes: the overall matching degree is greater than the preset matching degree threshold, or the highest N, where N is a positive integer.
[0081] One possible approach is to compare the overall matching score of all initial parameter sets with a preset matching score threshold one by one, and then select the parameter sets whose overall matching score is greater than the preset matching score threshold. Alternatively, all initial parameter sets can be sorted from highest to lowest overall matching score, and the top N parameter sets can be selected.
[0082] Therefore, by weighted summing of location matching, transparency matching, virtual distance matching, and display size matching, a comprehensive evaluation of the initial display parameter set is achieved. Simultaneously, dynamically assigning weights to each matching degree based on the type of content to be displayed makes the calculation of the overall matching degree more targeted. This allows for the selection of the target display parameter set most suitable for the current user's location, vehicle safety status, and content type, ensuring both the adaptability of the displayed content and viewing comfort, while reducing interference with the driver's field of vision and improving driving safety.
[0083] The above embodiment will be described in detail below with an example.
[0084] First, the user experience matching metric is quantified into an objective function U, which comprehensively considers factors such as the area of the displayed content, transparency, and virtual imaging distance. The weight w is dynamically adjusted based on the content type (e.g., video content prioritizes visual area and transparency, while navigation content prioritizes clarity).
[0085] Secondly, safety constraints are determined based on the vehicle safety level S_current. S_current is mapped to a set of safety thresholds, including: maximum permissible transparency α_max, minimum virtual imaging distance D_min, and prohibited coverage of core driving information areas (such as vehicle speed, navigation arrows, etc., which are not allowed to be covered by video content, represented by size), etc. These constraints are expressed in the form of inequalities or no-go zones.
[0086] Then, the user location and content type are translated into display resource requirements. To this end, the controller incorporates a pre-calibrated display requirement mapping table based on ergonomic experiments and user preference studies. This table stores the expected values or expected ranges of the following parameters for different combinations of user location and type, which are used for subsequent optimization solutions: The location P is determined by the requester's identity, serving as a feasible region constraint rather than a single expected value. For example, the driver's seat corresponds to the left side of the slide rail (0~300mm), the passenger seat to the right side (700~1000mm), and the rear right side to the rightmost side (850~1000mm). These ranges directly limit the search scope of P.
[0087] Transparency α: The content type determines the expected transparency. For example, navigation content has an expected transparency of 100% to ensure readability, video content has an expected transparency of 70%–80% for a good visual experience, and telephone content has an expected transparency of around 50% to reduce visual distractions. Expected transparency is used to calculate transparency matching (transparency matching).
[0088] Virtual Distance D: The desired virtual distance is jointly determined by the requester's identity and the content type. For example, when navigating, the driver expects a virtual distance of more than 7.5m to ensure that the AR indicators are aligned with the road, while rear passengers watching videos prefer a virtual distance of 3.5m to 5m for a more immersive experience. The desired virtual distance is used to calculate the virtual distance matching degree (VLD).
[0089] Display size: The content type determines the desired size; for example, videos should be as large as possible, while navigation should be of moderate size to avoid obstructing the view too much. At the same time, the size is limited by the optical performance corresponding to the slider position, and the actual set of available sizes needs to be considered in conjunction with the display size (P).
[0090] Layer priority: Content type and security level jointly determine the basic priority. For example, navigation information always has the highest priority (lowest layer number), video has the lowest priority, and telephone information is in between. This priority directly affects the occlusion relationship when synthesizing driving information.
[0091] The aforementioned expected values are encapsulated as reference points in the optimization objective, used to guide the pruning of the search space (e.g., prioritizing D-level which is close to the expected virtual distance, α-level which is close to the expected transparency), and participate in subsequent matching degree calculations.
[0092] Finally, a constraint optimization algorithm is used to maximize the user experience objective function U while satisfying safety constraints. The specific implementation process is as follows: 1. Define the decision variable as a quadruple x=(P,α,D,s), where P is the target position, α is the target transparency, D is the target virtual distance, and s is the target display size.
[0093] 2. Constraints derived from the current vehicle safety level S_current mapping include: upper limit of transparency, lower limit of virtual distance, and spatial avoidance constraints: the display area must not cover predefined core driving information areas (such as vehicle speed and navigation arrow areas). This constraint is verified through a geometric model: based on position and size, its projected rectangle on the windshield is calculated; if the intersection with the restricted area rectangle is not empty, the combination is invalid. Optical feasibility constraints: for a specific location, the available virtual distance settings and maximum size are given by a pre-calibrated optical parameter table.
[0094] 3. The objective function U(x) employs multi-attribute utility theory, mapping each decision variable to matching degree components and summing them with weights. Each matching degree component is defined as follows: Location matching degree is calculated using a Gaussian function based on the requester's preferred region. Transparency matching degree is determined based on the expected transparency preset for the content type. Virtual distance matching degree is determined based on the expected virtual distance preset for the content type. Area matching degree is determined based on the preset expected display size.
[0095] 4. Considering the limited computing resources of the controller, a depth-first search with pruning can be used to achieve real-time optimization, ensuring that the solution is completed in milliseconds.
[0096] 5.1 Pre-calculated lookup table: In order to improve the efficiency of online queries, the system preprocesses a large number of repetitive calculations during the offline stage and constructs a multi-level lookup table.
[0097] Location-Distance-Size Joint Utility Table: For each possible discrete point of the slide rail position, each available virtual distance level, and each size level, the corresponding basic matching degree component combination is pre-calculated. Since the location matching degree depends only on the requester's identity (i.e., the desired location), and different occupants have only a fixed few types (driver's seat, front passenger seat, left rear seat, right rear seat, etc.), the system constructs a three-dimensional lookup table for each identity. The values stored in the table are the basic utility under that combination (using the same method as the above-mentioned matching degree calculation). This split reduces the amount of pre-calculation while maintaining flexibility.
[0098] No-Cross-Track Collision Pre-Detection Table: For each pair (position, display size), pre-calculate whether its projected area intersects with the core driving information no-crossing zone, and store the result as a Boolean two-dimensional lookup table. During online searches, spatial avoidance constraints can be quickly determined simply by looking up the table, without the need for real-time geometric calculations.
[0099] Optical Capability Quick Index Table: For each location, a list of all virtual distance settings supported by that point and the maximum available size are pre-stored, forming two index tables. These are read directly during traversal, avoiding repeated queries to the optical parameter database.
[0100] 5.2 During the depth-first search process, the system employs a branch-and-bound approach for dynamic pruning to avoid invalid traversals. The specific implementation is as follows: Upper bound estimation: For any partial solution (e.g., location and virtual distance are determined, but transparency and size are not), the system estimates the maximum utility value U that the branch may reach. upper The estimation method is the same as the method for calculating the matching degree mentioned above.
[0101] Pruning condition: Maintain the global optimum U during the traversal process. best Before entering a sub-branch, calculate the corresponding U. best , if U upper Less than or equal to U best If a branch is not found, all subsequent combinations of that branch are skipped, and the search is stopped. This pruning strategy can significantly reduce the search space, especially when the safety level is low and the constraints are strict, as many branches are eliminated prematurely due to insufficient upper bounds.
[0102] Sorting optimization: To improve pruning efficiency, before traversing each position, sort the positions in descending order based on the maximum utility that position can achieve (i.e., the utility of the expected transparency and the maximum size when the position is fixed). This allows U... best Approaching the optimal value quickly in the early stages of the search enhances the effectiveness of subsequent pruning.
[0103] In some embodiments, to overcome the problem of virtual image shifting and jittering in AR-HUD projection caused by vehicle body shaking, turning, and bumping during vehicle operation, the above-mentioned S404 includes the following steps: determining the initial virtual image position corresponding to the content to be displayed based on the target position and target display size of the AR-HUD projection assembly; determining the initial correction parameters of the content to be displayed based on the target position of the AR-HUD projection assembly; correcting the initial correction parameters based on the vehicle's yaw rate and pitch rate to obtain target correction parameters; correcting the initial virtual image position based on the target correction parameters to obtain the target virtual image position of the content to be displayed; and displaying the content to be displayed based on the target virtual image position of the content to be displayed.
[0104] As one possible implementation, the controller calculates the initial virtual image position (3D coordinates) based on the target position and display size of the AR-HUD, combined with the reflection parameters (curvature and reflectivity) of the windshield and the user's three-dimensional eye coordinates, using an optical projection algorithm. Then, based on the target position and a pre-stored position-correction coefficient mapping table, initial correction coefficients are determined to compensate for deviations in the physical position of the AR-HUD. Compensation values are determined from a preset angular velocity-correction compensation value table based on yaw and pitch angular velocities, and these compensation values are used to correct the initial correction parameters, resulting in target correction parameters adapted to the current vehicle posture. The controller substitutes these target correction parameters into the virtual image position algorithm to correct the initial virtual image position. The AR-HUD projection assembly adjusts the focal length and projection angle of the optical lens according to the target virtual image position, projecting the content to the corrected position to ensure that the virtual image seen by the user remains stable in the field of vision, without shifting with the vehicle's movement.
[0105] Therefore, by dynamically correcting the position of the virtual image by fusing the vehicle's yaw rate and pitch rate in real time, the problem of virtual image offset and jitter in AR-HUD projection during vehicle dynamic driving is solved, ensuring that the virtual image can accurately fit the user's field of vision even when the vehicle is turning at high speed or driving over bumpy roads, thus improving display stability and driving safety.
[0106] The above embodiment will be explained with an example below.
[0107] To ensure that the video content projected onto the windshield is precisely aligned with the real road scene at any slider position, the controller integrates a visual processing workflow based on hybrid geometric correction and real-time dynamic compensation, which includes the following sub-steps: 1. Before the vehicle rolls off the production line or during the initial calibration, for each discrete position P_i within the entire travel range of the slide rail (typically in 1mm increments, or using non-uniform sampling depending on the optical system characteristics), the curved surface reflection characteristics of the windshield and the distortion field of the optical system are measured using a high-precision camera and checkerboard projection method. For each position P_i, the system generates a set of basic correction parameters (initial correction parameters), which can be expressed as: Geometric correction grid: A two-dimensional grid (e.g., 32×32 or 64×64) that records the mapping relationship (u,v)=f_i(x,y) of each grid vertex from the original video image coordinates to the coordinates to be projected after pre-distortion.
[0108] Polynomial fitting coefficients: or a low-order polynomial (such as second or third order) is used to fit the distortion model of the entire field of view in order to compress storage space.
[0109] These basic correction parameters are stored in the non-volatile memory of the cockpit domain controller by position index, forming a multi-dimensional lookup table. This table also contains information such as the optical axis offset and field-of-view clipping range corresponding to each position, which are used for subsequent dynamic compensation.
[0110] 2. Pitch and yaw movements during vehicle operation alter the relative pose of the AR-HUD projection assembly with the windshield and road environment, causing a shift between the virtual image and the real scene. To address this, the engine receives yaw and pitch angular velocities from the vehicle bus in real time and obtains the current absolute attitude angle change by integrating or fusing data from the inertial measurement unit. and .
[0111] An extended homography matrix model is used to compensate for attitude changes. The reference projection relationship when the vehicle has no attitude change is assumed to be... Where x is the original image coordinate and x' is the pre-distorted coordinate. The additional transformation introduced by the pose change can be modeled as a homography matrix related to the pose angle. The derivation of this matrix is based on the pinhole camera model and vehicle kinematics. Assuming a known offset exists between the virtual optical center of the HUD projection assembly and the vehicle's rotation center, then: Where K is the intrinsic parameter matrix of the HUD optical system (pre-calibrated), R is the rotation matrix, n is the normal vector of the windshield plane, and d is the distance from the optical center to the glass plane. In actual implementation, to reduce computational complexity, Hpose under different attitude angle combinations can be pre-calculated and a small-scale lookup table can be created, which can then be obtained online through interpolation.
[0112] 3. For the current target position, the engine performs the following steps to generate the final geometric correction mapping: read the basic correction mesh from the multidimensional lookup table, calculate the dynamic compensation matrix Hpose based on the real-time attitude angle, and apply Hpose to transform the coordinates (x, y) of each vertex of the basic mesh to obtain the new mapped coordinates (x', y'), which is the position of the target virtual image.
[0113] In some embodiments, in order to ensure that driving information is displayed first and does not obscure the content to be displayed, the above S404 includes the following steps: according to the target transparency of the content to be displayed, the content to be displayed and the driving information identifier are combined to generate a composite image; the composite image is output to the AR-HUD projection assembly to display the composite image.
[0114] As one possible implementation, driving information labels include: vehicle speed numbers, warning icons, directional indicators, etc. The transparency of this type of information is a fixed value. The controller determines the layer where the driving information labels are located and the layer where the content to be displayed is located. Based on the layers, the content to be displayed and the driving information labels are composited pixel by pixel to obtain a composite image.
[0115] For example, the transparency of the composite image is determined using the formula C_out=α*C_foreground+(1-α)*C_background, and the corrected video image (foreground layer) is composited pixel by pixel with the driving information label (background layer) output from the AR rendering pipeline.
[0116] Therefore, by mixing the transparency of the content to be displayed with the driving information labels, multimedia content and key driving safety information can be presented simultaneously. This ensures that users can view entertainment, communication and other content normally, while also ensuring that driving information such as vehicle speed, warnings, and navigation prompts are always clearly visible and prioritized, effectively improving driving safety and the integrity of the display experience.
[0117] In some embodiments, to ensure a natural, seamless transition at the edges of the display area without obstructing the driver's view, S404 includes the following steps: determining the edge transition weight of each pixel based on its distance from the boundary of the display area; the edge transition weight is used to characterize the degree of transparency gradient at the edges of the display area; the display area is determined based on the target location and the display size of the content to be displayed; the initial transparency of the content to be displayed is weighted by the edge transition weight to obtain the target transparency of the content to be displayed; and the content to be displayed is displayed based on the target transparency of the content to be displayed.
[0118] As one possible implementation, the controller calculates the display area of the virtual image based on the location of the AR-HUD and the target display size of the content to be displayed, and determines the transition zone within the display area. The target transparency of the pixels in the transition zone is equal to the initial transparency × (1 + edge transition weight). The closer the pixel is to the boundary of the display area, the higher the transition weight (the higher the transparency). Based on the target transparency of the content to be displayed, the content is displayed, thereby ensuring that the center of the projected virtual image is clear and the edges gradually become transparent, which ensures that the content is readable and avoids the edges from obscuring the road conditions in front.
[0119] Therefore, by processing the transparency of the display area edges through edge transition weights, the displayed content can achieve a natural and smooth transition of transparency from the center to the edge, avoiding harsh boundaries in the display area. While ensuring that the core content is clearly visible, the edges of the virtual image are softly integrated with the real road conditions, reducing interference with the driver's line of sight and thus improving the visual comfort of the AR-HUD display.
[0120] The above embodiment will be explained with an example below.
[0121] Edge Feathering: To achieve seamless visual integration of video entertainment content with the real driving environment and avoid harsh boundaries that could distract the driver or passengers, the dynamic content adaptation and rendering engine integrates a distance-field-based parametric edge feathering technique during the image compositing stage. The core of this technique is to generate a transparency mask that continuously changes with spatial location, resulting in a soft fading effect at the edges of the displayed area. Specific implementations include: 1. For a given display area, first define its effective display boundary in the image coordinate system. Let the display area be a rectangle or an arbitrary convex polygon (determined by the current display strategy). The shortest Euclidean distance from any pixel p=(x,y) inside the display area to the boundary of the display area is denoted as d(p). Normalized distance t(p): .
[0122] Where, r feather This is the preset feathering radius, in pixels, representing the physical width of the edge fading area. This radius can be dynamically adjusted according to the type of content being displayed and the security level (e.g., 30-50 pixels for video content, 10-20 pixels for navigation information).
[0123] 2. After obtaining the normalized distance t(p), the distance is mapped to the edge transparency weight α of the pixel through a monotonically increasing smooth transition function f(t). edge (p) The engine includes three optional transition functions: a linear gradient function for the simplest and fastest linear transition; a Gaussian smoothing function for a soft bokeh effect similar to a camera lens, resulting in a more natural transition; and a Sigmoid function, where the steepness of the transition curve can be controlled by adjusting the slope parameter, suitable for scenarios that require a balance between smoothness and edge sharpness (such as AR navigation arrows).
[0124] 3. Finally, the transparency is synthesized by combining the aforementioned edge transparency weights with the base display transparency α issued by the security intelligent controller. base (For example, 60%) Perform pixel-by-pixel compositing to obtain the final display transparency α of each pixel. final (p): .
[0125] This formula ensures that within the display area (d(p) is greater than or equal to d(p)r) feather The transparency remains at the set α. base ; at the edge transition zone (0 <d(p)<r feather ), transparency from α baseSmoothly decreases to 0; outside the display area, the transparency is 0, and the content is completely invisible.
[0126] It should be noted that the three implementation methods of S404 described above can be combined with each other or selected according to the scenario. This application does not impose any specific restrictions on this.
[0127] like Figure 8 As shown, the left side is the virtual image projected by AR-HUD without processing the content to be displayed based on the three implementation methods mentioned above, while the right side is the virtual image projected by AR-HUD with the content to be displayed processed based on the three implementation methods mentioned above. It can be seen that in the right image, the content to be displayed is semi-transparent, the road in front is clearly visible, the edge of the image is seamlessly transitioned with the real scene, and the navigation arrow is superimposed on the content to be displayed, which can clearly guide the user.
[0128] like Figure 9 As shown, the process of displaying content to be displayed by the in-vehicle display system includes: (1) Synchronization and fusion of multi-source heterogeneous data. The controller synchronously captures four types of data at a high frequency (e.g., 10ms cycle) through a dedicated data bus: vehicle dynamics (CAN bus signals, such as vehicle speed and yaw rate), autonomous driving status (current functional level and takeover request output by the autonomous driving domain controller), driver status (attention score, gaze direction, and hand position output by the DMS system), and occupant requests (display content requests issued by the HMI interaction system). All data is timestamped and enters a first-in-first-out buffer queue for time alignment, providing a basis for subsequent consistent decisions.
[0129] (2) Dynamic lookup table based on coupled safety baseline (i.e., determining the initial safety score as described above). The controller maintains a dynamic safety baseline matrix. The horizontal axis of this matrix represents the autonomous driving level (L0-L5), and the vertical axis represents the classification of the "dynamic risk index" synthesized based on vehicle speed, road curvature, etc. Each cell is preset with a "basic safety level" (permitted / restricted / prohibited). The controller inputs real-time vehicle dynamic parameters into a pre-trained risk index calculation model, outputs a quantified risk value, and then combines it with the current autonomous driving level to obtain a refined basic safety level in real time through lookup table and interpolation algorithms.
[0130] (3) Driver state correction based on multimodal perception (i.e., the above-mentioned determination of vehicle safety score).
[0131] (4) Security Decision. Determine the "current security level". If it is "prohibited", generate a "disable display" instruction directly and terminate the subsequent process immediately to ensure absolute security under the highest risk.
[0132] (5) Semantic parsing and resource allocation of requests. If the security level is "restricted" or "allowed", then the occupant request is parsed in depth. Not only is the identity of the requester identified (driver / passenger / rear seat), but the request content (such as navigation, video, telephone) is also parsed into specific requirements for display resources, including: the required display size, information update frequency, expected interaction complexity and other structured fields.
[0133] (6) Constraint-based display strategy generation (i.e., the generation of the target display parameter set mentioned above). The current security level is mapped to a security budget (e.g., a low budget corresponds to a restricted level). At the same time, the parsed resource requirements are quantified into costs. The controller has a built-in lightweight optimization algorithm (such as a constrained greedy algorithm) whose goal is to maximize the utility of satisfying user requests without exceeding the security budget (constraints). Through calculation, the globally optimal display strategy is output in real time, including the display area (position and size), visual parameters (brightness, transparency), and interaction permissions.
[0134] (7) Generate an executable arbitration instruction set (i.e., the control instructions issued by the controller mentioned above). Package the above decision results into a structured instruction set, including: instruction type, target display area coordinates, content source ID, and rendering parameters. This instruction set is sent directly to the rendering engine through a high-speed communication interface to drive it to perform pixel-level rendering in the next frame.
[0135] Please see Figure 10 , Figure 10 This is a flowchart illustrating the vehicle display control method disclosed in an embodiment of this application.
[0136] S1001. Obtain the current user location and vehicle safety score within the vehicle.
[0137] Vehicle safety scores are used to characterize the level of risk a vehicle is currently posing.
[0138] S1002. Determine the target display parameter set based on the user's location and vehicle safety score.
[0139] The target display parameter set includes: the target position of the AR-HUD projection assembly, the target transparency of the content to be displayed, the target virtual distance of the AR-HUD projection assembly, and the target display size of the virtual image corresponding to the content to be displayed; the target virtual distance of the AR-HUD projection assembly represents the distance between the virtual image of the content to be displayed after projection and the user.
[0140] S1003. Based on the target display parameter set, display the content to be displayed.
[0141] In one possible embodiment, the vehicle safety score is determined by: acquiring vehicle speed, road curvature, vehicle automation level, and driver attention score; determining an initial safety score based on vehicle speed, road curvature, and vehicle automation level; increasing the initial safety score to obtain a vehicle safety score if the driver attention score is greater than a first threshold; decreasing the initial safety score to obtain a vehicle safety score if the driver attention score is lower than a second threshold; and using the initial safety score as the vehicle safety score if the driver attention score is between the first and second thresholds.
[0142] In one possible embodiment, determining the target display parameter set based on the user's location within the vehicle and the vehicle safety score includes: determining multiple initial display parameter sets based on the user's location within the vehicle and the vehicle safety score; determining the location matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree corresponding to each initial display parameter set; for each initial display parameter set, performing a weighted summation of the location matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree to obtain a comprehensive matching degree for the initial display parameter set; the weights corresponding to the location matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree are determined based on the type of content to be displayed and a preset mapping relationship between the type of content to be displayed and the weights, where the types of content to be displayed include: navigation, video, and telephone; and selecting the initial display parameter set whose comprehensive matching degree satisfies a first preset condition as the target display parameter set; the first preset condition includes: the comprehensive matching degree is greater than a preset matching degree threshold, or the highest N values, where N is a positive integer.
[0143] In one possible embodiment, multiple initial display parameter sets are determined based on the user's position inside the vehicle and the vehicle safety score, including: determining the position range of the AR-HUD projection assembly matching the user's field of vision based on the user's position; determining a candidate display parameter set based on multiple preset positions, multiple virtual distances, multiple transparency levels, and multiple display sizes within the position range; determining virtual distance constraints, transparency constraints, and display size constraints based on the vehicle safety score; and using the candidate display parameter set that satisfies the virtual distance constraints, transparency constraints, and display size constraints as multiple initial display parameter sets.
[0144] In one possible embodiment, a candidate display parameter set is determined based on multiple preset locations, multiple virtual distances, multiple transparency levels, and multiple display sizes within a location range. This includes: generating multiple candidate parameter combinations based on the multiple preset locations and multiple virtual distances; determining a comprehensive score for each candidate parameter combination based on each candidate parameter combination, as well as multiple transparency levels and multiple display sizes; the comprehensive score is used to characterize the comprehensive matching degree corresponding to different transparency levels and different display sizes under the current candidate parameter combination; and determining the candidate display parameter set based on candidate parameter combinations whose comprehensive scores are greater than or equal to a preset comprehensive score, as well as multiple transparency levels and multiple display sizes.
[0145] In one possible embodiment, a candidate display parameter set is determined based on multiple preset locations, multiple virtual distances, multiple transparency levels, and multiple display sizes within a location range. This includes: for each preset location, determining a sorting weight based on the desired transparency level and the maximum display size; the sorting weight is used to characterize the upper limit of the overall matching degree corresponding to the preset location under the desired transparency level and the maximum display size; sorting the multiple preset locations in descending order according to the sorting weight; and determining the candidate display parameter set based on the multiple preset locations, multiple virtual distances, multiple transparency levels, and multiple display sizes according to the descending sorted order.
[0146] In one possible embodiment, displaying content to be displayed based on a target display parameter set includes: determining the initial virtual image position corresponding to the content to be displayed based on the target position and target display size of the AR-HUD projection assembly; determining initial correction parameters for the content to be displayed based on the target position of the AR-HUD projection assembly; correcting the initial correction parameters based on the vehicle's yaw rate and pitch rate to obtain target correction parameters; correcting the initial virtual image position based on the target correction parameters to obtain the target virtual image position of the content to be displayed; and displaying the content to be displayed based on the target virtual image position of the content to be displayed.
[0147] In one possible embodiment, displaying content to be displayed based on a target display parameter set includes: synthesizing the content to be displayed with driving information identifiers according to the target transparency of the content to be displayed to generate a synthesized image; and outputting the synthesized image to an AR-HUD projection assembly to display the synthesized image.
[0148] In one possible embodiment, displaying content to be displayed based on a target display parameter set includes: determining the edge transition weight of each pixel based on the distance from each pixel within the display area to the boundary of the display area; the edge transition weight is used to characterize the degree of transparency gradient at the edge of the display area; the display area is determined based on the target position and the display size of the content to be displayed; the initial transparency of the content to be displayed is weighted with the edge transition weight to obtain the target transparency of the content to be displayed; and the content to be displayed is displayed based on the target transparency of the content to be displayed.
[0149] It should be noted that the implementation process of the above method can be referred to the system implementation method, and will not be repeated here.
[0150] The foregoing mainly describes the solutions provided by the embodiments of this application from a methodological perspective. To achieve the above functions, the vehicle display control device or electronic device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0151] This application embodiment can, based on the above method, exemplarily divide a vehicle display control device or electronic device into functional modules. For example, the vehicle display control device or electronic device may include functional modules corresponding to each functional division, or two or more functions may be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division; in actual implementation, there may be other division methods.
[0152] Please see Figure 11 , Figure 11 This is a schematic diagram of the structure of a vehicle display control device disclosed in an embodiment of this application. The vehicle display control device 1100 includes: an acquisition unit 1101, a determination unit 1102, and a processing unit 1103.
[0153] The acquisition unit 1101 is used to acquire the current user location and vehicle safety score inside the vehicle. The vehicle safety score is used to characterize the risk level of the vehicle's current driving.
[0154] The determining unit 1102 is used to determine a set of target display parameters based on the user's location and vehicle safety score. The set of target display parameters includes: the target position of the AR-HUD projection assembly, the target transparency of the content to be displayed, the target virtual distance of the AR-HUD projection assembly, and the target display size of the virtual image corresponding to the content to be displayed. The target virtual distance of the AR-HUD projection assembly represents the distance between the virtual image of the content to be displayed after projection and the user.
[0155] The processing unit 1103 is used to display the content to be displayed based on the target display parameter set.
[0156] In one possible embodiment, the vehicle safety score is determined by: acquiring vehicle speed, road curvature, vehicle automation level, and driver attention score; determining an initial safety score based on vehicle speed, road curvature, and vehicle automation level; increasing the initial safety score to obtain a vehicle safety score if the driver attention score is greater than a first threshold; decreasing the initial safety score to obtain a vehicle safety score if the driver attention score is lower than a second threshold; and using the initial safety score as the vehicle safety score if the driver attention score is between the first and second thresholds.
[0157] In one possible embodiment, the determining unit 1102 is specifically configured to determine multiple initial display parameter sets based on the user's location within the vehicle and the vehicle safety score; determine the location matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree corresponding to each initial display parameter set; for each initial display parameter set, perform a weighted summation of the location matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree to obtain a comprehensive matching degree for the initial display parameter set; the weights corresponding to the location matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree are determined based on the type of content to be displayed and a preset mapping relationship between the type of content to be displayed and the weights, wherein the types of content to be displayed include: navigation, video, and telephone; and select the initial display parameter set whose comprehensive matching degree satisfies a first preset condition as the target display parameter set; the first preset condition includes: the comprehensive matching degree is greater than a preset matching degree threshold, or the highest N values, where N is a positive integer.
[0158] In one possible embodiment, the determining unit 1102 is specifically configured to: determine the position range of the AR-HUD projection assembly matching the user's field of view based on the user's position; determine a set of candidate display parameters based on multiple preset positions, multiple virtual distances, multiple transparency levels, and multiple display sizes within the position range; determine virtual distance constraints, transparency constraints, and display size constraints based on the vehicle safety score; and use the set of candidate display parameters that satisfy the virtual distance constraints, transparency constraints, and display size constraints as multiple initial display parameter sets.
[0159] In one possible embodiment, the determining unit 1102 is specifically configured to generate multiple candidate parameter combinations based on multiple preset positions and multiple virtual distances; determine a comprehensive score for each candidate parameter combination based on each candidate parameter combination, as well as multiple transparency levels and multiple display sizes; the comprehensive score is used to characterize the comprehensive matching degree corresponding to different transparency levels and different display sizes under the current candidate parameter combination; and determine a candidate display parameter set based on candidate parameter combinations whose comprehensive scores are greater than or equal to preset comprehensive scores, as well as multiple transparency levels and multiple display sizes.
[0160] In one possible embodiment, the determining unit 1102 is specifically used to determine a sorting weight for each preset position based on the desired transparency and the maximum display size; the sorting weight is used to characterize the upper limit of the comprehensive matching degree corresponding to the preset position under the conditions of desired transparency and maximum display size; sort the multiple preset positions in descending order according to the sorting weight; and determine a set of candidate display parameters based on the multiple preset positions, multiple virtual distances, multiple transparency and multiple display sizes according to the order after descending sort.
[0161] In one possible embodiment, the processing unit 1103 is specifically configured to: determine the initial virtual image position corresponding to the content to be displayed based on the target position and target display size of the AR-HUD projection assembly; determine the initial correction parameters of the content to be displayed based on the target position of the AR-HUD projection assembly; correct the initial correction parameters based on the yaw rate and pitch rate of the vehicle to obtain target correction parameters; correct the initial virtual image position based on the target correction parameters to obtain the target virtual image position of the content to be displayed; and display the content to be displayed based on the target virtual image position of the content to be displayed.
[0162] In one possible embodiment, the processing unit 1103 is specifically configured to synthesize the content to be displayed with the driving information identifier according to the target transparency of the content to be displayed, and generate a synthesized image; and output the synthesized image to the AR-HUD projection assembly to display the synthesized image.
[0163] In one possible embodiment, the processing unit 1103 is specifically configured to determine the edge transition weight of each pixel based on the distance from each pixel within the display area to the boundary of the display area; the edge transition weight is used to characterize the degree of transparency gradient at the edge of the display area; the display area is determined based on the target position and the display size of the content to be displayed; the initial transparency of the content to be displayed and the edge transition weight are weighted to obtain the target transparency of the content to be displayed; and the content to be displayed is displayed based on the target transparency of the content to be displayed.
[0164] Please see Figure 12The electronic device 1200 provided in this application embodiment includes, but is not limited to, a processor 1201 and a memory 1202.
[0165] The memory 1202 described above is used to store the executable instructions of the processor 1201. It is understood that the processor 1201 is configured to execute instructions to implement the vehicle display control method in the above embodiments.
[0166] It should be noted that those skilled in the art will understand that Figure 12 The electronic device structure shown does not constitute a limitation on electronic device 1200; electronic devices may include, but are not limited to, other types of electronic devices. Figure 12 This may indicate more or fewer components, or combinations of certain components, or different component arrangements.
[0167] Processor 1201 is the control center of electronic device 1200. It connects various parts of the electronic device via various interfaces and lines. By running or executing software programs and / or modules stored in memory 1202, and by calling data stored in memory 1202, it performs various functions and processes data of electronic device 1200, thereby providing overall monitoring of electronic device 1200. Processor 1201 may include one or more processing units. Optionally, processor 1201 may integrate an application processor and a modem processor. The application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into processor 1201.
[0168] The memory 1202 can be used to store software programs and various data. The memory 1202 may primarily include a program storage area and a data storage area. The program storage area may store the operating system, application programs required by at least one functional module (such as a determination unit, processing unit, etc.), etc. Furthermore, the memory 1202 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.
[0169] In an exemplary embodiment, a vehicle is also provided, including the aforementioned in-vehicle display system and electronic device.
[0170] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 1202 including instructions, which can be executed by a processor 1201 of an electronic device 1200 to implement the methods in the above embodiments.
[0171] In actual implementation, Figure 11 The functions of each module can be provided by Figure 12The processor 1201 calls the computer program stored in the memory 1202 to implement the process. The specific execution process can be found in the method section of the previous embodiment, and will not be repeated here.
[0172] Optionally, the computer-readable storage medium may be a non-transitory computer-readable storage medium, such as a read-only memory (ROM), random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device.
[0173] In an exemplary embodiment, this application also provides a computer program product including one or more instructions, which can be executed by the processor 1201 of the electronic device 1200 to perform the methods described above.
[0174] It should be noted that when one or more instructions in the computer-readable storage medium or computer program product are executed by the processor of an electronic device, they implement the various processes of the above method embodiments and achieve the same technical effect as the above method. To avoid repetition, they will not be described again here.
[0175] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0176] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0177] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0178] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0179] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.
[0180] It should be understood that the application of this application is not limited to the examples above. Those skilled in the art can make improvements or modifications based on the above description, and all such improvements and modifications should fall within the protection scope of the appended claims. Those skilled in the art can understand that implementing all or part of the processes of the above embodiments and making equivalent changes according to the claims of this application still fall within the scope of this application.
Claims
1. A vehicle-mounted display system, characterized in that, The system includes: an AR-HUD projection assembly, a driving device, and a controller; the driving device is used to adjust the pose of the AR-HUD projection assembly. The controller is configured to: Obtain the current user location and vehicle safety score within the vehicle, whereby the vehicle safety score characterizes the risk level of the vehicle's current driving. Based on the user's location and the vehicle safety score, a set of target display parameters is determined; the set of target display parameters includes: the target position of the AR-HUD projection assembly, the target transparency of the content to be displayed, the target virtual distance, and the target display size of the virtual image corresponding to the content to be displayed; the target virtual distance represents the distance between the virtual image of the content to be displayed after being projected by the AR-HUD projection assembly and the user; The drive device is controlled to move the AR-HUD projection assembly to the target position; The AR-HUD projection assembly is controlled to display the content to be displayed based on the target transparency, the target virtual distance, and the target display size.
2. The system according to claim 1, characterized in that, The vehicle safety score is determined in the following ways: Acquire vehicle speed, road curvature, vehicle autonomous driving level, and driver attention score; An initial safety score is determined based on the vehicle speed, the road curvature, and the degree of autonomous driving of the vehicle. If the driver attention score is greater than a first threshold, the initial safety score is increased to obtain the vehicle safety score; If the driver attention score is lower than the second threshold, the initial safety score is reduced to obtain the vehicle safety score. If the driver attention score is between the first threshold and the second threshold, the initial safety score is used as the vehicle safety score.
3. The system according to claim 1, characterized in that, The step of determining the target display parameter set based on the user's location inside the vehicle and the vehicle safety score includes: Based on the user's location inside the vehicle and the vehicle safety score, determine multiple initial display parameter sets; Determine the position matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree for each of the initial display parameter sets; For each set of initial display parameters, the position matching degree, the transparency matching degree, the virtual distance matching degree, and the display size matching degree are weighted and summed to obtain the comprehensive matching degree of the initial display parameter set. The weights corresponding to the position matching degree, transparency matching degree, virtual distance matching degree, and display size matching degree are determined according to the type of the content to be displayed and the preset mapping relationship between the type of the content to be displayed and the weight. The types of the content to be displayed include: navigation, video, and telephone. The initial set of display parameters whose overall matching degree satisfies the first preset condition is taken as the target set of display parameters; the first preset condition includes: the overall matching degree is greater than the preset matching degree threshold, or the highest N, where N is a positive integer.
4. The system according to claim 3, characterized in that, The method determines multiple initial display parameter sets based on the user's location inside the vehicle and the vehicle safety score, including: Based on the user's location, determine the position range of the AR-HUD projection assembly that matches the user's field of view; Based on multiple preset positions, multiple virtual distances, multiple transparency levels, and multiple display sizes within the specified location range, a set of candidate display parameters is determined; Based on the vehicle safety score, determine the virtual distance constraints, transparency constraints, and display size constraints; The set of candidate display parameters that satisfy the virtual distance constraint, transparency constraint, and display size constraint will be used as the set of multiple initial display parameters.
5. The system according to claim 4, characterized in that, The process of determining a set of candidate display parameters based on multiple preset positions, multiple virtual distances, multiple transparency levels, and multiple display sizes within the specified location range includes: Multiple candidate parameter combinations are generated based on the multiple preset locations and the multiple virtual distances; Based on each of the candidate parameter combinations, as well as the plurality of transparency levels and the plurality of display sizes, a comprehensive score is determined for each candidate parameter combination; the comprehensive score is used to characterize the overall matching degree corresponding to different transparency levels and different display sizes under the current candidate parameter combination. The candidate display parameter set is determined based on the candidate parameter combinations whose comprehensive score is greater than or equal to a preset comprehensive score, as well as the multiple transparency levels and the multiple display sizes.
6. The system according to claim 4, characterized in that, The process of determining a set of candidate display parameters based on multiple preset positions, multiple virtual distances, multiple transparency levels, and multiple display sizes within the specified location range includes: For each of the preset positions, a sorting weight is determined based on the desired transparency and the maximum display size; the sorting weight is used to characterize the upper limit of the overall matching degree corresponding to the preset position under the conditions of the desired transparency and the maximum display size; The plurality of preset positions are sorted in descending order according to the sorting weight; Based on the multiple preset positions, multiple virtual distances, multiple transparency levels, and multiple display sizes, a set of candidate display parameters is determined according to the descending order.
7. The system according to claim 1, characterized in that, The control of the AR-HUD projection assembly to display the content to be displayed based on the target transparency, the target virtual distance, and the target display size includes: Based on the target position of the AR-HUD projection assembly and the target display size, determine the initial virtual image position corresponding to the content to be displayed; Based on the target position of the AR-HUD projection assembly, the initial correction parameters of the content to be displayed are determined; Based on the vehicle's yaw rate and pitch rate, the initial correction parameters are corrected to obtain the target correction parameters; The initial virtual image position is corrected based on the target correction parameters to obtain the target virtual image position of the content to be displayed; Based on the target virtual image position of the content to be displayed, the content to be displayed is displayed.
8. The system according to claim 1, characterized in that, The control of the AR-HUD projection assembly to display the content to be displayed based on the target transparency, the target virtual distance, and the target display size includes: Based on the target transparency of the content to be displayed, the content to be displayed is combined with the driving information identifier to generate a composite image; The synthesized image is output to the AR-HUD projection assembly to display the synthesized image.
9. The system according to claim 1, characterized in that, The control of the AR-HUD projection assembly to display the content to be displayed based on the target transparency, the target virtual distance, and the target display size includes: The edge transition weight of each pixel is determined based on the distance from each pixel within the display area to the boundary of the display area; the edge transition weight is used to characterize the degree of transparency gradient at the edge of the display area; the display area is determined based on the target position and the display size of the content to be displayed. The initial transparency of the content to be displayed and the edge transition weight are weighted to obtain the target transparency of the content to be displayed; The content to be displayed is shown based on the target transparency of the content to be displayed.
10. A vehicle display control method, characterized in that, The method includes: Obtain the current user location and vehicle safety score within the vehicle, whereby the vehicle safety score characterizes the risk level of the vehicle's current driving. Based on the user's location and the vehicle safety score, a set of target display parameters is determined; the set of target display parameters includes: the target position of the AR-HUD projection assembly, the target transparency of the content to be displayed, the target virtual distance of the AR-HUD projection assembly, and the target display size of the virtual image corresponding to the content to be displayed; the target virtual distance of the AR-HUD projection assembly represents the distance between the virtual image of the content to be displayed after projection and the user. Based on the target display parameter set, the content to be displayed is shown.
11. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the method as described in claim 10.
12. A vehicle, characterized in that, include: The vehicle display system as described in any one of claims 1-9, and / or the electronic device as described in claim 11.