Vehicle display control method and device
By receiving user adjustments and dynamically adjusting ARHUD display parameters using vehicle driving status data, the problem of fixed display content in the ARHUD system has been solved, improving the matching degree and accuracy of information with driving scenarios.
Patent Information
- Application Number
- CN202510109035.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-23
- Publication Date
- 2025-10-31
- Estimated Expiration
- 2045-01-23
AI Technical Summary
The content displayed by existing ARHUD systems is relatively fixed, resulting in low matching degree and accuracy of information with actual driving scenarios.
By receiving the user's ARHUD adjustment commands and combining the vehicle's driving status data with the initial adjustment parameters, the display parameters of the ARHUD information are dynamically adjusted to match the user's needs and actual driving conditions.
It improves the matching degree and display accuracy of ARHUD information with actual driving scenarios, meeting users' visual needs in different scenarios.
Smart Images

Figure CN119928558B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of vehicle technology, and in particular to a display control method and apparatus for a vehicle. Background Technology
[0002] Augmented Reality Head-Up Display (ARHUD) is a vehicle display technology that combines augmented reality (AR) technology with a head-up display (HUD) system, and it is gradually becoming one of the important features of smart cars.
[0003] In related technologies, a vehicle's ARHUD system mainly consists of an AR algorithm unit, a microdisplay, and a windshield. The AR algorithm unit determines a display model based on vehicle information, and this display model includes various display content to be presented on the windshield. The AR algorithm unit sends the display model to the microdisplay, which generates corresponding light information based on the display model and then projects the light information onto the windshield to obtain ARHUD information.
[0004] However, the content displayed by ARHUD information in related technologies is relatively fixed and has low display flexibility, resulting in a low degree of matching between ARHUD information and actual driving scenarios, and low display accuracy of ARHUD information. Summary of the Invention
[0005] This application provides a display control method and apparatus for a vehicle, the technical solution of which is as follows:
[0006] On one hand, a display control method for a vehicle is provided, the method comprising:
[0007] The augmented reality head-up display (ARHUD) information of the vehicle is displayed. The ARHUD information is used to indicate vehicle prompt information that is integrated with the physical environment in which the vehicle is currently located. The ARHUD information corresponds to a first display parameter, which is used to characterize the first visual effect of the ARHUD information.
[0008] Receive an ARHUD adjustment operation on the ARHUD information, the ARHUD adjustment operation being used to adjust the visual effect of the ARHUD information;
[0009] The first adjustment parameter is obtained based on the ARHUD adjustment operation;
[0010] Based on the current driving status data of the vehicle and the first adjustment parameter, the first display parameter is adjusted to obtain the second display parameter corresponding to the ARHUD information. The second display parameter is used to characterize the second visual effect of the ARHUD information.
[0011] The ARHUD information of the vehicle is updated and displayed based on the second display parameter.
[0012] On the other hand, a display control device for a vehicle is provided, the device comprising:
[0013] The display module is used to display augmented reality head-up display (ARHUD) information of the vehicle, wherein the ARHUD information is used to indicate vehicle prompt information that is integrated with the physical environment in which the vehicle is currently located; the ARHUD information corresponds to a first display parameter, wherein the first display parameter is used to characterize the first visual effect of the ARHUD information.
[0014] The input module is used to receive ARHUD adjustment operations on the ARHUD information, wherein the ARHUD adjustment operations are used to adjust the visual effect of the ARHUD information;
[0015] The control module is used to obtain the first adjustment parameter based on the ARHUD adjustment operation;
[0016] The control module is further configured to adjust the first display parameter based on the current driving status data of the vehicle and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information. The second display parameter is used to characterize the second visual effect of the ARHUD information.
[0017] The display module is also used to update the ARHUD information of the vehicle based on the second display parameters.
[0018] On the other hand, a computer device is provided, the computer device including a processor and a memory, the memory storing at least one instruction, at least one program, code set or instruction set, the at least one instruction, the at least one program, the code set or instruction set being loaded and executed by the processor to implement the vehicle display control method described above.
[0019] On the other hand, a computer-readable storage medium is provided, wherein at least one instruction, at least one program, code set, or instruction set is stored therein, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the vehicle display control method described above.
[0020] On the other hand, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform any of the above-described vehicle display control methods.
[0021] The beneficial effects of the technical solutions provided in this application include at least the following:
[0022] By receiving user adjustments to ARHUD information, a first adjustment parameter is obtained. The display parameters corresponding to the ARHUD information are then adjusted based on driving status data and the first adjustment parameter to optimize the visual effect of the ARHUD information. Driving status data reflects the real-time driving status of the vehicle. Adjusting the display parameters based on this data makes the ARHUD information more closely match the actual driving conditions. The ARHUD adjustment operation reflects the user's display needs. Adjusting the display parameters based on this operation ensures that the ARHUD information meets the user's visual and actual driving needs in different scenarios. This achieves dynamic adjustment of the ARHUD information, ensuring that the adjusted information matches the actual driving conditions and user needs, thus improving the matching degree between the ARHUD information and the actual driving scenario and ultimately enhancing the display accuracy of the ARHUD information. Attached Figure Description
[0023] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0024] Figure 1 This is a schematic diagram of a computer system provided in an exemplary embodiment of this application;
[0025] Figure 2 This is a flowchart of a vehicle display control method provided in another exemplary embodiment of this application;
[0026] Figure 3 This is a schematic diagram of an ARHUD adjustment operation provided in an exemplary embodiment of this application;
[0027] Figure 4 This is a flowchart of a vehicle display control method provided in another exemplary embodiment of this application;
[0028] Figure 5This is a structural block diagram of a vehicle display control device provided in an exemplary embodiment of this application;
[0029] Figure 6 This is a structural block diagram of a computer system provided in an exemplary embodiment of this application. Detailed Implementation
[0030] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0031] In this application, the terms "first" and "second" are used to distinguish between identical or similar items that have essentially the same function. It should be understood that there is no logical or temporal dependency between "first" and "second", nor is there any limitation on the quantity or execution order.
[0032] It should be noted that all information (including but not limited to driving status data, driving environment data, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application are authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the framework data involved in this application was obtained with full authorization.
[0033] Figure 1 A structural block diagram of a computer system 100 provided in an exemplary embodiment of this application is shown. The computer system 100 can implement a system architecture for a display control method for a vehicle. The computer system 100 includes a vehicle 110.
[0034] Vehicle 110 includes at least one of the following: gasoline vehicle, electric vehicle, hybrid vehicle (a combination of gasoline vehicle and electric vehicle), fuel cell vehicle, solar vehicle, etc., but this application embodiment does not limit this.
[0035] In some embodiments, the computer system 100 further includes a terminal 120. The terminal 120 includes, but is not limited to, vehicle terminals, mobile phones, computers, intelligent voice interaction devices, smart home appliances, aircraft, etc.
[0036] Optionally, terminal 120 is implemented as a mobile control terminal for vehicle 110. Terminal 120 can control vehicle 110 to perform target operations (e.g., parking, closing windows, starting, etc.). Illustratively, a client application with a target application is installed and running on terminal 120. This target application includes at least one of vehicle control applications, instant messaging applications, navigation applications (e.g., map applications), etc., which have vehicle control functions. This application does not limit the specific form of the target application. Furthermore, this application does not limit the form of the target application, including but not limited to Apps (Applications), mini-programs, etc., installed on terminal 120, and it can also be in web page form.
[0037] Optionally, the vehicle 110 and the terminal 120 communicate via a wireless network (such as 4G / 5G, Wi-Fi, etc.) or a wired connection (such as USB, Bluetooth, etc.).
[0038] In some embodiments, the computer system 100 further includes a server 130, which may be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. Optionally, the server 130 may also be implemented as a node in a blockchain system.
[0039] In illustrative terms, if server 130 is implemented as a cloud server, the vehicle 110 and server 130 communicate via a wireless network, and the terminal 120 and server 130 communicate via a wireless network.
[0040] Optionally, the vehicle display control method provided in this application embodiment can be executed by vehicle 110; or, executed interactively by vehicle 110 and terminal 120; or, executed interactively by vehicle 110 and server 130; or, executed interactively by vehicle 110, terminal 120 and server 130. This application embodiment does not limit this. The following description uses vehicle 110 executing the vehicle display control method as an example.
[0041] Vehicle 110 includes an Augmented Reality Head-Up Display (ARHUD) system. Illustratively, the ARHUD system consists of the following modules:
[0042] 1. Input Module: The input module is used to receive ARHUD adjustment operations from users.
[0043] Indicatively, the hardware for implementing the input module in vehicle 110 includes at least one of the following devices: (1) Physical buttons: Dedicated buttons can be set on the steering wheel, center console, etc. of the vehicle for direct operation by the user. These buttons can be mechanical buttons that generate electrical signals by pressing, or touch-sensitive buttons that use the principle of capacitive sensing to detect the user's touch action. (2) Voice input device: A microphone is provided in the vehicle to receive the user's voice commands as ARHUD adjustment operations through voice recognition technology. (3) Touch screen: Relevant virtual buttons or gesture operation areas are set on the vehicle's center console display screen or other dedicated interactive screens. Users can perform ARHUD adjustment operations by touching the icons on the screen or using specific gestures (such as swiping, zooming, etc.). The touch screen senses the user's operation through a touch sensor. (4) Camera: A camera is installed in the vehicle. The camera can collect the user's specific hand movements and perform ARHUD adjustment operations based on the specific hand movements.
[0044] 2. Control Module: The control module is used to parse ARHUD adjustment operations and generate corresponding adjustment signals.
[0045] Schematic illustration: The control module can be implemented as at least one of the following in vehicle 110: microcontroller unit (MCU), central processing unit (CPU), programmable logic device (PLD), field-programmable gate array (FPGA), etc., without limitation. The control module includes an AR algorithm unit.
[0046] 3. Display Module: The display module is used to determine the display parameters based on the adjustment signal, and to display the ARHUD screen based on the display parameters.
[0047] Indicatively, the hardware for implementing the display module in vehicle 110 includes at least one of the following devices: (1) Projection unit: The projection unit includes a light source, a microdisplay, an optical system, etc., wherein the microdisplay can be implemented as at least one of a Liquid Crystal Display (LCD), a Digital Micromirror Device (DMD), etc., and the optical system includes at least one of a Collimating Lens, a Free-form Mirror, etc. (2) Windshield: In order to realize the ARHUD function, the windshield needs to undergo special optical coating treatment, which can enhance the reflection and refraction performance of the glass on the projected light. At the same time, the coating can also play an anti-reflection role, reduce the reflection of light inside the vehicle on the windshield, avoid the obstruction of the driver's line of sight by reflected light, and ensure that the driver can clearly see the ARHUD information projected on the windshield and the actual road conditions outside the vehicle. In some embodiments, in addition to using the windshield as the projection medium, a composite glass method is also used. The composite glass is a separate transparent optical element located in front of the driver's line of sight and can be fixed inside the vehicle by a special mounting bracket.
[0048] 4. Storage Module: The storage module is used to store the adjustment parameters corresponding to the user's ARHUD adjustment operations.
[0049] As an illustration, the storage module can be implemented as flash memory, solid-state drive, etc. in vehicle 110, without limitation here.
[0050] 5. Communication module (or acquisition module): The communication module is used to acquire the vehicle's driving status data and to feed the driving status data back to the control module.
[0051] Schematic, the hardware implementing the communication module in vehicle 110 includes at least one of the following devices: (1) On-board sensors: used to acquire vehicle driving status data. (2) Controller Area Network Bus Interface (CAN): various electronic devices and sensors inside the vehicle typically communicate via the CAN bus. The communication module receives driving status data from the on-board sensors via the CAN bus interface and feeds this data back to the control module.
[0052] In vehicle 110, after the input module receives an ARHUD adjustment operation on the ARHUD screen, the input module sends the ARHUD adjustment operation to the control module. The control module parses the ARHUD adjustment operation to obtain the first adjustment parameters, such as the brightness, contrast, and color adjustment parameters of the ARHUD information. The communication module sends the driving status data of vehicle 110 to the control module in real time. The control module determines the adjustment signal for the current ARHUD information based on the driving status data and the first adjustment parameters, and then sends the adjustment signal to the display module. The display module adjusts the ARHUD information according to the adjustment signal and displays the adjusted ARHUD information.
[0053] The display control method for vehicles provided in the embodiments of this application will be described below.
[0054] Based on the above introduction, Figure 2 This is a flowchart of a vehicle display control method provided in an embodiment of this application, which is applied to, for example... Figure 1 Taking vehicle 110 as an example, the method is described in steps 210 to 250 below.
[0055] Step 210: Display the vehicle's augmented reality head-up display (ARHUD) information.
[0056] ARHUD information is used to indicate vehicle prompts that are integrated with the vehicle's current physical environment. Illustratively, Augmented Reality Head-Up Display (ARHUD) is a vehicle display technology that projects vehicle prompts onto the vehicle's windshield in an augmented reality manner, helping the driver obtain information more intuitively and reducing distraction.
[0057] Optionally, the ARHUD information display content includes at least one of the following: (1) Vehicle status information, such as vehicle speed, engine speed, mileage, fuel / battery level, driving range, tire pressure monitoring, etc. (2) Navigation information, such as turn signals, driving mileage, speed limit reminders, dynamic navigation arrows, waypoint prompts, destination information, etc. (3) Lane information, such as lane departure warnings, lane keeping assist, etc. (4) Pedestrian and obstacle warnings, monitoring pedestrians or obstacles in complex environments (such as multiple intersections, night driving), and reminding the driver to pay attention through AR markers. (5) Traffic signal and safety warnings, such as red light warnings, speed limit warnings, forward collision warnings, distance information prompts, road hazard warnings, etc. It should be noted that the above examples of ARHUD information display content are only illustrative and this application embodiment does not limit them. The following mainly uses dynamic navigation arrows as an example for explanation.
[0058] ARHUD information corresponds to a first display parameter, which characterizes the initial visual effect of the ARHUD information. This first display parameter includes at least one of the following: brightness display parameter, contrast display parameter, color display parameter, position display parameter, and size display parameter. The brightness display parameter indicates the display brightness of the ARHUD information; the contrast display parameter indicates the display contrast of the ARHUD information; the color display parameter indicates the display color of the ARHUD information; the position display parameter indicates the display position of the ARHUD information; and the size display parameter indicates the display size of the ARHUD information.
[0059] Step 220: Receive ARHUD adjustment operation for ARHUD information.
[0060] The ARHUD adjustment operation is used to adjust the visual effect of ARHUD information.
[0061] Optionally, the ARHUD adjustment operation includes at least one of brightness adjustment operation, contrast adjustment operation, and color adjustment operation; wherein, the brightness adjustment parameter is used to adjust the display brightness of the ARHUD information, the contrast adjustment parameter is used to adjust the display contrast of the ARHUD information, and the color adjustment parameter is used to adjust the display color of the ARHUD information.
[0062] In some embodiments, an ARHUD interface is displayed, which includes a brightness adjustment area, a contrast adjustment area, and a color adjustment area, wherein the brightness adjustment area is used to receive brightness adjustment operations, the contrast adjustment area is used to receive contrast adjustment operations, and the color adjustment area is used to receive color adjustment operations.
[0063] This illustration demonstrates how to adjust the ARHUD via the terminal screen: A horizontal or vertical brightness adjustment bar is set up on the ARHUD interface as the brightness adjustment area. The driver can adjust the brightness by long-pressing the corresponding position on the brightness adjustment bar on the screen and then sliding their finger left / right (horizontal bar) or up / down (vertical bar). For example, sliding the finger to the right gradually increases the brightness; sliding the finger to the left gradually decreases the brightness; the current brightness value or progress indicator will be displayed on the adjustment bar in real time. Similar to the brightness adjustment area, a contrast adjustment bar is also used as the contrast adjustment area. The contrast adjustment bar can be displayed side-by-side with the brightness adjustment bar for easy driver operation. The driver long-presses the adjustment bar and slides it, such as sliding upwards to increase contrast and sliding downwards to decrease contrast; simultaneously, the contrast change value or level indicator is displayed in real time near the contrast adjustment area. Design a color selection panel as the color adjustment area. The panel can display a variety of preset color options in the form of circular or square color blocks, such as the common red, green, blue, and yellow. The driver can click on the color block they want to select to complete the color adjustment operation and make the ARHUD information display the selected color. In addition, a "Custom" button can be set. Clicking it will bring up a more detailed color adjustment interface, allowing users to customize the color by sliding the color slider or entering RGB values.
[0064] Alternatively, ARHUD adjustments can be performed via the in-car voice interaction system: When the driver speaks a specific command, such as "increase ARHUD brightness," the system automatically recognizes and executes the corresponding brightness adjustment. The system can then provide voice feedback to the driver regarding the current brightness adjustment, such as "Brightness has been increased; current brightness is 80%." When the driver speaks a voice command such as "Reduce ARHUD contrast to 50%," the voice interaction system recognizes the command, adjusts the contrast of the ARHUD information, and provides voice feedback on the result, such as "Contrast has been reduced to 50%." Finally, when the driver uses a voice command such as "Change ARHUD color to green," the voice interaction system recognizes the command, changes the displayed color of the ARHUD information, and responds, "Color has been switched to green."
[0065] Alternatively, in-vehicle gesture recognition cameras can be used to adjust the ARHUD: when the driver makes an upward or downward gesture in a specific recognition area (such as above the steering wheel), the system recognizes it as an adjustment to increase or decrease brightness. For example, waving the palm upward increases brightness, and waving the palm downward decreases brightness; the system determines the magnitude of the brightness adjustment based on the amplitude of the gesture and displays a progress bar showing the brightness change on the ARHUD interface. A specific gesture can be set, such as clenching a fist and then releasing it to increase contrast, and releasing and then clenching the fist to decrease contrast; when the driver makes the corresponding gesture in the recognition area, the system recognizes and adjusts the contrast, displaying the contrast change in real time on the ARHUD interface. Colors can be selected using specific finger pointing or rotating gestures; for example, the driver extends their index finger to a pre-defined color marker area on the ARHUD interface (different color markers correspond to different color options), and then rotates their wrist clockwise or counterclockwise; the system recognizes this and switches to the corresponding color. This method combines pointing and rotating actions, allowing for both color selection and fine-tuning between similar colors through rotation.
[0066] Step 230: Obtain the first adjustment parameter based on the ARHUD adjustment operation.
[0067] Taking ARHUD adjustment operations, which include brightness adjustment, contrast adjustment, and color adjustment operations, as an example: the brightness adjustment parameters, contrast adjustment parameters, and color adjustment parameters are obtained based on the ARHUD adjustment operations as the first adjustment parameters.
[0068] For illustrative purposes, if the ARHUD adjustment operation instructs the brightness to be adjusted to "80%", then "80%" is the brightness adjustment parameter; or, if the ARHUD adjustment operation instructs the brightness to be increased by "20%", then "+20%" is also the brightness adjustment parameter. In this embodiment, the brightness adjustment amount obtained from the brightness adjustment operation is used as the brightness adjustment parameter (if the ARHUD adjustment operation instructs the brightness to be increased by "20%", then "+20%" is the brightness adjustment parameter), the contrast adjustment amount obtained from the contrast adjustment operation is used as the contrast adjustment parameter, and the color adjustment amount obtained from the color adjustment operation is used as the color adjustment parameter.
[0069] In some embodiments, the method for obtaining the first adjustment parameter based on the ARHUD adjustment operation further includes the following steps:
[0070] Step 1 Based on the ARHUD adjustment operation, brightness adjustment parameters, contrast adjustment parameters, and color adjustment parameters are obtained.
[0071] The parameter acquisition method described in step 1 can be referred to the description of acquiring the first adjustment parameter above, and will not be repeated here. For example, if the ARHUD adjustment operation indicates that the brightness is increased by "20%", then "+20%" is also the brightness adjustment parameter.
[0072] The acquired brightness, contrast, and color adjustment parameters can be stored in the system's memory or database for use in subsequent steps. Simple data structures, such as variables or objects, can be used to store these parameters, ensuring easy access and modification throughout the adjustment process.
[0073] Step 2 The system acquires facial image data of the driver in the vehicle; analyzes the facial image data, determines the analysis results, and uses the analysis results to indicate whether the driver is wearing glasses.
[0074] In a schematic manner, an in-vehicle camera captures images of the driver's face at a preset frame rate (e.g., 15 frames per second), obtaining facial image data. This facial image data is then input into a trained recognition model (e.g., a model based on a convolutional neural network). The recognition model first identifies the precise facial regions within the facial image data, and then identifies the bounding boxes containing the driver's facial regions. After obtaining the bounding boxes, the recognition model further analyzes the image regions within the bounding boxes, such as identifying the eye region within the bounding box, and then extracting the corresponding regional feature representations. The analysis result is obtained by analyzing the regional features corresponding to the eye region. The analysis result can be implemented as a probability distribution, such as [0.2, 0.8], where 0.2 represents the probability of not wearing glasses is 0.2, and 0.8 represents the probability of wearing glasses is 0.8. The analysis result indicates that the driver is wearing glasses. In some embodiments, the analysis results are also used to indicate the type of glasses worn by the driver, such as contact lenses, sunglasses, clear lens glasses, etc., as shown in [0.2, 0.3, 0.7, 0.9], where 0.2 represents a probability of not wearing glasses of 0.2, 0.3 represents a probability of wearing contact lenses of 0.3, 0.7 represents a probability of wearing sunglasses of 0.7, and 0.9 represents a probability of wearing clear lens glasses of 0.9. The analysis result then indicates that the driver is wearing clear lens glasses. For contact lenses, the recognition model can analyze the color and reflective characteristics of the eyes and compare them with a feature database of normal eyes. If abnormal reflections or color changes occur, it can be inferred that contact lenses are being worn.
[0075] Optionally, the acquired facial image data can be preprocessed, including image denoising and normalization. For example, a Gaussian filtering algorithm can be used to remove noise from the image, improving image quality. The preprocessed facial image can then be input into the recognition model, making it easier for the subsequent recognition model to process. Optionally, the aforementioned recognition model needs to be trained in advance on a large facial image dataset, which includes different glasses wearing conditions, different lighting conditions, and facial expressions.
[0076] Step 3 When the analysis results indicate that the driver should wear glasses, the system determines brightness compensation data, contrast compensation data, and color compensation data based on the ambient light data of the vehicle's current physical environment. The brightness adjustment parameters are then adjusted based on the brightness compensation data; the contrast adjustment parameters are adjusted based on the contrast compensation data; and the color adjustment parameters are adjusted based on the color compensation data.
[0077] To illustrate, a vehicle is equipped with multiple ambient light sensors distributed at different locations (such as the windshield and roof) to measure the light intensity from different directions. The data from multiple sensors are weighted and averaged to obtain the overall ambient light intensity at which the vehicle is currently located. For example, different weights are assigned to sensors based on their importance; for instance, the windshield sensor has a weight of 0.6, and the roof sensor has a weight of 0.4. The calculation formula is: Overall Light Intensity = Windshield Sensor Data × 0.6 + Roof Sensor Data × 0.4.
[0078] The following is an illustrative explanation of the methods for determining various types of compensation data:
[0079] (1) Brightness compensation data:
[0080] When a driver wears glasses, the system calculates compensation based on light intensity. For example, if the analysis shows the driver is wearing dark-tinted sunglasses in a bright environment, the system adds an extra 30% brightness compensation according to a predefined rule. The original brightness adjustment parameter multiplied by 1.3 yields the compensated brightness adjustment parameter. For clear-tinted glasses in low-light environments, the system adds 10% brightness compensation according to a predefined rule. The original brightness adjustment parameter multiplied by 1.1 yields the compensated brightness adjustment parameter. For contact lenses, the calculation is based on the lens's transmittance characteristics and light intensity. For example, for contact lenses with 80% transmittance in a medium-light environment, a 15% brightness compensation is needed. The compensated brightness adjustment parameter would be: Original brightness adjustment parameter × (1 + 15% × (1 - transmittance)).
[0081] (2) Contrast compensation data:
[0082] Considering that glasses can affect the perceived contrast of an image, in high-light environments, if glasses are worn, a 20% increase in contrast compensation is needed to ensure image clarity. Multiplying the original contrast adjustment parameter by 1.2 yields the compensated contrast adjustment parameter. In low-light environments, contrast compensation needs to be reduced to avoid excessive contrast that could cause eye strain. For example, when wearing clear-lens glasses, a 10% reduction in contrast is acceptable; multiplying the original contrast adjustment parameter by 0.9 yields the compensated contrast adjustment parameter.
[0083] (3) Color compensation data:
[0084] The impact on color varies depending on the type of eyewear. Sunglasses may filter out some colors, and the system will determine the color components that need compensation based on spectral analysis. For example, for sunglasses that filter a significant amount of blue light, the compensation for the blue component can be appropriately increased in high-light environments. For instance, increasing the blue intensity by 15% would yield the compensated color adjustment parameters by multiplying the blue component in the color adjustment parameters by 1.15. For contact lenses that cause color deviation, matrix multiplication is performed on the color adjustment parameters based on a pre-stored color offset matrix to compensate for the color deviation. Contact lenses that cause color deviation include tinted contact lenses and contact lenses with special optical coatings.
[0085] Step 4 The compensated brightness adjustment parameters, compensated brightness adjustment parameters, and compensated color adjustment parameters are obtained as the first adjustment parameters.
[0086] Finally, the compensated brightness, contrast, and color adjustment parameters are stored in the system's storage unit as the first adjustment parameters for the ARHUD information. The system then passes these parameters to the AR algorithm unit to update the display effect of the ARHUD information.
[0087] It should be noted that the examples of various values above are only illustrative. In actual application, technicians can adjust the above values according to the actual situation, and no limitation is made here.
[0088] In some embodiments, at least one preset display mode is displayed, and each preset display mode corresponds to at least two display parameters; a selection operation of a target display mode among the at least one preset display mode is received as an ARHUD adjustment operation; and a first adjustment parameter is determined based on the at least two display parameters corresponding to the target display mode.
[0089] Illustratively, the ARHUD interface provides a menu or mode list to display at least one preset display mode. These preset display modes can be presented as icons, text labels, or thumbnails.
[0090] At least one preset display mode includes day mode, night mode, high-speed mode, city mode, etc. Different display modes have different display parameters, including brightness, contrast, and color parameters. For example, in day mode, the display parameters can be set to higher brightness, higher contrast, and color combinations suitable for daytime environments, such as white text against a dark background to ensure clear visibility in strong light. Display parameters include: 80% brightness, 90% contrast, white text in RGB(255, 255, 255) color, and a black background in RGB(0, 0, 0). To avoid visual interference to the driver in low-light conditions, night mode can have lower brightness, lower contrast, and softer colors. For example, 30% brightness, 50% contrast, gray text in RGB(180, 180, 180) color, and a dark gray background in RGB(30, 30, 30).
[0091] When a user taps an icon representing a display mode on the ARHUD interface, such as the icon for "Night Driving Mode," the system recognizes the tap as a selection. Alternatively, the user can use voice commands, such as "Switch to Daytime Mode." The system uses voice recognition technology to understand the user's intent and determine the target display mode. Once the target display mode is determined, the system searches for the corresponding display parameters in the data structure that stores display modes.
[0092] After obtaining at least two display parameters of the target display model, the at least two display parameters are compared with the first display parameter. Based on the difference between the at least two display parameters and the first display parameter, a first adjustment parameter is determined. For example, for the brightness display parameter, the brightness display parameter of the target display model and the brightness display parameter of the first display parameter are obtained, and the difference between them is calculated as the brightness adjustment parameter. If the brightness display parameter of the target display model is greater than the brightness display parameter of the first display parameter, the brightness adjustment parameter is positive; if the brightness display parameter of the target display model is less than the brightness display parameter of the first display parameter, the brightness adjustment parameter is negative.
[0093] Optionally, the system can continuously update the display parameters of the display mode to adapt to different user needs. For example, it can fine-tune display parameters such as brightness, contrast, and color based on the user's historical ARHUD operation, allowing the display mode to be dynamically adjusted according to user requirements. Through this approach, users can easily select preset display modes, and the system can quickly adjust the ARHUD display effect to meet the needs of different driving scenarios, while improving operational convenience and system usability.
[0094] Step 240: Adjust the first display parameters based on the current vehicle driving status data and the first adjustment parameters to obtain the second display parameters corresponding to the ARHUD information.
[0095] The second display parameter is used to characterize the secondary visual effect of ARHUD information.
[0096] Optionally, the driving status data includes at least one of the following:
[0097] (1) Real-time operating status of the vehicle during driving.
[0098] The real-time operating status includes at least one of the following: vehicle position data, driving speed data, steering angle data, and vehicle attitude data.
[0099] (2) Environmental data of the physical environment in which the vehicle is currently located.
[0100] The environmental data includes at least one of real-scene image data and ambient lighting data.
[0101] This illustration shows how cameras installed around the vehicle capture real-time images of the vehicle's surroundings, including lane markings, traffic signs, and road conditions. Ambient lighting data refers to the intensity and direction of light in the vehicle's current physical environment; vehicles can be equipped with dedicated light sensors to acquire ambient lighting data in real time.
[0102] (3) Vehicle navigation data.
[0103] The vehicle navigation data includes at least one of navigation route data and high-precision map data.
[0104] Indicatively, navigation route data includes information such as the starting point, destination, waypoints, and planned driving route. High-precision map data contains detailed road information, such as road geometry (e.g., curvature of curves, length of straight sections), lane information (number of lanes, lane width, lane type), traffic signs, and landmark locations.
[0105] In some embodiments, a first display parameter is adjusted based on the current vehicle driving status data to obtain a third display parameter; the third display parameter is adjusted based on the first adjustment parameter to obtain a second display parameter corresponding to the ARHUD information.
[0106] Taking brightness adjustment parameters, contrast adjustment parameters, and color adjustment parameters as the first adjustment parameters as an example. Optionally, the first display parameters are adjusted based on the current vehicle driving status data to obtain the third display parameters; the brightness display parameters in the third display parameters are adjusted according to the brightness adjustment parameters, the contrast display parameters in the third display parameters are adjusted according to the contrast adjustment parameters, and the color display parameters in the third display parameters are adjusted according to the color adjustment parameters; the adjusted third display parameters are used as the second display parameters corresponding to the ARHUD information.
[0107] The following uses a dynamic navigation arrow as an example to illustrate the process of adjusting the first display parameter based on the current vehicle's driving status data to obtain the third display parameter:
[0108] Step 1 : Obtain vehicle driving status data.
[0109] To illustrate, a vehicle's navigation system typically obtains navigation-related data such as the vehicle's current location, direction of travel, and destination information through satellite positioning systems, map data, and vehicle sensors. The navigation system then transmits this data to the AR algorithm unit of the ARHUD system via an in-vehicle communication network (such as a CAN bus).
[0110] Step 2 AR algorithm processing.
[0111] The AR algorithm unit calculates the precise position and direction of the dynamic navigation arrow relative to the vehicle's windshield based on received navigation data and real-time sensor data (such as vehicle speed and steering angle). For example, it determines the specific angle the arrow should point by combining the vehicle's current direction of travel and the upcoming steering instruction. Simultaneously, the AR algorithm unit uses the vehicle's cameras (such as the forward-facing camera) to acquire image information of the physical environment in front of the vehicle. Through image recognition and processing technology, it identifies environmental elements such as roads, lane lines, and traffic signs. Then, it fuses the dynamic navigation arrow with these environmental elements to ensure that the arrow's displayed position on the windshield matches the actual physical environment. For example, the arrow should accurately point in the direction of the upcoming turn without obstructing important road signs.
[0112] Step 3 : Determine the third display parameter.
[0113] Optionally, the third display parameter includes at least one of the following: brightness display parameter, contrast display parameter, color display parameter, position display parameter, and size display parameter.
[0114] Regarding brightness display parameters: Adjust the brightness display parameters based on the current ambient light data of the vehicle. For example, in high-light conditions, increase the display brightness of the dynamic navigation arrows to ensure the driver can see them clearly; in low-light conditions, appropriately reduce the brightness to avoid visual interference to the driver.
[0115] Regarding contrast display parameters: Adjust the contrast display parameters based on the ambient background and arrow color to create a sharp contrast between the arrow and the background (i.e., the actual scene in front of the vehicle), making it easy to identify. For example, when the background is a bright sky, increase the arrow's contrast to make it more prominent.
[0116] Regarding color display parameters: Select appropriate color display parameters based on the type and importance of the navigation information. For example, green is typically used to indicate normal driving direction guidance, while red is used for warning navigation information (such as missing an exit).
[0117] Regarding location display parameters: Based on the results calculated by the previous AR algorithm, determine the location display parameters to ensure that the dynamic navigation arrow is displayed in a suitable position in the driver's field of vision.
[0118] Regarding the size display parameters: The size display parameters are adjusted considering the driver's visual distance and angle, as well as the size of the windshield. The size can also be adjusted appropriately at different vehicle speeds; for example, at higher speeds, the arrow size is increased to facilitate quick driver identification.
[0119] After determining the aforementioned third display parameter, the brightness display parameter in the third display parameter is adjusted using the brightness adjustment parameter, the contrast display parameter in the third display parameter is adjusted using the contrast adjustment parameter, and the color display parameter in the third display parameter is adjusted using the color adjustment parameter. The adjusted third display parameter is then used as the second display parameter corresponding to the ARHUD information. For example, assuming the brightness adjustment parameter is "+20%" and the brightness display parameter in the third display parameter is "60%", then "80%" is used as the brightness display parameter in the second display parameter; assuming the contrast adjustment parameter is "-20%" and the contrast display parameter in the third display parameter is "50%", then "30%" is used as the contrast display parameter in the second display parameter; assuming the color adjustment parameter (color represented by RGB values) is "[25, 30, 40]" and the color display parameter in the third display parameter is "[100, 100, 100]", then "[125, 130, 140]" is used as the color display parameter in the second display parameter.
[0120] Step 250: Update the ARHUD information of the displayed vehicle based on the second display parameters.
[0121] Schematic illustration: After receiving the second display parameters, the AR algorithm unit sends these parameters to the microdisplay. The microdisplay generates an image containing ARHUD information based on the received parameters. The microdisplay projects the generated image onto the vehicle's windshield at a specific angle and intensity via an optical system. The projected light is reflected and refracted through the windshield and enters the driver's eyes. The driver sees the reflected and refracted ARHUD information through the windshield, which blends with the actual physical environment in front of the vehicle to create an augmented reality visual effect.
[0122] In other embodiments, the above-described ARHUD adjustment operation is further used to adjust the display content of ARHUD information, which corresponds to a first display content. Optionally, the ARHUD adjustment operation includes a display content adjustment operation; obtaining a second adjustment parameter based on the display content adjustment operation, the second adjustment parameter being used to adjust the second display content; adjusting the first display content based on the current vehicle driving status data to obtain the second display content; adjusting the second display content according to the second adjustment parameter to obtain a third display content; and updating the displayed vehicle's ARHUD information based on the second display parameter and the third display content.
[0123] In a demonstrative sense, the system adjusts the first display content based on the current vehicle's driving status data to obtain the second display content. Vehicle driving status data, such as speed, steering angle, and position, influences which information should be displayed or hidden. For example, when driving at high speeds, some secondary information will be automatically reduced to avoid distracting the driver; while approaching intersections, information such as turn signals will be added. User-triggered content adjustment operations can reduce or increase displayed content, such as adding specific warning signs or deleting tire pressure monitoring. If the user chooses to increase displayed content, the second adjustment parameters include which information to add; if reducing displayed content, the second adjustment parameters include instructions on which information to remove.
[0124] Optionally, the aforementioned ARHUD adjustment operation can be received on the in-vehicle terminal or on a mobile terminal (such as...). Figure 1 The operation received on the output terminal 120 is illustrative; please refer to [the example]. Figure 3 The vehicle-mounted terminal 301 is the terminal system inside the vehicle, and it has a touchscreen. The mobile terminal 302 contains the vehicle's control application, i.e., the target application, and it also has a touchscreen. The vehicle's customizable interface can be accessed from either the vehicle-mounted terminal 301 or the mobile terminal 302. Clicking the ARHUD option in the vehicle's customizable interface will take you to the ARHUD interface. In the ARHUD interface, ARHUD adjustment operations can be performed, such as customizing the displayed content and parameters of the ARHUD information.
[0125] In summary, the vehicle display control method provided in this application obtains a first adjustment parameter by receiving the user's ARHUD adjustment operation on the ARHUD information. It then adjusts the display parameters corresponding to the ARHUD information by combining driving status data and the first adjustment parameter to adjust the visual effect of the ARHUD information. The driving status data reflects the real-time driving status of the vehicle during driving. Adjusting the display parameters based on the driving status data makes the ARHUD information more consistent with the actual driving situation of the vehicle. The ARHUD adjustment operation reflects the user's display needs. Adjusting the display parameters based on the ARHUD adjustment operation makes the ARHUD information meet the user's visual needs and actual driving needs in different scenarios. This achieves dynamic adjustment of the ARHUD information, and the adjusted ARHUD information conforms to the actual driving situation of the vehicle and the user's needs, improving the matching degree between the ARHUD information and the actual driving scenario, thereby improving the display accuracy of the ARHUD information.
[0126] Figure 4 This is a flowchart illustrating a vehicle display control method provided in an embodiment of this application. It is illustrative; please refer to it. Figure 4 , Figure 2 The illustrated step 240 also includes steps 441 to 443.
[0127] Step 441: Obtain the parameter weights corresponding to the first display parameter.
[0128] The parameter weights are used to indicate the degree of influence of ARHUD adjustment operations on the first display parameter.
[0129] Optionally, the brightness parameter weights corresponding to the brightness adjustment parameters are obtained. The brightness parameter weights are used to indicate the degree of influence of the ARHUD adjustment operation on the brightness display parameters. The brightness adjustment parameters are adjusted according to the brightness parameter weights, and the third display parameters are updated through the adjusted brightness adjustment parameters.
[0130] Optionally, the contrast parameter weights corresponding to the contrast adjustment parameters are obtained, and the contrast parameter weights are used to indicate the degree of influence of the ARHUD adjustment operation on the contrast display parameters; the contrast adjustment parameters are adjusted according to the contrast parameter weights, and the third display parameters are updated through the adjusted contrast adjustment parameters.
[0131] Optionally, the color parameter weights corresponding to the color adjustment parameters are obtained. The color parameter weights are used to indicate the degree of influence of the ARHUD adjustment operation on the color display parameters. The color adjustment parameters are adjusted according to the color parameter weights, and the third display parameters are updated through the adjusted color adjustment parameters.
[0132] To illustrate, the brightness parameter weight, contrast parameter weight, and color parameter weight are indicators used to quantify the impact of ARHUD adjustments on the corresponding display parameters. These weights can be values between 0 and 1, where 0 indicates no impact and 1 indicates complete impact. For example, if the brightness parameter weight is 0.5 and the user adjusts the brightness by "+20%", the final brightness adjustment parameter applied to the third display parameter will be "+10%".
[0133] Optionally, the method for obtaining the parameter weight corresponding to the first display parameter includes at least one of the following methods:
[0134] (1) Obtain historical operation data, which is used to indicate the operation data of ARHUD adjustment operations within a historical time period; determine the adjustment frequency and adjustment range based on the historical operation data; determine the parameter weight corresponding to the first display parameter based on the adjustment frequency and adjustment range; the adjustment frequency and parameter weight are positively correlated, and the adjustment range and parameter weight are positively correlated.
[0135] Historical Operation Data: This refers to data related to user adjustments to ARHUD information within a specific historical period, such as records of user adjustments to parameters like brightness, contrast, and color at different times. Adjustment Frequency: This counts the number of times users adjusted ARHUD information within a historical period, reflecting how frequently users modified the ARHUD display. Adjustment Amount: This measures the magnitude of the change in relevant parameters (such as the change in brightness from one value to another) during each adjustment.
[0136] This is illustrative of how weights are determined based on adjustment frequency and adjustment magnitude. A higher adjustment frequency indicates greater user attention to the parameter, thus requiring a higher weight; a larger adjustment magnitude also indicates greater user sensitivity to the parameter, necessitating a correspondingly higher weight. Optionally, the adjustment frequency and magnitude can be combined to calculate the weight. For example, the adjustment frequency can be multiplied by a first preset coefficient, and the adjustment magnitude by a second preset coefficient. The two products are then added together to obtain a composite value. This composite value is normalized to the range of 0 to 1 to obtain the parameter weight.
[0137] (2) Determine the vehicle's driving scenario based on the driving status data, which includes at least one of the following: the road type the vehicle is currently driving on, the weather conditions, and the time period; determine the parameter weights corresponding to the first display parameter based on the driving scenario.
[0138] As an illustration, driving status data includes information such as the type of road the vehicle is currently traveling on (e.g., highway, city street, rural road), weather conditions (sunny, rainy, foggy), and time of day (daytime, nighttime). Different combinations of road type, weather conditions, and time of day create different driving scenarios. For example, driving on a highway at night is one scenario, while driving on a city street in the rain is another. Under different driving scenarios, the degree to which user adjustments affect the displayed parameters varies.
[0139] Road type can be determined through the matching of in-vehicle navigation system or geolocation information with map data. For example, the vehicle's current location can be obtained through the positioning system and compared with a map database to determine whether the vehicle is traveling on a highway, city street, or rural road. Weather conditions can be obtained through the vehicle's weather sensors, such as rain sensors to determine whether it is raining, and light sensors to help determine whether it is sunny or cloudy. More accurate weather information can also be obtained by connecting to external weather services. Time periods can be determined based on the in-vehicle system's clock, simply dividing the day into day and night, or more precisely into different time periods such as morning, noon, afternoon, evening, and night. The collected road type, weather conditions, and time periods are combined to form different driving scenarios. For example, different driving scenario combinations such as "highway-sunny-daytime" and "city street-rainy-night" can be formed. Corresponding parameter weights are assigned to each different driving scenario. For different driving scenarios, the degree of influence of ARHUD adjustment operations on display parameters is determined, and corresponding weights are assigned to them. For example, in scenarios that require a high level of user concentration (such as driving on a highway at night), users' ability to adjust display parameters independently may be limited, so the weight in such scenarios can be set lower; while in relatively relaxed scenarios (such as driving on city streets during the day on a sunny day), users pay more attention to personalized display, so the weight in such scenarios can be set higher.
[0140] (3) Identify the driver's fatigue level; determine the parameter weight corresponding to the first display parameter based on the fatigue level, and there is a negative correlation between the fatigue level and the parameter weight.
[0141] This example illustrates how driver fatigue levels are determined by weighting parameters. If driver fatigue is high, to ensure driving safety, the impact of driving status data on displayed parameters should be more prominent, ensuring the displayed information accurately and promptly reflects the vehicle's condition and helps the driver cope with road conditions. In this case, the parameter weight is reduced. That is, fatigue level and parameter weight are negatively correlated. The following example illustrates the method for identifying driver fatigue levels:
[0142] A camera installed inside the vehicle continuously captures facial images of the driver at a fixed frame rate (e.g., 30 frames per second). The camera must be able to clearly capture key facial areas such as the eyes, mouth, and eyebrows. Simultaneously, the vehicle's own sensors acquire vehicle driving status data, such as speed, acceleration, and steering wheel angle. This data reflects the driver's control of the vehicle and aids in fatigue assessment. The facial images and driving status data are input into a trained neural network model, which outputs a probability distribution representing the probability of the driver being in different fatigue levels. For example, an output of [0.8, 0.1, 0.05, 0.05] corresponds to the probabilities of "awake," "mildly fatigued," "moderately fatigued," and "severely fatigued," respectively, indicating that the driver is 80% likely to be "awake." Based on the output probability distribution, the category with the highest probability is selected as the model's predicted driver fatigue level. For example, if the probability value for "moderately fatigued" is the highest among all categories, the driver is determined to be in a moderately fatigued state.
[0143] After determining the degree of fatigue, parameter weights are assigned based on the determined fatigue level. Since the degree of fatigue is negatively correlated with parameter weights, a higher weight is given when the driver is determined to be in a conscious state, and a lower weight is given when the driver is determined to be in a fatigued state (such as moderate or severe fatigue). This ensures that when the driver is fatigued, the driving status data has a greater impact on the displayed parameters, thus guaranteeing driving safety.
[0144] Step 442: Adjust the first display parameter based on the driving status data to obtain the third display parameter.
[0145] Optionally, the first display parameter includes at least one of the following: brightness display parameter, contrast display parameter, color display parameter, position display parameter, size display parameter, etc.
[0146] The specific process of adjusting the first display parameter based on the driving status data to obtain the third display parameter can be found in step 240, and will not be elaborated here.
[0147] Step 443: Adjust the third display parameter according to the parameter weight and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information.
[0148] The first adjustment parameter includes at least one of the following: brightness adjustment parameter, contrast adjustment parameter, color adjustment parameter, etc.
[0149] Optionally, the first adjustment parameter is adjusted according to the parameter weight to obtain the adjusted first adjustment parameter; the third display parameter is adjusted based on the adjusted first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information.
[0150] To illustrate, the parameter weight represents the degree of influence of the ARHUD adjustment operation on the first display parameter, and the value range is usually between 0 and 1. For example, if the parameter weight is 0.8 and the brightness adjustment parameter is "+20%", then the adjusted brightness adjustment parameter will be "+16%".
[0151] In the above embodiments, by adjusting various display parameters such as brightness, contrast, and color in the third display parameters, the second display parameters corresponding to the ARHUD information are finally obtained. These parameters take into account the driving status and user adjustment needs, presenting a visual effect that conforms to the actual driving scenario and user expectations.
[0152] Figure 5 This is a structural block diagram of a vehicle display control device provided in an exemplary embodiment of this application, as shown below. Figure 5 As shown, the device includes the following parts:
[0153] Display module 510 is used to display augmented reality head-up display (ARHUD) information of the vehicle, wherein the ARHUD information is used to indicate vehicle prompt information that is integrated with the physical environment in which the vehicle is currently located; the ARHUD information corresponds to a first display parameter, wherein the first display parameter is used to characterize the first visual effect of the ARHUD information.
[0154] Input module 520 is used to receive an ARHUD adjustment operation on the ARHUD information, wherein the ARHUD adjustment operation is used to adjust the visual effect of the ARHUD information;
[0155] Control module 530 is used to obtain a first adjustment parameter based on the ARHUD adjustment operation;
[0156] The control module 530 is further configured to adjust the first display parameter based on the current driving status data of the vehicle and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information. The second display parameter is used to characterize the second visual effect of the ARHUD information.
[0157] The display module 510 is also used to update the ARHUD information of the vehicle based on the second display parameters.
[0158] In some embodiments, the ARHUD adjustment operation includes at least one of brightness adjustment operation, contrast adjustment operation, and color adjustment operation;
[0159] The brightness adjustment parameter is used to adjust the display brightness of the ARHUD information, the contrast adjustment parameter is used to adjust the display contrast of the ARHUD information, and the color adjustment parameter is used to adjust the display color of the ARHUD information.
[0160] In some embodiments, the ARHUD adjustment operation includes the brightness adjustment operation, the contrast adjustment operation, and the color adjustment operation; the control module 530 is configured to:
[0161] Based on the ARHUD adjustment operation, brightness adjustment parameters, contrast adjustment parameters, and color adjustment parameters are obtained as the first adjustment parameter;
[0162] The first display parameter is adjusted based on the current driving status data of the vehicle to obtain the third display parameter;
[0163] The brightness display parameter in the third display parameter is adjusted according to the brightness adjustment parameter; the contrast display parameter in the third display parameter is adjusted according to the contrast adjustment parameter; and the color display parameter in the third display parameter is adjusted according to the color adjustment parameter.
[0164] The adjusted third display parameter is used as the second display parameter corresponding to the ARHUD information.
[0165] In some embodiments, the control module 530 is configured to:
[0166] Obtain the parameter weight corresponding to the first display parameter, and the parameter weight is used to indicate the degree of influence of the ARHUD adjustment operation on the first display parameter;
[0167] The first display parameter is adjusted based on the driving status data to obtain the third display parameter;
[0168] The third display parameter is adjusted according to the parameter weight and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information.
[0169] In some embodiments, the control module 530 is configured to:
[0170] Acquire historical operation data, which indicates the operation data of the ARHUD adjustment operation within a historical time period;
[0171] The adjustment frequency and adjustment range are determined based on the historical operation data.
[0172] The parameter weight corresponding to the first display parameter is determined based on the adjustment frequency and the adjustment magnitude; the adjustment frequency and the parameter weight are positively correlated, and the adjustment magnitude and the parameter weight are positively correlated.
[0173] In some embodiments, the control module 530 is configured to:
[0174] The driving scenario of the vehicle is determined based on the driving status data, which includes at least one of the following: the road type, weather conditions, and time period in which the vehicle is currently driving.
[0175] The parameter weights corresponding to the first display parameters are determined based on the driving scenario.
[0176] In some embodiments, the control module 530 is configured to:
[0177] Identify the driver's level of fatigue in the vehicle;
[0178] The parameter weight corresponding to the first display parameter is determined based on the fatigue level, and there is a negative correlation between the fatigue level and the parameter weight.
[0179] In some embodiments, the ARHUD adjustment operation includes brightness adjustment, contrast adjustment, and color adjustment; the control module 530 is configured to:
[0180] Based on the ARHUD adjustment operation, obtain the brightness adjustment parameters, contrast adjustment parameters, and color adjustment parameters;
[0181] Acquire facial image data of the driver in the vehicle; analyze the facial image data and determine the analysis result, which is used to indicate whether the driver is wearing glasses;
[0182] If the analysis results indicate that the driver is wearing glasses, then based on the ambient light data of the current physical environment of the vehicle, determine the brightness compensation data, contrast compensation data, and color compensation data.
[0183] The brightness adjustment parameters are compensated based on the brightness compensation data; the contrast adjustment parameters are compensated based on the contrast compensation data; the color adjustment parameters are compensated based on the color compensation data.
[0184] The compensated brightness adjustment parameters, the compensated brightness adjustment parameters, and the compensated color adjustment parameters are used as the first adjustment parameters.
[0185] In some embodiments, the input module 520 is configured to:
[0186] Display at least one preset display mode, and each preset display mode corresponds to at least two display parameters;
[0187] The ARHUD adjustment operation is received as a selection operation of a target display mode among the at least one preset display modes.
[0188] The control module 530 is used for:
[0189] The first adjustment parameter is determined based on at least two display parameters corresponding to the target display mode.
[0190] In summary, the vehicle display control device provided in this application obtains a first adjustment parameter by receiving the user's ARHUD adjustment operation on the ARHUD information. It then adjusts the display parameters corresponding to the ARHUD information by combining driving status data and the first adjustment parameter to adjust the visual effect of the ARHUD information. The driving status data reflects the real-time driving status of the vehicle during driving. Adjusting the display parameters based on the driving status data makes the ARHUD information more consistent with the actual driving situation of the vehicle. The ARHUD adjustment operation reflects the user's display needs. Adjusting the display parameters based on the ARHUD adjustment operation makes the ARHUD information meet the user's visual needs and actual driving needs in different scenarios. This achieves dynamic adjustment of the ARHUD information, and the adjusted ARHUD information conforms to the actual driving situation of the vehicle and the user's needs, improving the matching degree between the ARHUD information and the actual driving scenario, thereby improving the display accuracy of the ARHUD information.
[0191] It should be noted that the vehicle display control device provided in the above embodiments is only an example of the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the vehicle display control device and the vehicle display control method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.
[0192] Figure 6 This illustration shows a structural block diagram of a computer device 600 provided in an exemplary embodiment of this application. The computer device 600 may be a smartphone, an in-vehicle terminal, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), a laptop computer, or a desktop computer. The computer device 600 may also be a vehicle equipped with an in-vehicle terminal; this application does not limit its scope to this type.
[0193] Typically, computer device 600 includes a processor 601 and a memory 602.
[0194] Processor 601 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 601 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 601 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 601 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 601 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.
[0195] The memory 602 may include one or more computer-readable storage media, which may be non-transitory. The memory 602 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 602 are used to store at least one instruction, which is executed by the processor 601 to implement the vehicle display control method provided in the method embodiments of this application.
[0196] In some embodiments, the computer device 600 further includes one or more sensors. These one or more sensors include, but are not limited to, proximity sensors, gyroscope sensors, and pressure sensors.
[0197] A proximity sensor, also known as a distance sensor, is typically located on the front panel of a computer device 600. The proximity sensor is used to detect the distance between the user and the front of the computer device 600.
[0198] The gyroscope sensor can detect the orientation and rotation angle of the computer device 600. The gyroscope sensor can work in conjunction with the accelerometer sensor to collect 3D motion data from the user on the computer device 600. Based on the data collected by the gyroscope sensor, the processor 601 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.
[0199] A pressure sensor can be installed on the side bezel and / or the lower layer of the display screen of the computer device 600. When the pressure sensor is installed on the side bezel of the computer device 600, it can detect the user's grip signal on the computer device 600, and the processor 601 can perform left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor. When the pressure sensor is installed on the lower layer of the display screen, the processor 601 can control the operable controls on the UI interface based on the user's pressure operation on the display screen. Operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.
[0200] In some embodiments, the computer device 600 also includes other component parts, as those skilled in the art will understand. Figure 6 The structure shown does not constitute a limitation on the computer device 600, and may include more or fewer components than shown, or combine certain components, or use different component arrangements.
[0201] Embodiments of this application also provide a computer device, which includes a processor and a memory. The memory stores at least one instruction, at least one program, code set, or instruction set. The at least one instruction, at least one program, code set, or instruction set is loaded and executed by the processor to implement the vehicle display control method provided in the above-described method embodiments.
[0202] Embodiments of this application also provide a computer-readable storage medium storing at least one instruction, at least one program, code set, or instruction set, wherein the at least one instruction, at least one program, code set, or instruction set is loaded and executed by a processor to implement the vehicle display control method provided in the above-described method embodiments.
[0203] Embodiments of this application also provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform any of the vehicle display control methods described in the above embodiments.
[0204] Optionally, the computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), solid-state drives (SSDs), or optical discs, etc. The random access memory may include resistive random access memory (ReRAM) and dynamic random access memory (DRAM). The sequence numbers of the embodiments in this application are merely descriptive and do not represent the superiority or inferiority of the embodiments.
[0205] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.
[0206] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.
Claims
1. A display control method for a vehicle, characterized in that, The method includes: The augmented reality head-up display (ARHUD) information of the vehicle is displayed. The ARHUD information is used to indicate vehicle prompt information that is integrated with the physical environment in which the vehicle is currently located. The ARHUD information corresponds to a first display parameter, which is used to characterize the first visual effect of the ARHUD information. Receive an ARHUD adjustment operation on the ARHUD information, the ARHUD adjustment operation being used to adjust the visual effect of the ARHUD information; The first adjustment parameter is obtained based on the ARHUD adjustment operation; Obtain the parameter weight corresponding to the first display parameter, and the parameter weight is used to indicate the degree of influence of the ARHUD adjustment operation on the first display parameter; The first display parameter is adjusted based on the current vehicle driving status data and the first adjustment parameter to obtain a second display parameter corresponding to the ARHUD information. The second display parameter is used to characterize the second visual effect of the ARHUD information. The step of adjusting the first display parameter based on the current vehicle driving status data and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information includes: obtaining the parameter weight corresponding to the first display parameter, the parameter weight being used to indicate the degree of influence of the ARHUD adjustment operation on the first display parameter; adjusting the first display parameter according to the driving status data to obtain a third display parameter; and adjusting the third display parameter according to the parameter weight and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information. The ARHUD information of the vehicle is updated and displayed based on the second display parameter.
2. The method according to claim 1, characterized in that, The ARHUD adjustment operation includes at least one of brightness adjustment operation, contrast adjustment operation, and color adjustment operation; The brightness adjustment parameter is used to adjust the display brightness of the ARHUD information, the contrast adjustment parameter is used to adjust the display contrast of the ARHUD information, and the color adjustment parameter is used to adjust the display color of the ARHUD information.
3. The method according to claim 2, characterized in that, The ARHUD adjustment operations include the brightness adjustment operation, the contrast adjustment operation, and the color adjustment operation; The step of obtaining the first adjustment parameter based on the ARHUD adjustment operation includes: Based on the ARHUD adjustment operation, brightness adjustment parameters, contrast adjustment parameters, and color adjustment parameters are obtained as the first adjustment parameter; The step of adjusting the first display parameters based on the current vehicle driving status data and the first adjustment parameters to obtain the second display parameters corresponding to the ARHUD information includes: The first display parameter is adjusted based on the current driving status data of the vehicle to obtain the third display parameter; Adjust the brightness display parameter in the third display parameter according to the brightness adjustment parameter, adjust the contrast display parameter in the third display parameter according to the contrast adjustment parameter, and adjust the color display parameter in the third display parameter according to the color adjustment parameter; The adjusted third display parameter is used as the second display parameter corresponding to the ARHUD information.
4. The method according to any one of claims 1 to 3, characterized in that, The step of obtaining the parameter weight corresponding to the first display parameter includes: Acquire historical operation data, which indicates the operation data of the ARHUD adjustment operation within a historical time period; The adjustment frequency and adjustment range are determined based on the historical operation data. The parameter weight corresponding to the first display parameter is determined based on the adjustment frequency and the adjustment magnitude; the adjustment frequency and the parameter weight are positively correlated, and the adjustment magnitude and the parameter weight are positively correlated.
5. The method according to any one of claims 1 to 3, characterized in that, The step of obtaining the parameter weight corresponding to the first display parameter includes: The driving scenario of the vehicle is determined based on the driving status data, which includes at least one of the following: the road type, weather conditions, and time period in which the vehicle is currently driving. The parameter weights corresponding to the first display parameters are determined based on the driving scenario.
6. The method according to any one of claims 1 to 3, characterized in that, The step of obtaining the parameter weight corresponding to the first display parameter includes: Identify the driver's level of fatigue in the vehicle; The parameter weight corresponding to the first display parameter is determined based on the fatigue level, and there is a negative correlation between the fatigue level and the parameter weight.
7. The method according to any one of claims 1 to 3, characterized in that, The ARHUD adjustment operations include brightness adjustment, contrast adjustment, and color adjustment. The step of obtaining the first adjustment parameter based on the ARHUD adjustment operation includes: Based on the ARHUD adjustment operation, obtain the brightness adjustment parameters, contrast adjustment parameters, and color adjustment parameters; Acquire facial image data of the driver in the vehicle; analyze the facial image data and determine the analysis result, which is used to indicate whether the driver is wearing glasses; If the analysis results indicate that the driver is wearing glasses, then based on the ambient light data of the current physical environment of the vehicle, determine the brightness compensation data, contrast compensation data, and color compensation data. The brightness adjustment parameters are compensated based on the brightness compensation data; the contrast adjustment parameters are compensated based on the contrast compensation data; the color adjustment parameters are compensated based on the color compensation data. The compensated brightness adjustment parameters, the compensated brightness adjustment parameters, and the compensated color adjustment parameters are used as the first adjustment parameters.
8. The method according to any one of claims 1 to 3, characterized in that, Before receiving the ARHUD adjustment operation on the ARHUD information, the method further includes: Display at least one preset display mode, and each preset display mode corresponds to at least two display parameters; The ARHUD adjustment operation for receiving the ARHUD information includes: The ARHUD adjustment operation is received as a selection operation of a target display mode among the at least one preset display modes. The step of obtaining the first adjustment parameter based on the ARHUD adjustment operation includes: The first adjustment parameter is determined based on at least two display parameters corresponding to the target display mode.
9. A display control device for a vehicle, characterized in that, The device includes: The display module is used to display augmented reality head-up display (ARHUD) information of the vehicle, wherein the ARHUD information is used to indicate vehicle prompt information that is integrated with the physical environment in which the vehicle is currently located; the ARHUD information corresponds to a first display parameter, wherein the first display parameter is used to characterize the first visual effect of the ARHUD information. The input module is used to receive ARHUD adjustment operations on the ARHUD information, wherein the ARHUD adjustment operations are used to adjust the visual effect of the ARHUD information; The control module is used to obtain the first adjustment parameter based on the ARHUD adjustment operation; The control module is further configured to adjust the first display parameter based on the current driving status data of the vehicle and the first adjustment parameter to obtain a second display parameter corresponding to the ARHUD information, wherein the second display parameter is used to characterize the second visual effect of the ARHUD information; wherein, adjusting the first display parameter based on the current driving status data of the vehicle and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information includes: obtaining the parameter weight corresponding to the first display parameter, wherein the parameter weight is used to indicate the degree of influence of the ARHUD adjustment operation on the first display parameter; adjusting the first display parameter according to the driving status data to obtain a third display parameter; adjusting the third display parameter according to the parameter weight and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information; The display module is also used to update the ARHUD information of the vehicle based on the second display parameters.
Citation Information
Patent Citations
Vehicle display enhancement
CN112699895A
Optical display device, display system, vehicle and color adjusting method
CN116068759A