Display control method and device of vehicle
By receiving user adjustment operations and adjusting ARHUD display parameters in combination with vehicle driving status data, the matching degree and accuracy problems caused by the fixed ARHUD information display content in the prior art are solved, and dynamic adjustment of information and higher matching degree and accuracy are achieved.
Patent Information
- Application Number
- CN202510109035.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-23
- Publication Date
- 2025-05-06
- Estimated Expiration
- 2045-01-23
AI Technical Summary
The content of the augmented reality head-up display (ARHUD) information display of existing vehicles is relatively fixed and has low flexibility, resulting in low matching and display accuracy of the information with the actual driving scenario.
By receiving the user's adjustment operation on ARHUD information, the adjustment parameters are obtained, and the display parameters are adjusted in combination with the vehicle's driving status data, so as to dynamically adjust the visual effect of ARHUD information to ensure that the information matches the actual driving situation of the vehicle and the user's needs.
The dynamic adjustment of ARHUD information is realized, the matching degree and display accuracy of the information with the actual driving scenario are improved, and the user's visual needs and actual driving needs in different scenarios are met.
Smart Images

Figure CN119928558A_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present application relate to the field of vehicle technology, and in particular, to a vehicle display control method and device. Background Art
[0002] Augmented Reality Head-Up Display (ARHUD) is a vehicle display technology that combines augmented reality (AR) technology with a head-up display (HUD) system. It is gradually becoming one of the important configurations of smart cars.
[0003] In the related art, the ARHUD system of a vehicle is mainly composed of an AR algorithm unit, a microdisplay and a front windshield. The AR algorithm unit determines the display model based on the vehicle information, and the display model includes various display contents presented on the front windshield; the AR algorithm unit sends the display model to the microdisplay, and the microdisplay generates corresponding light information based on the display model, and then projects the light information onto the front windshield to obtain the ARHUD information.
[0004] However, the display content of ARHUD information in the related art is relatively fixed and the display flexibility is low, resulting in a low match between the ARHUD information and the actual driving scene and a low display accuracy of the ARHUD information. Summary of the invention
[0005] The embodiment of the present application provides a display control method and device for a vehicle, and the technical solution is as follows:
[0006] In one aspect, a display control method for a vehicle is provided, the method comprising:
[0007] displaying augmented reality head-up display (ARHUD) information of the vehicle, wherein the ARHUD information is used to indicate vehicle prompt information integrated with a physical environment currently located by the vehicle; the ARHUD information corresponds to a first display parameter, and the first display parameter is used to characterize a first visual effect of the ARHUD information;
[0008] receiving an ARHUD adjustment operation on the ARHUD information, where the ARHUD adjustment operation is used to adjust a visual effect of the ARHUD information;
[0009] Acquire a first adjustment parameter based on the ARHUD adjustment operation;
[0010] adjusting the first display parameter based on the current driving state data of the vehicle and the first adjustment parameter to obtain a second display parameter corresponding to the ARHUD information, wherein the second display parameter is used to represent a second visual effect of the ARHUD information;
[0011] The ARHUD information displayed on the vehicle is updated based on the second display parameter.
[0012] In another aspect, a display control device for a vehicle is provided, the device comprising:
[0013] A display module, used for displaying augmented reality head-up display (ARHUD) information of the vehicle, wherein the ARHUD information is used to indicate vehicle prompt information integrated with a physical environment in which the vehicle is currently located; the ARHUD information corresponds to a first display parameter, and the first display parameter is used to characterize a first visual effect of the ARHUD information;
[0014] An input module, used for receiving an ARHUD adjustment operation on the ARHUD information, wherein the ARHUD adjustment operation is used for adjusting a visual effect of the ARHUD information;
[0015] A control module, configured to obtain a first adjustment parameter based on the ARHUD adjustment operation;
[0016] The control module is further used to adjust the first display parameter based on the current driving state data of the vehicle and the first adjustment parameter to obtain a second display parameter corresponding to the ARHUD information, wherein the second display parameter is used to characterize a second visual effect of the ARHUD information;
[0017] The display module is also used to update and display the ARHUD information of the vehicle based on the second display parameter.
[0018] On the other hand, a computer device is provided, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement any of the above-mentioned vehicle display control methods.
[0019] On the other hand, a computer-readable storage medium is provided, wherein at least one instruction, at least one program, a code set or an instruction set is stored in the storage medium, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement any of the above-mentioned vehicle display control methods.
[0020] On the other hand, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes any of the above-mentioned vehicle display control methods.
[0021] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:
[0022] A first adjustment parameter is obtained by receiving an ARHUD adjustment operation of the user on the ARHUD information, and the display parameters corresponding to the ARHUD information are adjusted according to the comprehensive driving status data and the first adjustment parameter to adjust the visual effect of the ARHUD information. The driving status data reflects the real-time driving status of the vehicle during driving, and the display parameters are adjusted according to the driving status data to make the ARHUD information more in line with the actual driving condition of the vehicle; the ARHUD adjustment operation reflects the display needs of the user, and the display parameters are adjusted according to the ARHUD adjustment operation to make the ARHUD information meet the visual needs and actual driving needs of the user in different scenarios, thereby realizing dynamic adjustment of the ARHUD information, and the adjusted ARHUD information meets the actual driving condition of the vehicle and user needs, thereby improving the matching degree of the ARHUD information and the actual driving scene, thereby improving the display accuracy of the ARHUD information. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0024] Figure 1 is a schematic diagram of a computer system provided by an exemplary embodiment of the present application;
[0025] Figure 2 is a flow chart of a display control method for a vehicle provided by another exemplary embodiment of the present application;
[0026] Figure 3 is a schematic diagram of an ARHUD adjustment operation provided by an exemplary embodiment of the present application;
[0027] Figure 4 is a flow chart of a display control method for a vehicle provided by another exemplary embodiment of the present application;
[0028] Figure 5is a structural block diagram of a display control device for a vehicle provided by an exemplary embodiment of the present application;
[0029] Figure 6 It is a structural block diagram of a computer system provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION
[0030] In order to make the purpose, technical solution and advantages of the present application clearer, the implementation mode of the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.
[0031] In this application, the terms "first", "second", etc. are used to distinguish identical or similar items with substantially the same effects and functions. It should be understood that there is no logical or temporal dependency between "first" and "second", nor is there any limitation on quantity and execution order.
[0032] It should be noted that the information (including but not limited to driving status data, driving environment data, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions. For example, the framework data involved in this application are all obtained with full authorization.
[0033] Figure 1 The structure block diagram of a computer system 100 provided by an exemplary embodiment of the present application is shown. The computer system 100 can be implemented as a system architecture of a display control method for a vehicle. The computer system 100 includes: a vehicle 110.
[0034] The vehicle 110 includes at least one of a fuel vehicle, an electric vehicle, a hybrid vehicle (a combination of a fuel vehicle and an electric vehicle), a fuel cell vehicle, a solar vehicle, etc., which is not limited in the embodiments of the present application.
[0035] In some embodiments, the computer system 100 further includes a terminal 120. The terminal 120 includes but is not limited to a vehicle-mounted terminal, a mobile phone, a computer, an intelligent voice interaction device, an intelligent home appliance, an aircraft, and the like.
[0036] Optionally, the terminal 120 is implemented as a mobile control terminal of the vehicle 110, and the terminal 120 can control the vehicle 110 to perform a target operation (for example, parking, closing windows, starting, etc.). Schematically, a client having a target application is installed and running in the terminal 120, and the target application includes at least one of the applications with vehicle control functions such as vehicle control applications, instant messaging applications, and navigation applications (for example, map applications), and the like, which are not limited in the embodiments of the present application. In addition, the present application does not limit the form of the target application, including but not limited to App (Application, application) installed in the terminal 120, applets, etc., and can also be in the form of a web page.
[0037] Optionally, the vehicle 110 and the terminal 120 communicate via a wireless network (such as 4G / 5G, Wi-Fi, etc.) or a wired connection (such as USB, Bluetooth, etc.).
[0038] In some embodiments, the computer system 100 further includes a server 130, which can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services. Optionally, the server 130 can also be implemented as a node in a blockchain system.
[0039] Illustratively, if the server 130 is implemented as a cloud server, the vehicle 110 and the server 130 communicate via a wireless network, and the terminal 120 and the server 130 communicate via a wireless network.
[0040] Optionally, the vehicle display control method provided in the embodiment of the present application may be executed by the vehicle 110; or, executed interactively by the vehicle 110 and the terminal 120; or, executed interactively by the vehicle 110 and the server 130; or, executed interactively by the vehicle 110, the terminal 120 and the server 130, which is not limited in the embodiment of the present application. The following is an example of the vehicle display control method executed by the vehicle 110.
[0041] The vehicle 110 includes an augmented reality head-up display (ARHUD) system. Schematically, the ARHUD system is composed of the following modules:
[0042] 1. Input module: The input module is used to receive the user's ARHUD adjustment operations.
[0043] Schematically, the hardware implementing the input module in the vehicle 110 includes at least one of the following devices: (1) Physical buttons: Special buttons can be set on the vehicle's steering wheel, center console, etc. for direct user operation. These buttons can be mechanical buttons that generate electrical signals by pressing, or touch-sensitive buttons that detect user touch actions using the principle of capacitive sensing. (2) Voice input device: The vehicle is equipped with a microphone to receive the user's voice instructions as ARHUD adjustment operations through voice recognition technology. (3) Touch screen: Relevant virtual buttons or gesture operation areas are set on the vehicle's central control display screen or other special interactive screens. The user can perform ARHUD adjustment operations by touching the icons on the screen or using specific gestures (such as sliding, zooming, etc.). The touch screen senses the user's operations through the touch sensor. (4) Camera: A camera is installed in the vehicle. The camera can collect the user's specific hand movements and implement ARHUD adjustment operations based on the specific hand movements.
[0044] 2. Control module: The control module is used to analyze the ARHUD adjustment operation and generate the corresponding adjustment signal.
[0045] Illustratively, the control module may be implemented as at least one of a microcontroller unit (MCU), a central processing unit (CPU), a programmable logic device (PLD), a field-programmable gate array (FPGA), etc. in the vehicle 110, which is not limited here. The control module includes an AR algorithm unit.
[0046] 3. Display module: The display module is used to determine display parameters according to the adjustment signal, and display the ARHUD screen according to the display parameters.
[0047] Schematically, the hardware for implementing the display module in the vehicle 110 includes at least one of the following devices: (1) Projection unit: The projection unit includes a light source, a microdisplay, an optical system, etc., wherein the microdisplay can be implemented as at least one of a liquid crystal display (LCD), a digital micromirror device (DMD), etc., and the optical system includes at least one of a collimating lens, a free-form mirror, etc. (2) Windshield: In order to implement the ARHUD function, the windshield needs to be treated with a special optical coating, which can enhance the reflection and refraction performance of the glass to the projected light. At the same time, the coating can also play an anti-reflection role, reduce the reflection of the light inside the car on the windshield, avoid the reflected light blocking the driver's line of sight, and ensure that the driver can clearly see the ARHUD information projected on the windshield and the actual road conditions outside the car. In some embodiments, in addition to using the windshield as a projection medium, a combined glass method is also used. The combined glass is a separate transparent optical element, which is located in front of the driver's line of sight and can be fixed in the car through a special mounting bracket.
[0048] 4. Storage module: The storage module is used to store the adjustment parameters corresponding to the user's ARHUD adjustment operations.
[0049] Illustratively, the storage module may be implemented as a flash memory, a solid state drive, etc. in the vehicle 110 , which is not limited here.
[0050] 5. Communication module (or acquisition module): The communication module is used to obtain the vehicle's driving status data and feed the driving status data back to the control module.
[0051] Illustratively, the hardware implementing the communication module in the vehicle 110 includes at least one of the following devices: (1) On-board sensor: used to obtain the driving status data of the vehicle. (2) Controller Area Network Bus Interface (CAN) bus interface: The various electronic devices and sensors inside the vehicle usually communicate via the CAN bus. The communication module receives the driving status data from the on-board sensor via the CAN bus interface and feeds the data back to the control module.
[0052] In vehicle 110, after the input module receives the ARHUD adjustment operation on the ARHUD screen, the input module sends the ARHUD adjustment operation to the control module, and the control module parses the ARHUD adjustment operation to obtain the first adjustment parameter, for example: the brightness, contrast, color and other adjustment parameters of the ARHUD information; the communication module will send the driving status data of the vehicle 110 to the control module in real time, and the control module will determine the adjustment signal for the current ARHUD information based on the driving status data and the first adjustment parameter, and then send the adjustment signal to the display module; the display module will adjust the ARHUD information according to the adjustment signal and display the adjusted ARHUD information.
[0053] The display control method of a vehicle provided in an embodiment of the present application is described below.
[0054] Combined with the above introduction, Figure 2 is a flow chart of a vehicle display control method provided by an embodiment of the present application, and the method is applied to Figure 1 Taking the vehicle 110 as an example, the method is described as follows: step 210 to step 250.
[0055] Step 210: Display the augmented reality head-up display (ARHUD) information of the vehicle.
[0056] Among them, ARHUD information is used to indicate vehicle prompt information that is integrated with the physical environment the vehicle is currently in. Schematically, augmented reality head-up display (ARHUD) is a vehicle display technology that is used to project vehicle prompt information onto the front windshield of the vehicle in an augmented reality manner, helping the driver to obtain information more intuitively and reduce distraction.
[0057] Optionally, the display content of ARHUD information includes at least one of the following: (1) vehicle status information, such as vehicle speed, speed, mileage, fuel / battery level, cruising range, tire pressure monitoring, etc. (2) Navigation information, such as turn prompts, mileage, speed limit reminders, dynamic navigation arrows, waypoint prompts, destination information, etc. (3) Lane information, such as lane departure warning, lane keeping assist, etc. (4) Pedestrian and obstacle warning, monitoring pedestrians or obstacles in complex environments (such as multiple intersections, driving at night), and reminding the driver through AR markings. (5) Traffic signal and safety warnings, such as red light running warnings, speed limit warnings, front vehicle collision warnings, vehicle distance information prompts, road hazard warnings, etc. It should be noted that the above examples of the display content of ARHUD information are only for illustrative purposes, and the embodiments of the present application do not limit this. The following mainly uses the dynamic navigation arrow as an example for explanation.
[0058] ARHUD information corresponds to a first display parameter, and the first display parameter is used to characterize a first visual effect of the ARHUD information. The first display parameter includes at least one of a brightness display parameter, a contrast display parameter, a color display parameter, a position display parameter, and a size display parameter. The brightness display parameter is used to indicate the display brightness of the ARHUD information, the contrast display parameter is used to indicate the display contrast of the ARHUD information, the color display parameter is used to indicate the display color of the ARHUD information, the position display parameter is used to indicate the display position of the ARHUD information, and the size display parameter is used to indicate the display size of the ARHUD information.
[0059] Step 220: Receive an ARHUD adjustment operation on the ARHUD information.
[0060] Among them, the ARHUD adjustment operation is used to adjust the visual effect of the ARHUD information.
[0061] Optionally, the ARHUD adjustment operation includes at least one of a brightness adjustment operation, a contrast adjustment operation, and a color adjustment operation; wherein the brightness adjustment parameter is used to adjust the display brightness of the ARHUD information, the contrast adjustment parameter is used to adjust the display contrast of the ARHUD information, and the color adjustment parameter is used to adjust the display color of the ARHUD information.
[0062] In some embodiments, an ARHUD interface is displayed, which includes a brightness adjustment area, a contrast adjustment area, and a color adjustment area, wherein the brightness adjustment area is used to receive brightness adjustment operations, the contrast adjustment area is used to receive contrast adjustment operations, and the color adjustment area is used to receive color adjustment operations.
[0063] Schematically, the ARHUD adjustment operation is implemented through the terminal screen: a horizontal or vertical brightness adjustment bar is set on the ARHUD interface as the brightness adjustment area. The driver can adjust the brightness by long pressing the position corresponding to the brightness adjustment bar on the screen, and then sliding the finger left and right (horizontal adjustment bar) or up and down (vertical adjustment bar). For example, sliding the finger to the right gradually increases the brightness; sliding the finger to the left gradually decreases the brightness; the current brightness value or progress mark will be displayed in real time on the adjustment bar. Similar to the brightness adjustment area, an adjustment bar is also used as the contrast adjustment area. The contrast adjustment bar can be displayed side by side with the brightness adjustment bar for the convenience of the driver. The driver long presses the adjustment bar and slides it, such as sliding up to increase the contrast and sliding down to reduce the contrast; at the same time, the contrast change value or level mark is displayed in real time near the contrast adjustment area. A color selection panel is designed as the color adjustment area. A variety of preset color options can be displayed in the form of circular or square color blocks on the panel, such as common red, green, blue, yellow, etc.; the driver clicks the color block he wants to select to complete the color adjustment operation and make the ARHUD information displayed in the selected color; in addition, a "Customize" button can be set. Clicking it will pop up a more detailed color adjustment interface, and the color can be customized by sliding the color slider or entering RGB values.
[0064] Alternatively, the ARHUD adjustment operation is implemented through the in-vehicle voice interaction system: when the driver speaks a specific command, such as "brighten the ARHUD brightness", the system automatically recognizes and performs the corresponding brightness adjustment operation. The system can inform the driver of the current brightness adjustment through voice feedback, such as "the brightness has been brightened, and the current brightness is 80%." The driver speaks voice commands such as "reduce the ARHUD contrast to 50%", and the voice interaction system adjusts the contrast of the ARHUD information after recognition, and voice feedback of the adjustment results, such as "the contrast has been reduced to 50%." The driver uses voice commands such as "change the ARHUD color to green", and the voice interaction system recognizes and changes the display color of the ARHUD information, and responds "the color has been switched to green."
[0065] Alternatively, the ARHUD adjustment operation is implemented using the gesture recognition camera in the car: when the driver makes an upward or downward gesture in a specific recognition area (such as above the steering wheel), the system recognizes it as an adjustment operation to increase or decrease the brightness. For example, waving the palm upward means increasing the brightness, and waving the palm downward means decreasing the brightness; the system determines the amplitude of the brightness adjustment based on the amplitude of the gesture waving, and displays the progress bar of the brightness change on the ARHUD interface. Set a specific gesture, such as clenching a fist and then releasing it to increase the contrast, and releasing the fist after releasing it to reduce the contrast; the driver makes a corresponding gesture in the recognition area, the system recognizes and adjusts the contrast, and displays the change of contrast in real time on the ARHUD interface. Select a color through a specific finger pointing or rotating gesture; for example, the driver extends his index finger to point to the pre-set color identification area on the ARHUD interface (different color identifications correspond to different color options), and then rotates his wrist clockwise or counterclockwise, and the system switches to the corresponding color after recognition; this method combines pointing and rotating actions, which can not only select colors, but also fine-tune between similar colors through rotation operations.
[0066] Step 230: Obtain a first adjustment parameter based on the ARHUD adjustment operation.
[0067] Taking the ARHUD adjustment operation including the brightness adjustment operation, the contrast adjustment operation and the color adjustment operation as an example: based on the ARHUD adjustment operation, a brightness adjustment parameter, a contrast adjustment parameter and a color adjustment parameter are acquired as the first adjustment parameter.
[0068] Illustratively, if the ARHUD adjustment operation indicates that the brightness is adjusted to "80%", then "80%" is also the brightness adjustment parameter; or, if the ARHUD adjustment operation indicates that the brightness is increased by "20%", then "+20%" is also the brightness adjustment parameter. In the embodiment of the present application, the brightness adjustment amount obtained by the brightness adjustment operation is used as the brightness adjustment parameter (if the ARHUD adjustment operation indicates that the brightness is increased by "20%", then "+20%" is the brightness adjustment parameter), the contrast adjustment amount obtained by the contrast adjustment operation is used as the contrast adjustment parameter, and the color adjustment amount obtained by the color adjustment operation is used as the color adjustment parameter.
[0069] In some embodiments, the method for obtaining the first adjustment parameter based on the ARHUD adjustment operation further includes the following steps:
[0070] Step 1 , based on the ARHUD adjustment operation, brightness adjustment parameters, contrast adjustment parameters and color adjustment parameters are obtained.
[0071] The parameter acquisition method described in step 1 can refer to the description of acquiring the first adjustment parameter above, which will not be repeated here. For example, if the ARHUD adjustment operation indicates to increase the brightness by "20%", then "+20%" is also the brightness adjustment parameter.
[0072] The obtained brightness adjustment parameters, contrast adjustment parameters and color adjustment parameters can be stored in the system's memory or database for use in subsequent steps. Simple data structures such as variables or objects can be used to store these parameters to ensure that they can be easily accessed and modified during the entire adjustment process.
[0073] Step 2 , obtain facial image data of a driver in a vehicle; analyze the facial image data and determine an analysis result, wherein the analysis result is used to indicate the glasses wearing condition of the driver.
[0074] Schematically, the camera installed in the car will capture the driver's face at a preset frame rate (such as 15 frames / second) to obtain facial image data. The facial image data is input into a trained recognition model (such as a model based on a convolutional neural network, etc.), and the recognition model first determines the precise facial area in the facial image data. The recognition model can identify the bounding box containing the driver's facial area. After obtaining the bounding box, the recognition model further analyzes the image area within the bounding box, such as: identifying the eye area of the bounding box, and then extracting the regional feature representation corresponding to the eye area, and obtaining the analysis result by analyzing the regional features corresponding to the eye area. The analysis result can be realized as a probability distribution, such as [0.2, 0.8], where 0.2 indicates that the probability of not wearing glasses is 0.2, and 0.8 indicates that the probability of wearing glasses is 0.8, then the analysis result indicates that the driver wears glasses. In some embodiments, the analysis result is also used to indicate the type of glasses configured by the driver, such as contact lenses, sunglasses, glasses with transparent lenses, etc., such as [0.2, 0.3, 0.7, 0.9], where 0.2 indicates that the probability of not wearing glasses is 0.2, 0.3 indicates that the probability of wearing contact lenses is 0.3, 0.7 indicates that the probability of wearing sunglasses is 0.7, and 0.9 indicates that the probability of wearing glasses with transparent lenses is 0.9. The analysis result indicates that the driver wears glasses with transparent lenses. For contact lenses, the recognition model can analyze the color and reflection characteristics of the eyes and compare them with the feature library of normal eyes. If abnormal reflection or color change occurs, it can be inferred that contact lenses are worn.
[0075] Optionally, the collected facial image data is preprocessed, including image noise reduction, normalization and other operations. For example, a Gaussian filter algorithm is used to remove noise from the image to improve image quality, and the preprocessed facial image is input into the recognition model to make the subsequent recognition model easier to process. Optionally, the above recognition model needs to be trained on a large number of facial image data sets in advance, and the facial image data sets contain different glasses wearing conditions, different lighting conditions and facial expressions, etc.
[0076] Step 3 , when the analysis result indicates that the driver is wearing glasses, the brightness compensation data, contrast compensation data and color compensation data are determined according to the ambient lighting data of the physical environment in which the vehicle is currently located; the brightness adjustment parameters are compensated according to the brightness compensation data; the contrast adjustment parameters are compensated according to the contrast compensation data; and the color adjustment parameters are compensated according to the color compensation data.
[0077] Schematically, the vehicle is equipped with multiple ambient light sensors, which are distributed in different positions of the vehicle (such as the front windshield, roof, etc.) to measure the light intensity in different directions. The data of multiple sensors are weighted averaged to obtain the comprehensive ambient light intensity of the vehicle. For example, different weights are set according to the importance of sensors at different positions, such as the sensor weight of the front windshield is 0.6, and the sensor weight of the roof is 0.4. The calculation formula is: Comprehensive light intensity = front windshield sensor data × 0.6 + roof sensor data × 0.4.
[0078] The following is a schematic description of the determination scheme for various types of compensation data:
[0079] (1) Brightness compensation data:
[0080] When the driver wears glasses, the system will perform compensation calculations based on the light intensity. For example, when the analysis results show that the driver is wearing sunglasses with dark lenses and is in a high-light environment, the system will use the predefined rules to add an additional 30% brightness compensation, and then multiply the original brightness adjustment parameter by 1.3 to get the compensated brightness adjustment parameter. For glasses with transparent lenses in low-light environments, the system will use the predefined rules to add 10% brightness compensation, and then multiply the original brightness adjustment parameter by 1.1 to get the compensated brightness adjustment parameter. For contact lenses, the calculation can be based on the transmittance characteristics of the contact lenses combined with the light intensity. For example, for contact lenses with a transmittance of 80%, in a medium-light environment, the brightness compensation is 15%, then the compensated brightness adjustment parameter = original brightness adjustment parameter × (1 + 15% × (1-transmittance)).
[0081] (2) Contrast compensation data:
[0082] Considering that glasses can affect the contrast perception of an image, in a high-light environment, if you wear glasses, you need to increase the contrast compensation by 20% to ensure a clear image. Then, the original contrast adjustment parameter is multiplied by 1.2 to get the compensated contrast adjustment parameter. In a low-light environment, the contrast compensation needs to be reduced to avoid excessive contrast causing visual fatigue. For example, when wearing glasses with clear lenses, the contrast can be reduced by 10%. Then, the original contrast adjustment parameter is multiplied by 0.9 to get the compensated contrast adjustment parameter.
[0083] (3) Color compensation data:
[0084] Different types of glasses have different effects on color. Sunglasses may filter out some colors, and the system will determine the color components that need to be compensated based on spectral analysis. For example, for sunglasses that filter more blue light, in a high-light environment, the compensation of the blue component can be appropriately increased, such as increasing the intensity of blue by 15%. Then multiplying the blue component in the color adjustment parameter by 1.15 can obtain the compensated color adjustment parameter. For contact lenses that cause color deviation, matrix multiplication is performed on the color adjustment parameters according to the pre-stored color offset matrix to compensate for the color deviation. Contact lenses that cause color deviation include colored contact lenses, contact lenses with special optical coatings, etc.
[0085] Step 4 , obtaining a compensated brightness adjustment parameter, a compensated luminance adjustment parameter, and a compensated color adjustment parameter as a first adjustment parameter.
[0086] Finally, the compensated brightness, contrast and color adjustment parameters are stored in the system's storage unit as the first adjustment parameters of the ARHUD information. The system will pass these parameters to the AR algorithm unit to update the display effect of the ARHUD information.
[0087] It should be noted that the above examples of various numerical values are only for illustrative purposes. In actual applications, technicians can adjust the above numerical values according to actual conditions, and no limitation is made here.
[0088] In some embodiments, at least one preset display mode is displayed, and at least one preset display mode corresponds to at least two display parameters respectively; a selection operation of a target display mode in at least one preset display mode is received as an ARHUD adjustment operation; and a first adjustment parameter is determined based on at least two display parameters corresponding to the target display mode.
[0089] Illustratively, in the ARHUD interface, a menu or mode list is provided for displaying at least one preset display mode. These preset display modes can be presented in the form of icons, text labels or thumbnails.
[0090] At least one preset display mode includes day mode, night mode, highway mode, city mode, etc. Different display modes have different display parameters, which include brightness display parameters, contrast display parameters, and color display parameters. Schematically, the display parameters in the day mode can be set to higher brightness, higher contrast, and color combinations suitable for daytime environments, such as white fonts with dark backgrounds to ensure clear visibility under strong light. The display parameters include: brightness 80%, contrast 90%, white fonts with RGB (255, 255, 255) and black backgrounds with RGB (0, 0, 0). In order to avoid visual interference to the driver in low-light environments, the display parameters of the night mode can be lower brightness, lower contrast, and soft colors. For example, brightness 30%, contrast 50%, gray fonts with RGB (180, 180, 180) and dark gray backgrounds with RGB (30, 30, 30).
[0091] When a user clicks on an icon of a display mode on the ARHUD interface, for example, the user clicks on the icon representing "night driving mode", the system will recognize the click operation as a selection operation. Alternatively, the user can use voice commands, such as "switch to day mode", and the system will recognize the user's intention through voice recognition technology and determine the target display mode. After determining the target display mode, the system will search for the display parameters corresponding to the mode in the data structure storing the display mode.
[0092] After obtaining at least two display parameters of the target display model, the at least two display parameters are compared with the first display parameter, and the first adjustment parameter is determined according to the difference between the at least two display parameters and the first display parameter. For example, for the brightness display parameter, the brightness display parameter of the target display model and the brightness display parameter of the first display parameter are obtained, and the difference between them is calculated as the brightness adjustment parameter. If the brightness display parameter of the target display model is greater than the brightness display parameter of the first display parameter, the brightness adjustment parameter is positive, and if the brightness display parameter of the target display model is less than the brightness display parameter of the first display parameter, the brightness adjustment parameter is negative.
[0093] Optionally, the system can continuously update the display parameters of the display mode to adapt to different user needs, for example, fine-tuning the display parameters such as brightness, contrast, and color based on the user's historical ARHUD adjustment operations, so that the display mode can be dynamically adjusted according to user needs. Through the above solution, users can easily select a preset display mode, and the system can quickly adjust the display effect of ARHUD to meet the needs of different driving scenarios, while improving the convenience of operation and the practicality of the system.
[0094] Step 240, adjusting the first display parameter based on the current vehicle driving status data and the first adjustment parameter to obtain a second display parameter corresponding to the ARHUD information.
[0095] The second display parameter is used to characterize the second visual effect of the ARHUD information.
[0096] Optionally, the driving status data includes at least one of the following data:
[0097] (1) Real-time operating status of the vehicle during driving.
[0098] The real-time operating status includes at least one of the vehicle position data, driving speed data, steering angle data, vehicle posture data, etc. of the vehicle.
[0099] (2) Environmental data of the vehicle’s current physical environment.
[0100] The environmental data includes at least one of real scene image data and environmental lighting data.
[0101] Schematically, the real-life image data of the vehicle driving is obtained through the cameras installed around the vehicle, including lane lines, traffic signs, road conditions, etc. The ambient light data is the light intensity and direction in the physical environment where the vehicle is currently located. The vehicle can be equipped with a special light sensor to obtain the ambient light data in real time.
[0102] (3) Vehicle navigation data.
[0103] Among them, the vehicle navigation data includes at least one of navigation route data and high-precision map data.
[0104] Schematically, the navigation route data includes information such as the starting point, destination, waypoints and planned driving route, and the high-precision map data contains detailed road information, such as the geometry of the road (such as the curvature of the curve, the length of the straight section, etc.), lane information (number of lanes, lane width, lane type, etc.), traffic signs and landmark locations, etc.
[0105] In some embodiments, the first display parameter is adjusted based on the driving status data of the current vehicle to obtain the third display parameter; the third display parameter is adjusted based on the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information.
[0106] Taking brightness adjustment parameter, contrast adjustment parameter and color adjustment parameter as the first adjustment parameter as an example, optionally, the first display parameter is adjusted based on the driving status data of the current vehicle to obtain the third display parameter; the brightness display parameter in the third display parameter is adjusted according to the brightness adjustment parameter, the contrast display parameter in the third display parameter is adjusted according to the contrast adjustment parameter, and the color display parameter in the third display parameter is adjusted according to the color adjustment parameter; the adjusted third display parameter is obtained as the second display parameter corresponding to the ARHUD information.
[0107] The following uses a dynamic navigation arrow as an example to schematically illustrate the process of adjusting the first display parameter based on the current vehicle driving status data to obtain the third display parameter:
[0108] Step 1 : Get the vehicle's driving status data.
[0109] Schematically, the vehicle's navigation system usually obtains navigation-related data such as the vehicle's current location, driving direction, and destination information through a satellite positioning system, map data, and vehicle sensors. The navigation system transmits this data to the AR algorithm unit of the ARHUD system through an in-vehicle communication network (such as a CAN bus, etc.).
[0110] Step 2 : AR algorithm processing.
[0111] The AR algorithm unit calculates the exact position and direction of the dynamic navigation arrow relative to the front windshield of the vehicle based on the received navigation data and the real-time sensor data of the vehicle (such as vehicle speed, steering angle, etc.). For example, the specific angle at which the arrow should point is determined in combination with the vehicle's current driving direction and the upcoming steering instruction. At the same time, the AR algorithm unit uses the vehicle's camera (such as a forward-looking camera) to obtain image information of the physical environment in front of the vehicle. Through image recognition and processing technology, environmental elements such as roads, lane lines, and traffic signs are identified. The dynamic navigation arrow is then fused and calculated with these environmental elements to ensure that the display position of the arrow on the windshield matches the actual physical environment. For example, the arrow should accurately point to the direction of the road where the turn is about to take place, and will not block important road signs.
[0112] Step 3 : Determine the third display parameter.
[0113] Optionally, the third display parameter includes at least one of a brightness display parameter, a contrast display parameter, a color display parameter, a position display parameter, a size display parameter, etc.
[0114] For brightness display parameters: adjust the brightness display parameters according to the ambient light data of the vehicle. For example, in a high-light environment, increase the display brightness of the dynamic navigation arrow to ensure that the driver can see it clearly; in a low-light environment, reduce the brightness appropriately to avoid visual interference to the driver.
[0115] Contrast display parameters: Combine the background and arrow color to adjust the contrast display parameters so that the arrow contrasts with the background (i.e. the real scene in front of the vehicle) and is easy to identify. For example, when the background is a bright sky, increase the contrast of the arrow to make it more eye-catching.
[0116] Color display parameters: Select appropriate color display parameters based on the type and importance of navigation information. For example, green is usually used to indicate normal driving direction guidance, and red is used for warning navigation information (such as about to miss an exit, etc.).
[0117] Regarding position display parameters: Based on the results calculated by the previous AR algorithm, the position display parameters are determined to ensure that the dynamic navigation arrow is displayed in the appropriate position in the driver's field of view.
[0118] Size display parameters: Considering the driver's visual distance and perspective, as well as the size of the windshield, the size display parameters are adjusted. The size can also be adjusted appropriately at different vehicle speeds. For example, when the vehicle speed is high, the arrow size can be appropriately increased to facilitate quick identification by the driver.
[0119] After determining the third display parameter, the brightness display parameter in the third display parameter is adjusted by the brightness adjustment parameter, the contrast display parameter in the third display parameter is adjusted according to the contrast adjustment parameter, and the color display parameter in the third display parameter is adjusted according to the color adjustment parameter, and the adjusted third display parameter is obtained as the second display parameter corresponding to the ARHUD information. In schematic, assuming that the brightness adjustment parameter is "+20%", the brightness display parameter in the third display parameter is "60%", then "80%" is used as the brightness display parameter in the second display parameter; assuming that the contrast adjustment parameter is "-20%", the contrast display parameter in the third display parameter is "50%", then "30%" is used as the contrast display parameter in the second display parameter; assuming that the color adjustment parameter (the color is represented by RGB value) is "[25, 30, 40]", the color display parameter in the third display parameter is "[100, 100, 100]", then "[125, 130, 140]" is used as the color display parameter in the second display parameter.
[0120] Step 250: Update the ARHUD information of the vehicle based on the second display parameter.
[0121] Schematically, after obtaining the second display parameter, the AR algorithm unit sends the second display parameter to the microdisplay. The microdisplay generates an image containing ARHUD information based on the received second display parameter. The microdisplay projects the generated image onto the front windshield of the vehicle at a specific angle and intensity through an optical system. The projected light is reflected and refracted by the windshield and enters the driver's eyes. The driver sees the reflected and refracted ARHUD information through the front windshield, and the ARHUD information is integrated with the actual physical environment in front of the vehicle to form an augmented reality visual effect.
[0122] In some other embodiments, the ARHUD adjustment operation is also used to adjust the display content of the ARHUD information, and the ARHUD information corresponds to the first display content. Optionally, the ARHUD adjustment operation includes a display content adjustment operation; obtaining a second adjustment parameter based on the display content adjustment operation, and the second adjustment parameter is used to adjust the second display content; adjusting the first display content based on the current vehicle driving status data to obtain the second display content; adjusting the second display content according to the second adjustment parameter to obtain the third display content; updating the ARHUD information of the displayed vehicle based on the second display parameter and the third display content.
[0123] Indicatively, the system adjusts the first display content according to the current vehicle driving status data to obtain the second display content. The vehicle's driving status data, such as speed, steering angle, position, etc., will affect which information should be displayed or hidden. For example, when driving at high speed, the display of some minor information will be automatically reduced to avoid distracting the driver; when approaching an intersection, information such as turning prompts will be added. Among them, the content adjustment operation triggered by the user can be to reduce the display content or increase the display content, such as adding specific warning signs, deleting tire pressure monitoring, etc. If the user chooses to increase the display content, the second adjustment parameter contains which information to add. If the display content is reduced, the second adjustment parameter contains an indication of which information to remove.
[0124] Optionally, the ARHUD adjustment operation may be an operation received on the vehicle terminal or on a mobile terminal (such as Figure 1 The operation received on the output terminal 120) is schematically shown in FIG. Figure 3 The vehicle terminal 301 is a terminal system inside the vehicle, and the vehicle terminal 301 has a touch screen; the vehicle control application, that is, the target application, is installed in the mobile terminal 302, and the mobile terminal 302 also has a touch screen. The vehicle customization interface can be entered from the vehicle terminal 301 or the mobile terminal 302, and the ARHUD interface can be entered by clicking the ARHUD option in the vehicle customization interface; the ARHUD adjustment operation can be performed in the ARHUD interface, such as: customizing the display content and display parameters of the ARHUD information.
[0125] In summary, the vehicle display control method provided in the embodiment of the present application obtains a first adjustment parameter by receiving the user's ARHUD adjustment operation on the ARHUD information, and adjusts the display parameters corresponding to the ARHUD information based on the driving status data and the first adjustment parameter to adjust the visual effect of the ARHUD information. The driving status data reflects the real-time driving status of the vehicle during driving, and the display parameters are adjusted according to the driving status data to make the ARHUD information more in line with the actual driving condition of the vehicle; the ARHUD adjustment operation reflects the user's display needs, and the display parameters are adjusted according to the ARHUD adjustment operation to make the ARHUD information meet the user's visual needs and actual driving needs in different scenarios, thereby realizing dynamic adjustment of the ARHUD information, and the adjusted ARHUD information meets the actual driving condition of the vehicle and user needs, thereby improving the matching degree between the ARHUD information and the actual driving scene, thereby improving the display accuracy of the ARHUD information.
[0126] Figure 4 This is a flow chart of a vehicle display control method provided in an embodiment of the present application. For illustration, please refer to Figure 4 , Figure 2 The illustrated step 240 also includes the following steps 441 to 443 .
[0127] Step 441, obtaining a parameter weight corresponding to the first display parameter.
[0128] The parameter weight is used to indicate the influence of the ARHUD adjustment operation on the first display parameter.
[0129] Optionally, a brightness parameter weight corresponding to the brightness adjustment parameter is obtained, where the brightness parameter weight is used to indicate the degree of influence of the ARHUD adjustment operation on the brightness display parameter; the brightness adjustment parameter is adjusted according to the brightness parameter weight, and the third display parameter is updated using the adjusted brightness adjustment parameter.
[0130] Optionally, a contrast parameter weight corresponding to the contrast adjustment parameter is obtained, where the contrast parameter weight is used to indicate the degree of influence of the ARHUD adjustment operation on the contrast display parameter; the contrast adjustment parameter is adjusted according to the contrast parameter weight, and the third display parameter is updated using the adjusted contrast adjustment parameter.
[0131] Optionally, a color parameter weight corresponding to the color adjustment parameter is obtained, where the color parameter weight is used to indicate the degree of influence of the ARHUD adjustment operation on the color display parameter; the color adjustment parameter is adjusted according to the color parameter weight, and the third display parameter is updated using the adjusted color adjustment parameter.
[0132] Indicatively, the brightness parameter weight, contrast parameter weight, and color parameter weight are indicators used to quantify the degree of influence of the ARHUD adjustment operation on the corresponding display parameters. These weights can be values between 0 and 1, where 0 means no influence and 1 means full influence. For example, the brightness parameter weight is 0.5, and the user's brightness adjustment amount for the brightness adjustment operation is "+20%", and the final brightness adjustment parameter acting on the third display parameter is "+10%".
[0133] Optionally, the method for obtaining the parameter weight corresponding to the first display parameter includes at least one of the following methods:
[0134] (1) Acquiring historical operation data, where the historical operation is used to indicate the operation data of the ARHUD adjustment operation within a historical time period; determining an adjustment frequency and an adjustment amplitude according to the historical operation data; determining a parameter weight corresponding to a first display parameter according to the adjustment frequency and the adjustment amplitude; there is a positive correlation between the adjustment frequency and the parameter weight, and there is a positive correlation between the adjustment amplitude and the parameter weight.
[0135] Historical operation data: refers to the data related to the user's adjustment operations on the ARHUD information in a certain historical period in the past, such as the user's adjustment records of parameters such as brightness, contrast, and color at different times. Adjustment frequency: Statistics on the number of times the user adjusted the ARHUD information in the historical period, reflecting the frequency of the user's adjustment of the ARHUD display effect. Adjustment range: Measures the size of the change in the relevant parameters (such as the change in brightness from one value to another) in each adjustment operation.
[0136] Indicatively, the weight is determined based on the adjustment frequency and the adjustment amplitude. The higher the adjustment frequency, the higher the user's attention to the parameter, and the corresponding weight should be higher; the larger the adjustment amplitude, the more sensitive the user is to the parameter, and the weight should be increased accordingly. Optionally, the adjustment frequency and the adjustment amplitude are combined to calculate the weight, such as multiplying the adjustment frequency by a first preset coefficient, multiplying the adjustment amplitude by a second preset coefficient, adding the two products to obtain a comprehensive value, and normalizing the comprehensive value to a range of 0 to 1 to obtain the parameter weight.
[0137] (2) determining a driving scenario of the vehicle based on driving status data, where the driving status data includes at least one of a type of road the vehicle is currently traveling on, weather conditions, and a time period; and determining a parameter weight corresponding to the first display parameter based on the driving scenario.
[0138] Schematically, the driving status data includes information such as the type of road the vehicle is currently traveling on (such as expressways, city streets, country roads, etc.), weather conditions (sunny, rainy, foggy, etc.), and time periods (daytime, nighttime, etc.). Different combinations of road types, weather conditions, and time periods form different driving scenarios. For example, driving on a highway at night is one scenario, and driving on a city street in the rain is another scenario. In different driving scenarios, the degree of influence of user adjustment operations on the display parameters varies.
[0139] Among them, the road type can be determined by matching the vehicle navigation system or geographic positioning information with the map data. For example, the current position of the vehicle is obtained through the positioning system, and then compared with the map database to determine whether the vehicle is traveling on a highway, a city street or a country road. Weather conditions can be obtained through the vehicle's meteorological sensors, such as a rain sensor that can determine whether it is raining, and a light sensor that can assist in determining whether it is sunny or cloudy. More accurate weather information can also be obtained by connecting to external meteorological services. The time period can be determined based on the clock of the vehicle system, simply dividing a day into day and night, or more finely divided into different time periods such as early morning, morning, noon, afternoon, evening, and night. The road types, weather conditions, and time periods collected above are combined to form different driving scenarios. For example, different driving scene combinations such as "highway-sunny-day", "city street-rainy day-night" are formed. Corresponding parameter weights are assigned to each different driving scene. For different driving scenes, the degree of influence of the ARHUD adjustment operation on the display parameters is determined, and corresponding weights are assigned to them. For example, for some scenarios that require users to concentrate highly (such as driving on a highway at night), the user's autonomous adjustment of display parameters may be restricted, so the weight in this scenario can be set lower; while for some relatively relaxing scenarios (such as driving on city streets on sunny daytime), users pay more attention to personalized display, so the weight in this scenario can be set higher.
[0140] (3) Identifying the fatigue level of the driver of the vehicle; determining a parameter weight corresponding to the first display parameter according to the fatigue level, wherein there is a negative correlation between the fatigue level and the parameter weight.
[0141] Indicatively, the weight is determined by identifying the fatigue level of the vehicle driver. If the driver's fatigue level is high, in order to ensure driving safety, the impact of the driving status data on the display parameters should be more prominent to ensure that the displayed information can timely and accurately reflect the vehicle status and help the driver deal with road conditions. At this time, the parameter weight is reduced. That is, the fatigue level is negatively correlated with the parameter weight. The following is an example of a method for identifying the fatigue level of a vehicle driver:
[0142] The driver's facial image is continuously collected at a fixed frame rate (such as 30 frames per second) through the camera installed in the car. The camera must be able to clearly capture the key areas of the driver's face, such as the eyes, mouth, eyebrows, etc. At the same time, the vehicle's own sensors are used to obtain the vehicle's driving status data, such as vehicle speed, acceleration, steering wheel angle and other information. These data can reflect the driver's control of the vehicle and assist in fatigue judgment. The facial image and driving status data are input into the trained neural network model, and a probability distribution is output, which represents the probability of the driver being in different fatigue levels. For example, the output result is [0.8, 0.1, 0.05, 0.05], which corresponds to the probabilities of "awake", "mild fatigue", "moderate fatigue" and "severe fatigue", respectively, indicating that the probability of the driver being in the "awake" state is 80%. According to the output probability distribution, the category with the highest probability is selected as the driver's fatigue level predicted by the model. For example, if the probability value corresponding to "moderate fatigue" is the largest among all categories, it is determined that the driver is currently in a moderate fatigue state.
[0143] After determining the fatigue level, the parameter weight is determined according to the determined fatigue level. Since the fatigue level is negatively correlated with the parameter weight, when it is determined to be in an awake state, a higher weight is given; when it is determined to be a fatigue state (such as moderate fatigue or severe fatigue), a lower weight is given to ensure that when the driver is fatigued, the driving status data has a greater impact on the displayed parameters to ensure driving safety.
[0144] Step 442: adjust the first display parameter according to the driving status data to obtain a third display parameter.
[0145] Optionally, the first display parameter includes at least one of a brightness display parameter, a contrast display parameter, a color display parameter, a position display parameter, a size display parameter, and the like.
[0146] The specific process of adjusting the first display parameter according to the driving status data to obtain the third display parameter can be referred to step 240, which will not be described in detail here.
[0147] Step 443: adjust the third display parameter according to the parameter weight and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information.
[0148] The first adjustment parameter includes at least one of a brightness adjustment parameter, a contrast adjustment parameter, a color adjustment parameter, and the like.
[0149] Optionally, the first adjustment parameter is adjusted according to the parameter weight to obtain the adjusted first adjustment parameter; and the third display parameter is adjusted based on the adjusted first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information.
[0150] Schematically, the parameter weight indicates the degree of influence of the ARHUD adjustment operation on the first display parameter, and the value range is usually between 0 and 1. For example, if the parameter weight is 0.8 and the brightness adjustment parameter is "+20%", the adjusted brightness adjustment parameter is "+16%".
[0151] In the above embodiment, by adjusting the brightness, contrast, color and other display parameters in the third display parameter, the second display parameter corresponding to the ARHUD information is finally obtained. This parameter comprehensively considers the driving status and user adjustment requirements, and presents a visual effect that conforms to the actual driving scenario and user expectations.
[0152] Figure 5 is a structural block diagram of a display control device for a vehicle provided by an exemplary embodiment of the present application, such as Figure 5 As shown, the device includes the following parts:
[0153] A display module 510 is used to display augmented reality head-up display (ARHUD) information of the vehicle, where the ARHUD information is used to indicate vehicle prompt information integrated with the physical environment currently located by the vehicle; the ARHUD information corresponds to a first display parameter, where the first display parameter is used to characterize a first visual effect of the ARHUD information;
[0154] An input module 520 is used to receive an ARHUD adjustment operation on the ARHUD information, where the ARHUD adjustment operation is used to adjust a visual effect of the ARHUD information;
[0155] A control module 530, configured to obtain a first adjustment parameter based on the ARHUD adjustment operation;
[0156] The control module 530 is further configured to adjust the first display parameter based on the current driving state data of the vehicle and the first adjustment parameter to obtain a second display parameter corresponding to the ARHUD information, wherein the second display parameter is used to represent a second visual effect of the ARHUD information;
[0157] The display module 510 is further used to update and display the ARHUD information of the vehicle based on the second display parameter.
[0158] In some embodiments, the ARHUD adjustment operation includes at least one of a brightness adjustment operation, a contrast adjustment operation, and a color adjustment operation;
[0159] Among them, the brightness adjustment parameter is used to adjust the display brightness of the ARHUD information, the contrast adjustment parameter is used to adjust the display contrast of the ARHUD information, and the color adjustment parameter is used to adjust the display color of the ARHUD information.
[0160] In some embodiments, the ARHUD adjustment operation includes the brightness adjustment operation, the contrast adjustment operation and the color adjustment operation; the control module 530 is used to:
[0161] Based on the ARHUD adjustment operation, acquiring a brightness adjustment parameter, a contrast adjustment parameter, and a color adjustment parameter as the first adjustment parameter;
[0162] Adjusting the first display parameter based on the current driving state data of the vehicle to obtain a third display parameter;
[0163] adjusting a brightness display parameter in the third display parameter according to the brightness adjustment parameter, adjusting a contrast display parameter in the third display parameter according to the contrast adjustment parameter, and adjusting the color display parameter in the third display parameter according to the color adjustment parameter;
[0164] The adjusted third display parameter is obtained as the second display parameter corresponding to the ARHUD information.
[0165] In some embodiments, the control module 530 is used to:
[0166] Acquire a parameter weight corresponding to the first display parameter, where the parameter weight is used to indicate the degree of influence of the ARHUD adjustment operation on the first display parameter;
[0167] adjusting the first display parameter according to the driving state data to obtain a third display parameter;
[0168] The third display parameter is adjusted according to the parameter weight and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information.
[0169] In some embodiments, the control module 530 is used to:
[0170] Acquire historical operation data, where the historical operation is used to indicate operation data of the ARHUD adjustment operation within a historical time period;
[0171] Determine the adjustment frequency and adjustment range according to the historical operation data;
[0172] The parameter weight corresponding to the first display parameter is determined according to the adjustment frequency and the adjustment amplitude; there is a positive correlation between the adjustment frequency and the parameter weight, and there is a positive correlation between the adjustment amplitude and the parameter weight.
[0173] In some embodiments, the control module 530 is used to:
[0174] Determining a driving scene of the vehicle according to the driving state data, wherein the driving state data includes at least one of a type of road, weather conditions, and time period on which the vehicle is currently traveling;
[0175] The parameter weight corresponding to the first display parameter is determined according to the driving scene.
[0176] In some embodiments, the control module 530 is used to:
[0177] identifying a level of fatigue of a driver of the vehicle;
[0178] The parameter weight corresponding to the first display parameter is determined according to the fatigue degree, and there is a negative correlation between the fatigue degree and the parameter weight.
[0179] In some embodiments, the ARHUD adjustment operation includes a brightness adjustment operation, a contrast adjustment operation, and a color adjustment operation; the control module 530 is used to:
[0180] Acquire a brightness adjustment parameter, a contrast adjustment parameter, and a color adjustment parameter based on the ARHUD adjustment operation;
[0181] Acquiring facial image data of the driver in the vehicle; analyzing the facial image data to determine an analysis result, wherein the analysis result is used to indicate the glasses wearing condition of the driver;
[0182] In the case where the analysis result indicates that the driver wears glasses, determining brightness compensation data, contrast compensation data and color compensation data according to ambient lighting data of a physical environment in which the vehicle is currently located;
[0183] Compensate the brightness adjustment parameter according to the brightness compensation data; compensate the contrast adjustment parameter according to the contrast compensation data; compensate the color adjustment parameter according to the color compensation data;
[0184] The compensated brightness adjustment parameter, the compensated luminance adjustment parameter, and the compensated color adjustment parameter are obtained as the first adjustment parameter.
[0185] In some embodiments, the input module 520 is used to:
[0186] Display at least one preset display mode, wherein the at least one preset display mode corresponds to at least two display parameters;
[0187] receiving a selection operation of a target display mode from the at least one preset display mode as the ARHUD adjustment operation;
[0188] The control module 530 is used to:
[0189] The first adjustment parameter is determined based on at least two display parameters corresponding to the target display mode.
[0190] In summary, the display control device of the vehicle provided in the embodiment of the present application obtains a first adjustment parameter by receiving the ARHUD adjustment operation of the user on the ARHUD information, and adjusts the display parameters corresponding to the ARHUD information according to the comprehensive driving status data and the first adjustment parameter to adjust the visual effect of the ARHUD information. The driving status data reflects the real-time driving status of the vehicle during driving, and the display parameters are adjusted according to the driving status data to make the ARHUD information more in line with the actual driving condition of the vehicle; the ARHUD adjustment operation reflects the display needs of the user, and the display parameters are adjusted according to the ARHUD adjustment operation to make the ARHUD information meet the visual needs and actual driving needs of the user in different scenarios, thereby realizing dynamic adjustment of the ARHUD information, and the adjusted ARHUD information meets the actual driving condition of the vehicle and user needs, thereby improving the matching degree between the ARHUD information and the actual driving scene, thereby improving the display accuracy of the ARHUD information.
[0191] It should be noted that the display control device for a vehicle provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the display control device for a vehicle provided in the above embodiment and the embodiment of the display control method for a vehicle belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.
[0192] Figure 6 The block diagram of the structure of a computer device 600 provided by an exemplary embodiment of the present application is shown. The computer device 600 may be a smart phone, a vehicle-mounted terminal, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Group Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Group Audio Layer 4), a laptop computer or a desktop computer. The computer device 600 may also be a vehicle with a vehicle-mounted terminal, which is not limited in the present application.
[0193] Typically, the computer device 600 includes a processor 601 and a memory 602 .
[0194] The processor 601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 601 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 601 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 601 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 601 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.
[0195] The memory 602 may include one or more computer-readable storage media, which may be non-transitory. The memory 602 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 602 is used to store at least one instruction, which is used to be executed by the processor 601 to implement the display control method of the vehicle provided in the method embodiment of the present application.
[0196] In some embodiments, the computer device 600 further includes one or more sensors, including but not limited to: a proximity sensor, a gyroscope sensor, and a pressure sensor.
[0197] The proximity sensor, also called a distance sensor, is usually disposed on the front panel of the computer device 600. The proximity sensor is used to collect the distance between the user and the front of the computer device 600.
[0198] The gyroscope sensor can detect the body direction and rotation angle of the computer device 600, and the gyroscope sensor can cooperate with the acceleration sensor to collect the user's 3D actions on the computer device 600. The processor 601 can implement the following functions based on the data collected by the gyroscope sensor: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.
[0199] The pressure sensor can be set on the side frame of the computer device 600 and / or the lower layer of the display screen. When the pressure sensor is set on the side frame of the computer device 600, it can detect the user's grip signal of the computer device 600, and the processor 601 performs left and right hand recognition or shortcut operations according to the grip signal collected by the pressure sensor. When the pressure sensor is set on the lower layer of the display screen, the processor 601 controls the operability controls on the UI interface according to the user's pressure operation on the display screen. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.
[0200] In some embodiments, the computer device 600 also includes other components, which can be understood by those skilled in the art. Figure 6 The structure shown in the figure does not constitute a limitation on the computer device 600, and the computer device 600 may include more or less components than those shown in the figure, or combine some components, or adopt a different arrangement of components.
[0201] An embodiment of the present application also provides a computer device, which includes a processor and a memory, in which at least one instruction, at least one program, a code set or an instruction set is stored, and the at least one instruction, at least one program, a code set or an instruction set is loaded and executed by the processor to implement the vehicle display control method provided by the above-mentioned method embodiments.
[0202] An embodiment of the present application also provides a computer-readable storage medium, on which is stored at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by a processor to implement the vehicle display control method provided by the above-mentioned method embodiments.
[0203] The embodiments of the present application also provide a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the display control method of the vehicle described in any of the above embodiments.
[0204] Optionally, the computer readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a solid state drive (SSD), or an optical disk. Among them, the random access memory may include a resistance random access memory (ReRAM) and a dynamic random access memory (DRAM). The serial numbers of the above embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.
[0205] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.
[0206] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.
Claims
1. A display control method for a vehicle, characterized in that: The method comprises: displaying augmented reality head-up display (ARHUD) information of the vehicle, wherein the ARHUD information is used to indicate vehicle prompt information integrated with a physical environment currently located by the vehicle; the ARHUD information corresponds to a first display parameter, and the first display parameter is used to characterize a first visual effect of the ARHUD information; receiving an ARHUD adjustment operation on the ARHUD information, where the ARHUD adjustment operation is used to adjust a visual effect of the ARHUD information; Acquire a first adjustment parameter based on the ARHUD adjustment operation; adjusting the first display parameter based on the current driving state data of the vehicle and the first adjustment parameter to obtain a second display parameter corresponding to the ARHUD information, wherein the second display parameter is used to represent a second visual effect of the ARHUD information; The ARHUD information displayed on the vehicle is updated based on the second display parameter.
2. The method according to claim 1, characterized in that The ARHUD adjustment operation includes at least one of a brightness adjustment operation, a contrast adjustment operation and a color adjustment operation; Among them, the brightness adjustment parameter is used to adjust the display brightness of the ARHUD information, the contrast adjustment parameter is used to adjust the display contrast of the ARHUD information, and the color adjustment parameter is used to adjust the display color of the ARHUD information.
3. The method according to claim 2, characterized in that The ARHUD adjustment operation includes the brightness adjustment operation, the contrast adjustment operation and the color adjustment operation; The acquiring a first adjustment parameter based on the ARHUD adjustment operation includes: Based on the ARHUD adjustment operation, acquiring a brightness adjustment parameter, a contrast adjustment parameter, and a color adjustment parameter as the first adjustment parameter; The adjusting the first display parameter based on the current driving state data of the vehicle and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information includes: Adjusting the first display parameter based on the current driving state data of the vehicle to obtain a third display parameter; adjusting a brightness display parameter in the third display parameter according to the brightness adjustment parameter, adjusting a contrast display parameter in the third display parameter according to the contrast adjustment parameter, and adjusting the color display parameter in the third display parameter according to the color adjustment parameter; The adjusted third display parameter is obtained as the second display parameter corresponding to the ARHUD information.
4. The method according to any one of claims 1 to 3, characterized in that: The adjusting the first display parameter based on the current driving state data of the vehicle and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information includes: Acquire a parameter weight corresponding to the first display parameter, where the parameter weight is used to indicate the degree of influence of the ARHUD adjustment operation on the first display parameter; adjusting the first display parameter according to the driving state data to obtain a third display parameter; The third display parameter is adjusted according to the parameter weight and the first adjustment parameter to obtain the second display parameter corresponding to the ARHUD information.
5. The method according to claim 4, characterized in that The obtaining a parameter weight corresponding to the first display parameter includes: Acquire historical operation data, where the historical operation is used to indicate operation data of the ARHUD adjustment operation within a historical time period; Determine the adjustment frequency and adjustment range according to the historical operation data; The parameter weight corresponding to the first display parameter is determined according to the adjustment frequency and the adjustment amplitude; there is a positive correlation between the adjustment frequency and the parameter weight, and there is a positive correlation between the adjustment amplitude and the parameter weight.
6. The method according to claim 4, characterized in that The obtaining a parameter weight corresponding to the first display parameter includes: Determining a driving scene of the vehicle according to the driving state data, wherein the driving state data includes at least one of a type of road, weather conditions, and time period on which the vehicle is currently traveling; The parameter weight corresponding to the first display parameter is determined according to the driving scene.
7. The method according to claim 4, characterized in that The obtaining a parameter weight corresponding to the first display parameter includes: identifying a level of fatigue of a driver of the vehicle; The parameter weight corresponding to the first display parameter is determined according to the fatigue degree, and there is a negative correlation between the fatigue degree and the parameter weight.
8. The method according to any one of claims 1 to 3, characterized in that: The ARHUD adjustment operation includes a brightness adjustment operation, a contrast adjustment operation and a color adjustment operation; The acquiring a first adjustment parameter based on the ARHUD adjustment operation includes: Acquire a brightness adjustment parameter, a contrast adjustment parameter, and a color adjustment parameter based on the ARHUD adjustment operation; Acquiring facial image data of the driver in the vehicle; analyzing the facial image data to determine an analysis result, wherein the analysis result is used to indicate the glasses wearing condition of the driver; In the case where the analysis result indicates that the driver wears glasses, determining brightness compensation data, contrast compensation data and color compensation data according to ambient lighting data of a physical environment in which the vehicle is currently located; Compensate the brightness adjustment parameter according to the brightness compensation data; compensate the contrast adjustment parameter according to the contrast compensation data; compensate the color adjustment parameter according to the color compensation data; The compensated brightness adjustment parameter, the compensated luminance adjustment parameter, and the compensated color adjustment parameter are obtained as the first adjustment parameter.
9. The method according to any one of claims 1 to 3, characterized in that: Before the receiving of the ARHUD adjustment operation on the ARHUD information, the method further includes: Display at least one preset display mode, wherein the at least one preset display mode corresponds to at least two display parameters; The receiving an ARHUD adjustment operation on the ARHUD information includes: receiving a selection operation of a target display mode from the at least one preset display mode as the ARHUD adjustment operation; The acquiring a first adjustment parameter based on the ARHUD adjustment operation includes: The first adjustment parameter is determined based on at least two display parameters corresponding to the target display mode.
10. A display control device for a vehicle, characterized in that: The device comprises: A display module, used for displaying augmented reality head-up display (ARHUD) information of the vehicle, wherein the ARHUD information is used to indicate vehicle prompt information integrated with a physical environment in which the vehicle is currently located; the ARHUD information corresponds to a first display parameter, and the first display parameter is used to characterize a first visual effect of the ARHUD information; An input module, used for receiving an ARHUD adjustment operation on the ARHUD information, wherein the ARHUD adjustment operation is used for adjusting a visual effect of the ARHUD information; A control module, configured to obtain a first adjustment parameter based on the ARHUD adjustment operation; The control module is further used to adjust the first display parameter based on the current driving state data of the vehicle and the first adjustment parameter to obtain a second display parameter corresponding to the ARHUD information, wherein the second display parameter is used to characterize a second visual effect of the ARHUD information; The display module is also used to update and display the ARHUD information of the vehicle based on the second display parameter.
Citation Information
Patent Citations
Vehicle display enhancement
CN112699895A
Optical display device, display system, vehicle and color adjusting method
CN116068759A
Display brightness adjusting method and device and electronic equipment
CN117198179A
AR-HUD intelligent adjusting system and method based on multi-modal large model
CN118953014A
Method for controlling display device of vehicle, medium and display device
US20240321153A1