Image presentation control method, and electronic device, storage medium, HUD system and transportation means
By detecting angle changes in the vehicle head-up display system and performing image compensation, the impact of bumpy roads on AR display is solved, and the driving experience is improved.
Patent Information
- Application Number
- PCT/CN2024/070801
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-11
- Filing Date
- 2024-01-05
- Publication Date
- 2024-11-14
AI Technical Summary
When a vehicle encounters bumpy road surfaces during driving, the augmented reality head-up display (AR-HUD) screen will be affected, resulting in the roadway not being fitted and the obstacles are incorrectly marked, which will affect the driving experience.
By using sensors in the head-up display system to detect the angular change, calculate the target display position, and translate and rotate the displayed image through a compensation strategy to ensure that the image is displayed stably in the display window.
It effectively reduces the negative impact of road bumps on AR display effect and improves the driver's driving experience.
Smart Images

Figure CN2024070801_14112024_PF_FP_ABST
Abstract
Description
Image display control method, electronic device, storage medium, HUD system and vehicle
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This disclosure claims priority to a Chinese patent application filed with the Patent Office of China on May 11, 2023, with application number 202310524374.2 and invention name “A method for displaying an image, an electronic device and a storage medium”. The contents of the Chinese patent application are hereby incorporated into this disclosure by reference. Technical Field
[0003] Embodiments of the present disclosure relate to the field of head-up display technology, and more particularly to a method for controlling image display, an electronic device, a storage medium, a HUD system, and a vehicle. Background Art
[0004] Augmented Reality Head Up Display (AR-HUD) technology is gradually being applied to automobiles. It can integrate the vehicle's driving assistance information into virtual and real information (such as marking information on lane lines, obstacles, etc.) and then project it onto the windshield in front of the driver's field of view, allowing the driver to take into account both instrument parameters and external environment information while keeping his eyes level.
[0005] When a vehicle encounters bumpy roads, the AR display will be severely affected, resulting in issues such as road lines not being aligned or obstacles not being correctly marked. This negatively impacts the user's driving experience. Therefore, how to compensate for the AR display to ensure that the AR display effect is not affected has become an urgent issue to be addressed.
[0006] Technical content
[0007] The present disclosure provides a control method for image display, an electronic device, a storage medium, a HUD system, and a vehicle, which can compensate for the AR display screen of the image to be displayed, reduce the negative impact of road bumps on the AR display effect, and enhance the user's driving experience.
[0008] In a first aspect, at least one embodiment of the present disclosure provides a method for controlling image display, which is applied to a head-up display system. The method includes:
[0009] Determining an angular change of the head-up display system during a current mission cycle;
[0010] Compensating the initial display position of the image to be displayed based on the angle variation to obtain a target display position;
[0011] The image to be displayed is displayed in a display window based on the target display position.
[0012] The disclosed embodiments provide a method for controlling image display. When a vehicle encounters a bumpy road during driving, the AR display screen of the image to be displayed is compensated by the angular change of the head-up display system in the vehicle's traveling direction. This can reduce the negative impact of the road bumps on the AR display effect and enhance the user's driving experience.
[0013] In some examples, the head-up display system is configured with a sensor; determining an angle change of the head-up display system during a current mission cycle includes:
[0014] A signal value of the sensor is acquired, and an angle change of the head-up display system in a current task cycle is determined according to the signal value.
[0015] In some examples, compensating the initial display position of the image to be displayed based on the angle change to obtain a target display position includes:
[0016] Determining a compensation strategy for the initial display position of the image to be displayed based on the angle variation, the compensation strategy including the element to be translated and the translation compensation value of the element to be translated;
[0017] The initial placement position is compensated based on the compensation strategy to obtain a target placement position.
[0018] In some examples, the compensation strategy for determining the initial display position corresponding to the image to be displayed based on the angle change includes: when the angle change satisfies the compensation condition, determining the angle offset cumulative value of the head-up display system based on the angle change; determining the translation compensation value based on the angle change, the offset cumulative value and the imaging distance, where the imaging distance is the distance between the image generator in the head-up display system and the virtual image plane of the image to be displayed; and determining the element to be translated based on the translation compensation value and the initial display position.
[0019] In some examples, the display window is located on an image display component, which also includes an optical area for displaying the display window, and the initial display position includes a first initial position of the display window relative to the optical area and a second initial position of the image to be displayed relative to the display window; determining the element to be translated based on the translation compensation value and the initial display position includes: determining the translation direction and the number of translation pixels based on the translation compensation value; determining the maximum number of translation pixels corresponding to the display window along the translation direction on the optical area based on the first initial position; if the number of translation pixels is not greater than the maximum number of translation pixels, determining that the element to be translated is the display window; if the number of translation pixels is greater than the maximum number of translation pixels, determining that the element to be translated is the display window and the image to be displayed.
[0020] In some examples, when the element to be translated is the display window, compensating the initial display position based on the compensation strategy to obtain the target display position includes: translating the display window from the first initial position by the number of translation pixels along the translation direction to obtain the target display position.
[0021] In some examples, the head-up display system is configured with a reflector. When the elements to be translated are the display window and the image to be displayed, the initial display position is compensated based on the compensation strategy to obtain a target display position, including: determining a first translation pixel number corresponding to the display window and a second translation pixel number corresponding to the image to be displayed based on the translation pixel number and the maximum translation pixel number; translating the display window from the first initial position by the first translation pixel number along the translation direction to obtain an intermediate display position; determining a rotation angle of the reflector based on the second translation pixel number, and controlling the reflector to rotate by the rotation angle so that the image to be displayed is translated from the second initial position by the second translation pixel number along the translation direction on the basis of the intermediate display position, thereby obtaining the target display position.
[0022] In some examples, the head-up display system is configured with a stepper motor, and controlling the reflector to rotate the rotation angle includes: determining the compensation steps of the stepper motor based on the rotation angle; and controlling the stepper motor to flip the compensation steps so that the reflector rotates the rotation angle.
[0023] In some examples, determining the offset accumulated value of the angle of the head-up display system based on the angle change includes: adding the angle change to an offset accumulated variable to obtain the offset accumulated value of the head-up display system in the current task cycle, the offset accumulated variable being a variable that continuously accumulates the corresponding angle change when the angle change meets the compensation condition for at least one consecutive task cycle, and clearing the offset accumulated variable when the angle change does not meet the compensation condition.
[0024] In some examples, the method further includes: when the angle change does not satisfy the compensation condition, determining the number of task cycles corresponding to the angle change continuously failing to satisfy the compensation condition; when the number of task cycles reaches a first number of cycles, determining whether the display position of the image to be displayed is compensated within a second number of task cycles, the second number of cycles being greater than the first number of cycles; if compensated, displaying the image to be displayed in the display window based on the first display position, the first display position being the display position set by the user or the display position after the first compensation after the current power-on.
[0025] In a second aspect, at least one embodiment of the present disclosure provides an image display control device integrated into a head-up display system, the device comprising:
[0026] an angle change determination module configured to determine an angle change amount of the head-up display system within a current mission cycle;
[0027] a compensation module configured to compensate an initial display position of the image to be displayed based on the angle variation to obtain a target display position;
[0028] The image display module is configured to display the image to be displayed in a display window based on the target display position.
[0029] In a third aspect, at least one embodiment of the present disclosure provides an electronic device, the electronic device including:
[0030] at least one processor; and
[0031] a memory communicatively connected to the at least one processor; wherein,
[0032] The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor to enable the at least one processor to perform any of the above-mentioned image display control methods.
[0033] In a fourth aspect, at least one embodiment of the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement any of the above-mentioned image display control methods when executed.
[0034] In a fifth aspect, at least one embodiment of the present disclosure provides a head-up display (HUD) system, the HUD system comprising: an image generator, an imaging optical path component, an image display component, and a processor; wherein,
[0035] The image generator is configured to generate an image digital signal and convert the image digital signal into light that carries image information;
[0036] The imaging optical path component is configured to reflect the light carrying the image information and project it onto the image display component;
[0037] The image display component is configured to form a visually observable virtual image based on the light projected by the imaging optical path component;
[0038] The processor is configured to perform the following steps:
[0039] Determining an angular change of the HUD system during a current mission cycle;
[0040] Compensating the initial display position of the image to be displayed based on the angle variation to obtain a target display position;
[0041] The image to be displayed is displayed in a display window located on the image display component based on the target display position.
[0042] In a sixth aspect, at least one embodiment of the present disclosure provides a vehicle comprising any of the above-mentioned HUD systems.
[0043] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description.
[0044] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, and usage scenarios of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0045] BRIEF DESCRIPTION OF THE DRAWINGS
[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0047] FIG1 is a schematic diagram of the HUD system structure provided by an embodiment of the present disclosure.
[0048] FIG2 is a first flow chart of a method for controlling image display provided by an embodiment of the present disclosure.
[0049] FIG3 is a schematic diagram of a vehicle body coordinate system provided by an embodiment of the present disclosure.
[0050] FIG4 is a schematic diagram of a flow chart of compensating an initial display position of an image to be displayed provided by an embodiment of the present disclosure.
[0051] FIG5 is a schematic diagram of a translation compensation value provided by an embodiment of the present disclosure;
[0052] FIG6 is a second flow chart of a method for controlling image display provided by an embodiment of the present disclosure;
[0053] FIG7 is a schematic diagram showing the relationship between the optical area and the display window in the image display assembly provided by an embodiment of the present disclosure;
[0054] FIG8 is a schematic structural diagram of an image display device provided by an embodiment of the present disclosure;
[0055] FIG9 is a block diagram of an electronic device for implementing a method for controlling image display according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0056] To make the purpose, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present disclosure.
[0057] It should be noted that the terms "first", "second", "target" and "original" in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including", "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0058] The present disclosure provides a HUD system. As shown in FIG1 , the HUD system 10 includes an image generator 11, an imaging optical path component 12, and an image display component 13. The image generator 11 is configured to generate a digital image signal (i.e., a real image) and convert the digital image signal into light that carries image information. In some examples, the image generator 11 may be an optical engine manufactured using digital light processing (DLP) or liquid crystal on silicon (LCOS) technology, including an illumination component and a projection component, wherein the projection component may be a micro-projection lens. The imaging optical path component 12 reflects the real image using, for example, a reflector and projects it onto the image display component 13, so that the image display component 13 forms a visually observable virtual image 2 based on the light projected by the imaging optical path component 12. Depending on the application scenario, the image display component 13 may also vary. For example, when the application scenario is a movie theater, the image display component 13 may be a projection screen or display screen. When the application scenario is displaying driving information on a vehicle's windshield, the image display component 13 may be the vehicle's windshield. In some examples, the image display component 13 is a windshield of a vehicle, which is used to display vehicle driving information.
[0059] FIG2 is a schematic diagram of a first flow chart of a method for controlling image display provided in an embodiment of the present disclosure. This embodiment is applicable to situations where an image to be displayed in a head-up display system is adjusted when a vehicle is traveling on a bumpy road. The method for controlling image display provided in this embodiment can be executed by an image display control device provided in an embodiment of the present disclosure. The control device can be implemented in software and / or hardware and integrated into an electronic device that executes the method. In some examples, the electronic device in the embodiment of the present disclosure can be a head-up display (HUD) system 10 as shown in FIG1 .
[0060] Referring to FIG2 , the method of this embodiment includes but is not limited to the following steps:
[0061] S210: Determine an angle change of the head-up display system in a current task cycle.
[0062] In the present disclosure, when a vehicle is traveling on a bumpy road, the vehicle's posture will change, such as tilting, obvious ups and downs, yaw, etc. The degree of these posture changes can be characterized by the angle change. As shown in Figure 1, the head-up display system 10 also includes a sensor 14, and the angle change of the head-up display system 10 can be detected by the sensor 14. The sensor 14 can be a positioning sensor for determining the orientation information of the movement of the HUD system during the driving process of the vehicle. In some examples, the positioning sensor can be a gyroscope sensor, which can be installed on a mechanical structure of the HUD system. By obtaining a signal value detected by the sensor, such as an angular velocity value, the angle change of the head-up display system during the current task cycle can be determined based on the signal value. In some examples, the angle change is the angle change in a preset direction (such as the direction of vehicle travel).
[0063] In the embodiment of the present disclosure, as shown in FIG3 , a vehicle body coordinate system is constructed. The vehicle body coordinate system is a three-dimensional coordinate system. The intersection of the vertical line from the HUD system 10 to the ground and the horizontal ground is the origin O of the coordinate system. The Y-axis direction is the direction of vehicle travel, the X-axis direction is the direction of the driver's left hand, and the Z-axis direction is the direction perpendicular to the horizontal ground.
[0064] During the driving process of the vehicle, as shown in FIG1 , the HUD system 10 further includes a processor 15 for realizing a control device for image display. The processor 15 detects the signal value of the gyroscope sensor in real time, or the gyroscope sensor converts the relevant physical signal into a digital signal (i.e., the signal value) and sends it to the processor 15 in real time, and the processor 15 obtains the signal value output by the gyroscope sensor within a task cycle. The processor 15 calculates the angular change of the gyroscope sensor in the vehicle's direction of travel (Y axis) based on the signal value based on the vehicle body coordinate system, thereby obtaining the angular change of the head-up display system 10 within the current task cycle, which is recorded as θ. In some examples, the current task cycle may be a task cycle for compensating for the display effect of the AR display screen of the image to be displayed. The period for the processor 15 to obtain the sensor signal value is less than the current task cycle.
[0065] S220 : Compensate the initial display position of the image to be displayed based on the angle variation to obtain a target display position of the image to be displayed.
[0066] In the present disclosure, the initial display position is the position information of the image to be displayed on the image display component after the previous task cycle or the current HUD system is powered on. When the vehicle posture changes due to bumps, the present disclosure uses the angle change that can characterize the degree of posture change caused by the bumps to compensate for the initial display position of the image to be displayed, and obtains the target display position to display the image to be displayed, thereby reducing the negative impact of road bumps on the AR display effect. In some examples, as shown in Figure 4, the compensation of the initial display position of the image to be displayed based on the angle change in step S220 to obtain the target display position of the image to be displayed includes:
[0067] S2201: Determine a compensation strategy for the initial display position of the image to be displayed based on the angle variation, where the compensation strategy includes the element to be translated and a translation compensation value of the element to be translated;
[0068] S2202: Compensating the initial placement position based on the compensation strategy to obtain a target placement position.
[0069] In the above example, the compensation strategy for determining the initial display position of the image to be displayed based on the angle change in step S2201 includes:
[0070] The first step is to determine whether the compensation condition is met by judging the relationship between the angle change and the preset threshold. For example, if the angle change is less than the preset threshold (denoted as Th θ ), it is considered that the angle change within a task cycle is very small, and the current angle change will not affect the fusion of the AR effect. In this case, there is no need to compensate for the virtual image height of the image to be displayed in the HUD, that is, the compensation condition is not met. If the angle change is greater than or equal to the preset threshold, it is considered that the angle change within a task cycle is large enough, and the current angle change will affect the fusion of the AR effect. In this case, it is necessary to compensate for the virtual image height of the image to be displayed in the HUD, that is, the compensation condition is met.
[0071] In the second step, when the angle change satisfies the compensation condition, an accumulated offset value for the head-up display system's angle is determined based on the angle change. Specifically, the angle change is added to an accumulated offset variable to obtain the accumulated offset value for the head-up display system for the current task cycle, denoted as β. The accumulated offset variable is used to continuously accumulate the angle change within at least one task cycle, while the angle change satisfies the compensation condition. However, if the angle change within a given task cycle fails to meet the compensation condition, the accumulated offset variable is cleared.
[0072] The third step is to determine a translation compensation value based on the angle change, the accumulated offset value, and the imaging distance, which is denoted as Δh. The imaging distance is the distance between the image generator 11 in the head-up display system 10 and the virtual image plane of the image to be displayed. The translation compensation value refers to the compensation value required to translate the virtual image of the image to be displayed on the virtual image plane. The calculation process of the translation compensation value is expressed by the following formula (1): Δh = -d*tan(β) + d*tan(β-θ) (1)
[0073] In the formula, Δh represents the translation compensation value, d represents the imaging distance, β represents the accumulated offset value, and θ represents the angular change. It is important to note that θ should be added to β before calculating Δh for the current task cycle, i.e., β = β + θ. Figure 5 shows a schematic diagram of the translation compensation value, which illustrates the compensation value required to translate the virtual image to be displayed on the virtual image plane.
[0074] Step 4: Determine the element to be translated based on the translation compensation value and the initial display position. Specifically, the maximum number of pixels that the display window can be translated is determined based on the initial display position. The specific element to be translated is then determined based on the relationship between the translation compensation value and the maximum number of pixels. In this disclosure, the element to be translated is at least one of the display window or the image to be displayed.
[0075] In the above example, the compensation strategy for determining the initial display position of the image to be displayed based on the angle variation in step S2201 may further include: when the angle variation does not satisfy the compensation condition, determining the number of task cycles corresponding to the angle variation continuously failing to satisfy the compensation condition; when the number of task cycles reaches the first number of cycles (denoted as Th n , the angle change θ is continuously less than Th θ times), it is considered that the vehicle is now in a relatively stable state (for example, the slope of the road changes very little, which has basically no effect on the AR fusion effect), then it is determined whether the display position of the image to be displayed has been compensated within the second number of task cycles, and the second number of cycles is greater than the first number of cycles; if compensation has been made, then the display position of the image to be displayed needs to be restored to the state before compensation, then the image to be displayed is displayed in the display window based on the first display position, and the first display position is the display position set by the user or the display position after the first compensation after the current power-on.
[0076] In the above example, the target placement location is obtained by compensating the initial placement location based on the compensation strategy in step S2202.
[0077] In the present disclosure, after the element to be translated and the translation compensation value of the element to be translated are determined in the above step S2201, the number of translation pixels for translating the element to be translated is determined based on the translation compensation value, and then the display window is translated based on the number of translation pixels. If stepper motor compensation is required, the stepper motor is driven to compensate the initial display position of the element to be translated to obtain the target display position.
[0078] For example, if the translation compensation value Δh>0, it means that the image should be compensated upward. In this case, the display window should be translated upward. If stepper motor step compensation is required, the stepper motor should be driven in the direction of driving the image upward. If the translation compensation value Δh<0, it means that the image should be compensated downward. In this case, the display window should be translated downward. If stepper motor step compensation is required, the stepper motor should be driven in the direction of driving the image downward.
[0079] S230: Display the image to be displayed in the display window based on the target display position.
[0080] In the present disclosure, other rendered contents are configured according to the target display position to generate an image to be displayed and send it to the image display component 13, and the image display component 13 displays the image to be displayed in the display window.
[0081] The technical solution provided in this embodiment determines the angular change of the head-up display system within the current task cycle; based on the angular change, compensates the initial display position of the image to be displayed to obtain a target display position; and displays the image to be displayed within the display window based on the target display position. When a vehicle encounters a bumpy road during driving, this disclosure compensates the AR display screen of the image to be displayed by using the angular change of the head-up display system in the direction of vehicle travel. This can reduce the negative impact of road bumps on the AR display effect and enhance the user's driving experience.
[0082] The following further describes the image display control method provided by the present embodiment. Figure 6 is a second flow chart of the image display control method provided by the present embodiment. This embodiment is an optimization based on the above embodiment. Specifically, this embodiment provides a detailed explanation of the process for determining the element to be translated and the process for compensating the display position.
[0083] Referring to FIG6 , the method of this embodiment includes but is not limited to the following steps:
[0084] S610: Determine the translation direction and the number of translation pixels based on the translation compensation value.
[0085] In the present disclosure, a display window is located on the image display assembly 13. The image display assembly 13 also includes an optical area for displaying the display window. The initial display position includes a first initial position of the display window relative to the optical area and a second initial position of the image to be displayed relative to the display window. Figure 7 illustrates the relationship between the optical area and the display window in the image display assembly 13. In the figure, the display window is located within the optical area. The optical area is the area corresponding to the outermost rectangle in the figure, and the display window is the area corresponding to the innermost rectangle in the figure. The portion of the optical area excluding the display window is called an optical reserved area, which is used to move and adjust the display window.
[0086] In the present disclosure, the translation direction can be either vertical or horizontal. The present disclosure explains the image display control method provided by the present disclosure by compensating the height of the virtual image of the image to be displayed in the HUD in the vertical direction. Compensating the height of the virtual image of the image to be displayed in the HUD in the horizontal direction is also applicable to the method provided by the present disclosure.
[0087] The translation direction is determined by the sign of the translation compensation value. For example, when the translation compensation value Δh>0, the translation direction is vertically upward; when the translation compensation value Δh<0, the translation direction is vertically downward. The virtual image height change corresponding to a one-pixel translation in the image display component 13 is set as h1, and the number of translated pixels corresponding to the translation compensation value (i.e., the virtual image height compensation value) Δh can be calculated.
[0088] S620: Determine a maximum number of pixels corresponding to the display window along the translation direction on the optical area based on the first initial position.
[0089] In this disclosure, the coordinate origin is the upper left corner of the optical area, with positive values being downward and rightward. The vertical starting point of the current display window is y1 (i.e., the first initial position). To prevent the display window from exceeding the optical area during vertical movement, there is a maximum vertical starting point ymax for downward translation and a minimum vertical starting point ymin for upward translation. Once the translation direction (downward or upward) is determined, the maximum number of pixels corresponding to the translation of the display window can be determined.
[0090] S630: Determine whether the number of translated pixels is greater than the maximum number of translated pixels.
[0091] In the present disclosure, the number of translated pixels determined in step S610 and the maximum number of translated pixels determined in step S620 are compared. If the number of translated pixels is greater than the maximum number of translated pixels, steps S650 to S670 are executed; if the number of translated pixels is not greater than the maximum number of translated pixels, step S640 is executed.
[0092] S640. If it is not greater than, determine the element to be translated as the display window, and translate the display window from the first initial position along the translation direction by the number of translation pixels to obtain the target display position.
[0093] In the present disclosure, if the number of translation pixels is not greater than the maximum number of translation pixels, it indicates that the display window is still within the optical region after translation. Then, determine the element to be translated as the display window. At this time, the HUD system translates the display window from the first initial position along the translation direction by the number of translation pixels to obtain the target display position. Specifically, the starting point y in the vertical direction of the target display position is y = y1 - Δh / h1. When Δh > 0, then y < y1, and at this time the image moves upward; when Δh < 0, then y > y1, and at this time the image moves downward.
[0094] It should be noted that the present disclosure is based on a system-on-chip (SoC) or a microcontroller unit (MCU) with a display system. A window with attribute parameters such as window size (length and width), position (horizontal starting point x0 and vertical starting point y0), and color format can be created on the display layer. And the attribute values of the window are updatable during the operation of the display window. By dynamically updating the parameter values of the horizontal starting point x0 or the vertical starting point y0, the translation of the display window can be quickly achieved, so that the compensation of the AR display screen of the image to be displayed can be completed within one image refresh cycle.
[0095] S650. If it is greater than, determine the elements to be translated as the display window and the image to be displayed, and determine the first number of translation pixels corresponding to the display window and the second number of translation pixels corresponding to the image to be displayed based on the number of translation pixels and the maximum number of translation pixels.
[0096] In the present disclosure, if the number of translation pixels is greater than the maximum number of translation pixels, it indicates that the display window will exceed the optical region after translation. However, since the display window must be located inside the optical region, then both the display window and the image to be displayed need to be translated. Therefore, determine the elements to be translated as the display window and the image to be displayed. Take the maximum number of translation pixels as the first number of translation pixels corresponding to the display window, that is, move the display window to the upper edge (the moving direction is vertically upward) or the lower edge (the moving direction is vertically downward) of the optical region. Then, take the difference between the number of translation pixels and the maximum number of translation pixels as the second number of translation pixels corresponding to the image to be displayed.
[0097] S660. Translate the display window from the first initial position along the translation direction by the first number of translation pixels to obtain the intermediate display position.
[0098] In the present disclosure, when the translation compensation value Δh>0, the translation direction is vertically upward, the display window moves upward, and the new window starting point y=ymin. When the translation compensation value Δh<0, the translation direction is vertically downward, then the window moves downward, and the new window starting point y=ymax, thus obtaining the intermediate display position.
[0099] S670: Determine a rotation angle of the reflector based on the second number of translated pixels, and control the reflector to rotate the rotation angle so that the image to be displayed is translated from the second initial position by the second number of translated pixels along the translation direction based on the intermediate display position, thereby obtaining a target display position.
[0100] Optionally, as shown in FIG1 , the imaging optical path component 12 of the head-up display system 10 is configured with a reflector 121 , and the head-up display system 10 is further configured with a pulse width modulation (PWM) module 16 , a stepper motor driver 17 and a stepper motor 18 .
[0101] Specifically, controlling the rotation angle of the reflector 121 includes: determining the compensation steps of the stepper motor based on the rotation angle, and converting it into a pulse width modulation (PWM) parameter to the PWM module 16 to drive the stepper motor 18 to work; controlling the stepper motor driver 17 through the PWM module 16 to amplify the PWM signal so that the voltage amplitude can reach the voltage level that drives the stepper motor 18 to work normally, and the stepper motor 18 flips the compensation step according to the amplified PWM signal to rotate the reflector 121 to achieve the function of adjusting the height of the image to be displayed.
[0102] If the number of pixels shifted exceeds the maximum number of pixels shifted, the display window will exceed the optical area after the shift. In this case, the display window is first shifted to the edge of the optically reserved area, and the remaining compensation height is compensated by rotating the stepper motor 18. According to optical design, the change in virtual image height corresponding to each pixel of vertical shift of the display window is known. Similarly, the change in virtual image height corresponding to each step of the stepper motor 18 is also known. Therefore, the corresponding pixel value of the vertical shift of the display window and the number of stepper motor compensation steps can be calculated.
[0103] The change in virtual image height corresponding to each step of the stepper motor 18 is set to h2. When the translation compensation value Δh>0, the translation direction is vertically upward. In this case, in addition to moving the display window upward by ymin pixels, the stepper motor 18 needs to rotate the required number of steps steps = (Δh-(y1-ymin)*h1) / h2. When the translation compensation value Δh<0, the translation direction is vertically downward. In this case, in addition to moving the display window downward by ymax pixels, the stepper motor 18 needs to rotate the required number of steps steps = (|Δh|-(ymax-y1)*h1) / h2. Only in this way can the image to be displayed be translated from the second initial position along the translation direction by the second translation pixel number to obtain the target display position, thereby completing the compensation of the AR display effect.
[0104] The present disclosure only translates the display window when the first number of pixels corresponding to the display window translation does not exceed the optical area. When the first number of pixels corresponding to the display window translation does exceed the optical area, the display window and the image to be displayed need to be translated. This configuration is based on the fact that display window translation is a fast motion (completed within a single image refresh cycle, or a maximum of 16ms if the image refresh rate is 60Hz), while stepper motor flipping is a slow motion. Therefore, vertical translation of the display window is prioritized. If the translated display window remains within the optical area, stepper motor flip compensation is not performed.
[0105] The technical solution provided by this embodiment determines the translation direction and the number of translation pixels based on the translation compensation value; determines the maximum number of translation pixels corresponding to the display window along the translation direction on the optical area based on the first initial position; judges whether the number of translation pixels is greater than the maximum number of translation pixels; if not, determines that the element to be translated is the display window, and translates the display window from the first initial position along the translation direction by the number of translation pixels to obtain a target display position; if greater, determines that the element to be translated is the display window and the image to be displayed, determines the first number of translation pixels corresponding to the display window and the second number of translation pixels corresponding to the image to be displayed based on the number of translation pixels and the maximum number of translation pixels; translates the display window from the first initial position along the translation direction by the first number of translation pixels to obtain an intermediate display position; determines the rotation angle of the reflector based on the second number of translation pixels, and controls the reflector to rotate the rotation angle so that the image to be displayed is translated from the second initial position along the translation direction by the second number of translation pixels on the basis of the intermediate display position, thereby obtaining the target display position. The present disclosure determines the maximum translation pixel corresponding to the display window, compares it with the number of translation pixels, determines the element to be translated based on the size relationship between the two, and then calculates the number of pixels that need to be translated in the vertical direction of the display window and / or the number of steps that the stepper motor needs to flip, thereby compensating the AR display screen of the image to be displayed, reducing the negative impact of road bumps on the AR display effect, and improving the user's driving experience.
[0106] FIG8 is a schematic diagram of the structure of an image display control device provided by an embodiment of the present disclosure, which is integrated into a head-up display system. As shown in FIG8 , the device 800 may include:
[0107] An angle change determination module 810 is configured to determine an angle change amount of the head-up display system during a current mission cycle;
[0108] The compensation module 820 is configured to compensate the initial display position of the image to be displayed based on the angle variation to obtain a target display position;
[0109] The image display module 830 is configured to display the image to be displayed in a display window based on the target display position.
[0110] In some examples, the head-up display system is configured with a sensor; the angle change determination module 810 is configured to obtain a signal value of the sensor and determine an angle change of the head-up display system in a current task cycle based on the signal value.
[0111] In some examples, the compensation module 820 is configured to:
[0112] Determining a compensation strategy for the initial display position of the image to be displayed based on the angle variation, the compensation strategy including the element to be translated and the translation compensation value of the element to be translated;
[0113] The initial placement position is compensated based on the compensation strategy to obtain a target placement position.
[0114] In some examples, the compensation module 820 is configured to:
[0115] When the angle change satisfies a compensation condition, an accumulated offset value of the angle of the head-up display system is determined based on the angle change; a translation compensation value is determined based on the angle change, the accumulated offset value, and an imaging distance, where the imaging distance is the distance between an image generator in the head-up display system and a virtual image plane of the image to be displayed; and the element to be translated is determined based on the translation compensation value and the initial display position.
[0116] In some examples, the display window is located on an image display component, the image display component further includes an optical area for displaying the display window, and the initial display position includes a first initial position of the display window relative to the optical area and a second initial position of the image to be displayed relative to the display window;
[0117] The above-mentioned compensation module 820 is configured to: determine the translation direction and the number of translation pixels based on the translation compensation value; determine the maximum number of translation pixels corresponding to the display window along the translation direction on the optical area based on the first initial position; if the number of translation pixels is not greater than the maximum number of translation pixels, determine that the element to be translated is the display window; if the number of translation pixels is greater than the maximum number of translation pixels, determine that the element to be translated is the display window and the image to be displayed.
[0118] In some examples, the compensation module 820 is configured to: when the element to be translated is the display window, translate the display window from the first initial position along the translation direction by the number of translation pixels to obtain the target display position.
[0119] In some examples, the head-up display system is configured with a reflector;
[0120] The above-mentioned compensation module 820 is configured to: when the elements to be translated are the display window and the image to be displayed, determine the first translation pixel number corresponding to the display window and the second translation pixel number corresponding to the image to be displayed based on the translation pixel number and the maximum translation pixel number; translate the display window from the first initial position by the first translation pixel number along the translation direction to obtain an intermediate display position; determine the rotation angle of the reflector based on the second translation pixel number, and control the reflector to rotate by the rotation angle so that the image to be displayed is translated from the second initial position by the second translation pixel number along the translation direction on the basis of the intermediate display position, thereby obtaining the target display position.
[0121] In some examples, the head-up display system is configured with a stepper motor;
[0122] The compensation module 820 is configured to: determine the compensation steps of the stepper motor based on the rotation angle; and control the stepper motor to flip the compensation steps so that the reflector rotates by the rotation angle.
[0123] In some examples, the compensation module 820 is configured to: accumulate the angle change to an offset accumulation variable to obtain an offset accumulation value of the head-up display system in the current task cycle, wherein the offset accumulation variable is a variable that continuously accumulates the corresponding angle change when the angle change meets the compensation condition for at least one consecutive task cycle, and clears the offset accumulation variable when the angle change does not meet the compensation condition.
[0124] In some examples, the compensation module 820 is further configured to: when the angle change does not satisfy the compensation condition, determine the number of task cycles corresponding to the angle change continuously failing to satisfy the compensation condition; when the number of task cycles reaches a first number of cycles, determine whether the display position of the image to be displayed is compensated within a second number of task cycles, the second number of cycles being greater than the first number of cycles; if compensated, display the image to be displayed in the display window based on the first display position, the first display position being the display position set by the user or the display position after the first compensation after the current power-on.
[0125] The image display device provided in this embodiment can be applied to the image display control method provided in any of the above embodiments, and has corresponding functions and beneficial effects.
[0126] 9 is a block diagram of an electronic device for implementing a method for controlling image display of an embodiment of the present disclosure. The electronic device 90 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.
[0127] As shown in Figure 9, the electronic device 90 includes at least one processor 91 and a memory connected to the at least one processor 91, such as a read-only memory (ROM) 92, a random access memory (RAM) 93, etc., wherein the memory stores a computer program that can be executed by the at least one processor, and the processor 91 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 92 or the computer program loaded from the storage unit 98 into the random access memory (RAM) 93. Various programs and data required for the operation of the electronic device 90 can also be stored in the RAM 93. The processor 91, ROM 92, and RAM 93 are connected to each other via a bus 94. An input / output (I / O) interface 95 is also connected to the bus 94.
[0128] Multiple components in the electronic device 90 are connected to the I / O interface 95, including an input unit 96, such as a keyboard, a mouse, etc.; an output unit 97, such as various types of displays, speakers, etc.; a storage unit 98, such as a magnetic disk, an optical disk, etc.; and a communication unit 99, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 99 allows the electronic device 90 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.
[0129] Processor 91 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of processor 91 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any other suitable processor, controller, microcontroller, etc. Processor 91 executes the various methods and processes described above, such as the image display control method.
[0130] In some embodiments, the image display control method can be implemented as a computer program that is tangibly contained in a computer-readable storage medium, such as storage unit 98. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 90 via ROM 92 and / or communication unit 99. When the computer program is loaded into RAM 93 and executed by processor 91, one or more steps of the image display control method described above can be performed. Alternatively, in other embodiments, processor 91 can be configured to perform the image display control method in any other appropriate manner (e.g., by means of firmware).
[0131] Computer programs for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.
[0132] In the context of the present disclosure, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use with or in conjunction with an instruction execution system, device, or apparatus. A computer-readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0133] Based on the same inventive concept as the aforementioned technical solution, in conjunction with FIG1 , an embodiment of the present disclosure provides a HUD system 10, which includes: an image generator 11, an imaging optical path component 12, an image display component 13, and a processor 15; wherein,
[0134] The image generator 11 is configured to generate an image digital signal and convert the image digital signal into light that carries image information;
[0135] The imaging optical path component 12 is configured to reflect the light carrying the image information and project it onto the image display component 13;
[0136] The image display component 13 is configured to form a visually observable virtual image based on the light projected by the imaging optical path component 12;
[0137] The processor 15 is configured to perform the following steps:
[0138] Determining an angular change of the HUD system during a current mission cycle;
[0139] Compensating the initial display position of the image to be displayed based on the angle variation to obtain a target display position;
[0140] The image to be displayed is displayed in a display window located on the image display component 13 based on the target display position.
[0141] In some examples, the HUD system 10 further includes a sensor 14; the processor 15 is configured to:
[0142] The signal value of the sensor is obtained, and the angle change of the HUD system 10 in the current task cycle is determined according to the signal value.
[0143] In some examples, the processor 15′ is configured to:
[0144] Determining a compensation strategy for the initial display position of the image to be displayed based on the angle variation, the compensation strategy including the element to be translated and the translation compensation value of the element to be translated;
[0145] The initial placement position is compensated based on the compensation strategy to obtain a target placement position.
[0146] In some examples, the processor 15′ is configured to:
[0147] When the angle variation satisfies a compensation condition, determining an accumulated offset value of the angle of the HUD system 10 based on the angle variation;
[0148] determining the translation compensation value based on the angle variation, the offset accumulation value, and an imaging distance, where the imaging distance is the distance between the image generator 11 in the HUD system 10 and a virtual image plane of the image to be displayed;
[0149] The element to be translated is determined based on the translation compensation value and the initial display position.
[0150] In some examples, the image display component 13 further includes an optical area for displaying the display window, and the initial display position includes a first initial position of the display window relative to the optical area and a second initial position of the image to be displayed relative to the display window. The processor 15 is configured to:
[0151] determining a translation direction and a number of translation pixels based on the translation compensation value;
[0152] Determining a maximum number of translation pixels corresponding to the display window along the translation direction on the optical area based on the first initial position;
[0153] If the number of pixels to be translated is not greater than the maximum number of pixels to be translated, determining that the element to be translated is the display window;
[0154] If the number of pixels to be translated is greater than the maximum number of pixels to be translated, it is determined that the elements to be translated are the display window and the image to be displayed.
[0155] In some examples, the processor 15′ is configured to:
[0156] When the element to be translated is the display window, the display window is translated from the first initial position by the number of translation pixels along the translation direction to obtain the target display position.
[0157] In some examples, the HUD system 10 further includes a reflector 121; and the processor 15 is configured to:
[0158] When the to-be-translated element is the display window and the to-be-translated image, determining a first translation pixel number corresponding to the display window and a second translation pixel number corresponding to the to-be-translated image based on the translation pixel number and the maximum translation pixel number;
[0159] Shifting the display window from the first initial position by the first shift pixel number along the shift direction to obtain an intermediate display position;
[0160] The rotation angle of the reflector is determined based on the second translation pixel number, and the reflector is controlled to rotate the rotation angle so that the image to be displayed is translated from the second initial position by the second translation pixel number along the translation direction based on the intermediate display position, thereby obtaining the target display position.
[0161] In some examples, the HUD system 10 further includes a stepper motor 18; the processor 15 is configured to: determine the number of compensation steps of the stepper motor 18 based on the rotation angle;
[0162] The stepping motor 18 is controlled to reverse the compensation step number so that the reflective mirror 121 rotates the rotation angle.
[0163] In some examples, the processor 15′ is configured to:
[0164] The angle change is accumulated to an offset accumulation variable to obtain an offset accumulation value of the HUD system 10 in the current task cycle. The offset accumulation variable is a variable that continuously accumulates the angle change within at least one task cycle when the angle change meets the compensation condition for at least one consecutive task cycle. When the angle change does not meet the compensation condition, the offset accumulation variable is cleared.
[0165] In some examples, the processor 15 is further configured to:
[0166] When the angle variation does not satisfy the compensation condition, determining a number of task cycles corresponding to when the angle variation continuously fails to satisfy the compensation condition;
[0167] When the number of task cycles reaches a first number of cycles, determining whether the display position of the image to be displayed is compensated within a second number of task cycles, the second number of cycles being greater than the first number of cycles;
[0168] If compensation is performed, the image to be displayed is displayed in the display window based on the first display position, where the first display position is the display position set by the user or the display position after the first compensation after current power-on.
[0169] It should be noted that the HUD system 10 provided in this embodiment can be applied to the image display control method provided in any of the above embodiments, and has corresponding functions and beneficial effects.
[0170] It is understandable that the exemplary technical solutions of the image display control device 800, electronic device 90, and HUD system 10 described above are based on the same concept as the technical solution of the aforementioned image display control method. Therefore, any details not described in detail in the technical solutions of the image display control device 800, electronic device 90, and HUD system 10 above can be referred to the description of the technical solution of the aforementioned image display control method. This disclosure does not elaborate on this in detail.
[0171] Some embodiments of the present disclosure also provide a transportation device, such as a vehicle, a ship, or an airplane, which includes any HUD system 10 provided by the embodiments of the present disclosure, so that a user (such as a driver) can use the HUD system 10 to control the transportation more safely and conveniently.
[0172] Note that the above are only preferred embodiments of the present disclosure and the technical principles used. Those skilled in the art will understand that the present disclosure is not limited to the specific embodiments described herein, and that those skilled in the art can make various obvious changes, readjustments, and substitutions without departing from the scope of protection of the present disclosure. For example, those skilled in the art can use the various forms of processes shown above, reorder, add, or delete steps; and can perform the steps described in the present disclosure in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present disclosure can be achieved, and this document does not limit them here.
[0173] The above specific embodiments do not limit the scope of protection of this disclosure. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the scope of protection of this disclosure.
Claims
1. A method for controlling image display, characterized in that: Applied to a head-up display system, the method comprises: Determining an angle change of the head-up display system during a current mission cycle; Compensating the initial display position of the image to be displayed based on the angle variation to obtain a target display position; The image to be displayed is displayed in a display window based on the target display position.
2. The image display control method according to claim 1, characterized in that: The head-up display system is equipped with a sensor; the determining of the angle change of the head-up display system in the current task cycle includes: A signal value of the sensor is acquired, and an angle change amount of the head-up display system in a current task cycle is determined according to the signal value.
3. The image display control method according to claim 1, characterized in that: The compensating the initial display position of the image to be displayed based on the angle variation to obtain a target display position includes: Determine a compensation strategy for the initial display position of the image to be displayed based on the angle variation, wherein the compensation strategy includes an element to be translated and a translation compensation value of the element to be translated; The initial placement position is compensated based on the compensation strategy to obtain a target placement position.
4. The method according to claim 3, characterized in that The compensation strategy for determining the initial display position corresponding to the image to be displayed based on the angle variation includes: When the angle variation satisfies a compensation condition, determining an accumulated offset value of the angle of the head-up display system based on the angle variation; Determine the translation compensation value based on the angle variation, the offset accumulation value and an imaging distance, wherein the imaging distance is the distance between an image generator in the head-up display system and a virtual image plane of the image to be displayed; The element to be translated is determined based on the translation compensation value and the initial display position.
5. The method for controlling image display according to claim 4, characterized in that: The display window is located on the image display component, the image display component also includes an optical area for displaying the display window, and the initial display position includes a first initial position of the display window relative to the optical area and a second initial position of the image to be displayed relative to the display window; The determining the element to be translated based on the translation compensation value and the initial display position includes: Determining a translation direction and a number of translation pixels based on the translation compensation value; Determine, based on the first initial position, a maximum number of pixels corresponding to the display window along the translation direction on the optical area; If the number of pixels to be translated is not greater than the maximum number of pixels to be translated, then the number of pixels to be translated is determined. The element is the display window; If the number of pixels to be translated is greater than the maximum number of pixels to be translated, it is determined that the elements to be translated are the display window and the image to be displayed.
6. The method for controlling image display according to claim 5, characterized in that: When the element to be translated is the display window, compensating the initial display position based on the compensation strategy to obtain a target display position includes: The display window is translated from the first initial position by the translation pixel number along the translation direction to obtain the target display position.
7. The method for controlling image display according to claim 5, characterized in that: The head-up display system is equipped with a reflector. When the elements to be translated are the display window and the image to be displayed, compensating the initial display position based on the compensation strategy to obtain a target display position includes: Determine a first number of translated pixels corresponding to the display window and a second number of translated pixels corresponding to the image to be displayed based on the number of translated pixels and the maximum number of translated pixels; Shifting the display window from the first initial position by the first shift pixel number along the shift direction to obtain an intermediate display position; The rotation angle of the reflector is determined based on the second translation pixel number, and the reflector is controlled to rotate the rotation angle so that the image to be displayed is translated from the second initial position by the second translation pixel number along the translation direction based on the intermediate display position, thereby obtaining the target display position.
8. The method for controlling image display according to claim 7, characterized in that: The head-up display system is equipped with a stepper motor, and the step of controlling the reflector to rotate the rotation angle includes: determining the number of compensation steps of the stepping motor based on the rotation angle; The stepping motor is controlled to flip the compensation step number so that the reflector rotates the rotation angle.
9. The method for controlling image display according to claim 4, characterized in that: The step of determining the accumulated offset value of the angle of the head-up display system based on the angle variation comprises: The angle change is accumulated to an offset accumulation variable to obtain an offset accumulation value of the head-up display system in the current task cycle, wherein the offset accumulation variable is a variable for continuously accumulating the angle change within the at least one task cycle when the angle change satisfies the compensation condition for at least one consecutive task cycle, and the offset accumulation variable is cleared when the angle change does not satisfy the compensation condition.
10. The method for controlling image display according to claim 4, characterized in that: The method further comprises: When the angle variation does not satisfy the compensation condition, determining the number of task cycles corresponding to when the angle variation continuously fails to satisfy the compensation condition; When the number of task cycles reaches the first number of cycles, the number of cycles in the second number of cycles is determined. whether the display position of the image to be displayed is compensated within the task cycle, and the second cycle number is greater than the first cycle number; If compensation is performed, the image to be displayed is displayed in the display window based on a first display position, where the first display position is a display position set by a user or a display position after the first compensation after current power-on.
11. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the image display control method described in any one of claims 1 to 10.
12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are configured to enable a processor to implement the image display control method according to any one of claims 1 to 10 when executed.
13. A head-up display (HUD) system, characterized in that: The HUD system includes: an image generator, an imaging optical path component, an image display component and a processor; wherein, The image generator is configured to generate an image digital signal and convert the image digital signal into light that carries image information; The imaging optical path component is configured to reflect the light carrying the image information and project it to the image display component; The image display component is configured to form a virtual image that can be visually observed based on the light projected by the imaging optical path component; The processor is configured to perform the following steps: Determining an angular change of the HUD system during a current mission cycle; Compensating the initial display position of the image to be displayed based on the angle variation to obtain a target display position; The image to be displayed is displayed in a display window located on the image display component based on the target display position.
14. The HUD system according to claim 13, characterized in that: The HUD system further includes a sensor; the processor is configured to: The signal value of the sensor is obtained, and the angle change of the HUD system in the current task cycle is determined according to the signal value.
15. The HUD system according to claim 13, characterized in that: The processor is configured to: Determine a compensation strategy for the initial display position of the image to be displayed based on the angle variation, wherein the compensation strategy includes an element to be translated and a translation compensation value of the element to be translated; The initial placement position is compensated based on the compensation strategy to obtain a target placement position.
16. The HUD system according to claim 15, characterized in that: The processor is configured to: When the angle variation satisfies a compensation condition, determining an accumulated offset value of the angle of the HUD system based on the angle variation; Determine the translation compensation value based on the angle variation, the offset accumulation value and an imaging distance, wherein the imaging distance is the distance between the image generator in the HUD system and a virtual image plane of the image to be displayed; The element to be translated is determined based on the translation compensation value and the initial display position.
17. The HUD system according to claim 16, characterized in that: The image display component further includes an optical area configured to display the display window, the initial display position includes a first initial position of the display window relative to the optical area and a second initial position of the image to be displayed relative to the display window; the processor is configured to: Determining a translation direction and a number of translation pixels based on the translation compensation value; Determine, based on the first initial position, a maximum number of pixels corresponding to the display window along the translation direction on the optical area; If the number of pixels to be translated is not greater than the maximum number of pixels to be translated, determining that the element to be translated is the display window; If the number of pixels to be translated is greater than the maximum number of pixels to be translated, it is determined that the elements to be translated are the display window and the image to be displayed.
18. The HUD system according to claim 17, characterized in that: The processor is configured to: When the element to be translated is the display window, the display window is translated from the first initial position by the number of translation pixels along the translation direction to obtain the target display position.
19. The HUD system according to claim 17, characterized in that: The HUD system further includes a reflector; and the processor is configured to: When the to-be-translated element is the display window and the to-be-translated image, determining a first translation pixel number corresponding to the display window and a second translation pixel number corresponding to the to-be-translated image based on the translation pixel number and the maximum translation pixel number; Shifting the display window from the first initial position by the first shift pixel number along the shift direction to obtain an intermediate display position; The rotation angle of the reflector is determined based on the second translation pixel number, and the reflector is controlled to rotate the rotation angle so that the image to be displayed is translated from the second initial position by the second translation pixel number along the translation direction based on the intermediate display position, thereby obtaining the target display position.
20. The HUD system according to claim 19, characterized in that: The HUD system further includes a stepper motor; the processor is configured to: determine the number of compensation steps of the stepper motor based on the rotation angle; The stepping motor is controlled to flip the compensation step number so that the reflector rotates the rotation angle.
21. The HUD system according to claim 16, wherein: The processor is configured to: The angle change is accumulated to the offset accumulation variable to obtain the offset accumulation value of the HUD system in the current task cycle. The offset accumulation variable is a variable that continuously accumulates the angle change within the at least one task cycle when the angle change meets the compensation condition for at least one task cycle. When the angle change does not meet the compensation condition, the offset accumulation variable is cleared.
22. The HUD system according to claim 16, wherein: The processor is further configured to: When the angle variation does not satisfy the compensation condition, determining the number of task cycles corresponding to when the angle variation continuously fails to satisfy the compensation condition; When the number of task cycles reaches a first number of cycles, determining whether the display position of the to-be-displayed image is compensated within a second number of task cycles, the second number of cycles being greater than the first number of cycles; If compensation is performed, the image to be displayed is displayed in the display window based on a first display position, where the first display position is a display position set by a user or a display position after the first compensation after current power-on.
23. A vehicle, characterized in that: The vehicle comprises the HUD system according to any one of claims 13 to 22.
Citation Information
Patent Citations
Head-up display device and method thereof
CN107272194A
Display control device, image display system, mobile body, display control method, and program
CN114025983A
Display picture compensation method and device, electronic equipment and storage medium
CN114779477A
Image display method, electronic equipment and storage medium
CN116243880A
Vehicle display system
JP2016185768A
