Focus adjustment device, head-up display device and computer-readable storage medium

By determining the duration of the virtual image distance state in the HUD, focal plane adjustment is only performed after a preset threshold is reached, thus solving the problem of frequent changes in virtual image distance and achieving mechanical and visual stability and responsiveness.

CN123113117APending Publication Date: 2026-11-17JIANGSU NEW VISION AUTOMOTIVE ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611601924.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-10-16
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Existing continuous zoom HUDs cause frequent adjustments to the virtual image distance when the vehicle speed changes in a short time, increasing mechanical wear and driver visual fatigue.

Method used

By obtaining the theoretical target virtual image distance and the current actual virtual image distance, the duration of the continuous state is determined, and the focal plane zoom-in or zoom-out drive command is output only after the preset time threshold is reached, reducing frequent adjustments.

Benefits of technology

It reduces mechanical wear on the zoom actuator, improves the stability and responsiveness of focal plane adjustment, and reduces the visual adjustment burden on the driver.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123113117A_ABST
    Figure CN123113117A_ABST
Patent Text Reader

Abstract

This application provides a focal plane adjustment device, a head-up display device, and a computer-readable storage medium, belonging to the field of automotive display technology. The focal plane adjustment device includes a memory and a processor. The processor is used to acquire the theoretical target virtual image distance and the current actual virtual image distance of the head-up display device; when the theoretical target virtual image distance is less than the current actual virtual image distance, it determines the duration for which this state is maintained; when the duration is less than a preset time threshold, it maintains the current actual virtual image distance; when the duration is greater than or equal to the preset time threshold, it outputs a focal plane zoom-in drive command to the zoom actuator to reduce the actual virtual image distance. This application can filter focal plane zoom-in requirements with short durations, reducing the need for repeated adjustments to the actual virtual image distance.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of vehicle display technology, and in particular to a focal plane adjustment device, a head-up display device, and a computer-readable storage medium. Background Technology

[0002] Head-up displays (HUDs) can display vehicle driving information, navigation information, or driver assistance information as virtual images in front of the driver. With the development of HUD display technology, zoomable HUDs can change the distance of the virtual image according to the vehicle's driving status, so that the displayed content is formed at different virtual image positions.

[0003] When existing continuous zoom HUDs adjust the virtual image distance according to vehicle speed, short-term changes in vehicle speed may also cause the virtual image distance to adjust accordingly, resulting in multiple adjustments of the virtual image distance within a short period of time. Summary of the Invention

[0004] This application provides a focal plane adjustment device, a head-up display device, and a computer-readable storage medium, which can reduce the reciprocating adjustment of the focal plane caused by short-term fluctuations in vehicle status.

[0005] The technical solution of this application is implemented as follows: In a first aspect, this application provides a focal plane adjustment device, comprising: a memory configured to store a computer program; and a processor connected to the memory and configured to execute the computer program to: acquire a theoretical target virtual image distance and a current actual virtual image distance of a head-up display device; when the theoretical target virtual image distance is less than the current actual virtual image distance, determine the duration for which the state of the theoretical target virtual image distance being less than the current actual virtual image distance is continuously maintained; when the duration is less than a preset time threshold, maintain the current actual virtual image distance; and when the duration is greater than or equal to the preset time threshold, output a focal plane zooming drive command to a zoom actuator to control the zoom actuator to reduce the actual virtual image distance.

[0006] Secondly, this application provides a focal plane adjustment method, which includes: acquiring the theoretical target virtual image distance and the current actual virtual image distance of a head-up display device; when the theoretical target virtual image distance is less than the current actual virtual image distance, determining the duration for which the state of the theoretical target virtual image distance being less than the current actual virtual image distance is continuously maintained; when the duration is less than a preset time threshold, maintaining the current actual virtual image distance; when the duration is greater than or equal to the preset time threshold, outputting a focal plane zooming drive command to a zoom actuator to control the zoom actuator to reduce the actual virtual image distance.

[0007] Thirdly, this application provides a head-up display device. The head-up display device includes a projection unit, an optical component, a zoom actuator, and the aforementioned focal plane adjustment device. The projection unit projects an image beam; the optical component reflects the image beam to form a virtual image; and the zoom actuator changes the virtual image distance of the formed virtual image.

[0008] Fourthly, this application provides a computer-readable storage medium storing at least one instruction that is executed by a processor to implement the focal plane adjustment method as described in the second aspect.

[0009] This application provides a focal plane adjustment device, a head-up display device, and a computer-readable storage medium. By confirming the duration of the continuous state when the theoretical target virtual image distance is less than the current actual virtual image distance, and only initiating focal plane zooming after the duration reaches a preset time threshold, the focal plane zooming demand caused by non-continuous states such as short-term vehicle speed reduction can be filtered out, reducing the frequent start-stop of the zoom actuator and the reciprocating adjustment of the focal plane. At the same time, when the theoretical target virtual image distance is greater than the current actual virtual image distance, the focal plane can be pushed away in a timely manner, thereby balancing the stability and responsiveness of focal plane adjustment, reducing mechanical wear and the visual adjustment burden on the driver. Attached Figure Description

[0010] Figure 1 This is a schematic diagram of the application architecture of a focal plane adjustment system provided in an embodiment of this application.

[0011] Figure 2 This is a structural block diagram of a focal plane adjustment device provided in an embodiment of this application.

[0012] Figure 3 This is a schematic diagram of the execution flow of the processor provided in an embodiment of this application.

[0013] Figure 4 This is a close-up view of the focal plane provided in an embodiment of this application.

[0014] Figure 5 This is a schematic diagram of focal plane projection provided in an embodiment of this application.

[0015] Figure 6 This is a schematic diagram of a display image under normal driving conditions provided in an embodiment of this application.

[0016] Figure 7 This is a schematic diagram of a display image under emergency conditions provided in an embodiment of this application.

[0017] Figure 8 This is a schematic diagram of display compensation before the focal plane zoom-in drive command is issued, provided in an embodiment of this application.

[0018] Figure 9 This is a schematic diagram of display compensation when a focal plane zoom-in drive command is issued, as provided in an embodiment of this application.

[0019] Figure 10 This is a schematic diagram of display compensation during the focal plane zooming process provided in an embodiment of this application.

[0020] Figure 11 This is a schematic diagram of display compensation when the focal plane zoom-in drive command is executed, as provided in an embodiment of this application.

[0021] Figure 12 This is a schematic flowchart of a focal plane adjustment method provided in an embodiment of this application.

[0022] Figure 13 This is a schematic diagram of the structure of a head-up display device provided in an embodiment of this application. Detailed Implementation

[0023] The technical solutions in this application will now be clearly and completely described with reference to the accompanying drawings.

[0024] Virtual Image Distance (VID) refers to the optically corresponding imaging distance of the virtual image when the driver observes it from the HUD. For example, if the virtual image formed by a certain HUD is located at an optical position approximately 12m from the driver, the VID at that moment can be represented as 12m. For variable-focus or continuously variable-focus HUDs, the optical system uses movable optical components to change the optical path, allowing the VID to be adjusted between multiple distance positions.

[0025] In a continuous zoom HUD control method, the desired target VID can be determined based on the vehicle's speed. When the vehicle is at a lower speed, the target VID can be located closer; as the vehicle speed increases, the target VID can move further away. To achieve this adjustment, the control system generates a focal plane control command based on the vehicle's status. The zoom motor or other actuators then drive the movable optical components to move, ultimately changing the actual VID.

[0026] The actual operating state of a vehicle is not a continuous, monotonous change. Even when the vehicle is generally in a stable driving phase, the instantaneous speed may still be affected by factors such as road surface undulations, changes in wind resistance, and minor foot movements by the driver, resulting in a small decrease or increase in speed within a short period of time. If the control system directly converts each short-term speed change into a new target VID and immediately drives the physical zoom mechanism, a short-duration speed decrease may first generate a zoom-in request; when the speed subsequently recovers, it generates a zoom-out request in the opposite direction of the zoom-in request, thus causing short-term state fluctuations to be successively converted into reciprocating movements of the focal plane.

[0027] This control method, which converts short-term vehicle speed fluctuations into reciprocating motion of the focal plane, easily causes the zoom motor, transmission mechanism, and movable optical components to frequently start, stop, or reverse within a short period of time, thereby increasing mechanical wear and drive load. As the above reciprocating adjustment process continues, the cumulative number of movements and the stroke of the movable optical components increase, which may shorten the service life of the relevant optical motion components and drive mechanism, and increase the possibility of motion noise, positioning errors, or response lag in the zoom mechanism.

[0028] Furthermore, while observing the road environment ahead and the HUD virtual image, the driver's eyes need to adjust focus and convergence according to the imaging distance of the observed object. When the VID (Visual ID) frequently zooms in and out with small fluctuations in vehicle speed within a short period, the optical imaging distance corresponding to the HUD virtual image also changes frequently, requiring the driver's eyes to repeatedly adjust their focus and convergence. Especially when the driver is continuously focusing on the HUD display or switching their gaze between the HUD display and the road target ahead, the frequently changing VID increases the visual adjustment burden, easily causing visual fatigue, and may reduce the driver's comfort in maintaining a stable view of the HUD display.

[0029] The focal plane adjustment device provided in this application can be applied to, for example... Figure 1 The focal plane adjustment system 100 shown can be applied to a vehicle 10. The focal plane adjustment system 100 includes a focal plane adjustment device 20, a HUD 30, a vehicle status source 40, and a driver assistance status source 50. The focal plane adjustment device 20 is communicatively connected to the HUD 30, the vehicle status source 40, and the driver assistance status source 50.

[0030] Vehicle 10 may be a passenger car, commercial vehicle, or other vehicle equipped with HUD 30. HUD 30 is an in-vehicle display device used to form an image to be displayed at a predetermined virtual image position in front of the driver through optical imaging.

[0031] The HUD 30 may include an image generation unit, optical components, and a zoom actuator. The image generation unit generates an image beam corresponding to the image to be displayed; the optical components reflect, refract, or magnify the image beam so that it is reflected through the vehicle's windshield or other optical components to the driver's eyes, thereby allowing the driver to observe a virtual image located in front of the vehicle.

[0032] The zoom actuator is used to change the optical operating state of the HUD 30, thereby altering the actual virtual image distance formed by the HUD 30. As the actual virtual image distance changes, the virtual image observed by the driver corresponds to different depth positions in front of the vehicle.

[0033] The zoom actuator may include a movable optical component and a drive component for driving the movement of the movable optical component. For example, the movable optical component may include a movable mirror, and the drive component may include a motor. In response to the zoom control command output by the focal plane adjustment device 20, the drive component drives the movable optical component to move, thereby changing the optical path or imaging relationship of the optical system and thus changing the position of the virtual image formed by the HUD 30.

[0034] The zoom actuator may also include a position detection unit. The position detection unit is used to acquire the mechanical position of the zoom actuator. This mechanical position can represent the position of the drive component, the position of the movable optical component, or other position parameters that reflect the current mechanical state of the zoom actuator. Since different mechanical positions of the zoom actuator correspond to different actual virtual image distances of the HUD 30, a correspondence between the mechanical position and the actual virtual image distance can be pre-established, and the actual virtual image distance of the HUD 30 can be determined based on the mechanical position detected by the position detection unit.

[0035] For example, during the calibration of the HUD 30, the zoom actuator can be controlled to move to multiple mechanical positions, and the actual virtual image distance corresponding to each mechanical position can be measured, thereby establishing a mapping relationship between the mechanical position and the actual virtual image distance. During vehicle operation, after the position detection unit obtains the current mechanical position, it can determine the current actual virtual image distance based on this mapping relationship.

[0036] The vehicle status source 40 is used to provide information related to the operating status of the vehicle 10. The vehicle status source 40 may include at least one of a vehicle communication bus, a vehicle speed acquisition unit, an inertial measurement unit, a braking status acquisition unit, or a vehicle controller. For example, the vehicle status source 40 can provide the instantaneous vehicle speed, longitudinal deceleration, or braking status of the vehicle 10.

[0037] The driver assistance status source 50 is used to provide status information generated by the driver assistance system of the vehicle 10. For example, the driver assistance status source 50 can provide information on whether Automatic Emergency Braking (AEB) is active.

[0038] The focal plane adjustment device 20 is used to control the virtual image distance of the HUD 30. The focal plane adjustment device 20 can acquire information related to the desired virtual image position and information related to the current actual virtual image position of the HUD 30, and determine whether to output a control command to the zoom actuator to change the actual virtual image distance according to the corresponding focal plane adjustment conditions.

[0039] For example, the focal plane adjustment device 20 can obtain the current desired virtual image distance based on the data provided by the vehicle status source 40, and can obtain the current actual virtual image distance based on the mechanical position information fed back by the position detection unit. When the corresponding focal plane adjustment conditions are met, the focal plane adjustment device 20 outputs a zoom drive command to the zoom actuator, causing the zoom actuator to change the actual virtual image distance.

[0040] pass Figure 1 The system architecture shown allows the focal plane adjustment device 20 to obtain the information required for focal plane adjustment and to control the zoom actuator to change the actual virtual image distance of the HUD 30.

[0041] The following is combined Figure 2 This section further explains the hardware structure of the focal plane adjustment device 20 and the specific focal plane adjustment process performed by the focal plane adjustment device 20. For example... Figure 2 As shown, the focal plane adjustment device 20 may include a processor 21 and a memory 22 connected in communication.

[0042] The memory 22 is configured to store computer programs. The memory 22 can also be used to store control parameters, mapping relationships, and operating status data used during focal plane adjustment.

[0043] The memory 22 may include read-only memory, random access memory, flash memory, non-volatile memory, or other storage components capable of storing computer programs and data.

[0044] The processor 21 is configured to execute the computer program stored in the memory 22 to implement the focal plane adjustment process of this application. The processor 21 can acquire the data required for focal plane adjustment through the vehicle communication interface and output the corresponding zoom drive command to the zoom actuator through the control interface.

[0045] like Figure 3 As shown, processor 21 executes the following steps S301 to S304.

[0046] In step S301, the theoretical target virtual image distance and the current actual virtual image distance of the head-up display device are obtained.

[0047] Among them, the theoretical target virtual image distance refers to the distance at which the HUD 30 is expected to form a virtual image, determined based on the current focal plane adjustment conditions. The theoretical target virtual image distance belongs to the target quantity of focal plane adjustment.

[0048] In one implementation of adjusting the HUD focal plane based on the vehicle's operating state, the theoretical target virtual image distance can be determined based on the vehicle's current reference speed and a preset mapping relationship between vehicle speed and virtual image distance. When the vehicle's state changes, the theoretical target virtual image distance can be adjusted accordingly.

[0049] In one implementation, the mapping relationship between vehicle speed and virtual image distance can be a piecewise function. For example, when 0 ≤ Vref ≤ 30, TargetVID = 5 meters; when 30 < Vref ≤ 120, TargetVID = 5 + 0.15 × (Vref - 30) meters; when Vref > 120, TargetVID = 18.5 meters. Here, Vref is the reference vehicle speed, and TargetVID is the theoretical target virtual image distance. The mapping relationship can also be a nonlinear function; as long as it can characterize the relationship between vehicle speed and virtual image distance, this application does not limit the implementation method of the mapping relationship.

[0050] For example, the actual virtual image distance formed by the current HUD 30 is 10m, while the desired virtual image distance is determined to be 8m based on the current vehicle operating status. Therefore, 8m can be used as the current theoretical target virtual image distance.

[0051] The current actual virtual image distance refers to the virtual image distance actually formed by the current optical operating state of the HUD 30 at the current control moment.

[0052] The current actual virtual image distance can be determined according to Figure 1 The mechanical position of the zoom actuator is determined. For example, during system calibration, a mapping relationship between the mechanical position of the zoom actuator and the actual virtual image distance is established in advance; during operation, the position detection unit obtains the current mechanical position, and the processor 21 queries the mapping relationship to determine the current actual virtual image distance.

[0053] Therefore, the theoretical target virtual image distance represents the position of the virtual image that is expected to be formed, while the current actual virtual image distance represents the position of the virtual image that has already been formed by the current optical system. The two can be the same, or they can differ due to changes in the vehicle's state.

[0054] In step S302, when the theoretical target virtual image distance is less than the current actual virtual image distance, the duration for which the state of the theoretical target virtual image distance being less than the current actual virtual image distance is continuously maintained is determined.

[0055] Processor 21 compares the theoretical target virtual image distance with the current actual virtual image distance. When the theoretical target virtual image distance is less than the current actual virtual image distance, it means that the expected virtual image position is closer to the driver's side than the current actual virtual image position, that is, there is a focal plane zooming requirement to reduce the actual virtual image distance.

[0056] For example, the current actual virtual image distance is 10m, and the theoretical target virtual image distance is 8m. Since 8m is less than 10m, the processor 21 determines that there is a need for the focal plane to be brought closer.

[0057] When processor 21 determines that there is a focal plane convergence requirement, it determines the duration. The duration of continuous state maintenance refers to the accumulated time from the point when the condition that the theoretical target virtual image distance is less than the current actual virtual image distance is met, without interruption of this condition.

[0058] The term "continuous" is used to distinguish between a single, continuous focal plane convergence state and multiple short-term focal plane convergence states that are separated from each other.

[0059] For example, if the theoretical target virtual image distance is first detected to be less than the current actual virtual image distance at time t0, and this relationship holds true throughout multiple control cycles from t0 to t1, then the difference between t1 and t0 can be determined as the duration for which the current state is continuously maintained.

[0060] If the theoretical target virtual image distance is no longer less than the current actual virtual image distance in a control cycle prior to t1, then the previous continuous state ends, and a new duration is determined when the condition is met again in subsequent cycles.

[0061] In step S303, when the duration is less than a preset time threshold, the current actual virtual image distance is maintained.

[0062] The processor 21 compares the duration with a preset time threshold, which is a time comparison benchmark used to determine whether the focal plane zoom-in state has existed continuously for a sufficient time, and the preset time threshold is greater than zero.

[0063] For example, a preset time threshold can be set to 1.5 seconds. If the zoom state only lasts for 0.4 seconds, the duration has not reached the preset time threshold; if the state continues for 1.5 seconds, the duration has reached the preset time threshold. The preset time threshold defines the waiting and judgment conditions before the zoom actuator begins to perform the physical focal plane zooming action.

[0064] If the duration does not reach the preset time threshold, the processor 21 maintains the current actual virtual image distance. Maintaining the current actual virtual image distance means that the processor 21 does not control the zoom actuator to perform mechanical actions that reduce the actual virtual image distance according to the current focal plane zooming requirement, thereby maintaining the current physical focal plane state of the zoom actuator.

[0065] For example, if the current actual virtual image distance is 10m, the theoretical target virtual image distance temporarily becomes 8m, the preset time threshold is 1.5s, but this size relationship only lasts for 0.5s, then during this 0.5s period, the processor 21 does not output the corresponding drive command for the zooming of the focal plane to the zoom actuator.

[0066] In step S304, when the duration is greater than or equal to a preset time threshold, a focal plane zoom drive command is output to the zoom actuator.

[0067] The focal plane zoom-in drive command is a control message used to control the zoom actuator to perform mechanical movements, thereby reducing the actual virtual image distance of the HUD 30. After receiving the focal plane zoom-in drive command, the zoom actuator drives the movable optical component to move from its current mechanical position toward the mechanical position corresponding to the smaller actual virtual image distance, so that the difference between the final adjusted actual virtual image distance and the theoretical target virtual image distance is within the allowable error range.

[0068] For example, such as Figure 4 As shown, the image beam projected by HUD 30 is reflected by the windshield 11 to the driver 42. The virtual image 44 seen by the driver 42 corresponds to the current actual virtual image distance of 10m, and the virtual image 46 corresponds to the theoretical target virtual image distance of 8m. This zooming state has been maintained continuously for 1.5s, so the processor 21 can output a focal plane zooming drive command. The zoom actuator responds to this command, changing the mechanical position of the optical components, so that the actual virtual image distance changes from 10m to 8m.

[0069] In this embodiment, a duration judgment is added before the focal plane zoom is initiated. If the duration has not reached a preset time threshold, the current actual virtual image distance is maintained. Therefore, for short-term zoom requests with insufficient duration, the zoom actuator does not initiate focal plane zoom, and the actual virtual image distance remains at its original position, thereby reducing the repeated adjustments to the actual virtual image distance triggered by short-duration focal plane zoom requests. For truly continuous focal plane zoom requests, a focal plane zoom drive command is output after the duration reaches the preset time threshold, thus ensuring the normal execution of continuous zoom requests.

[0070] In the above embodiments, the duration confirmation for focal plane approach is set because the vehicle operating states corresponding to focal plane approach and focal plane distance have different fluctuation characteristics. Specifically, focal plane approach usually corresponds to vehicle deceleration, and during actual driving, the vehicle may experience short-term deceleration due to factors such as the driver briefly releasing the accelerator, slight foot operation, changes in wind resistance, road bumps, uphill driving, or brief braking followed by acceleration while following another vehicle. The aforementioned short-term deceleration does not necessarily indicate that the driver has a continuous intention to decelerate, but it may still temporarily reduce the distance of the theoretical target virtual image. If the focal plane is immediately controlled to approach when such a short-term deceleration occurs, the focal plane will need to be controlled to distance again when the vehicle speed subsequently recovers, which can easily lead to repeated focal plane adjustments from approaching to distance. In contrast, focal plane distance usually corresponds to vehicle acceleration, and continuous vehicle acceleration generally requires the driver to continuously apply acceleration operations, so the situation of continuous acceleration caused by short-term unintentional factors is relatively rare. Therefore, the duration confirmation can be set only for the focal plane approach direction, without requiring the same time confirmation conditions for the focal plane distance direction.

[0071] Furthermore, the effects of focal plane approaching and focal plane receding on the driver's visual state differ. When the focal plane approaches, the virtual image moves towards the driver, requiring the driver to adjust their visual focus accordingly. If focal plane approaching and receding occur repeatedly within a short period, alternating changes in the depth of the virtual image can easily occur. When the focal plane recedes, the virtual image moves away from the driver, and this generally coincides with the driver's tendency to extend their line of sight further ahead during vehicle acceleration. Therefore, based on the aforementioned use of duration confirmation for the focal plane approaching direction, to avoid applying the same waiting conditions to the focal plane receding direction, an implementation method with different initiation conditions for the focal plane receding direction is further described below.

[0072] Therefore, when the theoretical target virtual image distance is greater than the current actual virtual image distance, the processor 21 outputs a focal plane push-out drive command to the zoom actuator to control the zoom actuator to increase the actual virtual image distance of the HUD 30.

[0073] The focal plane zoom-out drive command refers to the control information used to control the zoom actuator to perform a mechanical action that increases the actual virtual image distance of the HUD 30. After receiving the focal plane zoom-out drive command, the zoom actuator drives the movable optical component from its current mechanical position toward a mechanical position corresponding to a larger actual virtual image distance, ensuring that the difference between the final adjusted actual virtual image distance and the theoretical target virtual image distance is within the allowable error range. The focal plane zoom-out drive command corresponds to the aforementioned focal plane zoom-in drive command; both are used to control the actual virtual image distance to change in different directions.

[0074] For example, combining Figure 4 ,like Figure 5 As shown, the actual virtual image distance corresponding to the virtual image 44 seen by the driver 42 is 10m, and the theoretical target virtual image distance corresponding to the virtual image 48 is 12m. The processor 21 determines that there is a focal plane extension requirement and can output a focal plane extension drive command to the zoom actuator without waiting for the focal plane extension state to continuously reach the aforementioned preset time threshold. The zoom actuator responds to the focal plane extension drive command, increasing the actual virtual image distance from 10m to the direction corresponding to 12m.

[0075] In this embodiment, the focal plane approach direction and the focal plane push direction adopt different start conditions. This can filter short-term focal plane approach demand while enabling the focal plane push direction to have an independent start response mechanism, thereby achieving differentiated control of different focal plane adjustment directions.

[0076] In order to enable the duration to be continuously and accurately recorded during vehicle operation, this embodiment further explains the accumulation of duration across control cycles and the reset method after state interruption.

[0077] Specifically, the processor 21 can repeatedly execute the focal plane adjustment process according to a preset control cycle. The control cycle refers to the time interval between two consecutive focal plane state judgments performed by the processor 21. For example, the focal plane adjustment device 20 can cyclically execute the control logic at a frequency of 60Hz, in which case the duration Δt of one control cycle is approximately 16.6ms.

[0078] In the current control cycle, when the processor 21 detects that the theoretical target virtual image distance is less than the current actual virtual image distance, the processor 21 reads the cumulative duration corresponding to the previous control cycle and updates the duration based on the cumulative duration and the duration of the current control cycle.

[0079] The cumulative duration refers to the time from the inception of the current focal plane convergence state to its continuous maintenance in the current control cycle. The cumulative duration can be stored as a state variable across control cycles.

[0080] For example, the current control period can be denoted as the k-th control period, the cumulative duration saved at the end of the previous control period can be denoted as t_delay(k-1), and the duration of the current control period can be denoted as Δt. When the k-th control period still satisfies the condition that the theoretical target virtual image distance is less than the current actual virtual image distance, the current cumulative duration can be updated according to: t_delay(k) = t_delay(k-1) + Δt.

[0081] When the processor 21 first detects that the theoretical target virtual image distance is less than the current actual virtual image distance, it can start counting the cumulative duration from the initial value. If the state is always established in subsequent control cycles, the processor 21 continues to accumulate the corresponding control cycle duration in each control cycle, thereby obtaining the duration for which the state is continuously maintained.

[0082] For example, if the control cycle duration is 20ms, and the theoretical target virtual image distance is less than the current actual virtual image distance for 50 consecutive control cycles, the cumulative duration can reach 1s. If the preset time threshold is 1.5s, then the duration has not yet reached the preset time threshold. The processor 21 continues to maintain the current actual virtual image distance and saves the currently accumulated 1s, so that the next control cycle can continue timing based on this accumulated result.

[0083] Furthermore, if the processor 21 detects that the state of the theoretical target virtual image distance being less than the current actual virtual image distance is no longer valid before the duration reaches a preset time threshold, the duration is reset.

[0084] Resetting the duration means ending the continuous timing of the current zoom-in state and restoring the cumulative duration corresponding to that zoom-in state to the initial state, such as restoring it to 0, so that subsequent zoom-in states of the focal plane can restart the timing from a new continuous state.

[0085] For example, if the theoretical target virtual image distance is consistently less than the current actual virtual image distance for the first 30 control cycles, and the cumulative duration reaches 0.6 seconds, but in the 31st control cycle the theoretical target virtual image distance recovers to be equal to or greater than the current actual virtual image distance, then the aforementioned closing state has been interrupted. At this time, the processor 21 resets the accumulated 0.6 seconds to 0. If the theoretical target virtual image distance is less than the current actual virtual image distance again, the accumulation will restart from the initial value of 0, instead of continuing to accumulate based on the original 0.6 seconds.

[0086] In this embodiment, by updating the current cumulative duration using the cumulative duration of the previous control cycle and the duration of the current control cycle, the processor 21 can continuously record the holding time of the same focal plane convergence state across multiple control cycles. Furthermore, when the convergence state is no longer valid, the cumulative duration is reset, ensuring that only consecutively held focal plane convergence states can accumulate to a preset time threshold, while short-term convergence states that are separate from each other cannot jointly trigger focal plane convergence through time accumulation. This improves the correspondence between the duration judgment and the actual consecutive convergence states, avoiding interference from historical cumulative time in subsequent focal plane convergence judgments.

[0087] In one implementation, the processor 21 determines the focal plane difference based on the theoretical target virtual image distance and the current actual virtual image distance.

[0088] The focal plane difference is used to characterize the degree of deviation between the theoretical target virtual image distance and the current actual virtual image distance. It can be denoted as ΔVID and determined according to the following formula: ΔVID = TargetVID - CurrentVID, where TargetVID represents the theoretical target virtual image distance and CurrentVID represents the current actual virtual image distance.

[0089] The sign of the focal plane difference can be used to characterize the direction of focal plane adjustment, while the absolute value of the focal plane difference can be used to characterize the magnitude of the distance difference between the theoretical target virtual image distance and the current actual virtual image distance. For example, when the theoretical target virtual image distance is 9m and the current actual virtual image distance is 10m, ΔVID is -1m, indicating that the theoretical target virtual image distance is near the current actual virtual image distance; when the theoretical target virtual image distance is 12m and the current actual virtual image distance is 10m, ΔVID is 2m, indicating that the theoretical target virtual image distance is far from the current actual virtual image distance.

[0090] The processor 21 compares the absolute value of the focal plane difference with a preset focal plane difference threshold. The preset focal plane difference threshold is used to determine whether the change in the theoretical target virtual image distance relative to the current actual virtual image distance reaches the distance threshold that requires further focal plane adjustment. It can be denoted as Dth.

[0091] When |ΔVID|≤Dth, the processor 21 maintains the current actual virtual image distance. That is, if the deviation between the theoretical target virtual image distance and the current actual virtual image distance does not exceed the preset focal plane difference threshold, the processor 21 does not control the zoom actuator to change the actual virtual image distance.

[0092] In this embodiment, the focal plane difference range that satisfies |ΔVID|≤Dth can be referred to as the focal plane difference dead zone. The focal plane difference dead zone refers to the range within which, although the theoretical target virtual image distance changes to a certain extent relative to the current actual virtual image distance, this change will not trigger a physical adjustment of the actual virtual image distance.

[0093] When the absolute value of the focal plane difference is greater than the preset focal plane difference threshold, it means that the difference between the theoretical target virtual image distance and the current actual virtual image distance has exceeded the focal plane difference dead zone. The processor 21 then determines the subsequent focal plane adjustment path based on the relationship between the two.

[0094] Specifically, when |ΔVID| > Dth and TargetVID < CurrentVID, it indicates that the focal plane change has exceeded the preset focal plane difference threshold, and there is a current need for the focal plane to be brought closer. At this time, the processor 21 then performs the aforementioned processing to determine the duration of the continuously maintained state.

[0095] When |ΔVID| > Dth and TargetVID > CurrentVID, it indicates that there is a current need to push the focal plane further away. At this time, the processor 21 outputs a focal plane pushing-ahead drive command to the zoom actuator. This also avoids focal plane changes caused by small fluctuations.

[0096] In this embodiment, |ΔVID| is first compared with Dth. When the focal plane change does not exceed Dth, the current actual virtual image distance is maintained. Therefore, small focal plane changes do not exceed the focal plane difference threshold, and the zoom actuator maintains the current state, thereby avoiding frequent changes in the focal plane caused by small vehicle speed fluctuations.

[0097] In the above embodiments, the preset focal plane difference threshold Dth determines how much virtual image distance change can be filtered by the focal plane difference dead zone. Since the theoretical target virtual image distance is usually obtained from the vehicle state through the mapping relationship between vehicle speed and virtual image distance, the same vehicle speed fluctuation in different vehicle speed ranges does not necessarily correspond to the same virtual image distance change. Therefore, the preset focal plane difference threshold can be further determined based on the amount of vehicle speed fluctuation and the mapping relationship between vehicle speed and virtual image distance.

[0098] In one embodiment, the processor 21 acquires the reference vehicle speed and the preset speed fluctuation amount, and determines the preset focal plane difference threshold based on the reference vehicle speed, the preset speed fluctuation amount, and the preset mapping relationship between vehicle speed and virtual image distance.

[0099] The reference vehicle speed, denoted as Vref, refers to the preprocessed vehicle speed used for virtual image distance calculation. The instantaneous vehicle speed obtained during operation may be affected by signal sampling errors and short-term changes in the vehicle's motion state. Therefore, the instantaneous vehicle speed Vins can be filtered first to obtain the reference vehicle speed Vref. For example, other filtering methods such as sliding window filtering and Kalman filtering can be used to process the instantaneous vehicle speed.

[0100] The preset speed fluctuation amount refers to the speed change that is allowed as a reference for vehicle speed fluctuation when determining the focal plane difference threshold, and can be denoted as ΔV. For example, based on the short-term speed changes that may occur during actual vehicle operation, ΔV can be taken in the range of ±2 to ±3 km / h.

[0101] The processor 21 determines the first theoretical virtual image distance corresponding to the reference vehicle speed based on the preset mapping relationship between vehicle speed and virtual image distance. The mapping relationship between vehicle speed and virtual image distance is expressed as: VID = f(V), then the first theoretical virtual image distance can be expressed as: VID1 = f(Vref).

[0102] Furthermore, the processor 21 determines the sum of the reference vehicle speed and the preset speed fluctuation: Vref + ΔV, and determines the second theoretical virtual image distance corresponding to the vehicle speed: VID2 = f(Vref + ΔV) based on the mapping relationship between vehicle speed and virtual image distance.

[0103] The processor 21 determines the preset focal plane difference threshold based on the absolute value of the difference between the first theoretical virtual image distance and the second theoretical virtual image distance, i.e.: Dth=|VID2-VID1|.

[0104] For example, when 0 ≤ Vref ≤ 30, TargetVID is fixed at 5 meters. Thus, f(Vref + ΔV) = f(Vref), and Dth = 0. This means that within this low-speed range, since TargetVID is set as the limit that the zoom actuator can close, speed fluctuations within this range maintain the current actual virtual image distance. When 30 < Vref ≤ 120, TargetVID = 5 + 0.15 × (Vref - 30) meters. The theoretical target virtual image distance changes with increasing vehicle speed, so the same ΔV will correspond to a non-zero change in the theoretical virtual image distance, and Dth is determined accordingly. When Vref > 120, TargetVID is fixed at 18.5 meters, f(Vref + ΔV) = f(Vref), and Dth = 0. This means that within this high-speed range, since TargetVID is set as the limit that the zoom actuator can extend, even if the speed increases further, it cannot extend the virtual image distance further, thus maintaining the current actual virtual image distance.

[0105] In this embodiment, the preset focal plane difference threshold can correspond to the mapping relationship between vehicle speed and virtual image distance near the current vehicle speed, so that the focal plane difference judgment uses the virtual image distance change obtained by the actual mapping of the preset speed fluctuation as the comparison benchmark, without having to use the same fixed focal plane distance threshold in the entire vehicle speed range.

[0106] For emergency situations, this application provides a higher priority focal plane adjustment method. Specifically, the processor 21 acquires the longitudinal deceleration and AEB signal of the vehicle 10.

[0107] Longitudinal deceleration is used to characterize the degree of deceleration of vehicle 10 along the longitudinal direction of travel. Processor 21 can obtain longitudinal deceleration through the vehicle's underlying bus, such as through the CAN bus or in-vehicle Ethernet, to obtain longitudinal deceleration data provided by the vehicle's chassis system. The AEB signal can be provided by the advanced driver assistance system of vehicle 10 to indicate whether AEB is currently active.

[0108] The processor 21 determines whether the absolute value of the longitudinal deceleration is greater than a preset deceleration threshold, or whether the AEB signal indicates that AEB is in an active state.

[0109] The preset deceleration threshold is used to distinguish between normal deceleration states and larger deceleration states requiring entry into the emergency focal plane adjustment path. Using the absolute value of longitudinal deceleration for judgment ensures that emergency situation assessment is not affected by the definition of the positive and negative directions of longitudinal acceleration in the vehicle coordinate system.

[0110] For example, when vehicle 10 brakes rapidly due to a sudden obstacle ahead, causing the absolute value of its longitudinal deceleration to exceed a preset deceleration threshold, processor 21 can determine that the emergency focal adjustment conditions are met even if AEB has not yet been activated. As another example, when AEB has already output an activation signal, even if the absolute value of the longitudinal deceleration obtained in the current sampling period has not yet exceeded the preset deceleration threshold, the system can still enter the emergency focal adjustment path based on the AEB signal.

[0111] When any of the above conditions are met, the processor 21 outputs an emergency focal plane zoom-in drive command to the zoom actuator without performing a comparison between the duration and the preset time threshold.

[0112] The emergency focal plane zoom-in drive command refers to a drive command used in emergency situations to control the zoom actuator to directly zoom in on the focal plane. For example, the emergency focal plane zoom-in drive command is used to cause the zoom actuator to drive the focal plane to the set limit close focus at maximum motor drive power. Its difference from the aforementioned conventional focal plane zoom-in drive command lies in the activation condition: conventional focal plane zoom-in requires a duration confirmation, while emergency focal plane zoom-in does not require this duration to reach a preset time threshold as the activation condition.

[0113] In addition, the duration can be reset in emergency situations, triggering a warning highlighted on the user interface. For example... Figure 6 The image shown is image 60 displayed in the corresponding display area of ​​HUD 30 during normal driving. Figure 7 As shown, when an emergency occurs, a warning is triggered, the image displayed in the display area is adjusted to image 62, and it can flash red at a high frequency to remind the user to pay attention to driving safety.

[0114] This embodiment establishes an emergency focal adjustment method with higher processing priority, in addition to the conventional focal adjustment method. When an emergency condition is met, the processor 21 can skip the process of determining the duration and the dead zone corresponding to the focal difference, enabling the focal adjustment in emergency conditions to respond quickly.

[0115] The actual virtual image distance gradually changes with the mechanical position of the zoom actuator. Based on this mechanical movement process, the size of the image displayed on the head-up display device 30 can be further adjusted using the mechanical position information of the zoom actuator, so as to compensate for the image size as the actual virtual image distance is brought closer and pushed further away.

[0116] During the process of the zoom actuator changing the actual virtual image distance, the processor 21 acquires the mechanical position information of the zoom actuator. This change in the actual virtual image distance includes both driving the zoom actuator to decrease the actual virtual image distance (i.e., bringing the focal plane closer) and driving the zoom actuator to increase the actual virtual image distance (i.e., pushing the focal plane further away).

[0117] Mechanical position information is used to characterize the current actual mechanical state of the zoom actuator. This information may include the position, angle, or number of revolutions of the drive motor, the position of the transmission components, the position of the movable optical components, or other position parameters that reflect the current displacement state of the zoom actuator. For example, the zoom actuator may be equipped with a mechanical position feedback sensor that continuously or according to a preset sampling period reports the current position to the processor 21 during the drive motor's movement. The mechanical position feedback sensor may be an encoder, a Hall sensor, a displacement sensor, or other sensors capable of detecting mechanical position.

[0118] The processor 21 determines the scaling factor based on the acquired mechanical position information and adjusts the size of the image displayed by the head-up display device 30 according to the scaling factor.

[0119] The scaling factor characterizes the ratio of the currently displayed image size to a reference size. For example, a scaling factor of 1 indicates that the image is displayed at the reference size; a scaling factor greater than 1 indicates that the image is enlarged relative to the reference size; and a scaling factor less than 1 indicates that the image is shrunk relative to the reference size. The image size can be the size of the entire displayed image, or it can be the size of icons, text, warning signs, navigation signs, or other user interface elements within the displayed image.

[0120] In one implementation, a pre-established correspondence between the mechanical position of the zoom actuator and the scaling factor can be created. For example, multiple calibration positions can be selected within the mechanical stroke of the zoom actuator, and the image scaling parameters corresponding to each calibration position can be determined, forming a lookup table of mechanical position and scaling factor. During actual zooming, the processor 21 queries the corresponding scaling factor based on the current mechanical position. If the current mechanical position is between two adjacent calibration positions, the corresponding scaling factor can be determined through linear interpolation, curve interpolation, or other interpolation methods.

[0121] In another implementation, the processor 21 can also determine the current actual virtual image distance or the current optical magnification based on the current mechanical position of the zoom actuator, and calculate the scaling factor based on the current actual virtual image distance or the current optical magnification. This allows the software-side image size changes to match the imaging changes of the optical system caused by the mechanical position.

[0122] Specifically, when processor 21 outputs a zoom drive command, processor 21 obtains the starting mechanical position corresponding to the zoom actuator and the target mechanical position corresponding to the distance from the theoretical target virtual image. The zoom drive command can be either a focal plane zoom-in command or a focal plane zoom-out command.

[0123] The initial mechanical position refers to the mechanical position of the zoom actuator at the start of this zoom action. The target mechanical position refers to the mechanical position corresponding to when the zoom actuator moves to the point where the actual virtual image distance reaches the theoretical target virtual image distance. The processor 21 can determine the target mechanical position corresponding to the theoretical target virtual image distance based on the pre-calibrated correspondence between virtual image distance and mechanical position.

[0124] During the process of the zoom actuator moving from the starting mechanical position to the target mechanical position, the processor 21 continuously or periodically acquires the current mechanical position indicated by the mechanical position information, and determines the mechanical movement progress of the zoom actuator from the starting mechanical position to the target mechanical position based on the current mechanical position, the starting mechanical position and the target mechanical position.

[0125] Mechanical movement progress is used to characterize the proportion of the mechanical displacement already completed by the zoom actuator to the target mechanical displacement in this operation. For example, the initial mechanical position is denoted as... The target mechanical position is denoted as The current machine position is recorded as In one implementation, the mechanical movement progress can be determined according to the following formula: .in, This indicates the progress of mechanical movement. When the zoom actuator is at the initial mechanical position, the mechanical movement progress is 0; as the zoom actuator moves towards the target mechanical position, the mechanical movement progress gradually increases; when the zoom actuator reaches the target mechanical position, the mechanical movement progress reaches 1.

[0126] The processor 21 further determines the scaling factor based on the mechanical movement progress. Specifically, the initial scaling factor corresponding to the initial mechanical position can be determined separately. Target scaling factor corresponding to the target mechanical position And make the scaling factor gradually change from the initial scaling factor to the target scaling factor as the mechanical movement progresses.

[0127] For example, when using a linear correspondence, the current scaling factor can be determined as follows: ,in, This represents the current scaling factor. Therefore, when the mechanical movement progress is 0, the current scaling factor is the initial scaling factor; when the mechanical movement progress is 1, the current scaling factor is the target scaling factor.

[0128] The initial scaling factor and the target scaling factor can have either an increasing or decreasing relationship. For example, during the focal plane approaching, the scaling factor can be gradually decreased with the progress of mechanical movement; during the focal plane moving away, the scaling factor can be gradually increased with the progress of mechanical movement. Conversely, depending on the specific imaging characteristics of the optical system, the scaling factor can also be gradually increased during the focal plane approaching and gradually decreased during the focal plane moving away. This application does not limit this. The specific direction and magnitude of the scaling factor change can be pre-calibrated based on the magnification change characteristics, virtual image distance change characteristics, and desired visual compensation effect of the optical system at different mechanical positions.

[0129] In one example, when the focal plane is zoomed in, the initial scaling factor can be set to a value greater than the reference value, and then gradually decreased to the reference value as the mechanical movement progresses; when the focal plane is zoomed out, the initial scaling factor can be set to a value less than the reference value, and then gradually increased to the reference value as the mechanical movement progresses. In this way, software image scaling can be used to compensate for the mechanical movement delay of the zoom actuator in both zoom directions.

[0130] In other implementations, a non-linear mapping relationship between the mechanical movement progress and the scaling factor can also be used. For example, the scaling factor can be determined according to the following formula: .in, It is a nonlinear function corresponding to the mechanical movement progress, and it can satisfy... By setting different function forms, the image size can change rapidly in the early stages of zoom and slowly in the later stages of zoom, or vice versa. The processor 21 can also pre-calibrate the corresponding curve between the mechanical movement progress and the scaling factor based on the actual magnification change curve of the optical system.

[0131] When the zoom actuator reaches the target mechanical position, the processor 21 adjusts the scaling factor to the target scaling factor corresponding to the target mechanical position, and the subsequent image is displayed according to the normal display size corresponding to the target virtual image distance.

[0132] Therefore, regardless of whether the actual virtual image distance changes from far to near or from near to far, the processor 21 can continuously adjust the size of the displayed image according to the actual mechanical movement state of the zoom actuator, so that the software scaling process matches the actual optical zoom process, reducing sudden changes in image size and visual jumps caused by mechanical response delays or movement speed fluctuations of the zoom actuator.

[0133] For example, consider the process of zooming in on the focal plane. Figure 8The image shown depicts the state before the focal plane zoom-in drive command is issued. At this time, the zoom actuator is in the initial mechanical position, and the actual virtual image formed by the HUD 30 is located at the position corresponding to the virtual image distance 1; the display image 802 is displayed according to the reference size, and the driver observes the driving perspective image 804. If the display size is changed after the zoom actuator completes its mechanical movement, the time consumed by the mechanical movement will cause the image size change to lag relative to the focal plane zoom-in drive command.

[0134] like Figure 9 As shown, when the focal plane zoom-in drive command is issued, the zoom actuator has not yet undergone significant mechanical displacement or is in the starting phase. The processor 21 first sets the scaling factor to be greater than the reference value, making the display image 806 enlarged relative to the display image 802, and uses the fast response speed of software rendering to form size compensation in advance; the driver observes the corresponding driving perspective image 808, thereby reducing the perception of mechanical start-up delay.

[0135] like Figure 10 As shown, during the process of the zoom actuator moving from the initial mechanical position to the target mechanical position, the actual virtual image position changes from virtual image distance 1 to virtual image distance 2. The processor 21 determines the mechanical movement progress based on the mechanical position information, and gradually decreases the scaling factor as the mechanical movement progress gradually increases, so that the displayed image 810 gradually shrinks relative to the displayed image 806; the driver observes the driving perspective image 812, and the image size change and the actual virtual image distance change are smoothly connected.

[0136] like Figure 11 As shown, when the zoom actuator reaches the target mechanical position, the actual virtual image is located at the position corresponding to the virtual image distance 3. The processor 21 adjusts the scaling factor to the reference value, so that the display image 814 is displayed at the normal size corresponding to the theoretical target virtual image distance, and the driver observes the driving perspective image 816. This image size compensation ends as the mechanical movement is completed, thereby aligning the software scaling process with the physical zoom process at the target mechanical position.

[0137] By adjusting the scaling factor of the HUD display image in real time based on the mechanical position information of the zoom actuator as it changes the actual virtual image distance, the image size change on the software side can match the actual mechanical movement of the zoom actuator. Utilizing the fast response speed of software rendering to compensate for the mechanical movement delay of the zoom actuator, the image size change and the actual virtual image distance change are smoothly connected, reducing abrupt image size changes or visual jumps during zooming and improving the continuity and visual stability of the HUD focal plane switching process.

[0138] Furthermore, the driver's actual deceleration intention may be clearer in different deceleration scenarios. Therefore, the deceleration intention can be judged based on the multi-dimensional state information of the vehicle and the road, and the preset time threshold can be adjusted accordingly.

[0139] The processor 21 acquires the throttle opening change rate, brake pedal travel, longitudinal deceleration, forward distance change rate, and road type information of the vehicle 10.

[0140] The throttle opening change rate is used to characterize the degree of change in the driver's operation of the accelerator pedal. For example, when the driver releases the accelerator pedal quickly, the throttle opening decreases significantly in a short period of time, and the corresponding throttle opening change rate can reflect the degree of change in this throttle release action.

[0141] Brake pedal travel characterizes the degree of driver engagement with the brake pedal. Compared to longitudinal deceleration, which is reflected solely by vehicle motion, brake pedal travel directly reflects whether the driver actively applies the brakes and the degree of brake intervention.

[0142] Longitudinal deceleration is used to characterize the actual longitudinal deceleration state of vehicle 10. For example, even if the driver has released the accelerator or pressed the brake pedal, the actual degree of deceleration of vehicle 10 may still be affected by factors such as slope, vehicle load and road conditions. Therefore, longitudinal deceleration can be used as a characterization of the actual dynamic response of the vehicle.

[0143] The rate of change of distance to the vehicle in front is used to characterize the changing trend of the distance between vehicle 10 and the vehicle in front. The rate of change of distance to the vehicle in front can be determined based on the distance to the vehicle in front continuously obtained by forward radar, cameras, or other forward environmental perception devices. When vehicle 10 is approaching the vehicle in front at a relatively fast speed, the rate of change of distance to the vehicle in front can be used to characterize the urgency of the deceleration requirement under the current following condition.

[0144] Road type information is used to characterize the scene attributes of the vehicle 10's current road or roads within a preset range ahead, and can be obtained from navigation systems, high-precision maps, or road recognition results. For example, road type information can characterize road scenes that require the vehicle to slow down in advance, such as sharp bends, toll stations, or ramp exits ahead.

[0145] The processor 21 determines the confidence level of the deceleration intention based on the rate of change of throttle opening, brake pedal travel, longitudinal deceleration, rate of change of distance to the vehicle in front, and road type information.

[0146] The confidence level of deceleration intention is used to characterize the degree of credibility of the deceleration demand reflected by the current vehicle state and road scene, which is the driver's clear intention to decelerate. A low confidence level of deceleration intention indicates that the current information is more like a brief release of the accelerator or a general speed fluctuation; a high confidence level of deceleration intention indicates that multiple pieces of information point to a relatively clear and continuous deceleration demand.

[0147] In one implementation, the five types of input information mentioned above can be normalized to form a deceleration intention feature vector. Then, a preset weighting matrix is ​​used to fuse these features to obtain the deceleration intention confidence level. This process can be expressed as: deceleration intention confidence level Pdec = F(X), where X represents the feature set consisting of the throttle opening change rate, brake pedal travel, longitudinal deceleration, forward distance change rate, and road type information, and F represents a preset multi-dimensional fusion relationship.

[0148] For example, when only a slight release of the accelerator is detected, the brake pedal does not change significantly, the vehicle's longitudinal deceleration is small, the distance to the vehicle in front does not shorten significantly, and there is no obvious deceleration scenario on the current road, a low confidence level of deceleration intention can be obtained.

[0149] Conversely, when the driver simultaneously releases the accelerator quickly, the brake pedal intervenes significantly, the vehicle experiences a large longitudinal deceleration, and the distance to the vehicle in front decreases rapidly, multiple pieces of information together characterize the deceleration demand, and the processor 21 can obtain a high confidence level in the deceleration intention.

[0150] Road scene information can also serve as an auxiliary condition for judging deceleration intention. For example, when a vehicle approaches a toll station, sharp bend, or ramp exit, even if the current brake pedal travel is not large, this road type information can still be used together with other information such as throttle changes and vehicle deceleration to determine the confidence level of deceleration intention.

[0151] In addition to the weighted matrix, the processor 21 can also fuse the above information using fuzzy inference. For example, each input quantity can be divided into different levels of state, and the confidence level corresponding to the current deceleration intention can be determined according to preset fuzzy rules.

[0152] After obtaining the confidence level of the deceleration intention, the processor 21 adjusts the preset time threshold according to the confidence level of the deceleration intention. The preset time threshold is negatively correlated with the confidence level of the deceleration intention.

[0153] Negative correlation means that, all other things being equal, the higher the confidence level of the deceleration intention, the smaller the adjusted preset time threshold; and the lower the confidence level of the deceleration intention, the larger the adjusted preset time threshold.

[0154] A monotonically negatively correlated mapping relationship can be established between the confidence level of deceleration intention and the preset time threshold. The specific mapping relationship can be implemented using a lookup table, piecewise mapping, or a continuous function. For example, the corresponding time thresholds can be configured according to multiple confidence intervals of deceleration intention, or Tth can be calculated based on Pdec using a pre-calibrated continuous negative correlation function.

[0155] When using a fixed preset time threshold, both slight throttle release and deliberate braking require waiting the same amount of time before focal plane zoom can be initiated, making it impossible to adjust the observation time based on the clarity of the deceleration intention.

[0156] This embodiment determines the confidence level of deceleration intention by considering throttle operation, braking operation, vehicle dynamics, approach of the preceding vehicle, and road conditions. A preset time threshold is adjusted based on this confidence level, allowing the time scale for confirming the duration of deceleration to change with the clarity of the deceleration intention. When the confidence level of the deceleration intention is low, a larger preset time threshold is used, increasing the observation time for uncertain deceleration states such as slight throttle release. When multiple pieces of information jointly indicate a relatively clear deceleration intention, a smaller preset time threshold is used, shortening the duration required for the corresponding focal plane approach requirement to reach the initiation condition. This results in low-confidence deceleration requirements being filtered over a longer time, while high-confidence deceleration requirements are confirmed with a shorter time.

[0157] Furthermore, the driver's visual state can be determined based on the actual changes in the HUD's focal plane over a period of time, as well as the driver's eye movements, blinking, and other states, and the preset time threshold can be further adjusted based on this visual state.

[0158] The processor 21 acquires the frequency of focal plane changes and the cumulative change in virtual image distance of the HUD 30 within a preset time range, and acquires the driver's eye movement parameters and blink parameters collected by the driver monitoring system.

[0159] The preset time range is a time interval used to statistically analyze changes in the focal plane and evaluate the driver's visual state. The preset time range can be determined based on system calibration and can be continuously updated as the vehicle operates. For example, when the current moment arrives, the processor 21 can statistically analyze the focal plane changes that have occurred within a preset time range prior to the current moment and update the time range forward at the next statistical moment.

[0160] The focal plane change frequency is used to characterize the number of times or the frequency of actual focal plane adjustments occur in the HUD 30 within a preset time range. For example, each time the zoom actuator completes a zoom action that changes the actual virtual image distance, a focal plane change event can be recorded, and the focal plane change frequency can be determined based on the number of focal plane change events recorded within the preset time range.

[0161] The cumulative change in virtual image distance is used to characterize the cumulative degree of change in actual virtual image distance within a preset time range. To avoid the focal plane moving closer and farther away canceling each other out in sign, the cumulative change can be based on the absolute value of each actual virtual image distance change.

[0162] For example, within a preset time range, if the actual virtual image distance first changes from 10m to 8m, and then from 8m to 11m, the corresponding cumulative change in virtual image distance can be determined based on the absolute values ​​of the two changes, i.e., a cumulative 2m and 3m.

[0163] A Driver Monitoring System (DMS) is used to collect information about the driver's eye or facial state. The DMS uses cameras installed in the vehicle's cockpit to capture images of the driver and extracts eye movement and blink parameters from these images.

[0164] Among them, eye movement parameters are used to characterize the movement state of the driver's eyeballs or gaze, and may include at least one of the following: gaze frequency and eye movement trajectory characteristics; blinking parameters are used to characterize the driver's blinking state, and may include blinking frequency and its changes.

[0165] The processor 21 determines the driver's visual state based on the frequency of focal plane changes, the cumulative change in virtual image distance, eye movement parameters, and blink parameters.

[0166] Among them, the driver's visual state is used to characterize the driver's visual response state under the current focal plane accommodation condition. For example, it can be used to distinguish between a state that does not show obvious visual fatigue characteristics and a state that has shown visual fatigue characteristics.

[0167] On the one hand, the focal plane change load within a preset time range is determined based on the frequency of focal plane changes and the cumulative change in virtual image distance. When the frequency of focal plane changes increases, it means that the number of focal plane adjustments experienced by the driver within the corresponding time range increases; when the cumulative change in virtual image distance increases, it means that the total amount of focal plane depth change experienced by the driver increases.

[0168] On the other hand, eye movement and blinking parameters can be used to determine whether the driver is experiencing physiological changes corresponding to visual fatigue. For example, when the frequency of gaze wandering increases and the blinking frequency changes significantly compared to the normal state, it can be considered that the current eye state exhibits corresponding characteristics of visual fatigue.

[0169] In one specific implementation, corresponding evaluation conditions can be set for the frequency of focal plane changes, the cumulative change in virtual image distance, eye movement parameters, and blink parameters, and the driver's visual state can be determined based on the condition that multiple parameters meet the corresponding evaluation conditions.

[0170] For example, when the frequency of focal plane changes is high within a preset time range, the cumulative change in virtual image distance is also large, and the DMS detects that the driver's gaze wanders or blinks to the corresponding fatigue evaluation conditions, the processor 21 can determine that the driver's visual state meets the preset fatigue conditions.

[0171] The preset fatigue condition is used to determine whether the driver's current visual state requires a reduction in the frequency of subsequent focal plane changes. The preset fatigue condition can be determined based on the focal plane change load and the calibration thresholds corresponding to the driver's physiological parameters.

[0172] When the driver's visual state meets the preset fatigue condition, the processor 21 increases the preset time threshold.

[0173] In addition, after detecting a corresponding visual fatigue state, the focal plane difference threshold can be increased and the user interface compensation amplitude can be decreased simultaneously.

[0174] By feeding back the actual changes in the focal plane and the driver's visual state to a preset time threshold, the time threshold for subsequent focal plane convergence can be increased when the driver exhibits visual fatigue characteristics, thereby reducing the trigger frequency of subsequent focal plane convergence actions and enabling the focal plane adjustment parameters to be adjusted based on the driver's actual visual response.

[0175] like Figure 12 As shown, this application embodiment also provides a focal plane adjustment method. This method can be executed by a focal plane adjustment device 20. The processor 21 acquires the vehicle's longitudinal deceleration and automatic emergency braking signal, and acquires the theoretical target virtual image distance and the current actual virtual image distance of the head-up display device; when an emergency condition is met, it outputs an emergency focal plane convergence drive command; when an emergency condition is not met, it determines the focal plane difference value, maintains the current actual virtual image distance when the focal plane difference value is within a preset dead zone, outputs a focal plane deceleration drive command when the theoretical target virtual image distance is greater than the current actual virtual image distance, and determines the duration of this state when the theoretical target virtual image distance is less than the current actual virtual image distance. When the duration does not reach a preset time threshold, it maintains the current actual virtual image distance, and outputs a focal plane convergence drive command when the duration reaches the preset time threshold. Each step in this focal plane adjustment method corresponds to the processing procedure executed by the processor 21 in the aforementioned focal plane adjustment device 20. Therefore, the method embodiment can achieve the technical effects corresponding to the device embodiment.

[0176] like Figure 13 As shown, this application embodiment also provides a HUD 30. The HUD 30 is used to reflect a projected image through the windshield 11 of the vehicle 10 to the occupant 131, so as to provide visual information to the occupant 131.

[0177] The HUD 30 includes a zoom actuator 31, a projection unit 32, an optical component 33, and a focal plane adjustment device 20. The projection unit 32 projects an image beam corresponding to the image to be displayed; the optical component 33 reflects or refracts the image beam so that it is reflected through the windshield 11 to the occupant 131; the zoom actuator 31 changes the mechanical position or optical working state of the optical component 33 to change the actual virtual image distance formed by the HUD 30; and the focal plane adjustment device 20 controls the zoom actuator 31 and the projection unit 32 to project the image beam according to the corresponding display parameters.

[0178] By setting up a zoom actuator 31, a projection unit 32, an optical component 33, and a focal plane adjustment device 20 in the HUD 30, the focal plane can be controlled to move closer or farther according to the relationship between the theoretical target virtual image distance and the current actual virtual image distance. The size of the displayed image is compensated during the zoom process, so that the physical movement of the focal plane adjustment and the image display process are coordinated with each other.

[0179] This application embodiment also provides a focal plane adjustment method. This method can be executed by a focal plane adjustment device 20. The method includes: acquiring a theoretical target virtual image distance and a current actual virtual image distance; when the theoretical target virtual image distance is less than the current actual virtual image distance, determining the duration for which the state of the theoretical target virtual image distance being less than the current actual virtual image distance is continuously maintained; when the duration is less than a preset time threshold, maintaining the current actual virtual image distance; when the duration is greater than or equal to the preset time threshold, outputting a focal plane zooming drive command to a zoom actuator to control the zoom actuator to reduce the actual virtual image distance. Each step in this focal plane adjustment method corresponds to the processing procedure executed by the processor 21 in the aforementioned focal plane adjustment device 20. Therefore, the method embodiment can achieve the technical effects corresponding to the device embodiment.

[0180] This application also provides a computer-readable storage medium storing a computer program thereon. When the computer program is executed by a processor, it can implement the above-described focal plane adjustment method. The computer-readable storage medium may include a read-only memory, a random access memory, flash memory, a hard disk, an optical storage medium, or other non-transitory storage media.

[0181] It is understood that the above specific embodiments are only used to illustrate this application and are not intended to limit the scope of protection of this application. For those skilled in the art, the technical features in the above embodiments can be combined, substituted, or adjusted without departing from the concept of this application, and such combinations, substitutions, or adjustments should still fall within the scope of protection of this application.

[0182] Those skilled in the art will recognize that, in one or more of the examples above, the functions described in this application can be implemented using hardware, software, firmware, or any combination thereof. When implemented in software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium accessible to a general-purpose or special-purpose computer.

[0183] It should be noted that the technical solutions described in this application can be combined arbitrarily without conflict.

[0184] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A focal plane adjustment device, characterized in that, include: Memory, configured to store computer programs; A processor, connected to the memory, is configured to execute the computer program to: Obtain the theoretical target virtual image distance and the current actual virtual image distance of the head-up display device; When the theoretical target virtual image distance is less than the current actual virtual image distance, determine the duration for which the state of the theoretical target virtual image distance being less than the current actual virtual image distance is continuously maintained; When the duration is less than a preset time threshold, the current actual virtual image distance is maintained; When the duration is greater than or equal to the preset time threshold, a focal plane zoom drive command is output to the zoom actuator to control the zoom actuator to reduce the actual virtual image distance.

2. The focal plane adjustment device according to claim 1, characterized in that, The processor is also configured to: When the theoretical target virtual image distance is greater than the current actual virtual image distance, a focal plane push-out drive command is output to the zoom actuator to control the zoom actuator to increase the actual virtual image distance.

3. The focal plane adjustment device according to claim 1, characterized in that, The processor is configured to: When the theoretical target virtual image distance is detected to be less than the current actual virtual image distance in the current control cycle, the duration is updated according to the cumulative duration corresponding to the previous control cycle and the duration of the current control cycle; Before the duration is greater than or equal to the preset time threshold, if the state that the theoretical target virtual image distance is less than the current actual virtual image distance is not met, the duration is reset.

4. The focal plane adjustment device according to claim 1, characterized in that, The processor is also configured to: The focal plane difference is determined based on the theoretical target virtual image distance and the current actual virtual image distance. When the absolute value of the focal plane difference is less than or equal to a preset focal plane difference threshold, the current actual virtual image distance is maintained. The duration is determined when the absolute value of the focal plane difference is greater than the preset focal plane difference threshold and the theoretical target virtual image distance is less than the current actual virtual image distance.

5. The focal plane adjustment device according to claim 4, characterized in that, The processor is also configured to: When the absolute value of the focal plane difference is greater than the preset focal plane difference threshold, and the theoretical target virtual image distance is greater than the current actual virtual image distance, a focal plane push-away drive command is output to the zoom actuator.

6. The focal plane adjustment device according to claim 4, characterized in that, The processor is configured to: Obtain the vehicle's reference speed and preset speed fluctuation; Based on the preset mapping relationship between vehicle speed and virtual image distance, the first theoretical virtual image distance corresponding to the reference vehicle speed and the second theoretical virtual image distance corresponding to the sum of the reference vehicle speed and the preset speed fluctuation amount are determined. The preset focal plane difference threshold is determined based on the absolute value of the difference between the first theoretical virtual image distance and the second theoretical virtual image distance.

7. The focal plane adjustment device according to claim 1, characterized in that, The processor is also configured to: Acquire the vehicle's longitudinal deceleration and automatic emergency braking signals; When the absolute value of the longitudinal deceleration is greater than the preset deceleration threshold, or when the automatic emergency braking signal indicates that the automatic emergency braking is active, an emergency focal plane approach drive command is output to the zoom actuator.

8. The focal plane adjustment device according to any one of claims 1 to 7, characterized in that, The processor is also configured to: During the process of the zoom actuator changing the actual virtual image distance, the mechanical position information of the zoom actuator is acquired; The scaling factor is determined based on the mechanical position information; The size of the image displayed by the head-up display device is adjusted according to the scaling factor.

9. The focal plane adjustment device according to claim 8, characterized in that, The processor is configured to: Obtain the starting mechanical position corresponding to the zoom actuator, and the target mechanical position corresponding to the distance to the theoretical target virtual image; Based on the current mechanical position indicated by the mechanical position information, the starting mechanical position, and the target mechanical position, the mechanical movement progress of the zoom actuator from the starting mechanical position to the target mechanical position is determined; The scaling factor is determined based on the progress of the mechanical movement.

10. The focal plane adjustment device according to claim 1, characterized in that, The processor is also configured to: The confidence level of deceleration intention is determined based on the vehicle's throttle opening change rate, brake pedal travel, longitudinal deceleration, forward distance change rate, and road type information. The preset time threshold is adjusted based on the confidence level of the deceleration intention, wherein the preset time threshold is negatively correlated with the confidence level of the deceleration intention.

11. The focal plane adjustment device according to claim 1, characterized in that, The processor is also configured to: The driver's visual state is determined based on at least one of the following within a preset time range: the frequency of focal plane changes, the cumulative change in virtual image distance, driver's eye movement parameters, and blink parameters. When the driver's visual state meets the preset fatigue condition, the preset time threshold is increased.

12. A head-up display device, characterized in that, include: Projection unit, used to project image beams; Optical components for reflecting the image beam to form a virtual image; A zoom actuator is used to change the virtual image distance of the formed virtual image; The focal plane adjustment device as described in any one of claims 1 to 11.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, the processor: Obtain the theoretical target virtual image distance and the current actual virtual image distance of the head-up display device; When the theoretical target virtual image distance is less than the current actual virtual image distance, determine the duration for which the state of the theoretical target virtual image distance being less than the current actual virtual image distance is continuously maintained; When the duration is less than a preset time threshold, the current actual virtual image distance is maintained; When the duration is greater than or equal to the preset time threshold, a focal plane zoom drive command is output to the zoom actuator to control the zoom actuator to reduce the actual virtual image distance.