A near-eye display device, a display control method and apparatus therefor, and a storage medium

Abstract

This disclosure provides a near-eye display device and its display control method, apparatus, and storage medium. The display control method of the near-eye display device may include: generating a left-eye image sequence and a right-eye image sequence through a dual-channel display component; controlling the display sequence of the dual-channel display component such that there is a predetermined time difference between the display times of each frame in the left-eye image sequence and the corresponding frame in the right-eye image sequence; wherein the display sequence enables the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic image in visual perception.

Description

Technical Field

[0001] This disclosure relates to the field of display control technology, and in particular to a near-eye display device and its display control method, apparatus and storage medium. Background Technology

[0002] In near-eye display devices (such as AR / VR glasses / night vision devices), dual-channel display technology achieves a stereoscopic effect by generating independent images for the left and right eyes.

[0003] Current solutions typically display images simultaneously from both eyes, with the frame rate directly limited by the screen's physical refresh rate. While increasing the screen refresh rate can improve smoothness, it leads to a significant increase in power consumption and requires a higher-performance processor. Summary of the Invention

[0004] In view of this, the present disclosure aims to provide a near-eye display device and its display control method, apparatus and storage medium; which can solve the technical problem that the prior art cannot improve the refresh rate of near-eye display devices when the physical refresh rate of the screen is limited.

[0005] The technical solution of this disclosure embodiment is implemented as follows:

[0006] In a first aspect, embodiments of this disclosure provide a display control method for a near-eye display device, comprising:

[0007] The left-eye image sequence and the right-eye image sequence are generated separately using a dual-channel display component;

[0008] The display sequence of the dual-channel display component is controlled such that there is a predetermined time difference between the display times of each frame in the left-eye image sequence and the corresponding frame in the right-eye image sequence;

[0009] The display sequence enables the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic image in visual perception.

[0010] Secondly, embodiments of this disclosure provide a display control device for a near-eye display device, comprising:

[0011] The image acquisition module is used to generate left-eye and right-eye image sequences respectively through the dual-channel display component;

[0012] The display control module is used to control the display sequence of the dual-channel display component, so that there is a predetermined time difference between the display times of each frame in the left eye image sequence and the corresponding frame in the right eye image sequence.

[0013] The display sequence enables the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic image in visual perception.

[0014] Thirdly, embodiments of this disclosure provide a near-eye display device, the near-eye display device comprising: a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the display control method of the near-eye display device described in the first aspect.

[0015] Fourthly, embodiments of this disclosure provide a computer storage medium storing at least one instruction, which is executed by a processor to implement the display control method for a near-eye display device as described in the first aspect.

[0016] This disclosure provides a near-eye display device and its display control method, apparatus, and storage medium. It generates independent image sequences for the left and right eyes using dual-channel display components and precisely controls the display sequence difference between them. Utilizing the persistence of vision in the human eye and the brain's synthesis mechanism, the alternately displayed binocular images are fused into a continuous image in the visual cortex. This asynchronous timing strategy overcomes the dependence of traditional synchronous displays on hardware frame rates. Without increasing the physical refresh rate, it multiplies the apparent frame rate through the temporal synthesis capability of the biological visual system. Simultaneously, the dual-channel physical isolation mechanism eliminates optical crosstalk, ensuring independent transmission of image information for the left and right eyes. This provides the necessary signal purity foundation for timing difference control, ultimately significantly improving the smoothness of dynamic images while maintaining low power consumption. Attached Figure Description

[0017] Figure 1 This is a schematic diagram of the structure of a near-eye display device provided in an embodiment of this disclosure.

[0018] Figure 2 A flowchart of a display control method for a near-eye display device provided in an embodiment of this disclosure.

[0019] Figure 3 This is a system framework diagram of a near-eye display device provided in an embodiment of the present disclosure.

[0020] Figure 4 This is a system framework diagram of a near-eye display device with a timing control module provided in an embodiment of the present disclosure.

[0021] Figure 5 This is a schematic diagram of an image sequence display sequence provided in an embodiment of the present disclosure.

[0022] Figure 6 This is a system framework diagram of a near-eye display device with a motion tracking sensor provided in an embodiment of this disclosure.

[0023] Figure 7 This is a system framework diagram of a near-eye display device with an eye-tracking sensor provided in an embodiment of this disclosure.

[0024] Figure 8 This is a system framework diagram of a near-eye display device with a timing control module provided in an embodiment of the present disclosure.

[0025] Figure 9 This is a system framework diagram of a near-eye display device with a dynamic frame adjustment module, provided as an embodiment of the present disclosure.

[0026] Figure 10 A flowchart of a display control method for a near-eye display device provided in an embodiment of this disclosure.

[0027] Figure 11 This is a schematic diagram of the structure of a display control device for a near-eye display device provided in an embodiment of this disclosure.

[0028] Figure 12 This is a schematic diagram of the structure of a near-eye display device provided in an embodiment of this disclosure.

[0029] The accompanying drawings have illustrated specific embodiments of this disclosure, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this disclosure to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0030] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, they are provided so that this disclosure will be more comprehensive and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0031] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0032] Near-eye display devices (NEDs) are wearable human-computer interaction devices that project digital images directly onto the user's retina using an optical system. Their core function is to create a visual perception interface that blends into or isolates from the physical environment. This technology encompasses various device forms, primarily including augmented reality glasses (AR glasses), virtual reality head-mounted displays (VR HMDs), head-mounted displays (HMDs), and night vision goggles (NVGs). For example, augmented reality glasses like the Microsoft HoloLens series use waveguide technology to overlay virtual information onto the real environment; virtual reality headsets like the Oculus Quest series achieve a fully immersive display through curved reflector arrays; head-mounted displays widely used in industrial inspection typically integrate high-resolution Micro-OLED displays; and night vision devices rely on a dual-modal technology of low-light enhancement (LLA) and infrared imaging (IR) to achieve target observation in low-light environments. All of these devices require an optical system (including refractive, diffractive, or reflective elements) to achieve spatial image positioning, an ergonomic mounting structure to ensure precise alignment of the human eye with the optical axis, and a real-time rendering engine to guarantee low-latency display of dynamic scenes. Their technological differences mainly lie in the engineering implementation paths of environmental perception modes (such as through-hole or closed optical designs) and virtual-real fusion layers (such as augmented reality (AR), virtual reality (VR), or mixed reality (MR).

[0033] Near-eye display devices achieve smooth visual presentation of dynamic scenes through high refresh rate display modules (typically 90-120Hz) and low-latency rendering technology. The core technological challenge lies in balancing the physical refresh rate with power consumption and display accuracy. This is particularly relevant in night vision applications, where night vision devices are crucial for nighttime observation and are widely used in military and security fields. They collect faint light and convert it into a visible image, enabling people to observe objects even in low-light conditions.

[0034] In the field of night vision equipment, existing technologies are limited by the physical refresh rate bottleneck of image sensors, resulting in a significant decline in imaging quality and target tracking capabilities in dynamic scenes. Traditional low-light imaging systems employ a global exposure synchronous refresh mechanism, whose fixed frame rate mode is ill-suited to adapting to sudden changes in target movement speed. When a target moves rapidly in a low-light environment, the fixed refresh interval at the image acquisition end causes keyframe loss, resulting in displacement discontinuities between adjacent frames of the moving target. This manifests as a trailing effect on the target outline and inaccurate trajectory prediction. Simultaneously, the frame accumulation technology used by infrared thermal imaging components to reduce noise further exacerbates the attenuation of the effective refresh rate. In high-speed moving scenarios (such as vehicle obstacle avoidance and target pursuit), this causes heat source location information to lag behind the actual physical displacement, creating a time blind spot for decision-making. Even more seriously, existing frame interpolation compensation algorithms used to improve the display refresh rate can lead to motion vector misjudgments due to insufficient signal-to-noise ratio of the original image in low-light environments. This introduces artifact interference during the refresh rate enhancement process, disrupting the continuity of the true motion trajectory. These technical defects caused by the rigid constraints of refresh rate essentially limit the improvement of the practical performance of night vision devices in complex and dynamic scenarios.

[0035] Based on this, this disclosure first provides a near-eye display device and its display control method, such as Figure 1 As shown, the near-eye display device disclosed herein may include dual-channel display components. Each display component may include an imaging component and a display component. The imaging component is used to acquire and observe the corresponding image, transmit it to the display component, and display it on the display component. Optionally, the dual-channel display components may correspond to the left-eye display component 11 and the right-eye display component 12 respectively. The image sequences acquired by the left-eye display component 11 and the right-eye display component 12 correspond to each other, but there is a field of view deviation between the corresponding frames to adapt to the human left and right eyes without providing a change of angle.

[0036] Figure 2 A flowchart of a near-eye display device and its display control method is shown, wherein the near-eye display device and its display control method may include steps S210 to S220.

[0037] In step S210, the left eye image sequence and the right eye image sequence are generated by the dual-channel display component.

[0038] In one exemplary embodiment of this disclosure, a left-eye image sequence and a right-eye image sequence can be generated separately by a dual-channel display component of a near-eye display device. The dual-channel display component consists of a physically isolated left-eye display component 11 and a right-eye display component 12. Each display component includes an independent display module (such as a silicon-based OLED or LCoS module) composed of a micro-display panel and an imaging module (including a lens group, a polarizing beam splitter, etc.) of a matching optical system.

[0039] The left-eye display component 11 receives a left-eye image data stream generated by its imaging module. This data stream generates a left-eye image sequence at a preset frame rate, and the refresh timing of each pixel is precisely controlled by a timing controller. The right-eye display component 12 synchronously executes the same process, but there is a controllable offset between the two in terms of time reference. (Refer to...) Figure 3 The beam splitter or waveguide in the optical system physically isolates the image optical paths output by the left and right display components, ensuring that the left eye can only perceive the left eye image sequence output by the left eye display component 11, and the right eye only receives the right eye image sequence output by the right eye display component 12.

[0040] In step S220, the display sequence of the dual-channel display component is controlled so that there is a predetermined time difference between the display times of each frame in the left eye image sequence and the corresponding frame in the right eye image sequence.

[0041] Among them, the display sequence enables the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic picture in visual perception.

[0042] In some exemplary embodiments of this disclosure, reference is made to Figure 4 The aforementioned dual-channel display component may also include a timing control module 13. The timing control module 13 performs asynchronous timing control on the left-eye display component 11 and the right-eye display component 12 in the dual-channel display component to control the display sequence of the dual-channel display component. Specifically, the trigger signals of each frame of the left-eye image sequence received by the left-eye display component 11 and the corresponding frame trigger signals of the right-eye image sequence received by the right-eye display component 12 form a predetermined time difference through the phase offset of the synchronization signal (VSYNC).

[0043] Under this timing control mechanism, the left-eye display component 11 sequentially outputs discrete frames of the left-eye image sequence at intervals equal to a reference clock cycle, while the right-eye display component 12 outputs the corresponding frames of the right-eye image sequence after a predetermined time difference within each reference clock cycle. The motion fusion mechanism of the human visual system fuses the left-eye image sequence output by the left-eye display component 11 and the right-eye image sequence output by the right-eye display component 12 into a continuous dynamic image at the perceptual level during the transmission of retinal nerve signals to the visual center.

[0044] The display control method for a near-eye display device in this embodiment generates independent image sequences for the left and right eyes using dual-channel display components and precisely controls the display sequence difference between them. Utilizing the persistence of vision in the human eye and the brain's synthesis mechanism, the alternately displayed binocular images are fused into a continuous image in the visual cortex. This asynchronous timing strategy overcomes the dependence of traditional synchronous displays on hardware frame rates. Without increasing the physical refresh rate, it multiplies the apparent frame rate through the temporal synthesis capability of the biological visual system. Simultaneously, the dual-channel physical isolation mechanism eliminates optical crosstalk, ensuring independent transmission of image information for the left and right eyes. This provides the necessary signal purity foundation for timing difference control, ultimately significantly improving the smoothness of dynamic images while maintaining low power consumption.

[0045] In some examples, the predetermined time difference is positively correlated with the time taken to display one frame of an image. Specifically, the positive correlation between the predetermined time difference (Δt) and the time taken to display one frame of an image (T_frame) is achieved by the programmable clock divider in the timing control module 13.

[0046] Specifically, the time (T_frame) for displaying one frame of an image is determined by the physical refresh rate of the dual-channel display components. For example, when the refresh rate of the display components is 90Hz, T_frame is approximately 11.1 milliseconds. The predetermined time difference (Δt) is dynamically calculated based on T_frame according to a preset scaling factor, for example, Δt = K × T_frame, where K can be a scaling constant greater than or equal to 0.1 and less than or equal to 0.5.

[0047] In some examples, the aforementioned predetermined time difference could be half the total time for displaying a frame of an image; for example, refer to Figure 5 When the display system operates at a base frame rate of 50Hz, the duration of a single frame is 20 milliseconds. The right-eye display component 12 initiates the display process of right frame 1 at the initial moment, while the left-eye display component 11 triggers the display instruction of left frame 1 after 10 milliseconds. The display period of right frame 1 covers the period from the start moment to the 20th millisecond, while the display period of left frame 1 extends from the 10th millisecond to the 30th millisecond. The synthesis mechanism of the visual center operates in stages according to time windows.

[0048] Specifically, when the dual-channel display components operate between 10 and 20 milliseconds, the right eye continuously outputs the complete image of right frame 1, while the left eye begins outputting the data stream of left frame 1. At this time, the brain's visual processing area performs disparity matching and motion compensation on the two asynchronous signals to generate the first frame of fused image. After entering the 20 to 30 millisecond phase, the right eye display component 12 switches to the display cycle of right frame 2, while the left eye display component 11 is still in the final display phase of left frame 1. The visual system reconstructs the second frame of enhanced synthetic image by extracting the afterimage features of left frame 1 and the dynamic information of right frame 2. When the time progresses to the 30 to 40 millisecond range, the left eye display component 11 starts the rendering process of left frame 2, forming a spatiotemporal overlap with the right frame 2 output by the right eye display component 12. The brain's motor perception center uses the correlation features between the two frames to generate a third frame of high-smoothness image through a temporal interpolation algorithm. By fully utilizing the biological characteristics of the human visual system, the photochemical residue effect of retinal photoreceptor cells ensures the continuity of light signals between adjacent frames, while the time integration of neurons in the visual cortex transforms discrete input signals into smooth motion perception. By controlling the time phase difference between the left-eye display component 11 and the right-eye display component 12, the system maintains a physical refresh rate of 50Hz at the hardware level while achieving an equivalent visual smoothness of 100Hz at the perception level, breaking through the technical bottleneck of traditional display technology limited by the response speed of optoelectronic components.

[0049] In some examples, the predetermined time difference can be updated based on the motion data of the observed objects in the dual-channel display component. For details, refer to... Figure 6 The motion data of the observed object can be captured in real time by the motion tracking sensor 14 integrated in the dual-channel display component, and the predetermined time difference (Δt) between the left eye display component 11 and the right eye display component 12 can be dynamically adjusted accordingly.

[0050] For example, a motion tracking sensor continuously collects the velocity vector of the observed object in three-dimensional space. When the object's velocity exceeds a preset threshold V_th, an adjustment coefficient can be generated based on the linear relationship between the velocity increment ΔV and Δt.

[0051] Its mathematical expression can be:

[0052] ΔV = V_current - V_th

[0053] Δt_new = Δ - K×ΔV

[0054] Where K is a scaling factor, a constant term, such as 0.2ms / (m / s), and the specific value can be customized according to user needs, which will not be elaborated here; V_current represents the current moving speed value of the observed object obtained by the motion tracking module in real time; Δt_new represents the updated predetermined time difference.

[0055] The timing control module 13 reconfigures the display sequence of the left and right eye display components 12 according to the updated Δt_new value, so that the display time interval between the left eye image sequence and the right eye image sequence in high-speed motion scenes is shortened, thereby reducing the parallax matching error caused by the rapid displacement of the target.

[0056] It should be noted that the preset threshold can be 5 m / s, 6 m / s, etc., and can also be customized according to user needs, which will not be elaborated in this example implementation.

[0057] The embodiments disclosed herein use a dynamic adjustment mechanism to suppress motion blur in high-speed motion states; and maintain a large Δt in low-speed or stationary states to fully utilize the visual persistence effect to improve the apparent frame rate.

[0058] Optionally, the sampling frequency of the motion tracking sensor can be greater than or equal to twice the physical refresh rate of the display component to ensure the real-time performance of the time difference adjustment command and avoid visual perception mismatch caused by control delay.

[0059] In some examples, refer to Figure 7 As shown, the aforementioned near-eye display device may further include an image preprocessing module, which may be a temporal noise reduction and filtering module for performing temporal noise reduction and filtering on the left-eye image sequence and the right-eye image sequence, wherein the size of the filtering window for the noise reduction and filtering is positively correlated with a predetermined time difference.

[0060] Specifically, the temporal noise reduction filtering module dynamically adjusts the processing parameters based on the predetermined time difference between the dual-channel display components. In practice, independent temporal recursive filtering channels can be established for the left-eye image sequence and the right-eye image sequence, with the filtering window size of each channel being directly proportional to the currently set predetermined time difference.

[0061] When the display sequence adjusts the predetermined time difference between the display times of the left-eye and right-eye image sequences due to environmental changes or user needs, the temporal noise reduction filtering module synchronously expands or contracts the time span of the filtering window. When the predetermined time difference increases, the filtering window covers a longer historical frame data range, enhancing the ability to suppress random noise in static scenes; while when the predetermined time difference decreases, the window focuses on adjacent frame data, reducing motion blur effects in high-speed motion scenes.

[0062] It should be noted that "historical frames" refer to the sequence of previous image frames that are cached during the temporal denoising process and used in the calculation of the current frame. Specifically, when the system performs denoising processing on the current display frame, it extracts several consecutive image frames earlier than the current time from the frame cache queue. These processed old frames are collectively referred to as historical frames. For example, if the filtering window is set to 5 frames, the system will use the current frame and the previous 4 historical frames in the calculation. The role of historical frames is to eliminate random noise through temporal correlation analysis: since static objects in a scene have consistent pixel characteristics in multiple frames, while noise signals exhibit a temporal random distribution, the noise intensity can be effectively suppressed by weighted averaging or recursive filtering of multiple frames of historical data; neighboring frames specifically refer to the sequence of image frames that are adjacent to the current processing frame in the time dimension.

[0063] In some examples, refer to Figure 8 The aforementioned near-eye display device may also include an eye movement sensor 15 for acquiring the user's eye movement data in real time and dynamically adjusting the predetermined time difference between the left and right eye display components 12 based on this data.

[0064] Specifically, the eye-tracking sensor can capture changes in the pupil center position at a predetermined sampling rate, calculate the pupil movement velocity through real-time differential calculation, and convert the pupil movement velocity value into the eyeball angular velocity of eyeball rotation. When the user's eyeball angular velocity is detected to exceed a preset threshold, the timing control module 13 immediately activates the time difference compression mechanism, gradually reducing the display time difference of the left and right eye image sequences according to the linear proportional relationship of the angular velocity excess.

[0065] It should be noted that the above-mentioned preset threshold value can be 100 degrees / second, 150 degrees / second, etc., and can also be customized according to user needs, which will not be elaborated in this example implementation.

[0066] For example, when a user's gaze suddenly jumps from the left side of the screen to the right side, the eye's angular velocity may reach 500 degrees per second within 10 milliseconds. At this time, the system will reduce the predetermined time difference from the initial 15 milliseconds to 6 milliseconds.

[0067] Reducing the time difference during high-speed eye movement can decrease the display misalignment of the left and right eye image sequences, resulting in higher spatiotemporal consistency of the dual signals received by the visual center, thereby suppressing image ghosting and tearing phenomena commonly seen during rapid saccades.

[0068] In some examples, the eye-tracking data may also include the number of blinks, and the predetermined time difference may be adjusted based on the number of blinks. Specifically, the eye-tracking sensor may integrate a high-frame-rate near-infrared camera with a microprocessor to analyze the user's blinking behavior characteristics in real time, and incorporate the number of blinks into the eye-tracking dataset to participate in the dynamic adjustment of the predetermined time difference (Δt).

[0069] In practice, when the number of blinks detected per unit time is greater than a set threshold, the display time difference between the left-eye image sequence and the right-eye image sequence can be gradually increased to alleviate visual fusion pressure; when the number of blinks detected within a time is less than or equal to the set threshold, the predetermined time difference is restored or reduced to improve the smoothness of the image.

[0070] Optionally, at the instant the eyelids fully close during a single blink, the system resets the predetermined time difference to zero, ensuring that the binocular display components re-enter the synchronized refresh cycle when the eyes open, eliminating the image phase shift before and after the blink. This adjustment mechanism adaptively optimizes the continuity of visual perception through real-time matching of biological behavioral characteristics and display timing.

[0071] In some examples, refer to Figure 9 Near-eye display devices may also include a dynamic frame rate adjustment module, which is used to detect the frame rate of the image acquisition unit and change the frame rate of the image display portion to keep both ends consistent, thereby reducing blur and improving clarity.

[0072] In some examples, the adjustment of the above display sequence can also be achieved by adjusting the time difference between the image sampling times of the dual-channel display components to ensure that there is a predetermined time difference between the display times of each frame in the left-eye image sequence and the corresponding frame in the right-eye image sequence.

[0073] Specifically, refer to Figure 10 The near-eye display device can execute step S1010 to set a predetermined time difference. Specifically, during the initialization phase, the image display period and predetermined time difference parameters of the left-eye display component and the right-eye display component are set, and then a timer is started for timing monitoring. Step S1020 is executed to determine if the left-eye timing time has been reached. If so, when the display time of the left-eye display component is detected to have arrived, step S1030 is executed, and the left-eye display component performs image acquisition. Specifically, the left-eye display component sends an enable signal to trigger the left-eye image sequence acquisition process, including photoelectric signal conversion, digital image processing, and display unit output. If the left-eye trigger condition is not met, step S1040 is executed to determine if the right-eye timing time has been reached. Specifically, the right-eye display component's display time is polled to determine if it is met. If so, step S1050 is executed, and the right-eye display component performs image acquisition. Specifically, when the condition is met, the corresponding operation process of the right-eye image sequence is initiated. When both display components are in a non-triggered state, the system remains in a waiting state until the next timing detection cycle.

[0074] During the image acquisition stage, the photoelectric conversion module of the dual-channel display component converts the acquired analog light signal into a digital signal, which is then transmitted to the digital image processing unit to perform step S1060, a temporal domain noise reduction and filtering process, which optimizes image quality by enhancing edge sharpness and contrast. The processed left-eye image sequence and right-eye image sequence are then sent to their respective micro-display panels for optical projection, in order to perform step S1070, which displays the image sequence.

[0075] In some examples, after step S1060 is executed, step S1080 can also be executed to update the predetermined time difference based on the motion data. The motion data acquisition module analyzes the moving speed and trajectory of the observed object in the field of view in real time through a deep neural network. When the target speed is detected to exceed the preset threshold, a new predetermined time difference value is dynamically calculated according to the linear relationship of the weights.

[0076] The display control method for the near-eye display device in this embodiment firstly establishes independent optical path transmission channels based on physically isolated left-eye and right-eye display components. Spatial separation of optical signals is achieved through a beam splitter or waveguide, ensuring crosstalk-free transmission of the left-eye and right-eye image sequences at the retinal level and providing signal purity assurance for asynchronous timing control. Secondly, the timing control module dynamically adjusts the predetermined time difference between the left and right-eye display sequences using a programmable clock divider. Utilizing the temporal integral effect of the human visual system, the smoothness of dynamic images is significantly improved without requiring hardware refresh rate upgrades.

[0077] The motion detection module analyzes the target motion vector through a deep neural network. When the observed object's movement speed exceeds a preset threshold, it compresses a predetermined time difference linearly, effectively suppressing image blurring and parallax jumps caused by high-speed motion. Simultaneously, the temporal denoising and filtering module adaptively adjusts the filtering window size based on the predetermined time difference. Increasing the predetermined time difference enhances static scene noise suppression, while decreasing it reduces the risk of motion blur, achieving a dynamic balance between denoising intensity and motion fidelity.

[0078] An eye-tracking sensor monitors pupil movement speed and blink frequency in real time. During rapid eye saccades, it dynamically reduces a predetermined time difference to eliminate image tearing, and during frequent blinks, it increases the predetermined time difference to alleviate visual fusion stress. At the instant the eyelid closes during a blink, a predetermined time difference is zeroed to ensure phase synchronization of the image during visual recovery and eliminate transient visual distortions.

[0079] Further reference Figure 11 As shown, this example embodiment also provides a display control device 1100 for a near-eye display device, including an image acquisition module 1110 and a display control module 1120. Wherein:

[0080] The image acquisition module 1110 can be used to generate left-eye image sequences and right-eye image sequences respectively through the dual-channel display component.

[0081] The display control module 1120 can be used to control the display sequence of the dual-channel display component, so that there is a predetermined time difference between the display times of each frame in the left eye image sequence and the corresponding frame in the right eye image sequence.

[0082] Among them, the display sequence enables the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic picture in visual perception.

[0083] In some examples, the display control module 1120 can also be used to control the image acquisition time series of the dual-channel display component in order to control the display sequence of the dual-channel display component.

[0084] In some examples, the display control device 1100 of the near-eye display device can also be used to update a predetermined time difference based on the motion data of the observed object of the dual-channel display component.

[0085] In some examples, the display control device 1100 of the near-eye display device can also be used to reduce a predetermined time difference in a linear relationship when the moving speed of the observed object is detected to be greater than a preset threshold.

[0086] In some examples, the display control device 1100 of the near-eye display device can also be used to perform temporal noise reduction filtering on the left-eye image sequence and the right-eye image sequence, wherein the size of the filtering window for the noise reduction filtering is positively correlated with a predetermined time difference.

[0087] In some examples, the display control device 1100 of the near-eye display device can also be used to update a predetermined time difference based on eye movement data.

[0088] In some examples, the display control device 1100 of the near-eye display device can also be used to calculate the eyeball angular velocity in real time when the pupil movement speed exceeds a preset value; and reduce the predetermined time difference when the angular velocity exceeds a preset value.

[0089] In some examples, the predetermined time difference is positively correlated with the time taken to display a frame of an image.

[0090] It should be understood that the above-described device embodiments are merely illustrative, and the device disclosed herein can be implemented in other ways. For example, the division of units / modules in the above embodiments is only a logical functional division, and there may be other division methods in actual implementation. For example, multiple units, modules, or components may be combined, integrated into another system, or some features may be ignored or not executed.

[0091] Furthermore, unless otherwise specified, the functional units / modules in the various embodiments of this disclosure can be integrated into one unit / module, or each unit / module can exist physically separately, or two or more units / modules can be integrated together. The integrated units / modules described above can be implemented in hardware or as software program modules.

[0092] When integrated units / modules are implemented in hardware, the hardware can be digital circuits, analog circuits, etc. The physical implementation of the hardware structure includes, but is not limited to, transistors, memristors, etc. Unless otherwise specified, the processor can be any suitable hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the storage unit can be any suitable magnetic or magneto-optical storage medium, such as Resistive Random Access Memory (RRAM), Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), Enhanced Dynamic Random Access Memory (EDRAM), High-Bandwidth Memory (HBM), Hybrid Memory Cube (HMC), etc.

[0093] If the integrated unit / module is implemented as a software program module and sold or used as an independent product, it can be stored in a computer-readable storage device (CMSDD). Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this disclosure. The aforementioned memory includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.

[0094] Please refer to Figure 12This illustration shows a structural block diagram of a near-eye display device provided in an exemplary embodiment of this disclosure. In some examples, the near-eye display device can be at least one of devices such as a smartphone, smartwatch, desktop computer, laptop, virtual reality terminal, augmented reality terminal, wireless terminal, and laptop computer. The near-eye display device has communication capabilities and can access wired or wireless networks. The term "near-eye display device" can refer to one of multiple terminals; those skilled in the art will understand that the number of such terminals can be more or less. It is understood that the near-eye display device undertakes the computation and processing work of the technical solution of this disclosure, and the embodiments of this disclosure do not limit this aspect.

[0095] like Figure 12 As shown, the near-eye display device 1200 may include at least one processor 1210, a memory 1220, and a communication interface 1230.

[0096] The memory 1220 is used to store programs. Specifically, the program may include program code, which includes computer operation instructions.

[0097] The memory 1220 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0098] The processor 1210 is used to execute computer execution instructions stored in the memory 1220 to implement the display control method for the near-eye display device described in the foregoing method embodiments. The processor 1210 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this disclosure.

[0099] The near-eye display device 1200 may also include a communication interface 1230 for communication and interaction with external devices. In specific implementations, if the communication interface 1230, memory 1220, and processor 1210 are implemented independently, they can be interconnected via a bus to complete communication. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc., but this does not imply a single bus or only one type of bus.

[0100] Optionally, in a specific implementation, if the communication interface 1230, memory 1220 and processor 1210 are integrated on a single chip, then the communication interface 1230, memory 1220 and processor 1210 can communicate through an internal interface.

[0101] This disclosure also provides a computer-readable storage medium, which may include various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory, a random access memory, a disk, or an optical disk. Specifically, the computer-readable storage medium stores program instructions, which are used for the display control method of the near-eye display device in the above embodiments.

[0102] This disclosure also provides a computer program product including computer instructions stored in a computer-readable storage medium; a processor of a near-eye display device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the near-eye display device to perform the display control method of the near-eye display device described in the various embodiments above.

[0103] Those skilled in the art will recognize that the functions described in the embodiments of this disclosure in one or more of the foregoing examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented in software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0104] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combination of these technical features does not contradict each other, it should be considered within the scope of this specification.

[0105] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention applied herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not claimed herein.

[0106] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A display control method for a near-eye display device, characterized in that, include: The left-eye image sequence and the right-eye image sequence are generated separately using a dual-channel display component; The display sequence of the dual-channel display component is controlled such that there is a predetermined time difference between the display times of each frame in the left-eye image sequence and the corresponding frame in the right-eye image sequence; The display sequence enables the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic image in visual perception; The method further includes: Based on the motion data of the observed object of the dual-channel display component, the predetermined time difference is updated to control the display sequence of the dual-channel display component based on the updated predetermined time difference; Temporal denoising filtering is performed on the left-eye image sequence and the right-eye image sequence, wherein the size of the filtering window for the denoising filtering is positively correlated with the predetermined time difference.

2. The method of claim 1, wherein, The motion data includes the moving speed of the observed object; The step of updating the predetermined time difference based on the motion data of the observed object of the dual-channel display component includes: When the moving speed of the observed object is detected to be greater than a preset threshold, the predetermined time difference is reduced in a linear relationship.

3. The method of claim 1, wherein, The method further includes: The predetermined time difference is updated based on eye-tracking data to control the display sequence of the dual-channel display components based on the updated predetermined time difference.

4. The method of claim 3, wherein, The eye-tracking data includes pupil movement velocity; The step of updating the predetermined time difference based on eye-tracking data includes: The angular velocity of the eyeball is calculated in real time based on the pupil movement speed. When the angular velocity exceeds a preset value, the predetermined time difference is reduced.

5. The method of claim 1, wherein, The predetermined time difference is positively correlated with the time taken to display one frame of an image.

6. The method of claim 1, wherein, The control of the display sequence of the dual-channel display component includes: The image acquisition time series of the dual-channel display component is controlled to control the display sequence of the dual-channel display component.

7. A display control device of a near-eye display device, characterized by comprising: include: The image acquisition module is used to generate left-eye and right-eye image sequences respectively through the dual-channel display component; The display control module is used to control the display sequence of the dual-channel display component, so that there is a predetermined time difference between the display times of each frame in the left eye image sequence and the corresponding frame in the right eye image sequence. The display sequence enables the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic image in visual perception; The display control module is further configured to update the predetermined time difference based on the motion data of the observed object of the dual-channel display component, so as to control the display sequence of the dual-channel display component based on the updated predetermined time difference; and to perform temporal denoising filtering on the left-eye image sequence and the right-eye image sequence, wherein the size of the filtering window for the denoising filtering is positively correlated with the predetermined time difference.

8. A near-eye display device, comprising: The near-eye display device includes a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the display control method of the near-eye display device as described in any one of claims 1 to 6.

9. A computer storage medium, characterized in that The storage medium stores at least one instruction, which is executed by a processor to implement the display control method for a near-eye display device as described in any one of claims 1 to 6.

Images