Near-to-eye display equipment, display control method and device thereof and storage medium

Abstract

The embodiment of the invention discloses near-to-eye display equipment, a display control method and device thereof and a storage medium. The display control method of the near-to-eye display equipment can comprise the steps that a left eye image sequence and a right eye image sequence are generated through a dual-channel display assembly; controlling a display sequence of the dual-channel display assembly, so that a predetermined time difference exists between display moments of each frame of image in the left eye image sequence and display moments of corresponding frames of images in the right eye image sequence; wherein the display sequence enables the left eye image sequence and the right eye image sequence to be fused into a continuous dynamic picture in visual perception.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of display control technologies, and in particular, to a near-eye display device, a display control method, a device, and a storage medium therefor. Background Art

[0002] In near-eye display devices (such as AR / VR glasses / night vision goggles), dual-channel display technology achieves a stereoscopic effect by generating independent images for the left and right eyes.

[0003] Existing solutions usually display binocular images synchronously, and the frame rate is directly limited by the physical refresh rate of the screen. Although increasing the screen refresh rate can improve smoothness, it will cause a significant increase in power consumption and require a higher-performance processor. Summary of the Invention

[0004] In view of this, embodiments of the present disclosure are expected to provide a near-eye display device, a display control method, a device, and a storage medium therefor; which can solve the technical problem that the prior art cannot improve the refresh rate of a near-eye display device when the physical refresh rate of the screen is limited.

[0005] The technical solution of the embodiments of the present disclosure is implemented as follows: In a first aspect, an embodiment of the present disclosure provides a display control method for a near-eye display device, including: generating a left-eye image sequence and a right-eye image sequence respectively through a dual-channel display component; controlling the display sequence of the dual-channel display component such that there is a predetermined time difference between the display times of corresponding frames of the left-eye image sequence and the right-eye image sequence; wherein the display sequence enables the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic picture in visual perception.

[0006] In a second aspect, an embodiment of the present disclosure provides a display control device for a near-eye display device, including: an image acquisition module for generating a left-eye image sequence and a right-eye image sequence respectively through a dual-channel display component; a display control module for controlling the display sequence of the dual-channel display component such that there is a predetermined time difference between the display times of corresponding frames of the left-eye image sequence and the right-eye image sequence; wherein the display sequence enables the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic picture in visual perception.

[0007] In a third aspect, embodiments of the present disclosure provide a near-eye display device, which includes: a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the display control method of the near-eye display device described in the first aspect.

[0008] In a fourth aspect, embodiments of the present disclosure provide a computer storage medium, which stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the display control method of the near-eye display device as described in the first aspect.

[0009] Embodiments of the present disclosure provide a near-eye display device, its display control method, device and storage medium; by generating left and right eye independent image sequences through a dual-channel display component, and precisely controlling the display sequence difference between the two, using the human eye's visual persistence characteristic and the brain's synthesis mechanism, the alternately displayed binocular images are fused into a continuous picture in the visual cortex. This timing asynchronous strategy breaks through the dependence of traditional synchronous display on the hardware frame rate. Without increasing the physical refresh rate, the apparent frame rate is doubled through the time-domain synthesis ability of the biological visual system. At the same time, the dual-channel physical isolation mechanism eliminates optical path crosstalk, ensuring the independent transmission of left and right eye image information, providing a necessary signal purity basis for timing difference control, and ultimately significantly improving the smoothness of dynamic pictures while maintaining low power consumption. Description of the Drawings

[0010] Figure 1 It is a schematic structural diagram of a near-eye display device provided by an embodiment of the present disclosure.

[0011] Figure 2 It is a flowchart of a display control method of a near-eye display device provided by an embodiment of the present disclosure.

[0012] Figure 3 It is a system framework diagram of a near-eye display device provided by an embodiment of the present disclosure.

[0013] Figure 4 It is a system framework diagram of a near-eye display device with a timing control module provided by an embodiment of the present disclosure.

[0014] Figure 5 It is a schematic diagram of an image sequence display sequence provided by an embodiment of the present disclosure.

[0015] Figure 6 It is a system framework diagram of a near-eye display device with a motion tracking sensor provided by an embodiment of the present disclosure.

[0016] Figure 7 It is a system framework diagram of a near-eye display device with an eye movement sensor provided by an embodiment of the present disclosure.

[0017] Figure 8 System framework diagram of a near-eye display device with a timing control module provided by an embodiment of the present disclosure.

[0018] Figure 9 System framework diagram of a near-eye display device with a dynamic frame adjustment module provided by an embodiment of the present disclosure.

[0019] Figure 10 Flowchart of a display control method for a near-eye display device provided by an embodiment of the present disclosure.

[0020] Figure 11 Schematic structural diagram of a display control device for a near-eye display device provided by an embodiment of the present disclosure.

[0021] Figure 12 Schematic structural diagram of a near-eye display device provided by an embodiment of the present disclosure.

[0022] Through the above-mentioned drawings, specific embodiments of the present disclosure have been shown, and there will be more detailed descriptions hereinafter. These drawings and textual descriptions are not intended to limit the scope of the concept of the present disclosure in any way, but to illustrate the concept of the present disclosure to those skilled in the art by referring to specific embodiments. Detailed embodiments

[0023] Now, example embodiments will be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the present disclosure will be more thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments.

[0024] In addition, the drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0025] Near-Eye Display Devices (NED) are wearable human-computer interaction devices that directly project digital images onto the user's retina through an optical system. Its core function is to construct a visual perception interface that is integrated with or isolated from the physical environment. This technical field encompasses various forms of devices, mainly including typical categories such as Augmented Reality Glasses (AR Glasses), Virtual Reality Head-Mounted Displays (VR HMD), Head-Mounted Displays (HMD), and Night Vision Goggles (NVG). For example, AR glasses like the Microsoft HoloLens series use waveguide technology to superimpose virtual information onto the real environment; VR HMDs like the Oculus Quest series achieve fully immersive displays through curved mirror groups; HMDs widely used in industrial inspection usually integrate high-resolution Micro-OLED displays; while night vision goggles rely on dual-mode technologies of low-light amplification (LLA) and infrared imaging (IR) to observe targets in low-light environments. All of the above devices need to have an optical system (including refractive, diffractive, or reflective elements) to achieve image spatial positioning, ensure precise alignment of the human eye and the optical axis through an ergonomic mounting structure, and rely on a real-time rendering engine to ensure low-latency display of dynamic scenes. Their technical differences are mainly reflected in the engineering implementation paths of the environmental perception mode (such as transmissive or closed optical design) and the level of virtual-real integration (such as augmented reality AR, virtual reality VR, or mixed reality MR).

[0026] Near-eye display devices achieve smooth visual presentation of dynamic scenes through high-refresh-rate display modules (usually 90 - 120 Hz) and low-latency rendering technologies. The core technical contradiction focuses on the balance between physical refresh rate, power consumption, and display accuracy. Especially in the application scenario of night vision goggles, night vision goggles are an important night observation device widely used in military, security, and other fields. It collects weak light and converts it into a visible image, enabling people to observe objects even in low-light conditions.

[0027] In the field of night vision devices, the existing technologies are limited by the physical refresh rate bottleneck of image sensors, resulting in a significant decline in imaging quality and target tracking ability in dynamic scenes. Traditional low-light imaging systems adopt a global exposure synchronous refresh mechanism, and its fixed frame rate mode is difficult to adapt to sudden changes in the target movement speed: when the target rapidly displaces in a low-light environment, the fixed refresh interval at the image acquisition end will cause key frame loss, resulting in displacement tomograms of moving targets in adjacent two frames, specifically manifested as the trailing effect of the target contour and inaccurate trajectory prediction. At the same time, the frame accumulation technology adopted by infrared thermal imaging components to reduce noise further exacerbates the attenuation of the effective refresh rate, resulting in the lag of the heat source position information behind the actual physical displacement in high-speed moving scenes (such as vehicle obstacle avoidance, target pursuit and escape), forming a time blind spot for decision-making judgment. More seriously, the frame interpolation compensation algorithm adopted by the existing technologies to improve the display end refresh rate will generate misjudgment of motion vectors due to insufficient signal-to-noise ratio of the original image in a low-light environment, and instead introduce artifact interference in the operation of enhancing the refresh rate, destroying the continuity of the true motion trajectory. These technical defects caused by the rigid constraints of the refresh rate essentially limit the improvement of the actual combat effectiveness of night vision devices in complex dynamic scenes.

[0028] Based on this, the present disclosure first provides a near-eye display device and its display control method. As Figure 1 shown, the near-eye display device of the present disclosure may include a dual-channel display component. Each display component may include an imaging component and a display component. The imaging component is used to collect and observe corresponding images, and transmit them to the above display component, and display them on the display component. Optionally, the dual-channel display component may respectively correspond to a left-eye display component 11 and a right-eye display component 12. The image sequences collected by the left-eye display component 11 and the right-eye display component 12 correspond to each other, but there is a field-of-view deviation between the images of corresponding frames to adapt to the different viewing angles of the human left and right eyes.

[0029] Figure 2 The flowchart of the near-eye display device and its display control method is shown. Among them, the above near-eye display device and its display control method may include steps S210 to step S220.

[0030] In step S210, a left-eye image sequence and a right-eye image sequence are respectively generated through the dual-channel display component.

[0031] In an exemplary embodiment of the present disclosure, a left-eye image sequence and a right-eye image sequence may be respectively generated through the dual-channel display component of the near-eye display device. The dual-channel display component is composed of a physically isolated left-eye display component 11 and a right-eye display component 12. Each display component includes a display module (such as a silicon-based OLED or LCoS module) composed of an independent micro display panel and an imaging module (including a lens group, a polarization beam splitter, etc.) of a supporting optical system.

[0032] The left-eye display component 11 receives the left-eye image data stream generated by the imaging module in the left-eye display component 11. This data stream generates a left-eye image sequence at a preset frame rate, and the timing controller precisely controls the refresh timing of each pixel. The right-eye display component 12 synchronously executes the same process, but there is a controllable offset in the time reference between the two. Refer to Figure 3 , in the optical system, a beam-splitting prism or waveguide plate is set to physically isolate the image optical paths output by the left and right display components, ensuring that the left eye can only perceive the left-eye image sequence output by the left-eye display component 11, and the right eye only receives the right-eye image sequence output by the right-eye display component 12.

[0033] In step S220, control the display sequence of the dual-channel display component so that there is a predetermined time difference between the display times of each frame of the left-eye image sequence and the corresponding frame of the right-eye image sequence. Among them, the display sequence can cause the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic picture in visual perception.

[0034] In some exemplary embodiments of the present disclosure, refer to Figure 4 , a timing control module 13 may also be provided in the above-mentioned dual-channel display component. The timing control module 13 performs asynchronous timing regulation on the left-eye display component 11 and the right-eye display component 12 in the dual-channel display component to control the display sequence of the dual-channel display component. Specifically, a predetermined time difference is formed by the phase shift of the synchronization signal (VSYNC) between the trigger signals of each frame of the left-eye image sequence received by the left-eye display component 11 and the trigger signals of the corresponding frames of the right-eye image sequence received by the right-eye display component 12.

[0035] Under this timing control mechanism, the left-eye display component 11 sequentially outputs discrete frames of the left-eye image sequence at intervals of the reference clock cycle, and the right-eye display component 12 outputs the corresponding frames of the right-eye image sequence after a predetermined time difference is delayed within each reference clock cycle. The motion fusion mechanism of the human eye visual system fuses the left-eye image sequence output by the left-eye display component 11 and the right-eye image sequence output by the right-eye display component 12 into a continuous dynamic picture at the perceptual level during the process of retinal nerve signals being transmitted to the visual center.

[0036] The display control method of the near-eye display device in the embodiments of the present disclosure generates independent image sequences for the left and right eyes through a dual-channel display component, precisely controls the display sequence difference between the two, and utilizes the human eye's visual persistence characteristic and the brain's synthesis mechanism to fuse the alternately displayed binocular images into a continuous picture in the visual cortex. This timing asynchronous strategy breaks through the dependence of traditional synchronous display on the hardware frame rate. Without increasing the physical refresh rate, it doubles the apparent frame rate through the time-domain synthesis ability of the biological visual system. At the same time, the dual-channel physical isolation mechanism eliminates optical crosstalk, ensures the independent transmission of left and right eye image information, provides a necessary signal purity basis for the timing difference control, and ultimately significantly improves the smoothness of dynamic pictures while maintaining low power consumption.

[0037] In some examples, the above-mentioned predetermined time difference is positively correlated with the time used to display one frame of image. Specifically, the positive correlation relationship between the set value of the predetermined time difference (Δt) and the time used to display one frame of image (T_frame) is implemented by a programmable clock divider in the timing control module 13.

[0038] Specifically, the time used to display one frame of image (T_frame) is determined by the physical refresh rate of the dual-channel display component. For example, when the refresh rate of the display component is 90 Hz, T_frame is approximately 11.1 milliseconds. The predetermined time difference (Δt) is dynamically calculated and generated according to T_frame according to a preset proportional coefficient. For example, Δt = K × T_frame, where K can be a proportional constant greater than or equal to 0.1 and less than or equal to 0.5.

[0039] In some examples, the above-mentioned predetermined time difference can be half of the time used to display one frame of image. For example, referring to Figure 5 , when the display system operates at a base frame rate of 50 Hz, the duration of a single frame image is 20 milliseconds. The right-eye display component 12 starts the display process of the right frame 1 at the initial moment, and the left-eye display component 11 triggers the display instruction of the left frame 1 after 10 milliseconds. The display cycle of the right frame 1 covers the starting moment to the 20th millisecond, and the display period of the left frame 1 extends from the 10th millisecond to the 30th millisecond. The synthesis mechanism of the visual center operates in stages according to time windows.

[0040] Specifically, when the dual-channel display component runs in the range from the 10th millisecond to the 20th millisecond, the right eye continuously outputs a complete right frame 1 image, and the left eye starts to output the left frame 1 data stream. At this time, the brain's visual processing area performs disparity matching and motion compensation on the two asynchronous signals to generate the first fused image. After entering the stage from the 20th millisecond to the 30th millisecond, the right-eye display component 12 switches to the display cycle of right frame 2, while the left-eye display component 11 is still in the final stage of displaying left frame 1. The visual system reconstructs the second enhanced composite image by extracting the afterimage features of left frame 1 and the dynamic information of right frame 2. When the time advances to the range from the 30th millisecond to the 40th millisecond, the left-eye display component 11 starts the rendering process of left frame 2, overlapping in time and space with the right frame 2 output by the right-eye display component 12. The brain's motion perception center uses the correlation features between the two frames to generate the third high-fluidity image through the time-domain interpolation algorithm. By making full use of the biological characteristics of the human visual system, the photochemical residual effect of retinal photoreceptor cells ensures the continuity of optical signals between adjacent frame images, and the temporal integration of visual cortex neurons converts discrete input signals into smooth motion perception. By controlling the time phase difference between the left-eye display component 11 and the right-eye display component 12, the system maintains a physical refresh rate of 50 Hz at the hardware level while achieving an equivalent visual fluidity of 100 Hz at the perception level, breaking through the technical bottleneck of traditional display technologies limited by the response speed of optoelectronic components.

[0041] In some examples, the predetermined time difference can be updated according to the motion data of the observed object of the dual-channel display component. Specifically, referring to Figure 6 , the motion tracking sensor 14 integrated in the dual-channel display component can be used to capture the motion data of the observed object in real time, and accordingly dynamically adjust the predetermined time difference (Δt) between the left-eye display component 11 and the right-eye display component 12.

[0042] For example, the motion tracking sensor continuously collects the moving speed vector of the observed object in the three-dimensional space. When it detects that the object's moving speed exceeds the preset threshold V_th, an adjustment coefficient can be generated based on the linear relationship between the speed increment ΔV and Δt.

[0043] Its mathematical expression can be: ΔV = V_current - V_th Δt_new = Δ - K×ΔV Where K is the proportionality factor, a constant term, such as 0.2 ms / (m / s), and the specific value can be customized according to user needs and will not be elaborated here; V_current represents the current moving speed value of the observed object measured by the motion tracking module in real time; Δt_new represents the updated predetermined time difference.

[0044] The timing control module 13 reconfigures the display sequences of the left-eye and right-eye display components 12 according to the updated Δt_new value, so as to shorten the display time interval between the left-eye image sequence and the right-eye image sequence in a high-speed motion scenario, thereby reducing the parallax matching error caused by the rapid displacement of the target.

[0045] It should be noted that the above preset threshold can be 5 m / s, 6 m / s, etc., and can also be customized according to user needs, which will not be elaborated in this exemplary embodiment.

[0046] The embodiment of the present disclosure suppresses the motion blur effect in a high-speed motion state through a dynamic adjustment mechanism; maintaining a larger Δt in a low-speed or static state makes full use of the persistence of vision effect to increase the apparent frame rate.

[0047] Optionally, the sampling frequency of the motion tracking sensor can be greater than or equal to twice the physical refresh rate of the display component, ensuring the real-time nature of the time difference adjustment instruction and avoiding the visual perception mismatch problem caused by control delay.

[0048] In some examples, referring to Figure 7 As shown, the above near-eye display device may further include an image preprocessing module, and the image preprocessing module may be a time-domain noise reduction filtering module for performing time-domain noise reduction filtering processing on the left-eye image sequence and the right-eye image sequence. Among them, the size of the filtering window for the noise reduction filtering processing is positively correlated with the predetermined time difference.

[0049] Specifically, the time-domain noise reduction filtering module dynamically adjusts the processing parameters according to the predetermined time difference of the dual-channel display component. In specific implementation, independent time-domain recursive filtering channels can be established for the left-eye image sequence and the right-eye image sequence respectively, and the filtering window size of each channel is in a proportional relationship with the currently set predetermined time difference.

[0050] When the display sequence adjusts the predetermined time difference between the display times of the left-eye image sequence and the right-eye image sequence due to environmental changes or user needs, the time-domain noise reduction filtering module synchronously expands or contracts the time span of the filtering window. When the predetermined time difference increases, the filtering window covers a longer historical frame data interval, enhancing the ability to suppress random noise in a static scene; while when the predetermined time difference decreases, the window focuses on adjacent frame data, reducing the motion blur effect in a high-speed motion scenario.

[0051] It should be noted that the historical frames refer to the sequence of previous image frames cached and used for the calculation of the current frame during the time-domain noise reduction process. Specifically, when the system performs noise reduction processing on the current display frame, several consecutive image frames earlier than the current moment are extracted from the frame buffer queue, and these processed old frames are collectively referred to as historical frames. For example, if the filtering window is set to 5 frames, the system will use the current frame and the previous 4 frames of historical data for joint calculation. The role of historical frames is to eliminate random noise through time-domain correlation analysis: since static objects in the scene have consistent pixel characteristics in multiple frames of images, while the noise signal shows random distribution in the time domain, by weighted averaging or recursive filtering of multiple frames of historical data, the noise intensity can be effectively suppressed; adjacent frames specifically refer to the sequence of image frames adjacent to the current processed frame in the time dimension.

[0052] In some examples, referring to Figure 8 , the above near-eye display device may further include an eye movement sensor 15 for real-time acquisition of the user's eye movement data and dynamically adjusting the predetermined time difference between the left and right eye display components 12 based on this.

[0053] Specifically, the eye movement sensor can capture the change in the pupil center position at a predetermined sampling rate, obtain the pupil movement speed through real-time differential calculation, and convert the pupil movement speed value into the eye angular velocity of the eye rotation. When it is detected that the user's eye angular velocity exceeds the preset critical value, the timing control module 13 immediately activates the time difference compression mechanism, and gradually reduces the display time difference of the left and right eye image sequences according to the linear proportional relationship of the angular velocity excess.

[0054] It should be noted that the above preset critical value can be 100 degrees / second, 150 degrees / second, etc., and can also be customized according to user needs, which will not be elaborated in this example implementation.

[0055] For example, when the user's line of sight suddenly jumps from the left side of the screen to the right side, the eye angular velocity may reach 500 degrees / second within 10 milliseconds. At this time, the system reduces the predetermined time difference from the initial 15 milliseconds to 6 milliseconds.

[0056] Reducing the time difference during the high-speed eye movement stage can reduce the display misalignment amount of the left and right eye image sequences, making the dual-channel signals received by the visual cortex have higher spatio-temporal consistency, thereby suppressing the common image ghosting and tearing phenomena during rapid saccades.

[0057] In some examples, the above eye movement data may further include the number of blinks, and the predetermined time difference is adjusted based on the number of blinks. Specifically, the eye movement sensor can integrate a high-frame-rate near-infrared camera and a microprocessor to real-time analyze the user's blink behavior characteristics, incorporate the number of blinks into the eye movement data set, and participate in the dynamic adjustment of the predetermined time difference (Δt).

[0058] In specific implementation, when the number of blinks per unit time is detected to be greater than the set threshold, the display time difference between the left-eye image sequence and the right-eye image sequence can be gradually increased to relieve the visual fusion pressure; when the number of blinks within the detected time is less than or equal to the set threshold, the predetermined time difference is restored or reduced to improve the frame smoothness.

[0059] Optionally, at the moment when the eyelids are fully closed during a single blink action, the system resets the predetermined time difference to ensure that when the eyes are opened, the binocular display components re-enter the synchronous refresh cycle, eliminating the phase shift of the images before and after blinking. This adjustment mechanism adaptively optimizes the visual perception continuity through the real-time matching of biological behavior characteristics and display timing.

[0060] In some examples, referring to Figure 9 , the near-eye display device may further include a dynamic frame rate adjustment module for detecting the frame rate of the image acquisition unit and changing the frame rate of the image display part to make both ends consistent, so as to reduce blurring and improve clarity.

[0061] In some examples, the adjustment of the above display sequence can also be achieved by adjusting the time difference between the image sampling times of the dual-channel display components, so that there is a predetermined time difference between the display times of the corresponding frame images in the left-eye image sequence and the right-eye image sequence.

[0062] Specifically, referring to Figure 10 , the near-eye display device can execute step S1010 to set a predetermined time difference. Specifically, in the initialization stage, the image display periods and the parameters of the predetermined time difference of the left-eye display component and the right-eye display component are set, and then a timer is started for timing monitoring. Execute step S1020 to determine whether the left-eye timing time has been reached. If so, when it is detected that the display time of the left-eye display component has reached, execute step S1030, and the left-eye display component performs image acquisition. Specifically, the left-eye display component sends an enable signal to trigger the left-eye image sequence acquisition process, including photoelectric signal conversion, digital image processing, and output of the display unit; if the left-eye trigger condition is not met, then execute step S1040 to determine whether the right-eye timing time has been reached. Specifically, poll to determine whether the display time of the right-eye display component is satisfied. If so, execute step S1050, and the right-eye display component performs image acquisition. Specifically, when it is satisfied, the corresponding operation process of the right-eye image sequence is started. When both dual-channel display components are in the non-trigger state, the system maintains a waiting state until the next timing detection cycle.

[0063] In the image acquisition stage, after the photoelectric conversion module of the dual-channel display component converts the collected analog optical signal into a digital signal, it transmits the digital image to the processing unit to execute step S1060, time-domain noise reduction filtering processing, and optimize the image quality by enhancing the edge sharpness and contrast. The processed left-eye image sequence and right-eye image sequence are respectively sent to the corresponding micro-display panel for optical projection to execute step S1070, displaying the image sequence.

[0064] In some examples, after step S1060 is executed, step S1080 can also be executed to update the predetermined time difference according to the motion data; the motion data acquisition module uses a deep neural network to parse the moving speed and motion trajectory of the observed object in the field of view in real time. When the detected target speed exceeds the preset threshold, a new predetermined time difference is dynamically calculated according to the linear relationship of the weights.

[0065] In the display control method of the near-eye display device in the embodiments of the present disclosure, first, an independent optical path transmission channel is constructed based on the physically isolated left-eye display component and right-eye display component, and the spatial separation of optical signals is realized through a beam splitter prism or a waveguide plate to ensure crosstalk-free transmission of the left-eye image sequence and the right-eye image sequence at the retinal level, providing signal purity guarantee for the sequential asynchronous control. Secondly, the timing control module dynamically adjusts the predetermined time difference between the left-eye and right-eye display sequences through a programmable clock divider, and utilizes the time-domain integration effect of the human eye visual system to significantly improve the smoothness of the dynamic picture on the premise of avoiding the upgrade of the hardware refresh rate.

[0066] The motion detection module analyzes the target motion vector through a deep neural network. When the moving speed of the observed object exceeds the preset threshold, the predetermined time difference is compressed according to the linear relationship, effectively suppressing image smear and parallax jump caused by high-speed motion. At the same time, the time-domain noise reduction filtering module adaptively adjusts the filtering window size according to the predetermined time difference, enhances the static scene noise suppression ability when the predetermined time difference increases, and reduces the risk of motion blur when the predetermined time difference decreases, realizing the dynamic balance between noise reduction intensity and motion fidelity.

[0067] The eye movement sensor continuously tracks the pupil movement speed and blink frequency, dynamically reduces the predetermined time difference during the rapid saccade stage of the eyeball to eliminate image tearing, and increases the predetermined time difference during the frequent blinking stage to relieve the visual fusion pressure. A predetermined time difference zeroing operation is performed at the moment when the eyelids close during the blinking action to ensure the picture phase synchronization during the visual recovery stage and eliminate the transient visual tomogram.

[0068] Further, referring to Figure 11 As shown, in the embodiment of this example, a display control device 1100 for a near-eye display device is further provided, including an image acquisition module 1110 and a display control module 1120. Among them: The image acquisition module 1110 can be used to generate a left-eye image sequence and a right-eye image sequence respectively through a dual-channel display component.

[0069] The display control module 1120 can be used to control the display sequence of the dual-channel display component, so that there is a predetermined time difference between the display times of each frame image in the left-eye image sequence and the corresponding frame image in the right-eye image sequence; wherein, the display sequence can enable the left-eye image sequence and the right-eye image sequence to be fused into a continuous dynamic picture in visual perception.

[0070] In some examples, the display control module 1120 can also be used to control the image acquisition time sequence of the dual-channel display component to control the display sequence of the dual-channel display component.

[0071] In some examples, the display control device 1100 of the near-eye display device can also be used to update the predetermined time difference according to the motion data of the observation object of the dual-channel display component.

[0072] In some examples, the display control device 1100 of the near-eye display device can also be used to decrease the predetermined time difference according to a linear relationship when it is detected that the moving speed of the observation object is greater than a preset threshold.

[0073] In some examples, the display control device 1100 of the near-eye display device can also be used to perform time-domain noise reduction filtering processing on the left-eye image sequence and the right-eye image sequence, wherein the window size of the noise reduction filtering processing is positively correlated with the predetermined time difference.

[0074] In some examples, the display control device 1100 of the near-eye display device can also be used to update the predetermined time difference according to the eye movement data.

[0075] In some examples, the display control device 1100 of the near-eye display device can also be used to calculate the angular velocity of the eyeball in real time based on the pupil movement speed; when the angular velocity exceeds a preset value, the predetermined time difference is decreased.

[0076] In some examples, the predetermined time difference is positively correlated with the time used to display one frame of image.

[0077] It should be understood that the above device embodiments are merely illustrative, and the devices of the present disclosure can also be implemented in other ways. For example, the division of units / modules in the above embodiments is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.

[0078] In addition, unless otherwise specified, in each embodiment of the present disclosure, each functional unit / module may be integrated into one unit / module, may exist physically as individual units / modules, or may be integrated together by two or more units / modules. The above integrated unit / module may be implemented in the form of hardware or in the form of a software program module.

[0079] When the integrated unit / module is implemented in the form of hardware, the hardware may be a digital circuit, an analog circuit, etc. Physical implementations of the hardware structure include, but are not limited to, transistors, memristors, etc. Unless otherwise specified, the processor may be any suitable hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the storage unit may be any suitable magnetic storage medium or magneto-optical storage medium, such as resistive random access memory (RRAM), dynamic random access memory (DRAM), static random access memory (SRAM), enhanced dynamic random access memory (EDRAM), high-bandwidth memory (HBM), hybrid memory cube (HMC), etc.

[0080] When the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it may be stored in a computer-readable memory. Based on such an understanding, the technical solution of the present disclosure, in essence, or the part that contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product. The computer software product is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in the various embodiments of the present disclosure. The aforementioned memory includes: USB flash drives, read-only memory (ROM), random access memory (RAM), mobile hard disks, magnetic disks, or optical discs, etc., which are various media that can store program codes.

[0081] Please refer to Figure 12, which shows a block diagram of the structure of a near-eye display device provided by an exemplary embodiment of the present disclosure. In some examples, the near-eye display device may be at least one of devices such as a smart phone, a smart watch, a desktop computer, a laptop computer, a virtual reality terminal, an augmented reality terminal, a wireless terminal, and a laptop computer. The near-eye display device has a communication function and can access a wired network or a wireless network. The near-eye display device can generally refer to one of multiple terminals, and those skilled in the art can know that the number of the above terminals can be more or less. It can be understood that the near-eye display device undertakes the computing and processing work of the technical solution of the present disclosure, and the embodiments of the present disclosure do not limit this.

[0082] As Figure 12 shown, the near-eye display device 1200 may include: at least one processor 1210, a memory 1220, and a communication interface 1230.

[0083] The memory 1220 is used to store programs. Specifically, the program may include program code, and the program code includes computer operation instructions.

[0084] The memory 1220 may contain high-speed RAM memory and may also include non-volatile memory, such as at least one disk memory.

[0085] The processor 1210 is used to execute the computer execution instructions stored in the memory 1220 to implement the display control method of the near-eye display device described in the foregoing method embodiments. Among them, the processor 1210 may be a central processing unit (Central Processing Unit, abbreviated as CPU), or a specific integrated circuit (Application Specific Integrated Circuit, abbreviated as ASIC), or one or more integrated circuits configured to implement the embodiments of the present disclosure.

[0086] The near-eye display device 1200 may further include a communication interface 1230 through which communication interaction can be performed with an external device. In a specific implementation, if the communication interface 1230, the memory 1220, and the processor 1210 are implemented independently, the communication interface 1230, the memory 1220, and the processor 1210 may be interconnected through a bus and communicate with each other. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc., but it does not mean that there is only one bus or one type of bus.

[0087] Optionally, in a specific implementation, if the communication interface 1230, the memory 1220, and the processor 1210 are integrated on a single chip, the communication interface 1230, the memory 1220, and the processor 1210 may communicate through an internal interface.

[0088] The present disclosure also provides a computer-readable storage medium, which may include various media capable of storing program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk, or an optical disc. Specifically, the computer-readable storage medium stores program instructions for the display control method of the near-eye display device in the above embodiments.

[0089] The embodiments of the present disclosure also provide a computer program product, which includes computer instructions stored in a computer-readable storage medium; a processor of the near-eye display device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to enable the near-eye display device to perform the display control method of the near-eye display device in the above various embodiments.

[0090] Those skilled in the art should be able to realize that in the above one or more examples, the functions described in the embodiments of the present disclosure can be implemented by hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. The computer-readable medium includes a computer storage medium and a communication medium, where the communication medium includes any medium that facilitates the transmission of a computer program from one place to another. The storage medium can be any available medium accessible by a general-purpose or special-purpose computer.

[0091] In the above embodiments, the descriptions of the respective embodiments have their own focuses. For parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as within the scope described in this specification.

[0092] After considering the specification and practicing the invention herein applied, those skilled in the art will readily conceive of other embodiments of the present disclosure. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common general knowledge or conventional technical means in the technical field not claimed in the present disclosure.

[0093] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A display control method for a near-eye display device, characterized in that, Including: Generating a left-eye image sequence and a right-eye image sequence respectively through a dual-channel display component; Controlling the display sequence of the dual-channel display component so that there is a predetermined time difference between the display times of each frame image in the left-eye image sequence and the corresponding frame image in the right-eye image sequence; Wherein, the display sequence can make the left-eye image sequence and the right-eye image sequence be fused into a continuous dynamic picture in visual perception.

2. The method according to claim 1, wherein The method further includes: Updating the predetermined time difference according to the motion data of the observation object of the dual-channel display component, and controlling the display sequence of the dual-channel display component based on the updated predetermined time difference.

3. The method according to claim 2, wherein The motion data includes the moving speed of the observation object; The updating the predetermined time difference according to the motion data of the observation object of the dual-channel display component includes: When it is detected that the moving speed of the observation object is greater than a preset threshold, reducing the predetermined time difference according to a linear relationship.

4. The method according to claim 1, characterized in that The method further includes: Performing time-domain noise reduction filtering processing on the left-eye image sequence and the right-eye image sequence, wherein the size of the filtering window of the noise reduction filtering processing is positively correlated with the predetermined time difference.

5. The method according to claim 1, wherein, The method further includes: Updating the predetermined time difference according to the eye movement data, and controlling the display sequence of the dual-channel display component based on the updated predetermined time difference.

6. The method according to claim 5, characterized in that The eye movement data includes the pupil moving speed; The updating the predetermined time difference according to the eye movement data includes: Calculating the eyeball angular velocity in real time according to the pupil moving speed; Reducing the predetermined time difference when the angular velocity exceeds a preset value.

7. The method according to claim 1, wherein The predetermined time difference is positively correlated with the time used to display one frame of image.

8. The method according to claim 1, wherein The controlling the display sequence of the dual-channel display component includes: Controlling the image acquisition time sequence of the dual-channel display component to control the display sequence of the dual-channel display component.

9. A display control device for a near-eye display device, characterized in that, Including: An image acquisition module for generating a left-eye image sequence and a right-eye image sequence respectively through a dual-channel display component; A display control module for controlling the display sequence of the dual-channel display component so that there is a predetermined time difference between the display times of each frame image in the left-eye image sequence and the corresponding frame image in the right-eye image sequence; Wherein, the display sequence can make the left-eye image sequence and the right-eye image sequence be fused into a continuous dynamic picture in visual perception.

10. A near-eye display device, characterized in that, The near-eye display device includes: a processor and a memory; the processor is used to execute the instructions stored in the memory to implement the display control method of the near-eye display device according to any one of claims 1 to 8.

11. A computer storage medium, characterized in that, The storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the display control method of the near-eye display device according to any one of claims 1 to 8.

Images