Display method, display apparatus, electronic device, storage medium, and program product

Abstract

A display method, a display apparatus, an electronic device, a storage medium, and a program product. The display method comprises: when a display device and a head of a target object move synchronously, acquiring a head movement distance and a head movement direction of the target object within a target sub-field scanning duration (S901), wherein the target sub-field scanning duration is a scanning duration of a sub-field to be displayed, and the sub-field to be displayed is any sub-field among sub-fields which are contained in a single image frame to be displayed; on the basis of the head movement distance and the pixel width of a single pixel in the single image frame, determining the number of target pixels corresponding to the head movement distance (S902); in a direction opposite to the head movement direction and on the basis of the number of target pixels, shifting the sub-field to be displayed so as to obtain a target sub-field (S903); and displaying the single image frame in a display area of the display device on the basis of the target sub-field (S904). The display method can weaken the dynamic false contour phenomenon and improve the image display quality.

Description

Display method, display device, electronic device, storage medium, and program product

[0001] Cross-references

[0002] This application claims priority to the Chinese patent application filed on January 31, 2024, with application number "202410138892.5" and invention name "Display method, display device, electronic device, storage medium and program product", the entire content of which is incorporated by reference into this application. Technical Field

[0003] The present application belongs to the field of display technology, and in particular relates to a display method, a display device, an electronic device, a storage medium, and a program product. Background Art

[0004] Silicon-based microdisplays have garnered widespread attention in the display industry due to their advantages, including high resolution, high contrast, and low power consumption. Excellent display quality is a key performance metric for silicon-based microdisplays. However, when the display moves in sync with the head and the human eye doesn't track the image displayed, digitally driven silicon-based microdisplays can exhibit dynamic false contouring due to the human eye's visual response.

[0005] As users have increasingly higher requirements for image display quality, how to reduce the dynamic false contour phenomenon in scenarios where the display moves synchronously with the head and the human eye does not track has become an urgent problem that needs to be solved in the field of image display technology.

[0006] Summary of the Invention

[0007] Embodiments of the present application provide a display method, a display device, an electronic device, a storage medium, and a program product, which can reduce the dynamic false contour phenomenon and improve the quality of image display.

[0008] In a first aspect, an embodiment of the present application provides a display method, which includes: when a display device moves synchronously with the head of a target object, obtaining the head movement distance and head movement direction of the target object within a target subfield scanning time, wherein the target subfield scanning time is the scanning time of the subfield to be displayed, and the subfield to be displayed is any subfield in the subfields contained in a single-frame image to be displayed; determining the target number of pixels corresponding to the head movement distance based on the head movement distance and the pixel width of a single pixel in the single-frame image; shifting the subfield to be displayed based on the target number of pixels in the opposite direction of the head movement direction to obtain a target subfield; and displaying the single-frame image in the display area of ​​the display device based on the target subfield.

[0009] In the second aspect, an embodiment of the present application provides a display device, which includes: a data acquisition module for acquiring the head movement distance and head movement direction of the target object within the target subfield scanning time when the display device and the head of the target object move synchronously, wherein the target subfield scanning time is the scanning time of the subfield to be displayed, and the subfield to be displayed is any subfield in the subfields contained in the single-frame image to be displayed; a pixel determination module for determining the target number of pixels corresponding to the head movement distance based on the head movement distance and the pixel width of a single pixel in the single-frame image; a shift module for shifting the subfield to be displayed based on the target number of pixels in the opposite direction of the head movement direction to obtain the target subfield; and a display module for displaying the single-frame image in the display area of ​​the display device based on the target subfield.

[0010] In a third aspect, an embodiment of the present application provides an electronic device comprising: a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, the display method as described in the first aspect is implemented.

[0011] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by a processor, the display method as described in the first aspect is implemented.

[0012] In a fifth aspect, an embodiment of the present application provides a computer program product. When the instructions in the computer program product are executed by a processor of an electronic device, the electronic device executes the display method described in the first aspect.

[0013] As can be seen from the above, when the display device moves synchronously with the head of the target object and the human eye does not track, the image displayed in the display area of ​​the display device may have a dynamic false contour phenomenon. In order to reduce the dynamic false contour phenomenon, in an embodiment of the present application, the display data corresponding to the subfield is shifted in the opposite direction of the head movement direction to reduce the human eye's perception of the false contour line, thereby reducing the dynamic false contour phenomenon. In addition, in an embodiment of the present application, the head movement distance is converted into the number of pixels, and the display data corresponding to the subfield is shifted by the number of pixels corresponding to the head movement distance, thereby avoiding the problem that the dynamic false contour phenomenon cannot be reduced or the reduction effect is poor due to excessive or insufficient subfield shifting, thereby effectively reducing the dynamic false contour phenomenon and improving the quality of image display. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0015] FIG1 is a schematic diagram showing the principle of a dynamic false contour phenomenon generated by a digitally driven display screen when the display is fixed;

[0016] FIG2 is a diagram showing the dynamic integration result of pixel brightness when the human eye moves from grayscale 127 to grayscale 128;

[0017] FIG3 is a diagram showing the dynamic integration result of pixel brightness when the human eye moves from grayscale 128 to grayscale 127;

[0018] FIG4 is a diagram showing the result of quantizing the integral brightness of image pixels during eye tracking;

[0019] FIG5 is a schematic diagram showing the light and dark stripes produced when the human eye tracks pixels on a display as the head moves to the left;

[0020] FIG6 is a schematic diagram showing the light and dark stripes produced when the human eye tracks pixels on a display as the head moves to the right;

[0021] FIG7 is a schematic diagram of light and dark stripes generated when the display moves with the head to the left but the human eye does not track pixels;

[0022] FIG8 is a schematic diagram showing the light and dark stripes produced when the display moves rightward with the head but the human eye tracks pixels;

[0023] FIG9 is a flow chart of a display method according to an embodiment of the present application;

[0024] FIG10 is a schematic diagram of a display device and a head moving synchronously according to an embodiment of the present application;

[0025] FIG11 is a schematic diagram of a display area of ​​a display device before shifting provided by one embodiment of the present application;

[0026] FIG12 is a schematic diagram of a display area of ​​a shifted display device provided by one embodiment of the present application;

[0027] FIG13 is a schematic diagram of a display area of ​​a shifted display device provided by one embodiment of the present application;

[0028] FIG14 is a schematic diagram showing the light and dark stripes produced when the human eye tracks pixels on a display before optimization as the head moves to the right;

[0029] FIG15 is a schematic diagram showing the optimization of the dynamic false contour phenomenon using the solution provided by the present application;

[0030] FIG16 is a schematic structural diagram of a display device provided by another embodiment of the present application;

[0031] FIG17 is a schematic structural diagram of an electronic device provided in yet another embodiment of the present application. DETAILED DESCRIPTION

[0032] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is merely to provide a better understanding of the present application by illustrating the examples of the present application.

[0033] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, the elements defined by the phrase "comprising..." do not exclude the presence of other identical elements in the process, method, article, or device comprising the elements.

[0034] For ease of understanding, before explaining the solution provided in this application, the relevant technologies involved in the solution provided in this application are first explained.

[0035] In the display industry, silicon-based microdisplay technology not only achieves higher pixel density and system integration by integrating more display units per unit area thanks to the mature CMOS (Complementary Metal-Oxide-Semiconductor) process, but also offers the advantages of high resolution, high contrast, and low power consumption. Therefore, silicon-based microdisplay technology is currently a focus of industry attention. A good display effect is an important factor in measuring display performance. Due to the human eye's visual response process, digitally driven silicon-based microdisplays are subject to the dynamic false contour phenomenon. Eliminating the impact of this dynamic false contour phenomenon on display quality is one of the issues that needs to be addressed.

[0036] Because the human eye's perception of external light brightness is energy-accumulating, there is a slight delay between the moment the light appears and the moment the eye begins to perceive the brightness, and again between the moment the light disappears and the moment the eye no longer perceives the brightness. These delays are known as the visual delay effect and the persistence of vision effect. Depending on the color and brightness of the light, as well as individual differences between people, these delays typically range from 50ms to 200ms. The visual delay effect and the persistence of vision effect together represent the visual response process of the human eye. Due to the existence of the visual response process, the process by which the human eye perceives the brightness of an image is usually represented as a dynamic integration of the brightness of the image pixels.

[0037] Figure 1 shows the principle diagram of the dynamic false contour phenomenon in the traditional display industry, where the display is fixed and the digital drive display produces a dynamic false contour phenomenon. In Figure 1, the horizontal axis is the pixel position, that is, the position of the pixel on the display. In Figure 1, X1, X2, X3, X4, X5, X6, X7, and X8 respectively represent the positions of the eight pixels on the display; the vertical axis is time, T frame Indicates the time it takes for the display to display one frame of an image. Furthermore, taking 256 grayscale levels as an example, a frame of an image is divided into eight subfields, and the scanning weight sequence for each subfield is 128:64:32:16:8:4:2:1. It should be noted that in the various example diagrams shown in this application, a gray subfield represents an unlit subfield, and a white subfield represents a lit subfield.

[0038] In Figure 1, the left half represents 127-level grayscale pixels, and the right half represents 128-level grayscale pixels. The oblique arrows indicate the eye's tracking trajectory of the pixels in this frame. Figure 1 shows six eye tracking trajectories: A, B, B2, C, C2, and D. For trajectory A, the eye's perception of brightness remains at 127-level grayscale. For trajectory B, the eye's tracking trajectory moves from 127 to 128. Due to the visual response process, the eye integrates the brightness of multiple pixels along the moving trajectory, increasing the perceived brightness to 255 levels, represented as bright streaks. Similarly, when the eye moves in the opposite direction from position X5, dark streaks are also produced, as shown in trajectory C. For trajectory D, the eye's perception of brightness remains at 128-level grayscale.

[0039] Figures 2 and 3 show the results of the human eye's quantization of the pixel brightness integral of an image. Figure 2 shows the dynamic integral of pixel brightness when the eye moves from a grayscale of 127 to a grayscale of 128, and Figure 3 shows the dynamic integral of pixel brightness when the eye moves from a grayscale of 128 to a grayscale of 127. In Figures 2 and 3, a frame of an image is divided into eight subfields, and the scanning weights and encoding of each subfield are shown in Figures 2 and 3. In Figure 2, when the eye tracks from a grayscale region of 127 to a grayscale region of 128, the maximum integral brightness appears as grayscale 255, i.e., a bright streak. In Figure 3, when the eye tracks in the reverse direction, from a grayscale region of 128 to a grayscale region of 127, the minimum integral brightness appears as grayscale 0, i.e., a dark streak. Figure 4 shows the results of the quantization of the pixel brightness integral of an image when the eye tracks. In Figure 4, curve L1 represents the change in integral brightness when a bright streak is generated, and curve L2 represents the change in integral brightness when a dark streak is generated.

[0040] The above is an explanation of the dynamic false contour phenomenon that occurs when the display is fixed.

[0041] In near-eye display environments, such as AR (Augmented Reality) and VR (Virtual Reality), the display moves synchronously with the human head. Therefore, based on head movement and eye tracking, it can be divided into the following situations:

[0042] 1) Keep your head still and track your eyes;

[0043] 2) The head does not move, and the human eye does not track;

[0044] 3) Head movement and eye tracking;

[0045] 4) The head moves, but the eyes do not track.

[0046] For the above situation 1), similar to the phenomenon in the traditional display industry, the process of generating dynamic false contours is shown in FIG1 , and the cause is the same as the principle shown in FIG2 and FIG3 .

[0047] For case 2), since neither the display nor the human eye moves, no dynamic false contour phenomenon occurs.

[0048] For case 3), as shown in Figures 5 and 6, Figure 5 shows a schematic diagram of the light and dark stripes generated when the display moves to the left with the head and the human eye tracks the pixels, and Figure 6 shows a schematic diagram of the light and dark stripes generated when the display moves to the right with the head and the human eye tracks the pixels. In Figures 5 and 6, when the display moves to the left or right with the head, the human eye will track from the 127-level grayscale area to the 128-level grayscale area during the tracking process, thereby generating light stripes, as shown in track B in Figures 5 and 6. The reason for this is similar to the principle shown in Figure 2. Similarly, when the human eye tracks in the opposite direction, dark stripes will be generated, as shown in track A in Figures 5 and 6. The reason for this is similar to the principle shown in Figure 3. In Figures 5 and 6, the slope of the pixel point is related to the speed of the head movement.

[0049] For case 4), as shown in Figures 7 and 8, Figure 7 shows a schematic diagram of light and dark stripes generated when the display moves to the left with the head but the human eye does not track the pixels, and Figure 8 shows a schematic diagram of light and dark stripes generated when the display moves to the right with the head but the human eye tracks the pixels. In Figures 7 and 8, when the display moves to the left or right with the head and the human eye does not track, the dynamic false contour phenomenon will still occur. In Figure 7, although the human eye does not move, the display moves to the left with the head, causing the different subfields of the pixel points to shift to the left in physical space, causing the human eye to passively move from the 127-level grayscale area to the 128-level grayscale area, which in turn causes the generation of light stripes. In addition, the duration of this process is much longer than the process of active tracking by the human eye, so the duration of the light stripes is also longer. This is a phenomenon that does not occur in the traditional display industry when the display is fixed. The reason for the generation of light stripes is similar to the principle shown in Figure 2. Similarly, in FIG8 , as the head moves to the right, the display causes the human eye to passively move from the 128-level grayscale area to the 127-level grayscale area, thus generating dark stripes. The reason for the generation of dark stripes is similar to the principle shown in FIG3 .

[0050] In summary, the most obvious difference between near-eye display environments (including AR / VR environments) and the traditional display industry (where the display is fixed) is that when the display moves with the head but the human eye does not track it, a new dynamic false contour phenomenon is introduced, and this phenomenon is more obvious because it lasts longer.

[0051] In order to reduce the newly introduced dynamic false contour phenomenon generated when the display moves with the head in a near-eye display environment (including AR / VR environments), embodiments of the present application provide a display method, display device, electronic device, storage medium, and program product. The display method proposed in the embodiments of the present application can be applied to digitally driven display devices that have the dynamic false contour phenomenon, such as liquid crystal displays (LCDs), digitally driven light-emitting diode (LED) displays, and organic light-emitting diode (OLED) displays. Of course, other displays are also possible, and the present application is not limited thereto.

[0052] The display method proposed in the embodiment of the present application can reduce the dynamic false contour phenomenon by shifting the sub-field data, especially the dynamic false contour phenomenon generated in the scene where the display device and the head move synchronously and the human eye does not track.

[0053] The following first introduces the display method provided in the embodiment of the present application.

[0054] FIG9 shows a flow chart of a display method provided by an embodiment of the present application. As shown in FIG9 , the method includes the following steps:

[0055] Step S901 : When the display device and the head of the target object move synchronously, the head movement distance and the head movement direction of the target object within the target subfield scanning time are obtained.

[0056] In step S901, the display device moves synchronously with the target subject's head, and the movement state of the target subject's head is also the movement state of the display device. In an embodiment of the present application, the target subject may wear a display device, for example, the target subject wears VR glasses. In this scenario, the target subject's head moves synchronously with the display device. In another scenario, the target subject may not wear a display device. In this case, the display device moves with the target subject's head. For example, the display device has a face tracking unit that can detect the movement state of the target subject's head and adjust the position of the display device according to the movement state of the head so that the display device moves synchronously with the target subject's head.

[0057] Furthermore, in step S901, the target subfield scan duration is the scan duration of the subfield to be displayed, and the subfield to be displayed is any subfield included in the single-frame image to be displayed. In the embodiment of the present application, each single-frame image can be divided into multiple subfields. For example, in Figure 1, a single-frame image is divided into 8 subfields, each of which has its own scan duration and scan weight.

[0058] As an example, the display device can be configured with a detection unit for detecting the motion state of the display device. The detection unit can be a gyroscope, which can detect the relevant data of the head movement of the target object in real time. By calculating the data related to the head movement, the head movement distance and head movement direction of the target object can be obtained.

[0059] Step S902 : determining the target number of pixels corresponding to the head movement distance according to the head movement distance and the pixel width of a single pixel in the single-frame image.

[0060] It should be noted that the head movement distance determined by step S901 is the distance of the target object's head in the world space. In the display industry, images are usually processed in pixels. Therefore, for the convenience of calculation, after the head movement distance is determined by step S901, the head movement distance needs to be converted into the number of pixels. In the subsequent process, calculations are performed in units of pixels to improve calculation efficiency.

[0061] Step S903 : shifting the sub-field to be displayed based on the target number of pixels in the opposite direction of the head movement direction to obtain a target sub-field.

[0062] It should be noted that in a scenario where the head moves synchronously with the display device and the human eye does not track, the occurrence of the dynamic false contour phenomenon is related to the head movement. Therefore, in order to reduce the dynamic false contour phenomenon, in an embodiment of the present application, the sub-field is shifted in a direction opposite to the direction of head movement to reduce the human eye's perception of the false contour line, thereby reducing the dynamic false contour phenomenon.

[0063] Furthermore, if the subfield shifts are too few, dynamic false contouring cannot be effectively reduced; however, if the shift is too large, dynamic false contouring may occur in the opposite direction, thus failing to reduce the dynamic false contouring. In the embodiment of the present application, the subfields are shifted based on the target number of pixels corresponding to the head movement distance, effectively reducing the linearity of dynamic false contouring and ensuring that the shifted subfields have a higher-quality display effect.

[0064] Step S904 : displaying a single frame image in a display area of ​​the display device based on the target subfield.

[0065] In step S904 , the display area of ​​the display device may be an area in a display screen of the display device.

[0066] In one example, after shifting the subfield to be displayed to obtain the target subfield, the target subfield can be scanned; steps S901 to S903 are repeated to scan each subfield in the single-frame image to be displayed. After the scanning is completed, the complete single-frame image can be displayed in the display area of ​​the display device.

[0067] Based on the scheme defined by the above steps S901 to S904, it can be known that in an embodiment of the present application, when the display device moves synchronously with the head of the target object and the human eye is not tracking, the image displayed in the display area of ​​the display device may have a dynamic false contour phenomenon. In order to reduce the dynamic false contour phenomenon, in an embodiment of the present application, the display data corresponding to the subfield is shifted in the opposite direction of the head movement direction to reduce the human eye's perception of the false contour line, thereby reducing the dynamic false contour phenomenon. In addition, in an embodiment of the present application, the head movement distance is converted into the number of pixels, and the display data corresponding to the subfield is moved by the number of pixels corresponding to the head movement distance, thereby avoiding the problem that the dynamic false contour phenomenon cannot be reduced or the reduction effect is poor due to excessive or insufficient subfield shifting, thereby effectively reducing the dynamic false contour phenomenon and improving the quality of image display.

[0068] The display method proposed in the embodiment of the present application is explained in detail below.

[0069] In the process of displaying a single-frame image, the head motion data of the target object within the target subfield scanning time is first required. The head motion data at least includes the head motion distance and the head motion direction.

[0070] Specifically, first, the head movement state of the target object is monitored to obtain the angular velocity of the target object's head and the rotation radius of the target object's head; then, the product of the angular velocity and the rotation radius is calculated to obtain the linear velocity of the target object's head; then, the product of the target subfield scanning time and the linear velocity is calculated to obtain the head movement distance of the target object within the target subfield scanning time, and at the same time, the speed direction of the linear velocity is determined to be the head movement direction.

[0071] In one example, a gyroscope can be used to monitor the head's motion in real time. When the head moves, the angular velocity ω of the head is obtained from the data detected by the gyroscope, and the linear velocity v of the head's motion direction is calculated based on the angular velocity. The linear velocity can be expressed as follows: v = ωr (1)

[0072] In formula (1), r is the rotation radius of the head, which can be obtained from the data detected by the gyroscope.

[0073] For example, in the schematic diagram of the synchronous movement of the display device and the head shown in Figure 10, when the display device rotates toward the right with the head at an angular velocity ω0, the linear velocity v0 of the head toward the right can be calculated according to formula (1). As an example, the linear velocity v0 toward the right is 0.03 m / s, or 0.03 mm / ms.

[0074] After obtaining the linear velocity of the head, the direction of the linear velocity can be used as the head movement direction. At the same time, the head movement distance in the target subfield scanning time can be calculated by the following formula: d = k*v*t (2)

[0075] In formula (2), d is the head movement distance, t is the target subfield scanning time, and k is the correction coefficient.

[0076] Using the angular velocity shown in Figure 10 as an example, if the display frequency of the display device is 90 Hz and 25 subfields are used to display a single frame, the scan duration of one subfield is approximately 0.444 ms. For k = 1, the head moves to the right within the scan duration of one subfield (i.e., the target subfield scan duration), i.e., d = 0.013 mm.

[0077] Furthermore, after determining the head movement distance of the target object within the target subfield scanning time, the number of target pixels corresponding to the head movement distance can be determined based on the head movement distance and the pixel width of a single pixel in a single frame image.

[0078] Specifically, after obtaining the pixel width of a single pixel in a single-frame image, the ratio between the head movement distance and the pixel width is calculated to obtain the target pixel number corresponding to the head movement distance.

[0079] As an example, the target number of pixels corresponding to the head movement distance can be expressed as follows:

[0080] In formula (3), n is the number of target pixels, and l is the pixel width of a single pixel.

[0081] It should be noted that if the ratio of the head movement distance to the pixel width of a single pixel is a non-integer, the ratio may be rounded, and the rounded value may be used as the target pixel number. The rounding operation may include, but is not limited to, rounding up, rounding down, rounding toward zero, etc. In the embodiments of this application, rounding is used as an example for explanation.

[0082] In the example shown in Figure 10, when a 1.3-inch screen with a resolution of 2560*2560 is used for display, the pixel width l of a pixel is approximately 0.009 mm. In this case, the distance the head moves to the right within a subfield scan duration is rounded to the nearest integer, resulting in a target pixel number of 1. Therefore, the upper screen data of the subfield to be transmitted is shifted to the left by 1 bit. The scan data corresponding to each subfield can be shown in Table 1.

[0083] Table 1

[0084] It should be noted that when the display device has a resolution of 2560*2560, the actual resolution of the display device will be larger because some pixels are reserved around the edges and are not displayed. For example, the actual resolution of 2560*2560 is 2580*2580. In this scenario, the shifting of the sub-fields to be displayed can be achieved by using either of the following two solutions.

[0085] In the first solution, the display data of the subfield to be displayed is shifted by a target number of pixels in the opposite direction of the head movement to obtain a target subfield.

[0086] For example, in the schematic diagrams of subfield shift shown in Figures 11 and 12, Figure 11 is the display area of ​​the display device before the shift, and Figure 12 is the display area of ​​the display device after the shift. In Figures 11 and 12, the yellow area is the display area, and the blue area is the black screen, that is, the area with a pixel value of 0. In Figure 11, the display area is the area from the 11th column to the 2570th column, and from the 11th row to the 2570th row; the starting lit column in Figure 11 is moved from the 11th column to the 10th column, and the ending lit column is moved from the 2570th column to the 2569th column, that is, the display area is shifted to the left by 1 pixel as a whole, and the display area shown in Figure 12 can be obtained. The display data corresponding to the display area is the display data corresponding to the target subfield (that is, the upper screen data), as shown in Figures 11 and 12. 1-1 、a 1-2 、…a 1-2560 .

[0087] It should be noted that, in the embodiment of the present application, the upper screen data is the data corresponding to each pixel in the display area of ​​the display device, including but not limited to the values ​​corresponding to each color channel.

[0088] In the second solution, the display data of the last n columns of pixels in the subfield to be displayed is set as the target display data along the direction of head movement. Then, the display data corresponding to the last n columns of pixels in the subfield to be displayed is removed from the subfield to be displayed in the direction opposite to the direction of head movement, and the display data corresponding to the remaining columns of pixels are shifted by n pixels to obtain the target subfield. Here, n is the number of target pixels, and n ≥ 0.

[0089] For example, in the display area of ​​the display device shown in FIG11 , by shifting all display data in the display area to the left by one pixel, the display area of ​​the shifted display device shown in FIG13 can be obtained. In FIG13 , after the entire data is shifted to the left by one pixel, the pixels in the 2570th column are replaced by the data 0 in the 2571st column. Therefore, the pixels in the 2570th column display a black screen (i.e., the target display data).

[0090] Figures 11 to 13 above are schematic diagrams of shifting a subfield. However, in actual applications, a frame of image usually consists of multiple subfields. In this case, the head movement distance corresponding to each subfield is related to the head movement distance of the previous subfield.

[0091] Specifically, when the single-frame image to be displayed includes multiple subfields, the scanning order of the subfields to be displayed in the single-frame image to be displayed can be detected; then, based on the scanning order of the subfields to be displayed, it is determined whether to update the head movement distance to obtain a judgment result, and when the judgment result is the first judgment result, the head movement distance of the subfield to be displayed is updated to obtain an updated head movement distance.

[0092] In the above embodiments, the types of head movement may include, but are not limited to, uniform motion and non-uniform motion. In the embodiments of the present application, the types of head movement are the types of head movement performed within the subfield scanning duration of the subfield to be displayed. For ease of explanation, the embodiments of the present application use uniform head movement as an example. In scenarios where the head performs other types of movement, the steps for improving the dynamic false contour phenomenon using the solution provided in this application are similar to those for uniform motion scenarios.

[0093] In addition, in the above embodiment, the scanning order of the subfield to be displayed in a single frame image is used to characterize the scanning order of the subfield to be displayed. For example, in Figure 2, the scanning order of the subfield with a subfield weight of 1 is 0, indicating that the subfield is the first scanned subfield; the scanning order of the subfield with a subfield weight of 2 is 1, indicating that the subfield is the second scanned subfield.

[0094] In the above embodiment, the determination result is used to indicate whether the head motion distance of the subfield to be displayed is allowed to be updated. The first determination result indicates that the head motion distance of the subfield to be displayed is allowed to be updated. If the subfield to be displayed is the first scanned subfield, the head motion distance within the scan duration of the subfield does not need to be updated. However, if the subfield to be displayed is not the first scanned subfield, the head motion distance corresponding to the subfield to be displayed needs to be updated.

[0095] That is, if the scanning order of the subfield to be displayed is the first order, the determination result is determined to be the second determination result; if the scanning order of the subfield to be displayed is any other order, the determination result is determined to be the first determination result. The second determination result is used to indicate that the head movement distance of the subfield to be displayed is prohibited from being updated.

[0096] When the subfield to be displayed is not the first scanned subfield in the single-frame image to be displayed, for example, when the subfield to be displayed is the second or third scanned subfield, it is necessary to obtain the head movement distances of other subfields, and based on the head movement direction, the head movement distances of other subfields and the head movement distance of the subfield to be displayed are accumulated and calculated to obtain the updated head movement distance.

[0097] In the above embodiment, the other subfields are subfields in the single-frame image to be displayed that are scanned before the subfield to be displayed. For example, if the subfield to be displayed is the fourth scanned subfield in the single-frame image, then the other subfields are the first, second, and third scanned subfields in the single-frame image. The updated head movement distance corresponding to the subfield to be displayed is the sum of the head movement distances of the first, second, third, and fourth scanned subfields. That is, the second subfield is shifted based on the first subfield, and the actual head movement distance of the second subfield is accumulated with the head movement distance of the first subfield, and so on. The accumulated head movement distance is cleared when the next frame image is displayed.

[0098] It should be noted that when the head movement direction of other subfields is the same as that of the subfield to be displayed, the head movement distances of the other subfields and the head movement distances of the subfield to be displayed are accumulated to obtain the updated head movement distance of the subfield to be displayed. When the head movement directions of the other subfields are partially different, for example, the other subfields include a first subfield and a second subfield, the head movement direction of the subfield to be displayed is the first direction, the head movement direction of the first subfield is the second direction, and the head movement direction of the second subfield is the first direction, and the first direction is opposite to the second direction, then when accumulating the head movement distances of the other subfields and the head movement distances of the subfield to be displayed, the head movement direction must be considered. In the above example, the updated head movement distance of the subfield to be displayed is the sum of the head movement distance of the subfield to be displayed and the head movement distance of the second subfield, minus the head movement distance of the second subfield. That is, when the head movement directions of the other subfields are partially different, the head movement distances with the same head movement direction are summed, and the head movement distances with different head movement directions are subtracted.

[0099] In addition, it should be noted that in actual applications, when there are some differences in the head movement directions of other sub-fields, there may be a certain angle between different head movement directions. At this time, in this scenario, the head movement direction can be decomposed into multiple sub-directions, and the head movement distances of other sub-fields are calculated. The first head movement distance in the head movement direction of the sub-field to be displayed, and the second head movement distance in the opposite direction of the head movement direction of the sub-field to be displayed are calculated. Then, the sum of all the first head movement distances and the head movement distance of the sub-field to be displayed (recorded as the first distance), as well as the sum of the second head movement distances (recorded as the second distance) are calculated, and then the difference between the first distance and the second distance is calculated to obtain the updated head movement distance of the sub-field to be displayed.

[0100] After obtaining the updated head movement distance, the target number of pixels corresponding to the sub-field to be displayed can be obtained by using formulas (1)-(3). Then, after shift scanning the sub-field to be displayed based on the target number of pixels, the single-frame image to be displayed can be displayed.

[0101] As an example, Table 2 shows scanning data of multiple subfields under continuous motion.

[0102] Table 2

[0103] By repeatedly repeating the above-mentioned solution provided in the embodiments of this application, the dynamic false contour phenomenon in the near-eye display environment (including AR / VR environments) can be optimized in the scene where the display device and the head move synchronously, but the human eye does not track. The corresponding optimization results are shown in Figures 14 and 15. Among them, Figure 14 is a schematic diagram of the display moving to the right with the head before optimization, and the light and dark stripes generated when the human eye tracks the pixels. Figure 15 is a schematic diagram after the dynamic false contour phenomenon is optimized using the solution provided by this application.

[0104] It should be noted that the above descriptions are all based on the case where the head moves only along the x-axis. In fact, when the head moves only along the y-axis or along an oblique direction (moving both the x-axis and the y-axis), the solution provided in the embodiments of the present application can also be used to reduce the dynamic false contour phenomenon. The principle is similar to that of the head moving along the x-axis.

[0105] It can be seen that the solution proposed in the embodiment of the present application can greatly reduce the dynamic false contour phenomenon newly introduced in the near-eye display environment (including AR / VR and other environments), that is, when the display moves with the head and the human eye does not track, thereby improving the quality of image display.

[0106] An embodiment of the present application further provides a display device, as shown in FIG16 . The device 1600 includes: a data acquisition module 1601 , a pixel determination module 1602 , a shift module 1603 and a display module 1604 .

[0107] A data acquisition module 1601 is configured to acquire, when the display device and the target subject's head move synchronously, a distance and a direction of the target subject's head movement within a target subfield scanning duration, wherein the target subfield scanning duration is the scanning duration of a subfield to be displayed, and the subfield to be displayed is any subfield included in a single frame image to be displayed;

[0108] The pixel determination module 1602 is configured to determine the target number of pixels corresponding to the head movement distance based on the head movement distance and the pixel width of a single pixel in a single frame image;

[0109] A shift module 1603 is configured to shift the subfield to be displayed based on the target number of pixels in the opposite direction of the head movement direction to obtain a target subfield;

[0110] The display module 1604 is configured to display a single frame image in a display area of ​​the display device based on the target subfield.

[0111] In one example, the data acquisition module includes: a state monitoring module, a speed calculation module, a distance calculation module, and a direction determination module. The state monitoring module is configured to monitor the target subject's head motion state and obtain the target subject's head angular velocity and the target subject's head rotation radius; the speed calculation module is configured to calculate the product of the angular velocity and the rotation radius to obtain the target subject's head linear velocity; the distance calculation module is configured to calculate the product of the target subfield scanning duration and the linear velocity to obtain the target subject's head motion distance within the target subfield scanning duration; and the direction determination module is configured to determine the linear velocity as the head motion direction.

[0112] In one example, the direction determination module is specifically used to obtain the pixel width of a single pixel in a single frame image; calculate the ratio between the head movement distance and the pixel width, and obtain the target number of pixels corresponding to the head movement distance.

[0113] In one example, a single-frame image to be displayed includes multiple subfields, and the display device further includes: a sequence detection module, a discrimination module, and a distance update module. The sequence detection module is configured to detect the scanning sequence of the subfields to be displayed in the single-frame image to be displayed; the discrimination module is configured to determine whether to update the head motion distance based on the scanning sequence of the subfields to be displayed, thereby obtaining a discrimination result; and the distance update module is configured to update the head motion distance of the subfield to be displayed if the discrimination result is a first discrimination result, thereby obtaining an updated head motion distance, wherein the first discrimination result is used to indicate that the head motion distance of the subfield to be displayed can be updated.

[0114] In one example, the judgment module is specifically used to determine that the judgment result is a second judgment result when the scanning order of the subfield to be displayed is the first order, wherein the second judgment result is used to indicate that the head movement distance of the subfield to be displayed is prohibited from being updated; when the scanning order of the subfield to be displayed is other orders, the judgment result is determined to be the first judgment result.

[0115] In one example, the distance update module is specifically used to obtain the head movement distance of other subfields, wherein the other subfields are subfields in the single-frame image to be displayed, whose scanning order is located before the subfield to be displayed; based on the head movement direction, the head movement distance of the other subfields and the head movement distance of the subfield to be displayed are accumulated and calculated to obtain the updated head movement distance.

[0116] In one example, the shift module is specifically configured to shift the display data of the to-be-displayed subfield by a target number of pixels in a direction opposite to the direction of head movement to obtain a target subfield.

[0117] In one example, a module is specifically used to set the display data of the last n columns of pixels in the subfield to be displayed as target display data along the direction of head movement, where n is the number of target pixels, n≥0; remove the display data corresponding to the last n columns of pixels in the subfield to be displayed from the subfield to be displayed along the opposite direction of the head movement direction, and move the display data corresponding to other columns of pixels by n pixels to obtain the target subfield.

[0118] The display device provided in the embodiment of the present application can implement each process implemented in the aforementioned method embodiment, and to avoid repetition, they will not be described here.

[0119] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0120] FIG17 shows a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0121] The electronic device may include a processor 1701 and a memory 1702 storing computer program instructions.

[0122] Specifically, the processor 1701 may include a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0123] Memory 1702 may include a large capacity memory for data or instructions. By way of example and not limitation, memory 1702 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 1702 may include removable or non-removable (or fixed) media. Where appropriate, memory 1702 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, memory 1702 is a non-volatile solid-state memory.

[0124] The memory may include read-only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical / tangible memory storage devices. Thus, generally, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.

[0125] The processor 1701 implements any one of the display methods in the above embodiments by reading and executing computer program instructions stored in the memory 1702 .

[0126] In one example, the electronic device may further include a communication interface 1703 and a bus 1710. As shown in FIG17 , the processor 1701, the memory 1702, and the communication interface 1703 are connected via the bus 1710 and communicate with each other.

[0127] The communication interface 1703 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0128] Bus 1710 includes hardware, software or both, couples the parts of electronic equipment to each other.For example, but not limitation, bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industry standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industry standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 1710 may include one or more buses. Although the present application embodiment describes and shows specific bus, the application considers any suitable bus or interconnection.

[0129] In addition, in conjunction with the display method in the above embodiment, the present application embodiment can provide a computer-readable storage medium for implementation. The computer-readable storage medium stores computer program instructions; when the computer program instructions are executed by a processor, any one of the display methods in the above embodiment is implemented.

[0130] In addition, in combination with the display method in the above embodiment, the embodiment of the present application can provide a computer program product for implementation. When the instructions in the computer program product are executed by the processor of the electronic device, the electronic device executes and implements any one of the display methods in the above embodiment.

[0131] It should be understood that the present application is not limited to the specific configurations and processes described above and illustrated in the figures. For the sake of brevity, a detailed description of known methods is omitted here. In the above embodiments, several specific steps are described and illustrated as examples. However, the method process of the present application is not limited to the specific steps described and illustrated. Those skilled in the art can make various changes, modifications, and additions, or change the order of the steps after understanding the spirit of the present application.

[0132] The functional modules shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in unit, a function card or the like. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium that can store or transmit information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROMs, flash memories, erasable ROMs (EROMs), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0133] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps. In other words, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0134] The above description of various aspects of the present disclosure refers to the flowcharts and / or block diagrams of the display method, display device, electronic device, storage medium and program product according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor or a field programmable logic circuit. It can also be understood that each box in the block diagram and / or flowchart and the combination of boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0135] The above description is only a specific embodiment of the present application. Those skilled in the art will clearly understand that for the convenience and brevity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the scope of protection of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the scope of protection of the present application.

Claims

1. A display method, characterized in that: include: When the display device and the target subject's head move synchronously, obtaining the target subject's head movement distance and head movement direction within a target subfield scanning duration, wherein the target subfield scanning duration is the scanning duration of a subfield to be displayed, and the subfield to be displayed is any subfield included in a single frame image to be displayed; Determining the target number of pixels corresponding to the head movement distance according to the head movement distance and the pixel width of a single pixel in the single-frame image; shifting the subfield to be displayed based on the target number of pixels in a direction opposite to the head movement direction to obtain a target subfield; The single frame image is displayed within the display area of the display device based on the target subfield.

2. The method according to claim 1, characterized in that Obtaining the head movement distance and head movement direction of the target object within the target subfield scanning time, including: Monitoring the movement state of the target object's head to obtain the angular velocity of the target object's head and the rotation radius of the target object's head; Calculating the product of the angular velocity of the movement and the rotation radius to obtain the linear velocity of the head of the target object; Calculating the product of the target subfield scanning time and the motion linear velocity to obtain the head movement distance of the target object within the target subfield scanning time; The speed direction of the motion linear speed is determined to be the head motion direction.

3. The method according to claim 2, characterized in that Determining the target number of pixels corresponding to the head movement distance according to the head movement distance and the pixel width of a single pixel in the single-frame image includes: Obtaining the pixel width of a single pixel in the single-frame image; The ratio of the head movement distance to the pixel width is calculated to obtain the target pixel number corresponding to the head movement distance.

4. The method according to claim 3, characterized in that The single-frame image to be displayed includes a plurality of subfields. Before calculating the ratio between the head movement distance and the pixel width to obtain the target number of pixels corresponding to the head movement distance, the method further includes: detecting a scanning order of the subfield to be displayed in the single frame image to be displayed; determining whether to update the head movement distance based on the scanning order of the subfield to be displayed, and obtaining a determination result; When the determination result is the first determination result, the head movement distance of the subfield to be displayed is updated to obtain an updated head movement distance, wherein the first determination result is used to indicate that the head movement distance of the subfield to be displayed is allowed to be updated.

5. The method according to claim 4, characterized in that Determining whether to update the head movement distance based on the scanning order of the subfield to be displayed, and obtaining a determination result, including: When the scanning order of the subfield to be displayed is the first order, determining that the discrimination result is a second discrimination result, wherein the second discrimination result is used to indicate that updating of the head movement distance of the subfield to be displayed is prohibited; When the scanning order of the subfield to be displayed is another order, the determination result is determined to be the first determination result.

6. The method according to claim 5, characterized in that Updating the head movement distance of the sub-field to be displayed to obtain an updated head movement distance includes: Acquiring head movement distances of other subfields, wherein the other subfields are subfields in the single-frame image to be displayed, the scanning order of which is located before the subfield to be displayed; The head movement distances of the other subfields and the head movement distance of the subfield to be displayed are cumulatively calculated based on the head movement direction to obtain the updated head movement distance.

7. The method according to claim 1, characterized in that Shifting the subfield to be displayed based on the target number of pixels in a direction opposite to the head movement direction to obtain a target subfield, comprising: The display data of the subfield to be displayed is shifted by the target number of pixels in a direction opposite to the head movement direction to obtain the target subfield.

8. The method according to claim 1, characterized in that Shifting the subfield to be displayed based on the target number of pixels in a direction opposite to the head movement direction to obtain a target subfield, comprising: Setting the display data of the last n columns of pixels in the subfield to be displayed as target display data along the direction of the head movement, where n is the number of target pixels and n≥0; The display data corresponding to the last n columns of pixels in the subfield to be displayed are removed from the subfield to be displayed along the opposite direction of the head movement direction, and the display data corresponding to the other columns of pixels are shifted by n pixels to obtain the target subfield.

9. A display device, characterized in that: include: a data acquisition module, configured to acquire, when the display device and the target subject's head move synchronously, a distance and a direction of the target subject's head movement within a target subfield scanning duration, wherein the target subfield scanning duration is the scanning duration of a subfield to be displayed, and the subfield to be displayed is any subfield included in a single frame image to be displayed; a pixel determination module, configured to determine a target number of pixels corresponding to the head movement distance based on the head movement distance and a pixel width of a single pixel in the single-frame image; a shifting module, configured to shift the subfield to be displayed based on the target number of pixels in a direction opposite to the direction of the head movement to obtain a target subfield; A display module is configured to display the single-frame image within a display area of the display device based on the target subfield.

10. An electronic device, characterized in that: The electronic device includes: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, the display method according to any one of claims 1 to 8 is implemented.

11. A computer-readable storage medium, characterized in that Computer program instructions are stored on the computer-readable storage medium, and when the computer program instructions are executed by the processor, the display method according to any one of claims 1 to 8 is implemented.

12. A computer program product, characterized in that When the instructions in the computer program product are executed by a processor of an electronic device, the electronic device executes the display method according to any one of claims 1 to 8.

Images