Display method and device, storage medium and electronic device

Abstract

The present disclosure provides a display method and device, a storage medium and an electronic device, and relates to the technical field of field sequential display. The method comprises the following steps: determining the color separation region width located at the edge of a display target in the field sequential display based on the eye movement speed information obtained by observing the display target; determining the offset amount of a plurality of sub-fields constituting the field sequential display according to the color separation region width; performing displacement compensation on a to-be-displayed image frame according to the offset amount of the plurality of sub-fields to determine a to-be-displayed image frame after displacement compensation; and rendering and displaying the to-be-displayed image frame after displacement compensation. The present disclosure achieves the effect of eliminating color separation without affecting the display effect.

Description

Technical Field

[0001] This disclosure relates to the field of field sequence display technology, and in particular to a display method and apparatus, storage medium and electronic device. Background Technology

[0002] In traditional LCD displays, color filters are placed on pixels to filter the light source. Color display is achieved by mixing the light from various color filters in space. However, color filters reduce the transmittance of the light emitted by the light source.

[0003] Field sequence display is a time-series light mixing without color filters. It divides a pixel into multiple subfields of different colors, and the different subfields are lit up sequentially in time. Due to the persistence of vision in the human eye, time-series light mixing is achieved, thus realizing color image display. Compared with traditional LCD displays, field sequence display has the advantages of low power consumption and high resolution.

[0004] In display applications, when the eye is moving, the constituent subfields of the display target will reach the retina of the eye at different times, thus forming impact points at different locations on the retina. The faster the eye moves, the more severe the separation of impact points will be. At the edge of the display target, a color separation area composed of multiple color patterns will be seen, resulting in color break-up (CBU).

[0005] Color separation can cause visual fatigue, tension, and interfere with the visual experience, hindering the further development and application of field-sequence display methods. How to accurately and effectively suppress color separation has become an urgent problem to be solved.

[0006] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0007] This disclosure provides a display method and apparatus, a storage medium and an electronic device, which at least to some extent overcome the problem of color separation.

[0008] Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part from practice of this disclosure.

[0009] According to one aspect of this disclosure, a display method is provided, comprising:

[0010] Based on the eye movement speed information obtained from the display target in the observation field sequence display, the width of the color separation region located at the edge of the display target is determined;

[0011] Based on the width of the color separation region, the offset of the multiple subfields constituting the field sequence display is determined;

[0012] The image frame to be displayed is displacement compensated according to the offset of the multiple subfields to determine the displacement compensated image frame to be displayed;

[0013] The image frame to be displayed is rendered after displacement compensation.

[0014] In some embodiments, determining the width of the color separation region located at the edge of the display target based on eye movement velocity information obtained from the display target in the observation field sequence display includes:

[0015] Collect eye image information when the target is displayed in the field sequence display, and determine the eye movement velocity information of the eye when observing the target in the field sequence display;

[0016] Based on the eye movement speed information, the width of the color separation region located at the edge of the display target is determined.

[0017] In some embodiments, acquiring eye image information when observing a displayed target in a field sequence display, and determining eye movement velocity information of the eye observing the displayed target in the field sequence display, includes:

[0018] Collect eye image information of the target displayed in the observation field sequence display, identify the pupil region in the eye image information, and determine the pupil position at the current time;

[0019] Based on the current pupil position, calculate the multiple trajectory changes of the pupil in the next time period;

[0020] Connect the multiple trajectory changes of the pupil within the next time period to form a line, and determine the eye movement trajectory for the next time period;

[0021] Based on the physical model of the eyeball and the eye movement trajectory for the next time period, the eye movement velocity information for the next time period is determined. The eye movement velocity information includes: eye movement rate value and eye movement velocity direction.

[0022] In some embodiments, determining the width of the color separation region located at the edge of the display target based on the eye movement speed information includes:

[0023] The eye movement speed information is input into the relationship function between eye movement speed and color separation region width to determine the width of the color separation region located at the edge of the display target.

[0024] In some embodiments, the process of constructing the relationship function between eye movement velocity and color separation region width includes:

[0025] The eyeball diameter, test target width, and field sequence display device refresh rate are set to fixed values. Eye movement speed is used as a control variable. A function formula for calculating the eye movement speed and color separation region width is established. The function formula for calculating the eye movement speed and color separation region width includes fitting parameters. The eye movement speed, the eyeball diameter, the test target width, and the field sequence display device refresh rate are control parameters related to the color separation region width.

[0026] According to the set initial value of the test step size, the test target is moved at a constant speed on the field sequence display device according to the test rate, and the width of the test color separation area located at the edge of the test target is obtained.

[0027] The eye movement speed is determined based on the test rate;

[0028] The test step size is gradually increased to gradually reduce the width of the test color separation region until the width of the test color separation region is zero. The current test step size is then determined as the subfield compensation displacement corresponding to the test eye movement velocity. The increase in the test step size is in pixels.

[0029] Based on the tested eye movement velocity and the subfield compensation displacement, the fitting parameters of the function formula for calculating the eye movement velocity and color separation region width are fitted to determine the relationship function between eye movement velocity and color separation region width.

[0030] In some embodiments, according to a set initial test step size, the test target is moved at a constant speed on the field sequence display device at a test rate to obtain the width of the test color separation region located at the edge of the test target, including:

[0031] Based on the refresh rate of the field sequence display device, which is set to a fixed value, the display time difference between multiple sub-fields constituting the field sequence display is determined;

[0032] Based on the display time difference and test rate between the multiple subfields that constitute the field sequence display, the positional relationship between the multiple subfields and the test target is determined;

[0033] According to the set initial value of the test step size and the positional relationship between the multiple subfields and the test target, displacement compensation is performed on the test image frame displaying the test target to determine the compensated test image frame;

[0034] The compensated test image frame is rendered and displayed so that the test target moves at a constant speed on the field sequence display device according to the test rate, and the width of the test color separation region located at the edge of the test target is obtained.

[0035] In some embodiments, determining the test eye movement speed based on the test rate includes:

[0036] Acquire the field of view, observation distance, lens magnification, and pixel size of the field sequence display device;

[0037] Based on the test rate, determine the display position of the test target in the test image frame;

[0038] The test eye movement speed is determined based on the display position of the test target in the test image frame, the field of view of the field sequence display device, the observation distance, the lens magnification and pixel size, and the refresh rate of the field sequence display device, which is set to a fixed value.

[0039] In some embodiments, the test step size is gradually increased to gradually reduce the width of the test color separation region until the width of the test color separation region is zero. Then, the current test step size is determined as the subfield compensation displacement corresponding to the test eye movement velocity, including:

[0040] The test step size is updated by increasing the test step size from the initial value in pixels;

[0041] Based on the updated test step size, obtain the corresponding test color separation region width;

[0042] The test step size is gradually increased to gradually reduce the width of the corresponding test color separation region until the width of the test color separation region is zero. Then, the number of pixels of the currently updated test step size is determined as the subfield compensation displacement corresponding to the test eye movement speed.

[0043] In some embodiments, the fitting parameters of the function formula for calculating the eye movement velocity and the color separation region width are fitted based on the tested eye movement velocity and the subfield compensation displacement to determine the relationship function between eye movement velocity and color separation region width, including:

[0044] The eye-tracking velocity and the corresponding subfield compensation displacement are associated with an array to complete a set of tests;

[0045] Change the test rate of the test target to perform multiple sets of tests, and determine multiple sets of arrays;

[0046] Substitute the multiple sets of arrays into the function formula for calculating eye movement speed and color separation region width to perform quadratic polynomial fitting, and determine the values ​​of the fitting parameters;

[0047] Substitute the values ​​of the fitting parameters into the formula for calculating the relationship between eye movement speed and color separation region width to determine the function relating eye movement speed and color separation region width.

[0048] In some embodiments, determining the offset of the plurality of subfields constituting the field sequence display based on the width of the color separation region includes:

[0049] Based on the refresh rate of the field sequence display device, the display time difference between the multiple sub-fields constituting the field sequence display is determined;

[0050] Based on the display time difference between the multiple subfields constituting the field sequence display and the eye movement speed information, the positional relationship between the multiple subfields and the display target is determined;

[0051] The offset of the multiple subfields constituting the field sequence display is determined based on the positional relationship between the multiple subfields and the display target and the width of the color separation region.

[0052] In some embodiments, when the multiple subfields constituting the field sequence display are a first subfield, a second subfield, and a third subfield, the positional relationship between the multiple subfields and the display target is that the first subfield, the second subfield, and the third subfield are sequentially closer to the edge of the display target, and the third subfield is adjacent to the display target.

[0053] Based on the positional relationship between the multiple subfields and the display target and the width of the color separation region, the offset of the multiple subfields constituting the field sequence display is determined, including:

[0054] Based on the positional relationship between the multiple subfields and the display target and the width of the color separation region, the offset of the first subfield is determined to be three times the width of the color separation region, the offset of the second subfield is determined to be twice the width of the color separation region, and the offset of the first subfield is equal to the width of the color separation region.

[0055] In some embodiments, the first subfield is a red subfield, the second subfield is a green subfield, and the third subfield is a blue subfield.

[0056] In some embodiments, the process of performing displacement compensation on the image frame to be displayed according to the offset of the plurality of subfields, and determining the displacement-compensated image frame to be displayed, includes:

[0057] According to the offset of the multiple subfields, the subfield of each pixel of the image frame to be displayed is displacement compensated in the opposite direction of the eye movement velocity direction of the eye movement velocity information to determine the displacement compensated image frame to be displayed. Each pixel of the image frame to be displayed corresponds to multiple subfields.

[0058] According to another aspect of this disclosure, a display device is also provided, comprising:

[0059] The color separation region width determination module is used to determine the width of the color separation region located at the edge of the display target based on the eye movement speed information obtained from the display target in the observation field sequence display.

[0060] The subfield offset determination module is used to determine the offset of multiple subfields constituting the field sequence display based on the width of the color separation region.

[0061] The displacement-compensated image frame determination module is used to perform displacement compensation on the image frame to be displayed according to the offset of the multiple subfields, and determine the displacement-compensated image frame to be displayed.

[0062] The rendering and display module is used to render and display the displacement-compensated image frame to be displayed.

[0063] According to another aspect of this disclosure, an electronic device is also provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the display method described in any of the preceding claims by executing the executable instructions.

[0064] According to another aspect of this disclosure, a computer-readable storage medium is also provided, on which a computer program is stored, which, when executed by a processor, implements the display method described in any of the preceding claims.

[0065] According to another aspect of this disclosure, a computer program product is also provided, including a computer program that, when executed by a processor, implements the display method of any of the above.

[0066] The display method, apparatus, storage medium, and electronic device provided in the embodiments of this disclosure determine the width of the color separation region located at the edge of the display target based on eye movement speed information obtained from the display target in the field-sequence display; determine the offset of multiple subfields constituting the field-sequence display according to the width of the color separation region; perform displacement compensation on the image frame to be displayed according to the offset of the multiple subfields to determine the displacement-compensated image frame to be displayed; and render and display the displacement-compensated image frame to be displayed. In field-sequence displays, the severity of color separation primarily depends on the width of the color separation region. Different widths of the color separation region correspond to different degrees of color separation. This disclosure determines the width of the color separation region located at the edge of the display target by obtaining eye movement speed information based on the observed display target in the field-sequence display, establishing a continuous relationship between eye movement speed and the width of the color separation region. Since the field-sequence display consists of multiple subfields, the offset of multiple subfields in the field-sequence display is determined based on the width of the color separation region. The image frame to be displayed is then displacement-compensated according to the offset of the multiple subfields in the field-sequence display. By compensating the color separation region through displacement compensation, a displacement-compensated image frame to be displayed is obtained, achieving the effect of eliminating color separation without affecting the display effect. The dynamic compensation method of the embodiment of this disclosure, which follows eye movement speed information to perform displacement compensation on the image frame to be displayed, can be applied to any type of field-sequence display image content. Depending on the degree of color separation under different eye movement speeds, the corresponding color separation suppression processing is different, effectively solving the impact of insufficient or excessive color separation suppression on the visual effect in field-sequence displays.

[0067] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0068] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0069] Figure 1 A schematic diagram of the system structure of a display method according to an embodiment of the present disclosure is shown.

[0070] Figure 2 A schematic diagram of a display method according to an embodiment of this disclosure is shown.

[0071] Figure 3 This diagram illustrates the process of determining the width of the color separation region located at the edge of the display target using a display method according to an embodiment of the present disclosure.

[0072] Figure 4 This diagram illustrates the process of determining the eye movement velocity information of the display target in the eye observation field sequence display according to an embodiment of the present disclosure.

[0073] Figure 5 This diagram illustrates the process of constructing the relationship function between eye movement speed and color separation region width in a display method according to an embodiment of the present disclosure.

[0074] Figure 6 This diagram illustrates the process of obtaining the width of the test color separation region located at the edge of the test target using a display method according to an embodiment of the present disclosure.

[0075] Figure 7 This diagram illustrates the process of determining test eye movement speed using a display method according to an embodiment of the present disclosure.

[0076] Figure 8 This diagram illustrates the process of determining the subfield compensation displacement corresponding to the eye movement velocity in a display method according to an embodiment of the present disclosure.

[0077] Figure 9 This diagram illustrates the process of determining the relationship between eye movement speed and color separation region width in a display method according to an embodiment of the present disclosure.

[0078] Figure 10 This diagram illustrates the process of determining the offsets of multiple subfields constituting the field sequence display in a display method according to an embodiment of the present disclosure.

[0079] Figure 11 The diagram illustrates the color sorting of different subfields and the color separation phenomenon under different eye movement directions in a display method according to an embodiment of the present disclosure.

[0080] Figure 12 This diagram illustrates a subfield displacement compensation process of a display method according to an embodiment of the present disclosure.

[0081] Figure 13 A schematic diagram of a display device according to an embodiment of the present disclosure is shown.

[0082] Figure 14 A structural block diagram of a computer device for a display method according to an embodiment of the present disclosure is shown. Detailed Implementation

[0083] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, they are provided so that this disclosure will be more comprehensive and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0084] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0085] The specific implementation methods of the embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0086] Figure 1 A schematic diagram of an exemplary application system architecture to which the methods shown in the embodiments of this disclosure can be applied is illustrated. For example... Figure 1 As shown, the system architecture may include a display screen 101 and a controller 102.

[0087] Display screen 101 can be a display screen of various electronic devices with display functions, including but not limited to monitors, smart TVs, smart screens, smartphones, tablets, laptops, desktop computers, augmented reality devices, virtual reality devices, etc.

[0088] The controller 102 can be a server that provides various services and functions, such as eye-tracking speed information obtained based on the display target in the field sequence display, determining the width of the color separation region located at the edge of the display target, determining the offset of multiple subfields constituting the field sequence display based on the width of the color separation region, performing displacement compensation on the image frame to be displayed according to the offset of the multiple subfields, determining the displacement-compensated image frame to be displayed, and rendering the displacement-compensated image frame to be displayed.

[0089] The control display screen 101 is used to display the image frame to be displayed after displacement compensation.

[0090] Optionally, the server can be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.

[0091] Those skilled in the art will know that Figure 1 The number of displays and controllers shown is merely illustrative; any number of displays and controllers can be used depending on actual needs. This disclosure does not limit the number of displays and controllers.

[0092] Under the above system architecture, this disclosure provides a display method that can be executed by any electronic device with computing power.

[0093] The color separation phenomenon in field sequence display, from the perspective of visual characteristics, is mainly due to imperfect visual stability, that is, different subfields are imaged at different positions on the retina during eye movement, which leads to the eye perceiving a color separation area formed by misaligned color patterns caused by the superposition of multiple subfield colors at the edge of the displayed target.

[0094] Color separation region width (CBU) on the retina width Related to eye movement speed ω, human eye diameter D, refresh rate RF, and target width T width The relationship between the color separation region width and the above parameters is related to the parameters, which is expressed as CBU. width =f(k,RF,ω,D,T) width ), where f() is a functional relationship, k is a correction coefficient, representing the correction part of the perceived position of the object based on the eye position in visual perception, the correction coefficient is a variable parameter, and the target width T width This refers to the size of the displayed target (or test target) in the direction of eye movement, measured in pixels. In a fixed display scenario, the correction factor is usually a fixed value, the refresh rate (RF) is a property of the display device and is usually a fixed value, and the diameter (D) of the human eye for the same user is also fixed. Therefore, the overall reflection of the color separation degree is through the width of the color separation area and the color of the chromatic aberration. In a typical field sequence display, the number of subfields is usually three, and the colors of the three subfields are red, green, and blue. That is, the subfields constituting the field sequence display include red subfield, green subfield, and blue subfield. At this time, the color separation degree mainly depends on the width of the color separation area. Different widths of the color separation area correspond to different degrees of color separation, and the corresponding degree of displacement compensation also varies.

[0095] Existing research has found that there is currently no particularly effective method to solve the color separation problem. For example, some methods for reducing subfield saturation are only effective for images with a small color gamut distribution; there is also a stencil algorithm based on four subfields, which performs poorly when the image has high contrast, and due to the additional subfield, it loses 25% of the video information in the same amount of time.

[0096] Figure 2 This diagram illustrates a display method according to an embodiment of the present disclosure, such as... Figure 2 As shown, the display method provided in this embodiment includes the following steps:

[0097] Step S202: Based on the eye movement speed information obtained from the displayed target in the observation field sequence display, determine the width of the color separation region located at the edge of the displayed target;

[0098] Step S204: Determine the offset of multiple subfields constituting the field sequence display based on the width of the color separation region;

[0099] Step S206: Perform displacement compensation on the image frame to be displayed according to the offset of multiple subfields, and determine the image frame to be displayed after displacement compensation;

[0100] Step S208: Render and display the image frame to be displayed after displacement compensation.

[0101] In field-sequence displays, the severity of color separation primarily depends on the width of the color separation region. Different widths of the color separation region correspond to different degrees of color separation. This disclosure determines the width of the color separation region located at the edge of the display target by obtaining eye movement speed information based on the observed display target in the field-sequence display, establishing a continuous relationship between eye movement speed and the width of the color separation region. Since the field-sequence display consists of multiple subfields, the offset of multiple subfields in the field-sequence display is determined based on the width of the color separation region. The image frame to be displayed is then displacement-compensated according to the offset of the multiple subfields in the field-sequence display. By compensating the color separation region through displacement compensation, a displacement-compensated image frame to be displayed is obtained, achieving the effect of eliminating color separation without affecting the display effect. The dynamic compensation method of the embodiment of this disclosure, which follows eye movement speed information to perform displacement compensation on the image frame to be displayed, can be applied to any type of field-sequence display image content. Depending on the degree of color separation under different eye movement speeds, the corresponding color separation suppression processing is different, effectively solving the impact of insufficient or excessive color separation suppression on the visual effect in field-sequence displays.

[0102] Figure 3 This illustration shows a process for determining the width of the color separation region located at the edge of the display target in an embodiment of this disclosure, as shown below. Figure 3 As shown in the embodiment, determining the width of the color separation region located at the edge of the display target based on eye movement velocity information obtained from the display target in the observation field sequence display includes:

[0103] Step S302: Collect eye image information when the target is displayed in the observation field sequence display, and determine the eye movement velocity information of the target displayed in the eye observation field sequence display;

[0104] Step S304: Determine the width of the color separation region located at the edge of the display target based on eye movement speed information.

[0105] The eye-tracking target is located in the image frames of the field-sequence display. The image frames are displayed according to the refresh rate to form a dynamic video. When the user's eyes observe the displayed target in the field-sequence display, the user's eyes can follow the movement of the eye-tracking target. The eye image data can be collected by the eye tracker and analyzed to determine the eye movement speed information of the displayed target in the field-sequence display. Based on the above eye movement speed information of the displayed target in the field-sequence display, the width of the color separation region located at the edge of the displayed target is calculated.

[0106] Figure 4 This illustration shows a process for determining the eye movement velocity information of the display target in the eye observation field sequence display in an embodiment of the present disclosure, such as... Figure 4 As shown, in this embodiment, acquiring eye image information when displaying a target in the observation field sequence display, and determining the eye movement velocity information of the displayed target in the eye observation field sequence display, includes:

[0107] Step S402: Collect eye image information of the target displayed in the observation field sequence display, identify the pupil region in the eye image information, and determine the pupil position at the current time;

[0108] Step S404: Based on the current pupil position, calculate the multiple trajectory changes of the pupil in the next time period;

[0109] Step S406: Connect the multiple trajectory changes of the pupil in the next time period to form a line and determine the eye movement trajectory in the next time period;

[0110] Step S408: Based on the physical model of the eyeball and the eye movement trajectory of the next time period, determine the eye movement velocity information for the next time period. The eye movement velocity information includes: eye movement rate value and eye movement velocity direction.

[0111] When a user's eyes observe a target displayed in a sequence display, an eye tracker collects eye image information at that moment. An image recognition algorithm identifies the pupil region within the eye image information, locating the pupil's position at the current instant. Based on the current pupil position, a Kalman filter-based motion trajectory prediction algorithm calculates multiple trajectory changes of the pupil within the next time period. After obtaining these multiple trajectory changes, they are smoothly connected in chronological order to form a curve, determining the eye movement trajectory for the next time period. A general eye physics model is obtained, and combined with the eye movement trajectory for the next time period, the eye movement trajectory is imported into the eye physics model to obtain the eye movement length and direction. Dividing the eye movement length by the duration of the next time period yields the eye movement rate value. This eye movement rate value and direction are then used to determine the eye movement velocity information for the next time period.

[0112] Eye movement types are mainly divided into five categories: fixation, convergence, tracking, vestibular movement, and saccades. Among them, fixation does not involve color separation, while color separation is observed in convergence, tracking, vestibular movement, and saccades when the eye movement speed reaches a certain value. Moreover, the higher the eye movement speed, the more significant the color separation becomes, until it approaches saturation. When color separation reaches saturation, the width of the color separation region reaches its maximum value. When the eye movement speed increases further, the width of the color separation region will only remain at its maximum value. The corresponding values ​​of the eye movement speeds in which color separation is observed change with the refresh rate. For convergent, tracking, and vestibular eye movements, the eye tracks a moving target. During this tracking, the eye typically follows the target smoothly and uniformly at a fixed velocity. When the eye movement velocity reaches a certain value, a stable color-separated region is observed at the edge of the target, with its width increasing as the eye movement velocity increases. Therefore, for convergent, tracking, and vestibular eye movements, the eye movement velocity information for the next time period is constant; that is, both the eye movement rate and direction are fixed. In this case, the eye movement velocity is typically 0-60° / s (degrees per second). For saccadic eye movements, the eye actively changes its fixation point, jumping from one target to another. This is a process of initial acceleration followed by deceleration, with an average velocity greater than 200° / s (degrees per second) and a duration between 10ms and 100ms. Due to its rapid velocity change and short duration, the calculated and predicted eye movement velocity information for the next time period is usually variable. To achieve rapid compensation of color separation areas, the next time interval in this case is typically the display duration of the next image frame. For example, when the display frame rate is 60Hz, the display duration of one image frame is approximately 16.67 milliseconds, so the next time interval is 16.67 milliseconds. Calculating the eye's trajectory during these 16.67 milliseconds and dividing it by 16.67 milliseconds yields the eye movement rate value in the eye movement velocity information. The aforementioned 60Hz display frame rate is converted to a field-sequence display refresh rate of 180Hz in a field-sequence display device with three subfields. The eye movement velocity direction is the direction formed by the line connecting the second-to-last trajectory change position to the last trajectory change position among the multiple trajectory change positions of the pupil.

[0113] In this embodiment, determining the width of the color separation region located at the edge of the display target based on eye movement speed information includes: inputting eye movement speed information into the relationship function between eye movement speed and color separation region width to determine the width of the color separation region located at the edge of the display target.

[0114] Different color separation region widths correspond to different eye movement velocities. The relationship function between eye movement velocity and color separation region width characterizes the continuous relationship between eye movement velocity and color separation region width. Using this continuous relationship, after measuring and calculating the eye movement velocity, the color separation region width of the displayed target can be calculated by inputting it into the relationship function between eye movement velocity and color separation region width, thereby quickly performing displacement compensation.

[0115] Figure 5 This diagram illustrates the process of constructing the function relating eye movement velocity and color separation region width in an embodiment of this disclosure, as shown below. Figure 5 As shown in the embodiment, the process of constructing the relationship function between eye movement speed and color separation region width includes:

[0116] Step S502: Set the eyeball diameter, test target width and field sequence display device refresh rate to fixed values, use eye movement speed as a control variable, and establish a function formula for calculating the eye movement speed and color separation region width. The function formula for calculating the eye movement speed and color separation region width includes fitting parameters. Eye movement speed, eyeball diameter, test target width and field sequence display device refresh rate are control parameters related to the color separation region width.

[0117] Step S504: According to the set initial value of the test step length, move the test target on the field sequence display device at a uniform speed according to the test rate, and obtain the width of the test color separation area located at the edge of the test target;

[0118] Step S506: Determine the test eye movement speed based on the test rate;

[0119] Step S508: Gradually increase the test step size to gradually reduce the width of the test color separation region until the width of the test color separation region is zero. Then, determine the current test step size as the subfield compensation displacement corresponding to the test eye movement speed. The test step size is increased in pixels.

[0120] Step S5010: Based on the tested eye movement velocity and subfield compensation displacement, fit the fitting parameters of the function formula for calculating the eye movement velocity and color separation region width to determine the relationship function between eye movement velocity and color separation region width.

[0121] The process of constructing the relationship function between eye movement speed and color separation region width involves conducting color separation region width tests at different eye movement speeds. Control parameters related to color separation region width include: eye movement speed ω, human eye diameter D, refresh rate RF, and target width T. width wait.

[0122] Refresh rate is a fundamental parameter of field-sequence display devices. The refresh rate of a field-sequence display device can be directly obtained, so it's set to a fixed value. For example, if a field-sequence display device has a refresh rate of 480Hz, then its refresh rate is set to 480Hz. The diameter of the human eye, as a parameter related to human eye characteristics, is statistically analyzed by ignoring individual differences and taking the mode as a fixed value. For example, the fixed value of the human eye diameter is set to 24 millimeters. When testing, the target is used as the test target, and the target width corresponds to the test target width. Based on human eye characteristics, the fixed value of the test target width is set to 10 pixels. At this point, the eye movement speed is the dynamically changing control parameter related to the color separation region width. Therefore, the color separation region and eye movement speed have a corresponding relationship. Using the controlled variable method, the color separation region width is used as the calculation target, and eye movement speed is used as the control variable. The controlled variable method is applied based on the expression CBU of the color separation region width. width =f(k,RF,ω,D,T) width Establish a function formula for calculating eye movement velocity and color separation region width (CBU). width =Aω 2 +Bω+C, where CBU widthLet ω be the width of the color separation region, A, B, and C be the eye movement velocity, and A, B, and C be the fitting parameters. Since the fitting parameters are unknowns, a series of subsequent calculations are needed to determine their values, leading to the specific function relating eye movement velocity and color separation region width. Because the test target is displayed on a field-sequence display device, the test rate of the test target needs to be converted into the test eye movement velocity. The experimental environment involves placing an image acquisition device at a certain distance in front of the color separation display device, simulating the user's eye. The image acquisition device rotates to follow the test target moving at the test rate, keeping its center aligned with the moving test target. To control the color separation region width, an initial value for the test step size needs to be set. For example, to ensure accuracy, the initial test step size is set to 1 pixel. Then, the test target is moved uniformly on the field-sequence display device at the test rate, and the width of the test color separation region located at the edge of the test target is obtained. Typically, a test step size of 1 pixel is insufficient to directly compensate for the color separation region. Therefore, the test step size needs to be gradually increased by 1 pixel each time to progressively reduce the width of the color separation region until it reaches zero. The number of pixels corresponding to the current test step size is then determined as the subfield compensation displacement corresponding to the tested eye movement speed. Finally, the fitting parameters of the function calculating the eye movement speed versus color separation region width are fitted based on the tested eye movement speed and the corresponding subfield compensation displacement to determine the relationship function between eye movement speed and color separation region width. The fitting parameters A, B, and C in the aforementioned relationship function between eye movement speed and color separation region width have been obtained through fitting and can be directly calculated by substituting them into the relationship function after obtaining real-time eye movement speed information, thus achieving rapid calculation of the color separation region width.

[0123] Figure 6 This illustration shows a schematic diagram of the process for obtaining the width of the test color separation region located at the edge of the test target in an embodiment of this disclosure, as shown below. Figure 6 As shown in the embodiment, according to the set initial test step size, the test target is moved at a constant speed on the field sequence display device according to the test rate, and the width of the test color separation area located at the edge of the test target is obtained, including:

[0124] Step S602: Determine the display time difference between multiple sub-fields constituting the field sequence display based on the refresh frequency of the field sequence display device, which is set to a fixed value;

[0125] Step S604: Determine the positional relationship between the multiple subfields and the test target based on the display time difference and test rate between the multiple subfields that constitute the field sequence display;

[0126] Step S606: According to the set initial value of the test step size and the positional relationship between multiple subfields and the test target, perform displacement compensation on the test image frame displaying the test target, and determine the compensated test image frame;

[0127] Step S608: Render and display the compensated test image frame so that the test target moves at a constant speed on the field sequence display device according to the test rate, and obtain the width of the test color separation area located at the edge of the test target.

[0128] Field-sequence display devices typically have high refresh rates. Taking the common red, green, and blue three-subfield field-sequence display as an example, the display of one frame of an image is formed by the sequential refresh of the red, green, and blue subfields, that is, one frame of an image is formed by three refreshes. When the refresh rate of the field-sequence display device is 480Hz, the refresh duration of the red subfield is 1 / 480 ≈ 2.08 milliseconds, the refresh duration of the green subfield is 1 / 480 ≈ 2.08 milliseconds, and the refresh duration of the blue subfield is 1 / 480 ≈ 2.08 milliseconds. Correspondingly, at the refresh rate of the field-sequence display device, its display frame rate is the ratio of the refresh rate to the number of subfields. For example, the display frame rate PFS of the above-mentioned 480Hz refresh rate field-sequence display device is 480Hz / 3 = 160Hz, and the display duration of one frame of an image is approximately 6.24 milliseconds. As shown above, each subfield has the same display duration. Since the arrangement of the subfields is also fixed, each subfield has a fixed and equal time difference in the display time sequence. For example, the display time difference between the red subfield and the green subfield is 2.08 milliseconds, the display time difference between the red subfield and the blue subfield is 4.16 milliseconds, and the display time difference between the green subfield and the blue subfield is 2.08 milliseconds. Therefore, the display time difference between the multiple subfields that constitute multiple field sequence displays can be determined according to the refresh rate of the field sequence display device. Furthermore, when the eye movement speed is a certain fixed value, the positional relationship of the red, green, and blue subfields during eye movement is related to the display time difference. By converting the test rate into the corresponding test eye movement speed and combining it with the display time difference between the multiple subfields constituting the field sequence display, the positional relationship between the multiple subfields and the test target can be obtained. Taking the field sequence display composed of red, green, and blue subfields as an example, when the arrangement order of the red, green, and blue subfields is RGB, the specific positional relationship at the edge of the test target is as follows: at the edge of the test target, the blue subfield is adjacent to the test target, the green subfield is adjacent to the blue subfield in the direction away from the test target, and the red subfield is adjacent to the green subfield in the direction away from the test target. That is, from the edge of the test target outwards, the subfields are blue, green, and red. Then the distance between the red, green, and blue subfields and the test target is red subfield: green subfield: blue subfield = 3:2:1.

[0129] During the initial test, the relationship between eye movement speed and color separation region width cannot be determined. Therefore, a test step size needs to be set, measured in pixels. For more accurate test results, the initial test step size is set to 1 pixel. Combining the positional relationship between multiple subfields and the test target, displacement compensation is applied to the test image displaying the test target to obtain the compensated test image frame. Specifically, taking the field sequence display composed of red, green, and blue subfields as an example, based on the positional relationship of blue, green, and red subfields outward from the edge of the test target, the blue subfield is compensated by 1 pixel in the opposite direction to the test speed, the green subfield by 2 pixels in the opposite direction to the test speed, and the red subfield by 3 pixels in the opposite direction to the test speed. This displacement compensation of the entire test image frame yields the compensated test image frame. The test target is typically a white strip with a certain width, such as a white strip 600 pixels long and 200 pixels wide. The white strip moves along its width. An xy coordinate system is established, with the movement direction being the x-direction. The original display position of the blue subfield is (1,1), the original display position of the green subfield is (1,2), and the original display position of the red subfield is (1,3). With an initial test step size of 1 pixel, the displacement compensation display positions for the blue subfield are (1,4), the displacement compensation display positions for the green subfield are (1,5), and the displacement compensation display positions for the red subfield are (1,6). Displaying the original display position information at these displacement compensation display positions yields the corresponding compensated test image frame. The compensated test image frame is rendered and displayed. Multiple test image frames are displayed in a display sequence to form a dynamic image. This dynamic image is displayed on a field-sequence display device, causing the test target to move uniformly at the test rate on the field-sequence display device. The width of the test color separation region located at the edge of the test target is obtained through an image acquisition device.

[0130] Figure 7 This illustration shows a schematic diagram of the process for determining the test eye movement speed in an embodiment of this disclosure, such as... Figure 7 As shown in the embodiment, determining the test eye movement speed based on the test rate includes:

[0131] Step S702: Obtain the field of view, observation distance, lens magnification, and pixel size of the field sequence display device;

[0132] Step S704: Determine the display position of the test target in the test image frame based on the test rate;

[0133] Step S706: Determine the test eye movement speed based on the display position of the test target in the test image frame, the field of view of the field sequence display device, the observation distance, the lens magnification and pixel size, and the refresh rate of the field sequence display device set to a fixed value.

[0134] Since the image acquisition device simulates the user's eye to observe the moving test target, the test rate of the test target's reciprocating motion on the field-sequence display device is known. However, when converting the eye-tracking velocity, more calculation parameters are needed, such as the field of view of the field-sequence display device, observation distance, lens magnification, and pixel size. Because the display position of the test target in the isomorphic image moves with the test rate, the display position of the test target in the test image frame of the dynamic image can be obtained based on the test rate. The eye-tracking velocity is determined using a function calculation formula based on the display position of the test target in the test image frame, the field of view of the field-sequence display device, observation distance, lens magnification, pixel size, and the refresh rate of the field-sequence display device (set to a fixed value). Specifically, the function calculation formula ω... eye =h(P n The eye movement velocity is calculated using ω(FOV, d, RF, β, pitch), where ω eye To test eye movement speed, h() is a functional relationship, P n The display position of the test target in the nth test image frame is defined by FOV, d is the field of view of the field sequence display device, RF is the refresh rate of the field sequence display device, β is the lens magnification, which is used to control the lens magnification when there is a lens in front of the screen of the field sequence display device, and pitch is the pixel size.

[0135] Figure 8 This illustration shows a schematic diagram of the process for determining the subfield compensation displacement corresponding to the test eye movement velocity in an embodiment of this disclosure, such as... Figure 8 As shown, in this embodiment, the test step size is gradually increased to gradually reduce the width of the test color separation region until the width of the test color separation region is zero. Then, the current test step size is determined as the subfield compensation displacement corresponding to the test eye movement velocity, including:

[0136] Step S802: Update the test step size by increasing the test step size from the initial value in pixels;

[0137] Step S804: Obtain the width of the corresponding test color separation region based on the updated test step size;

[0138] Step S806: Gradually increase the test step size to gradually reduce the width of the corresponding test color separation region until the width of the test color separation region is zero. Then, determine the number of pixels of the currently updated test step size as the subfield compensation displacement corresponding to the test eye movement speed.

[0139] Normally, color separation still exists when the initial test step size is 1 pixel. To suppress color separation, the test step size needs to be gradually increased. Starting from the initial value of 1 pixel, the test step size is increased by 1 pixel each time to update the test step size. For example, in the first update of the test step size, the test step size is 2 pixels. Based on the first updated test step size, the above steps S602-S608 are executed to obtain the width of the test color separation region corresponding to the test step size of 2 pixels. At this time, the width of the test color separation region is reduced relative to the initial value of the test step size. In order to completely suppress color separation, the test step size needs to be gradually increased so that the width of the corresponding test color separation region gradually decreases until the width of the test color separation region is zero. Then, the number of pixels of the currently updated test step size is determined as the subfield compensation displacement corresponding to the test eye movement speed. In one example, when the test step size is updated to 20 pixels, the width of the test color separation region is not yet zero, and color separation can still be observed. When the test step size is updated to 21 pixels, the width of the test color separation region is zero, and color separation can no longer be observed. Therefore, the 21-pixel test step size is determined as the subfield compensation displacement corresponding to the eye movement velocity test. This subfield compensation displacement refers to the displacement distance of the subfield closest to the test target. Taking the distances between the red, green, and blue subfields and the test target as follows (red:green:blue = 3:2:1), the blue subfield is the closest to the test target. The subfield compensation displacement obtained above is 21 pixels for the blue subfield, 21 × 2 = 42 pixels for the green subfield, and 21 × 3 = 63 pixels for the red subfield.

[0140] Figure 9 This illustration shows a schematic diagram of the process for determining the relationship function between eye movement speed and color separation region width in an embodiment of this disclosure, such as... Figure 9 As shown, in this embodiment, based on the tested eye movement velocity and subfield compensation displacement, the fitting parameters of the function formula for calculating the eye movement velocity and color separation region width are fitted to determine the relationship function between eye movement velocity and color separation region width, including:

[0141] Step S902: Associate the eye-tracking velocity and the corresponding subfield compensation displacement into an array to complete a set of tests;

[0142] Step S904: Change the test rate of the test target to perform multiple sets of tests, and determine multiple sets of arrays;

[0143] Step S906: Substitute multiple sets of arrays into the function formula for calculating eye movement speed and color separation region width to perform quadratic polynomial fitting, and determine the values ​​of the fitting parameters;

[0144] Step S908: Substitute the values ​​of the fitting parameters into the formula for calculating the eye movement speed and color separation region width to determine the relationship function between eye movement speed and color separation region width.

[0145] Based on the eye movement velocity (EMV) and corresponding subfield compensation displacement obtained from the test, an array is created by associating an EMV with a specific value with its corresponding subfield compensation displacement. This completes one set of tests. This array represents the fixed value of the subfield compensation displacement when the EMV reaches that specific value, assuming the eye diameter, test target width, and field sequence display device refresh rate are set to fixed values. The test rate of the test target is changed, and the test step size is reset to 1 pixel. Steps S602-S608, S702-S706, and S802-S806 are executed to perform multiple sets of tests, resulting in multiple arrays. Each array has a different test rate and includes both the test rate and the corresponding subfield compensation displacement. These multiple arrays are then substituted into the eye movement velocity and color separation region width function CBU. width =Aω 2 A quadratic polynomial fitting is performed using +Bω+C to determine the values ​​of the fitting parameters A, B, and C. Specifically, the test eye movement velocity of each array is substituted into ω in the function formula for calculating the eye movement velocity versus color separation region width, and the subfield compensation displacement corresponding to the test eye movement velocity is substituted into CBU in the function formula for calculating the eye movement velocity versus color separation region width. width By performing a quadratic polynomial fitting, the specific values ​​of the fitting parameters can be calculated. Substituting these values ​​into the formula for calculating the relationship between eye movement speed and color separation region width, the relationship function between eye movement speed and color separation region width is determined. Since the values ​​of the fitting parameters A, B, and C vary considerably, specific values ​​are not provided in this embodiment. In practical implementation, the specific values ​​of the fitting parameters A, B, and C can be obtained by referring to the construction process of the relationship function between eye movement speed and color separation region width in this embodiment.

[0146] By conducting color separation region width tests at different eye movement speeds, a function relating eye movement speed and color separation region width at a fixed refresh rate was obtained. When the field-sequence display device has only one fixed refresh rate, the above process of constructing the relationship function between eye movement speed and color separation region width can be performed once. When the display device has multiple refresh rates, it is necessary to conduct color separation region width tests at different eye movement speeds for each of these refresh rates to obtain the relationship function between eye movement speed and color separation region width for that refresh rate. This establishes a correspondence between refresh rate and the relationship function, ultimately resulting in multiple sets of relationship functions between eye movement speed and color separation region width for multiple refresh rates.

[0147] Figure 10This illustration shows a schematic diagram of the process for determining the offsets of multiple subfields constituting the field sequence display in an embodiment of this disclosure, such as... Figure 10 As shown, in this embodiment, the offset of multiple sub-fields constituting the field sequence display is determined based on the width of the color separation region, including:

[0148] Step S1002: Based on the refresh rate of the field sequence display device, determine the display time difference between multiple sub-fields constituting the field sequence display;

[0149] Step S1004: Determine the positional relationship between the multiple subfields and the display target based on the display time difference and eye movement speed information between the multiple subfields that constitute the field sequence display;

[0150] Step S1006: Determine the offset of the multiple subfields constituting the field sequence display based on the positional relationship between the multiple subfields and the display target and the width of the color separation area.

[0151] The multiple subfields constituting a field-sequence display have a fixed and equal time difference in their display time sequence. This display time difference is determined by the refresh rate of the field-sequence display device. For example, in a red, green, and blue three-subfield field-sequence display device with a refresh rate of 480Hz, the refresh duration of the red subfield is approximately 1 / 480 ≈ 2.08 milliseconds, the refresh duration of the green subfield is approximately 1 / 480 ≈ 2.08 milliseconds, and the refresh duration of the blue subfield is approximately 1 / 480 ≈ 2.08 milliseconds. Each subfield has an equal display duration. Based on the fixed arrangement order of the subfields, each subfield has a fixed and equal time difference in its display time sequence. The display time difference between the red and green subfields is 2.08 milliseconds, the display time difference between the red and blue subfields is 4.16 milliseconds, and the display time difference between the green and blue subfields is 2.08 milliseconds. Therefore, the display time difference between the multiple subfields constituting multiple field-sequence displays can be determined based on the refresh rate of the field-sequence display device. When the eye movement speed is a certain fixed value, the positional relationship of the red, green and blue subfields during eye movement is related to the display time difference. The eye movement rate value is extracted from the eye movement speed information obtained above. Combined with the display time difference between the multiple subfields that constitute the field sequence display, the positional relationship between the multiple subfields and the display target is obtained. Based on the positional relationship between the multiple subfields and the display target and the width of the color separation region, the offset of the multiple subfields that constitute the field sequence display is determined.

[0152] In this embodiment, when the multiple subfields constituting the field sequence display are a first subfield, a second subfield, and a third subfield, the display time difference between the first subfield, the second subfield, and the third subfield is fixed. The positional relationship between the multiple subfields and the display target is that the first subfield, the second subfield, and the third subfield are sequentially closer to the edge of the display target, with the third subfield being adjacent to the display target. An xy coordinate system is established with the display target as the origin. Taking the case where a color separation region is located to the left of the display target as an example, the display target is located at the origin, with coordinates (0,0). The third subfield is adjacent to the display target, so the coordinates of the third subfield are (-1,0). If the second subfield is located in a direction away from the display target and immediately adjacent to the third subfield, then the coordinates of the second subfield are (-2, 0). If the first subfield is located in a direction away from the display target and immediately adjacent to the second subfield, then the coordinates of the first subfield are (-3, 0). Therefore, the distance relationship between the first, second, and third subfields and the display target is: First subfield: Second subfield: Third subfield = 3:2:1. When the first subfield is red, the second subfield is green, and the third subfield is blue, the distance relationship between the red, green, and blue subfields and the display target is: Red subfield: Green subfield: Blue subfield = 3:2:1.

[0153] Based on the positional relationship between multiple subfields and the display target and the width of the color separation region, the offset of multiple subfields constituting the field sequence display is determined, including: based on the positional relationship between multiple subfields and the display target and the width of the color separation region, the offset of the first subfield is determined to be three times the width of the color separation region, the offset of the second subfield is determined to be twice the width of the color separation region, and the offset of the first subfield is equal to the width of the color separation region.

[0154] Based on the positional relationship between the multiple subfields and the display target as "First subfield: Second subfield: Third subfield = 3:2:1", then the offset of the first subfield, Shift1, = 3 × CBU. width The offset of the second subfield, Shift2, is 2 × CBU. width The offset of the third subfield, Shift3, is 1 × CBU. width ;

[0155] Figure 11 This illustration shows a schematic diagram of color separation phenomena under different subfield color ordering and different eye movement directions in embodiments of this disclosure, such as... Figure 11 As shown, the red, green, and blue subfields are a common field order display configuration. Under different subfield arrangement structures, the colors and arrangement order of the patterns differ depending on the eye movement speed direction. Taking a white bar W as the display target, when the width of the white bar is greater than the first threshold, color separation occurs on both sides of the white bar in the eye movement speed direction and in the opposite direction, resulting in patterns of different colors. These color separation phenomena are mainly divided into three types: (a), (b), and (c).

[0156] For example, in Figure 11 (a) Type (a) color separation phenomenon: When the red, green, and blue subfields are arranged in the order RGB, and the eye movement direction is to the right, a color separation region consisting of cyan (C) and blue (B) patterns appears on the left side of the white bar W, while a color separation region consisting of yellow (Y) and red (R) patterns appears on the right side of the white bar W. The cyan (C) mentioned above is composed of blue (B) and green (G), and the yellow (Y) mentioned above is composed of red (R) and green (G). Furthermore, when the red, green, and blue subfields are arranged in the order BGR, and the eye movement direction is to the left, the same phenomenon occurs. Figure 7 (a) color separation phenomenon.

[0157] exist Figure 11 (b) Type (a) color separation phenomenon occurs when the red, green, and blue subfields are arranged in the order of blue-red-green (BRG), and the eye movement direction is to the right. On the left side of the white bar W, a color separation region composed of yellow (Y) and green (G) patterns appears, while on the right side of the white bar W, a color separation region composed of magenta (M) and blue (B) patterns appears. The magenta (M) pattern is formed by superimposing red (R) and blue (B), and the yellow (Y) pattern is formed by superimposing red (R) and green (G). Furthermore, when the red, green, and blue subfields are arranged in the order of green-red-blue (GRB), and the eye movement direction is to the left, the same phenomenon occurs. Figure 7 (b) Color separation phenomenon.

[0158] exist Figure 11 (c) Type (c) color separation phenomenon occurs when the red, green, and blue subfields are arranged in the order of green-blue-red (GBR), and the eye movement direction is to the right. On the left side of the white bar W, a color separation region composed of magenta (M) and red (R) patterns appears, while on the right side of the white bar W, a color separation region composed of cyan (C) and green (G) patterns appears. The magenta (M) is formed by superimposing red (R) and blue (B), and the cyan (C) is formed by superimposing blue (B) and green (G). Furthermore, when the red, green, and blue subfields are arranged in the order of red-blue-green (RBG), and the eye movement direction is to the left, the same phenomenon occurs. Figure 7 (c) color separation phenomenon.

[0159] When the width of the white strip is less than the first threshold, color separation will occur on one side of the white strip in the direction of eye movement velocity, resulting in a color separation region composed of different colored patterns. This first threshold varies with the refresh rate and viewing distance. For example, at a refresh rate of 90Hz and a viewing distance of 20cm, the first threshold is 10 pixels.

[0160] In this embodiment, the process of performing displacement compensation on the image frame to be displayed according to the offset of multiple subfields to determine the image frame to be displayed after displacement compensation includes: performing displacement compensation on the subfield of each pixel of the image frame to be displayed according to the offset of multiple subfields in the opposite direction to the eye movement velocity direction of the eye movement velocity information to determine the image frame to be displayed after displacement compensation, wherein each pixel of the image frame to be displayed corresponds to multiple subfields.

[0161] When each pixel of the image frame to be displayed corresponds to a first subfield, a second subfield, and a third subfield, the offset of the first subfield, Shift1 = 3 × CBU, is used. width The offset of the second subfield, Shift2, is equal to 2 × CBU. width The offset of the third subfield, Shift3, is 1 × CBU. width For each pixel of the image frame to be displayed, the first subfield, the second subfield, and the third subfield are compensated for displacement in the opposite direction to the eye movement speed information. Specifically, the first subfield is compensated for displacement by three times the width of the color separation region, the second subfield is compensated for displacement by two times the width of the color separation region, and the third subfield is compensated for displacement by one width of the color separation region.

[0162] Figure 12 This diagram illustrates the subfield displacement compensation process in an embodiment of the present disclosure, as shown below. Figure 12 As shown in the embodiment, the image frame to be displayed has a white stripe W representing the display target. When the eye movement direction is to the left, a color separation phenomenon will form on one side of the white stripe in the eye movement direction before compensation. The color separation phenomenon is formed by the superposition of the red subfield R, the green subfield G, and the blue subfield B. When performing displacement compensation on the image frame to be displayed, the offset of the red subfield R is 3×CBU. width The offset of the green subfield G is 2×CBU. width The offset of blue subfield B is 1×CBU. width After the above displacement compensation, a displacement-compensated image frame to be displayed is obtained. This displacement-compensated image frame will have blank pixel areas on one side of the eye movement direction. If there is no other display content, black pixels are added. On the opposite side of the eye movement direction, there will be overflow; the overflowing portion is then cropped to ensure that the displacement-compensated image frame maintains the same size as the initial image frame. By performing displacement compensation on multiple subfields according to different eye movement speeds, the imaging position of each subfield on the retina is adjusted, thereby eliminating color separation. In this embodiment, the color separation area presented on the retina is compensated by subfield displacement in the opposite direction, achieving the elimination of color separation. Finally, the displacement-compensated image frame is rendered and displayed on a field-sequence display device. The displacement-compensated image frame has compensated the width of the color separation area to zero, thereby suppressing color separation.

[0163] The displacement compensation method proposed in this invention, which dynamically adjusts the target subfield position according to eye movement speed, is applicable to any image content and can completely eliminate color separation. The eye movement speed ranges from a minimum of 0° / s to a maximum of 1000° / s. Eye movement types can be categorized into five main types: fixation, convergence, tracking, vestibular movement, and saccades. Fixation does not involve color separation, while the other four types exhibit color separation at certain speeds (these values ​​vary depending on the refresh rate), with the separation becoming more pronounced with increasing eye movement speed until it approaches saturation. This invention combines eye-tracking technology to perform corresponding motion compensation based on the varying degrees of color separation caused by different eye movement speeds, achieving the elimination of color separation without affecting display quality. Based on the different degrees of color separation at different eye movement speeds, different color separation suppression processes are applied. This invention proposes a dynamic motion compensation method adapted to different eye movement speeds. By combining eye-tracking technology, color separation suppression is performed when the eye movement speed exceeds the visible color separation threshold, establishing a dynamic relationship between eye movement speed and suppression processing. It effectively solves the problem of insufficient or excessive color separation suppression affecting visual effects in field-sequence liquid crystal displays.

[0164] It should be noted that the acquisition, storage, use, and processing of data in this disclosed technical solution comply with the relevant provisions of national laws and regulations. The various types of data, such as personal identity data, operational data, and behavioral data related to individuals, customers, and groups, obtained in the embodiments of this disclosure have all been authorized.

[0165] Based on the same inventive concept, this disclosure also provides a display device, as shown in the following embodiments. Since the principle by which this device embodiment solves the problem is similar to that of the above-described method embodiments, the implementation of this device embodiment can refer to the implementation of the above-described method embodiments, and repeated details will not be elaborated further.

[0166] Figure 13 This diagram illustrates a display device according to an embodiment of the present disclosure, such as... Figure 13 As shown, the device includes:

[0167] The color separation region width determination module 1301 is used to determine the width of the color separation region located at the edge of the display target based on the eye movement speed information obtained from the display target in the observation field sequence display.

[0168] The subfield offset determination module 1302 is used to determine the offset of multiple subfields constituting the field sequence display based on the width of the color separation region.

[0169] The displacement-compensated image frame determination module 1303 is used to perform displacement compensation on the image frame to be displayed according to the offset of multiple subfields, and determine the displacement-compensated image frame to be displayed.

[0170] The rendering and display module 1304 is used to render and display the image frame to be displayed after displacement compensation.

[0171] It should be noted that the color separation region width determination module 1301, subfield offset determination module 1302, displacement-compensated image frame determination module 1303, and rendering display module 1304 correspond to S202 to S208 in the method embodiment. These modules and their corresponding steps implement the same examples and application scenarios, but are not limited to the content disclosed in the above method embodiment. It should also be noted that these modules, as part of the apparatus, can be executed in a computer system, such as a set of computer-executable instructions.

[0172] Those skilled in the art will understand that various aspects of this disclosure can be implemented as a system, method, or program product. Therefore, various aspects of this disclosure can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, collectively referred to herein as a "circuit," "module," or "system."

[0173] The following reference Figure 14 To describe an electronic device 1400 according to such an embodiment of the present disclosure. Figure 14 The electronic device 1400 shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.

[0174] like Figure 14 As shown, the electronic device 1400 is manifested in the form of a general-purpose computing device. The components of the electronic device 1400 may include, but are not limited to: at least one processing unit 1410, at least one storage unit 1420, and a bus 1430 connecting different system components (including storage unit 1420 and processing unit 1410).

[0175] The storage unit stores program code that can be executed by the processing unit 1410, causing the processing unit 1410 to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure. For example, the processing unit 1410 can perform the following steps of the above method embodiment: determining the width of the color separation region located at the edge of the display target based on eye movement velocity information obtained from the display target in the field sequence display; determining the offset of multiple subfields constituting the field sequence display based on the width of the color separation region; performing displacement compensation on the image frame to be displayed according to the offset of the multiple subfields to determine the displacement-compensated image frame to be displayed; and rendering and displaying the displacement-compensated image frame to be displayed.

[0176] Storage unit 1420 may include readable media in the form of volatile storage units, such as random access memory (RAM) 14201 and / or cache memory 14202, and may further include read-only memory (ROM) 14203.

[0177] Storage unit 1420 may also include a program / utility 14204 having a set (at least one) of program modules 14205, such program modules 14205 including but not limited to: operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.

[0178] Bus 1430 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0179] Electronic device 1400 can also communicate with one or more external devices 1440 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with electronic device 1400, and / or with any device that enables electronic device 1400 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 1450. Furthermore, electronic device 1400 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 1460. As shown, network adapter 1460 communicates with other modules of electronic device 1400 via bus 1430. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 1400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0180] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the methods according to the embodiments of this disclosure.

[0181] In particular, according to embodiments of this disclosure, the process described above with reference to the flowchart can be implemented as a computer program product, which includes a computer program that, when executed by a processor, implements the above-described display method.

[0182] In exemplary embodiments of this disclosure, a computer-readable storage medium is also provided, which may be a readable signal medium or a readable storage medium. A program product capable of implementing the methods described above is stored thereon. In some possible implementations, various aspects of this disclosure may also be implemented as a program product including program code, which, when run on a terminal device, causes the terminal device to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure.

[0183] More specific examples of computer-readable storage media in this disclosure may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0184] In this disclosure, a computer-readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of transmitting, propagating, or transmitting a program for use by or in connection with an instruction execution system, apparatus, or device.

[0185] Optionally, the program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0186] In practical implementation, program code for performing the operations of this disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0187] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0188] Furthermore, although the steps of the method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and / or a step may be broken down into multiple steps.

[0189] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, mobile terminal, or network device, etc.) to execute the methods according to the embodiments of this disclosure.

[0190] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.

Claims

1. A display method, characterized in that, include: Based on the eye movement speed information obtained from the display target in the observation field sequence display, the width of the color separation region located at the edge of the display target is determined; Based on the width of the color separation region, the offset of the multiple sub-fields constituting the field sequence display is determined; The image frame to be displayed is displacement compensated according to the offset of the multiple subfields to determine the displacement compensated image frame to be displayed; The displacement-compensated image frame to be displayed is rendered; Based on eye-tracking velocity information obtained from the displayed target in the observation field sequence display, the width of the color separation region located at the edge of the displayed target is determined, including: Collect eye image information when the target is displayed in the field sequence display, and determine the eye movement velocity information of the eye when observing the target in the field sequence display; Based on the eye movement speed information, determine the width of the color separation region located at the edge of the display target; Determining the width of the color separation region located at the edge of the display target based on the eye movement speed information includes: The eye movement speed information is input into the relationship function between eye movement speed and color separation region width to determine the width of the color separation region located at the edge of the display target; The process of constructing the relationship function between eye movement velocity and color separation region width includes: The eyeball diameter, test target width, and field sequence display device refresh rate are set to fixed values. Eye movement speed is used as a control variable. A function formula for calculating the eye movement speed and color separation region width is established. The function formula for calculating the eye movement speed and color separation region width includes fitting parameters. The eye movement speed, the eyeball diameter, the test target width, and the field sequence display device refresh rate are control parameters related to the color separation region width. According to the set initial value of the test step size, the test target is moved at a constant speed on the field sequence display device according to the test rate, and the width of the test color separation area located at the edge of the test target is obtained. The eye movement speed is determined based on the test rate; The test step size is gradually increased to gradually reduce the width of the test color separation region until the width of the test color separation region is zero. The current test step size is then determined as the subfield compensation displacement corresponding to the test eye movement speed. The test step size is increased in pixels. Based on the tested eye movement velocity and the subfield compensation displacement, the fitting parameters of the function formula for calculating the eye movement velocity and color separation region width are fitted to determine the relationship function between eye movement velocity and color separation region width.

2. The display method according to claim 1, characterized in that, Acquire eye image information when a target is displayed in the field sequence display, and determine the eye movement velocity information of the eye observing the target in the field sequence display, including: Collect eye image information of the target displayed in the observation field sequence display, identify the pupil region in the eye image information, and determine the pupil position at the current time; Based on the current pupil position, calculate the multiple trajectory changes of the pupil in the next time period; Connect the multiple trajectory changes of the pupil within the next time period to form a line, and determine the eye movement trajectory for the next time period; Based on the physical model of the eyeball and the eye movement trajectory for the next time period, the eye movement velocity information for the next time period is determined. The eye movement velocity information includes: eye movement rate value and eye movement velocity direction.

3. The display method according to claim 1, characterized in that, According to the set initial test step size, the test target is moved at a constant speed on the field sequence display device at the test rate, and the width of the test color separation region located at the edge of the test target is obtained, including: Based on the refresh rate of the field sequence display device, which is set to a fixed value, the display time difference between multiple sub-fields constituting the field sequence display is determined; Based on the display time difference and test rate between the multiple subfields that constitute the field sequence display, the positional relationship between the multiple subfields and the test target is determined; According to the set initial value of the test step size and the positional relationship between the multiple subfields and the test target, displacement compensation is performed on the test image frame displaying the test target to determine the compensated test image frame; The compensated test image frame is rendered and displayed so that the test target moves at a constant speed on the field sequence display device according to the test rate, and the width of the test color separation region located at the edge of the test target is obtained.

4. The display method according to claim 1, characterized in that, Determining the eye movement velocity test based on the test rate includes: Acquire the field of view, observation distance, lens magnification, and pixel size of the field sequence display device; Based on the test rate, determine the display position of the test target in the test image frame; The test eye movement speed is determined based on the display position of the test target in the test image frame, the field of view of the field sequence display device, the observation distance, the lens magnification and pixel size, and the refresh rate of the field sequence display device, which is set to a fixed value.

5. The display method according to claim 1, characterized in that, Gradually increase the test step size to gradually decrease the width of the test color separation region until the width of the test color separation region is zero. Then, determine the current test step size as the subfield compensation displacement corresponding to the test eye movement velocity, including: The test step size is updated by increasing the test step size from the initial value in pixels; Based on the updated test step size, obtain the corresponding test color separation region width; The test step size is gradually increased to gradually reduce the width of the corresponding test color separation region until the width of the test color separation region is zero. Then, the number of pixels of the currently updated test step size is determined as the subfield compensation displacement corresponding to the test eye movement speed.

6. The display method according to claim 1, characterized in that, Based on the tested eye movement velocity and the subfield compensation displacement, the fitting parameters of the function formula for calculating the eye movement velocity and color separation region width are fitted to determine the relationship function between eye movement velocity and color separation region width, including: The eye-tracking velocity and the corresponding subfield compensation displacement are associated with an array to complete a set of tests; Change the test rate of the test target to perform multiple sets of tests, and determine multiple sets of arrays; Substitute the multiple sets of arrays into the function formula for calculating eye movement speed and color separation region width to perform quadratic polynomial fitting, and determine the values ​​of the fitting parameters; Substitute the values ​​of the fitting parameters into the formula for calculating the relationship between eye movement speed and color separation region width to determine the function relating eye movement speed and color separation region width.

7. The display method according to claim 1, characterized in that, Based on the width of the color separation region, the offset of the multiple sub-fields constituting the field sequence display is determined, including: Based on the refresh rate of the field sequence display device, the display time difference between the multiple sub-fields constituting the field sequence display is determined; Based on the display time difference between the multiple subfields constituting the field sequence display and the eye movement speed information, the positional relationship between the multiple subfields and the display target is determined; The offset of the multiple subfields constituting the field sequence display is determined based on the positional relationship between the multiple subfields and the display target and the width of the color separation region.

8. The display method according to claim 7, characterized in that, When the multiple subfields constituting the field sequence display are a first subfield, a second subfield, and a third subfield, the positional relationship between the multiple subfields and the display target is that the first subfield, the second subfield, and the third subfield are successively closer to the edge of the display target, and the third subfield is adjacent to the display target. Based on the positional relationship between the multiple subfields and the display target and the width of the color separation region, the offset of the multiple subfields constituting the field sequence display is determined, including: Based on the positional relationship between the multiple subfields and the display target and the width of the color separation region, the offset of the first subfield is determined to be three times the width of the color separation region, the offset of the second subfield is determined to be twice the width of the color separation region, and the offset of the first subfield is equal to the width of the color separation region.

9. The display method according to claim 8, characterized in that, The first subfield is red, the second subfield is green, and the third subfield is blue.

10. The display method according to claim 1, characterized in that, The process of performing displacement compensation on the image frame to be displayed according to the offset of the plurality of subfields, and determining the displacement-compensated image frame to be displayed, includes: According to the offset of the multiple subfields, the subfield of each pixel of the image frame to be displayed is displacement compensated in the opposite direction of the eye movement velocity direction of the eye movement velocity information to determine the displacement compensated image frame to be displayed. Each pixel of the image frame to be displayed corresponds to multiple subfields.

11. A display device, characterized in that, include: The color separation region width determination module is used to determine the width of the color separation region located at the edge of the display target based on the eye movement speed information obtained from the display target in the observation field sequence display. The subfield offset determination module is used to determine the offset of multiple subfields constituting the field sequence display based on the width of the color separation region. The displacement-compensated image frame determination module is used to perform displacement compensation on the image frame to be displayed according to the offset of the multiple subfields, and determine the displacement-compensated image frame to be displayed. The rendering and display module is used to render and display the displacement-compensated image frame to be displayed; Determining the width of the color separation region located at the edge of the display target based on the eye movement speed information includes: The eye movement speed information is input into the relationship function between eye movement speed and color separation region width to determine the width of the color separation region located at the edge of the display target; The process of constructing the relationship function between eye movement velocity and color separation region width includes: The eyeball diameter, test target width, and field sequence display device refresh rate are set to fixed values. Eye movement speed is used as a control variable. A function formula for calculating the eye movement speed and color separation region width is established. The function formula for calculating the eye movement speed and color separation region width includes fitting parameters. The eye movement speed, the eyeball diameter, the test target width, and the field sequence display device refresh rate are control parameters related to the color separation region width. According to the set initial value of the test step size, the test target is moved at a constant speed on the field sequence display device according to the test rate, and the width of the test color separation area located at the edge of the test target is obtained. The eye movement speed is determined based on the test rate; The test step size is gradually increased to gradually reduce the width of the test color separation region until the width of the test color separation region is zero. The current test step size is then determined as the subfield compensation displacement corresponding to the test eye movement speed. The test step size is increased in pixels. Based on the tested eye movement velocity and the subfield compensation displacement, the fitting parameters of the function formula for calculating the eye movement velocity and color separation region width are fitted to determine the relationship function between eye movement velocity and color separation region width.

12. An electronic device, characterized in that, include: processor; as well as Memory for storing the executable instructions of the processor; The processor is configured to execute the display method according to any one of claims 1 to 10 by executing the executable instructions.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the display method according to any one of claims 1 to 10.

14. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the display method according to any one of claims 1 to 10.

Images