Image display method

Abstract

The present invention provides a method for displaying an image. A gaze tracking element is used to obtain the position of a user's gaze convergence plane. A display is used to provide an image, and the image is located on a virtual image plane, wherein the image has a misalignment between different viewing directions. A controller is provided, coupled to the gaze tracking element and the display, wherein the controller receives data on the position of the gaze convergence plane obtained by the gaze tracking element, performs an algorithm based on the data to obtain the misalignment, and transmits display data including the misalignment to the display. When a single eye of the user views the image, the focus is on a focal plane, and a position of the focal plane is different from a position of the virtual image plane.

Description

Technical Field

[0001] The present disclosure relates to an image display method, and more particularly to an image display method capable of alleviating a user's visual convergence-accommodation conflict. Background Art

[0002] Three-dimensional (3D) display technologies, such as augmented reality (AR) and virtual reality (VR), have been widely adopted in various fields. These technologies present images to users through head-mounted displays (HMDs) or near-eye displays (NEDs) in glasses. However, when viewing these images, users experience vergence-accommodation conflict, which can cause discomfort. Therefore, reducing this conflict is a pressing issue. Summary of the Invention

[0003] One embodiment of the present disclosure provides a method for displaying an image, which includes the following steps. A first position of a user's line of sight convergence plane is obtained by a line of sight tracking element. An image is provided using a display, and the image is located on a virtual image plane, wherein the image has a misalignment amount between different video directions. A controller is provided to be coupled to the line of sight tracking element and the display, wherein the controller receives data of the first position of the line of sight convergence plane obtained by the line of sight tracking element, the controller performs an algorithm processing based on the data to obtain the misalignment amount, and the controller transmits display data including the misalignment amount to the display. When a single eye of the user views the image, it focuses on a focusing plane, and there is a first distance between the first position of the line of sight convergence plane and the single eye, a second distance between a second position of the focusing plane and the single eye, there is a distance difference between the first distance and the second distance, and the distance difference meets the following relationship:

[0004] da+(dv / 1.3052-0.2657*dv)>Δd>da–(dv / 1.1286+0.442*dv) where da represents the second distance, dv represents the first distance, and Δd represents the distance difference.

[0005] Another embodiment of the present disclosure provides a method for displaying an image, which includes the following steps: obtaining a first position of a user's line of sight convergence plane through a line of sight tracking element. Using a display to provide multiple images, wherein the multiple images are different from each other, and the multiple images are provided by the display at multiple time points. The user receives the multiple images through a single eye and perceives an image located on a virtual image plane, wherein the image has a misalignment amount between different video directions. A controller is provided to be coupled to the line of sight tracking element and the display, wherein the controller receives data of the first position of the line of sight convergence plane obtained by the line of sight tracking element, the controller performs an algorithm processing based on the data to obtain the misalignment amount, and the controller transmits display data including the misalignment amount to the display. When the user's single eye views the image, it focuses on a focusing plane, and there is a first distance between the first position of the line of sight convergence plane and the single eye, a second distance between a second position of the focusing plane and the single eye, a distance difference between the first distance and the second distance, and the distance difference meets the following relationship:

[0006] da+(dv / 1.3052-0.2657*dv)>Δd>da–(dv / 1.1286+0.442*dv) where da represents the second distance, dv represents the first distance, and Δd represents the distance difference. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 FIG. 1 is a schematic diagram of an electronic device according to a first embodiment of the present disclosure.

[0008] Figure 2 FIG. 1 is a schematic diagram illustrating an example of an image display method according to the first embodiment.

[0009] Figure 3 FIG. 1 is a schematic diagram showing an example of monocular focusing according to the present disclosure.

[0010] Figure 4 FIG. 4 is a schematic diagram showing another example of monocular focusing according to the present disclosure.

[0011] Figure 5 FIG. 1 is a flowchart of the steps of the image display method according to the first embodiment.

[0012] Figure 6 FIG. 1 is a schematic diagram showing another example of the image display method of the first embodiment.

[0013] Figure 7 FIG. 1 is a schematic diagram illustrating an image display method according to a second embodiment.

[0014] Figure 8 FIG. 1 is a schematic diagram illustrating an image display method according to a third embodiment.

[0015] Figure 9FIG. 1 is a flow chart showing the steps of an image display method disclosed herein.

[0016] Figure 10 FIG. 4 is a flow chart showing the steps of another image display method disclosed herein.

[0017] Explanation of reference numerals: 10 - electronic device; 1001, 1003 - display; 1021, 1023 - eye; 1041, 1043 - optical element; 106 - sight tracking element; 108 - controller; 110 - pupil; 112 - lens; Ap1, Ap2 - focus; da - second distance; dv - first distance; Lb1-Lb14 - light beam; Pa1, Pa2 - focusing plane; Pe - plane; Pi - Virtual image plane; Pv1, Pv2 - line of sight convergence plane; Px1-Px14 - sub-pixels; S, S1-S2, T1-T12, R, R1-R2, U1-U12 - images; S101-S115, S201-S207, S301-S309 - steps; V1, V2, V4, V5 - images; V3 - three-dimensional virtual image; Vp1-Vp14 - viewpoints; X, Y, Z - directions; Δd - distance difference. DETAILED DESCRIPTION

[0018] The present disclosure will be understood by referring to the following detailed description in conjunction with the accompanying drawings. It should be noted that, for ease of understanding and simplicity, many of the drawings in this disclosure depict only portions of an electronic device, and certain components in the drawings are not drawn to scale. Furthermore, the number and dimensions of components in the drawings are for illustrative purposes only and are not intended to limit the scope of this disclosure.

[0019] Throughout this disclosure and the following claims, certain terms are used to refer to specific components. Those skilled in the art will appreciate that electronic device manufacturers may refer to the same components by different names. This document does not intend to distinguish between components that have the same function but different names. In the following description and claims, the words "including" and "comprising" are open-ended and should be interpreted as meaning "including, but not limited to..."

[0020] In addition, when an element is referred to as being "directly on," "directly disposed on," "directly connected to," or "directly coupled to" another element or layer, there are no intervening elements or layers present.

[0021] An electrical connection can be direct or indirect. An electrical connection between two components can involve direct contact to transmit electrical signals, with no other components between them. Alternatively, an electrical connection between two components can involve a bridge between them to transmit electrical signals. An electrical connection is also called a coupling.

[0022] While the terms "first," "second," "third," etc. may be used to describe various components, these terms are not intended to be limiting. These terms are used solely to distinguish a single component from other components within the specification. Claims may not use the same terms, but may be replaced with "first," "second," "third," etc., according to the order in which the components are declared in the claims. Thus, in the following description, the first component may be referred to as the second component in a claim.

[0023] It should be noted that the following embodiments may replace, reorganize, or mix the technical features of several different embodiments to implement other embodiments without departing from the spirit of the present disclosure.

[0024] The display device disclosed herein may include a head-mounted display, a heads-up display (HUD), or glasses, and the display device may include one or more near-eye displays, but is not limited thereto. The display device disclosed herein may also include a touch display, a curved display, or a free-form display, but is not limited thereto. The display device may be a bendable or flexible display device. The display device may, for example, include a light-emitting diode (LED), a liquid crystal, fluorescence, phosphor, other suitable display media, or a combination thereof, but is not limited thereto. The light-emitting diode may, for example, include an organic light-emitting diode (OLED), an inorganic light-emitting diode (LED), a submillimeter light-emitting diode (mini LED), a micro-light-emitting diode (micro-LED), a quantum dot (QDs) light-emitting diode (such as a QLED or QDLED), other suitable materials, or any combination thereof, but is not limited thereto. The concepts and principles disclosed herein may also be applied to non-luminous liquid crystal displays (LCDs), but are not limited thereto.

[0025] The display device may be any of the aforementioned arrangements or combinations, but is not limited thereto. Furthermore, the display device may be rectangular, circular, polygonal, have curved edges, or other suitable shapes. The display device may include peripheral systems such as a drive system, a control system, a light source system, and a shelf system to support the display device.

[0026] The following figures indicate a direction X, a direction Y, and a direction Z. Direction Z may be perpendicular to both directions X and Y, and direction X may be perpendicular to direction Y. For example, direction Z may be perpendicular to a surface of display 1001 or display 1003, while directions X and Y may be parallel to the surface, but this is not a limitation. The following figures may describe spatial relationships based on directions X, Y, and Z.

[0027] Please refer to Figure 1 , which is a schematic diagram of an electronic device according to a first embodiment of the present disclosure. The electronic device 10 may be, for example, a virtual reality system, an augmented reality system, or other type of three-dimensional image display system, but is not limited thereto. For example, a virtual reality system may include a head-mounted display or a heads-up display, while an augmented reality system may include glasses, but is not limited thereto.

[0028] like Figure 1 The electronic device 10 may include, but is not limited to, multiple displays (e.g., display 1001 and display 1003), multiple optical elements (e.g., optical element 1041 and optical element 1043), a gaze tracking device 106, and a controller 108. Controller 108 may be coupled to display 1001, display 1003, optical element 1041, optical element 1043, and gaze tracking device 106.

[0029] Display 1001 and display 1003 may be, for example, near-eye displays, but are not limited thereto. Display 1001 may correspond to a user's eye 1021, and display 1003 may correspond to a user's eye 1023. Eye 1021 may be, for example, one eye (e.g., the left eye), and eye 1023 may be, for example, the other eye (e.g., the right eye). Furthermore, optical element 1041 may correspond to the user's eye 1021 and be disposed between display 1001 and eye 1021, while optical element 1043 may correspond to the user's eye 1023 and be disposed between display 1003 and eye 1023. Optical element 1041 (or optical element 1043) may include, but is not limited to, at least one lens.

[0030] For example, display 1001 can provide an image that can enter eye 1021 through optical element 1041 and form image V1 on a virtual image plane Pi. Meanwhile, display 1003 can provide another image that can enter eye 1023 through optical element 1043 and form image V2 on virtual image plane Pi. Images V1 and V2 can be virtual images. In short, eye 1021 can view image V1, while eye 1023 can view image V2.

[0031] Please refer to Figure 2 , which is a schematic diagram of an example of the image display method of the first embodiment. For the sake of simplicity, Figure 2 Omitted Figure 1 The electronic device 10 in Figure 2 The images V1 and V2 in the image may be provided by the display 1001 and the display 1003 and imaged on the virtual image plane Pi through the optical element 1041 and the optical element 1043. Figure 1 When using electronic device 10, eye 1021 can view image V1 and focus monocularly on a focal plane (accommodation surface) Pa1. Eye 1023 can view image V2 and also focus on focal plane Pa1. Eyes 1021 and 1023 can converge binocularly on a vergence surface Pv1. The focal plane and the vergence surface can be planar or non-planar. Furthermore, the content of image V1 corresponding to eye 1021 can differ from the content of image V2 corresponding to eye 1023. This difference between images V1 and V2 can cause the user's brain to perceive or generate a three-dimensional virtual image V3 on the vergence surface Pv1 after synthesizing images V1 and V2.

[0032] When a user uses an existing device, the position of the focusing plane and the position of the virtual image plane are the same, which results in a large distance difference between the position of the focusing plane and the position of the line of sight convergence plane, thereby causing the user to be affected by a vergence-accommodation conflict and feel uncomfortable. However, in the present disclosure, the position of the focusing plane Pa1 of the eye 1021 and the eye 1023 can be adjusted so that the position of the focusing plane Pa1 and the position of the virtual image plane Pi are different, or the focusing plane Pa1 is located between the line of sight convergence plane Pv1 and the virtual image plane Pi in the direction Z. Therefore, the distance difference between the position of the focusing plane Pa1 and the position of the line of sight convergence plane Pv1 can be reduced, thereby reducing the user's uncomfortable feeling caused by the visual convergence-accommodation conflict. The positions of the virtual image plane Pi, the focusing plane Pa1, and the line of sight convergence plane Pv1 can be, for example, Figure 2 The position in the direction Z.

[0033] The following will describe the method of adjusting the focus position of the monocular lens disclosed in this disclosure. Figure 3 and Figure 4 , Figure 3 FIG. 1 is a schematic diagram showing an example of monocular focusing according to the present disclosure. Figure 4 FIG. 4 is a schematic diagram showing another example of monocular focusing according to the present disclosure. Figure 3 and Figure 4The display 1001 and the eye 1021 are used as an example, but this method can also be applied to the display 1003 and the eye 1023. In addition, for the sake of simplicity of the figure, Figure 3 and Figure 4 Optical elements and gaze tracking elements are omitted.

[0034] exist Figure 3 In the example, sub-pixel Px1, sub-pixel Px2, sub-pixel Px3, sub-pixel Px4, sub-pixel Px5, sub-pixel Px6 and sub-pixel Px7 of the display 1001 can respectively emit light beams Lb1, light beams Lb2, light beams Lb3, light beams Lb4, light beams Lb5, light beams Lb6 and light beams Lb7 to view points Vp1, viewpoints Vp2, viewpoints Vp3, viewpoints Vp4, viewpoints Vp5, viewpoints Vp6 and viewpoints Vp7 on a plane Pe where the eye 1021 is located, wherein the light beams Lb1, light beams Lb2, light beams Lb3, light beams Lb4, light beams Lb5, light beams Lb6 and light beams Lb7 can be focused on a focal point Ap1, and the focal point Ap1 can be located between the display 1001 and the eye 1021 in the direction Z, but is not limited thereto.

[0035] Furthermore, the light beams Lb3, Lb4, and Lb5 emitted by sub-pixels Px3, Px4, and Px5 can enter the pupil 110 of the eye 1021 from different viewing directions. In other words, the eye 1021 can simultaneously view the light beams Lb3, Lb4, and Lb5 emitted by different sub-pixels. Extending the above principle, each light beam can represent an image, each image can be displayed by one or more corresponding sub-pixels, and different images can be displayed by different sub-pixels. Specifically, a single image provided by the display 1001 can simultaneously include the images represented by light beams Lb1 through Lb7, and the eye 1021 can simultaneously view the images represented by light beams Lb3, Lb4, and Lb5. By displaying the images represented by the light beams Lb3, Lb4 and Lb5 by different sub-pixels, the images represented by the light beams Lb3, Lb4 and Lb5 can be misaligned with each other within the same image, thereby allowing the eye 1021 to focus on the focal point Ap1.

[0036] Also in Figure 4In the example, sub-pixel Px8, sub-pixel Px9, sub-pixel Px10, sub-pixel Px11, sub-pixel Px12, sub-pixel Px13 and sub-pixel Px14 of the display 1001 can respectively emit light beams Lb8, light beams Lb9, light beams Lb10, light beams Lb11, light beams Lb12, light beams Lb13 and light beams Lb14 to viewpoints Vp8, viewpoints Vp9, viewpoints Vp10, viewpoints Vp11, viewpoints Vp12, viewpoints Vp13 and viewpoints Vp14 on the plane Pe where the eye 1021 is located, wherein the light beams Lb8, light beams Lb9, light beams Lb10, light beams Lb11, light beams Lb12, light beams Lb13 and light beams Lb14 can be focused on another focal point Ap2, and in the direction Z, the eye 1021 can be located on one side of the display 1001, and the focal point Ap2 can be located on the other side of the display 1001, but the present invention is not limited thereto.

[0037] Furthermore, the light beams Lb8, Lb9, and Lb10 emitted by sub-pixels Px8, Px9, and Px10 can enter the pupil 110 of the eye 1021 from different viewing directions. In other words, the eye 1021 can simultaneously view the light beams Lb8, Lb9, and Lb10 emitted by different sub-pixels. Extending the above principle, each light beam can represent an image, each image can be displayed by one or more corresponding sub-pixels, and different images can be displayed by different sub-pixels. Specifically, a single image provided by the display 1001 can simultaneously include the images represented by light beams Lb8 through Lb14, and the eye 1021 can simultaneously view the images represented by light beams Lb8, Lb9, and Lb10. By displaying the images represented by light beams Lb8, Lb9 and Lb10 by different sub-pixels, the images represented by light beams Lb8, Lb9 and Lb10 can be misaligned with each other within the same image, thereby allowing the eye 1021 to focus on the focal point Ap2.

[0038] like Figure 3 and Figure 4 , different images (such as images including light beams Lb1-Lb7 and images including light beams Lb8-Lb14) are displayed through different sub-pixels (such as sub-pixels Px1-Px7 and sub-pixels Px8-Px14), which can make Figure 3 The image provided by the display 1001 is Figure 4 The images provided by the middle display 1001 have different offset amounts, thereby adjusting the focus position of the eye 1021 (eg, focus Ap1 and focus Ap2).

[0039] In addition, Figure 3For example, viewpoints Vp1, Vp2, Vp6, and Vp7 are located outside the pupil 110. These viewpoints (or the images they represent) allow the eye 1021 to see images while moving, that is, these viewpoints increase the dimension of the eye's movement range.

[0040] By using the above-mentioned method of adjusting the focus position of a single eye, the present disclosure further proposes a method for displaying an image, which can alleviate the user's discomfort caused by the conflict between visual convergence and accommodation. The image can be, for example, a three-dimensional image, but is not limited thereto. Please refer to Figure 1 、 Figure 2 and Figure 5 ,in Figure 5 The flowchart of the image display method of the first embodiment is shown. First, Figure 5 In step S101, the gaze tracking component 106 is used to track the gazes of the user's two eyes (such as eye 1021 and eye 1023), and the process proceeds to step S103. The gaze tracking component 106 can transmit the obtained gaze convergence data (vergence information) of the two eyes to the controller 108 (such as Figure 1 ), the data may include a vergence vector, a two eyes vector, a vergence surface, etc., and the controller 108 may obtain the data and calculate a position of the vergence surface Pv1 (or may be called a first position).

[0041] On the other hand, step S105 may be performed to provide the image data of the left eye (e.g., eye 1021) to the controller 108, and the process may proceed to step S107. The controller 108 may perform algorithm processing based on the data of the position of the line of sight convergence plane Pv1 to obtain a position that allows the eye 1021 to focus on the focal plane Pa1 (e.g., Figure 2 ) and transmits a display data including the offset amount to the left eye display (such as Figure 1 Then, step S109 may be performed, the left eye display (such as the display 1001) may provide an image V1 according to the display data, and the image V1 may be formed on the virtual image plane Pi (such as the optical element 1041) through the optical element 1041. Figure 1 ), and image V1 includes the misalignment amount.

[0042] Furthermore, step S111 can be performed to provide the image data of the right eye (such as eye 1023) to the controller 108, and step S113 can be entered. The controller 108 can perform algorithm processing based on the data of the position of the visual convergence plane Pv1 to obtain a method that allows the eye 1023 to focus on the focal plane Pa1 (such as Figure 2) and transmits a display data including the offset amount to the right eye display (such as Figure 1 Then, step S115 may be performed, the right eye display (such as the display 1003) may provide an image V2 according to the display data, and the image V2 may be formed on the virtual image plane Pi (such as the optical element 1043) through the optical element 1043. Figure 1 ), and the image V2 includes the misalignment amount. Steps S105 to S109 and steps S111 to S115 may be performed simultaneously, but are not limited thereto.

[0043] like Figure 2 For example, after controller 108 obtains data on the position of the convergence plane Pv1 of the two eyes through gaze tracking element 106 and calculates it through an algorithm, controller 108 can control displays 1001 and 1003 to provide images V1 and V2 with a certain amount of misalignment. By viewing image V1 by eye 1021 and image V2 by eye 1023, the user ultimately sees an image S in the three-dimensional virtual image V3 at the location of the convergence plane Pv1.

[0044] In addition, the images T1, T2, and T3 in the image V1 are simultaneously displayed in the image V1, and the image S in the three-dimensional virtual image V3 may correspond to the images T1, T2, and T3 in the image V1, wherein the images T1, T2, and T3 are respectively different viewing directions (e.g., Figure 2 The image S viewed under the three different dotted lines in FIG, image T1, image T2 and image T3 are different from each other and have a misalignment amount between each other. Figure 3 or Figure 4 According to the illustrated principle, when the eye 1021 views the image V1 and simultaneously views the images T1 , T2 , and T3 , the misalignment allows the eye 1021 to focus on the focal plane Pa1 .

[0045] On the other hand, the images T4, T5, and T6 in the image V2 are simultaneously displayed in the image V2, and the image S in the three-dimensional virtual image V3 may correspond to the images T4, T5, and T6 in the image V2, wherein the images T4, T5, and T6 are respectively in different viewing directions (e.g., Figure 2 The image S viewed under the three different dotted lines in FIG, image T4, image T5 and image T6 are different from each other and have a misalignment amount between each other. Figure 3 or Figure 4 According to the illustrated principle, when the eye 1023 views the image V2 and simultaneously views the images T4 , T5 , and T6 , the misalignment amount enables the eye 1023 to focus on the focal plane Pa1 .

[0046] Furthermore, images U7, U8, and U9 within image V1 are also displayed simultaneously within image V1. Images U7, U8, and U9 may be different from each other and may be offset from each other. When eye 1021 views image V1 while simultaneously viewing images U7, U8, and U9, the offset allows eye 1021 to focus on focal plane Pa1 and perceive image R2 within three-dimensional virtual image V3. Meanwhile, images U10, U11, and U12 within image V2 are also displayed simultaneously within image V2. Images U10, U11, and U12 may be different from each other and may be offset from each other. When eye 1023 views image V2 while simultaneously viewing images U10, U11, and U12, the offset allows eye 1023 to focus on focal plane Pa1 and perceive image R1 within three-dimensional virtual image V3.

[0047] exist Figure 2 In the example, when eyes 1021 and 1023 converge on the line of sight convergence plane Pv1 and clearly see image S in 3D virtual image V3, images R1 and R2 in 3D virtual image V3 may be separate images. For example, image S may be an object in 3D virtual image V3, while images R1 and R2 may be another object in 3D virtual image V3, but this is not limiting.

[0048] See also Figure 6 , which is a schematic diagram showing another example of the image display method of the first embodiment. Figure 6 In the example, the position of the line of sight convergence surface Pv2 in direction Z is Figure 2 The position of the eye-gathering plane Pv1 of the eyes is different. When the controller 108 obtains the position data of the eye-gathering plane Pv2 of the eyes through the eye-gathering tracking element 106 and calculates it through the algorithm, the controller 108 can control the display 1001 and the display 1003 to provide the image V4 and the image V5 with the misalignment amount. Figure 6 The position of the line of sight convergence surface Pv2 and Figure 2 Because the position of the convergent line of sight Pv1 is different, the algorithm calculates that the offset of image V4 may be different from that of image V1, and the offset of image V5 may be different from that of image V2. By viewing image V4 with eye 1021 and image V5 with eye 1023, the user ultimately sees an image R in the three-dimensional virtual image V3 at the position of the convergent line of sight Pv2.

[0049] In addition, the images U1, U2, and U3 in the image V4 are simultaneously displayed in the image V4, and the image R in the three-dimensional virtual image V3 may correspond to the images U1, U2, and U3 in the image V4, wherein the images U1, U2, and U3 are respectively different viewing directions (e.g., Figure 6 The image R viewed under the three different dotted lines in FIG, image U1, image U2 and image U3 may be different from each other and may also have a misalignment amount between each other. Figure 3 or Figure 4 According to the principle described above, when the eye 1021 views the image V4 and simultaneously views the images U1, U2, and U3, the displacement amount allows the eye 1021 to focus on the focal plane Pa2, and in the direction Z, Figure 6 The position of the focal plane Pa2 can be Figure 2 The position of the focal plane Pa1 is different.

[0050] On the other hand, the images U4, U5, and U6 in the image V5 are simultaneously displayed in the image V5, and the image R in the three-dimensional virtual image V3 may correspond to the images U4, U5, and U6 in the image V5, wherein the images U4, U5, and U6 are respectively different viewing directions (e.g., Figure 6 The image R viewed under the three different dotted lines in FIG, image U4, image U5 and image U6 may be different from each other and may also have a misalignment amount between each other. Figure 3 or Figure 4 According to the illustrated principle, when the eye 1023 views the image V5 and simultaneously views the images U4 , U5 , and U6 , the misalignment may enable the eye 1023 to focus on the focal plane Pa2 .

[0051] Furthermore, images T7, T8, and T9 within image V4 are also displayed simultaneously within image V4. Images T7, T8, and T9 may be different from each other and may be offset from each other. When eye 1021 views image V4 while simultaneously viewing images T7, T8, and T9, the offsets allow eye 1021 to focus on focal plane Pa2 and perceive image S1 within three-dimensional virtual image V3. Meanwhile, images T10, T11, and T12 within image V5 are also displayed simultaneously within image V5. Images T10, T11, and T12 may be different from each other and may be offset from each other. When eye 1023 views image V5 while simultaneously viewing images T10, T11, and T12, the offsets allow eye 1023 to focus on focal plane Pa2 and perceive image S2 within three-dimensional virtual image V3.

[0052] exist Figure 6In the example, when eyes 1021 and 1023 converge on the convergence plane Pv2 and clearly see image R in 3D virtual image V3, image S1 and image S2 in 3D virtual image V3 may be separate images. For example, image R may be an object in 3D virtual image V3, while image S1 and image S2 may be another object in 3D virtual image V3, but this is not limiting.

[0053] As Figure 2 and Figure 6 As shown, in the image display method of this embodiment, the controller 108 can adjust the misalignment of an image (e.g., image V1, V2, V4, or V5) to adjust the position (or second position) of the focal plane (e.g., focal plane Pa1 or focal plane Pa2) of a single eye (e.g., eye 1021 or eye 1023). Furthermore, the position of the focal plane of the user's single eye can differ from the position of the virtual image plane in direction Z, or the focal plane can be located between the visual convergence plane and the virtual image plane in direction Z. Thus, the distance difference between the position of the focal plane and the visual convergence plane can be reduced, thereby alleviating the user's discomfort caused by the vergence-accommodation conflict.

[0054] by Figure 2 For example, in the direction Z, when the position of the focusing plane Pa1 is farther away from the user's eye 1021 or eye 1023, or when the position of the focusing plane Pa1 is closer to the position of the visual convergence plane Pv1, Figure 3 The images represented by the light beams Lb3, Lb4, and Lb5 in the image may crosstalk with each other within the pupil 110. Therefore, in this embodiment, positioning the focusing plane between the line of sight convergence plane and the virtual image plane in the direction Z can reduce the impact of this crosstalk and improve the user's viewing quality.

[0055] by Figure 2 For example, there is a first distance dv between the convergent line of sight plane Pv1 and the eye 1021 (or eye 1023), a second distance da between the focusing plane Pa1 and the eye 1021 (or eye 1023), and a distance difference Δd between the first distance dv and the second distance da. In some embodiments, the distance difference Δd may satisfy the following relationship:

[0056] da+(dv / 1.3052-0.2657*dv)>Δd>da-(dv / 1.1286+0.442*dv)

[0057] When the controller 108 controls the display 1001 and the display 1003 to provide images V1 and V2 with the misalignment amount calculated by the algorithm and enables the position of the focal plane Pa1 of the eye 1021 (or the eye 1023) to conform to the above relationship, crosstalk can be reduced to improve the user's viewing quality, and at the same time, the distance difference Δd can be reduced to alleviate the user's uncomfortable feeling caused by the visual convergence and accommodation conflict.

[0058] Displays (such as display 1001 or display 1003) may include light-emitting diodes, liquid crystals, fluorescence, phosphor, other suitable display media, or combinations thereof, but are not limited thereto. Light-emitting diodes may include, for example, organic light-emitting diodes (OLEDs), inorganic light-emitting diodes (LEDs), sub-millimeter light-emitting diodes (mini LEDs), micro-light-emitting diodes (micro-LEDs), quantum dots (QDs) light-emitting diodes (such as QLEDs or QDLEDs), other suitable materials, or any combination thereof, but are not limited thereto. Displays 1001 and 1003 may also be bendable or flexible electronic devices.

[0059] Another example Figure 3 As shown, the display surface may include multiple lenses 112, and the lenses 112 may have different shapes based on different optical requirements, but are not limited thereto. The surface of display 1001 (or display 1003) may also include a barrier layer with openings or a holographic optical element (HOE), but is not limited thereto. Furthermore, display 1001 (or display 1003) may also include a three-dimensional backlight unit (3D BLU), but is not limited thereto.

[0060] The optical element (such as optical element 1041 or optical element 1043) may include an image surface shift system, but is not limited thereto. The image surface shift system may include a projection system, a light field technology element, a folding light path element, or a combination thereof, but is not limited thereto. The projection system may include a lens projector element, but is not limited thereto. The light field technology element may include a holographic optical element, an integral image element, or a combination thereof, but is not limited thereto. The light path folding element may include a multi-mirror and space element, but is not limited thereto.

[0061] Another example Figure 1 As shown, image V1 or image V2 may include a fixed surface plane, but is not limited thereto. The fixed image plane may include a single surface, and image V1 or image V2 may be a vertical surface or an inclined surface. In this case, the optical element (such as optical element 1041 or optical element 1043) may include a projection optical element (POE), but is not limited thereto. The projection optical element may include a lens, a liquid crystal lens, a concave mirror, a holographic optical element, or a combination thereof, wherein the lens may include a Fresnel lens, a geometry lens, or a combination thereof, but is not limited thereto.

[0062] Furthermore, image V1 or image V2 may include a changeable image surface, but is not limited thereto. For example, the distance between image V1 (or image V2) and eye 1021 (or eye 1023) may change over time, but is not limited thereto. The changeable image surface may include, but is not limited to, a single surface that changes over time or a partial image that changes over time. In this case, the optical element (such as optical element 1041 or optical element 1043) may include a focus-adjustable projection optical element, and the focus-adjustable projection optical element may include, but is not limited to, a liquid crystal lens, a holographic optical element combined with liquid crystal, a polarizer projection optical element, or a combination thereof.

[0063] The gaze tracking element 106 may include, but is not limited to, an eye tracking sensor, a gaze tracking sensor, or a combination thereof. The controller 108 may include a programmable program to execute algorithmic processing, and may include, but is not limited to, a central processing unit (CPU), a system on chip (SoC), or an application specific integrated circuit (ASIC).

[0064] The following will further detail other embodiments of the present disclosure. To simplify the description, identical elements will be referenced using the same reference numerals. To highlight the differences between the various embodiments, the following details the differences between the various embodiments, without repetitive technical features. Furthermore, these repetitive technical features are applicable to all of the following embodiments.

[0065] Please refer to Figure 7 , which is a schematic diagram of the image display method of the second embodiment. Figure 7 ), after controller 108 obtains data on the position of the gaze convergence plane Pv1 of both eyes through gaze tracking element 106 and calculates the data through an algorithm, controller 108 can control displays 1001 and 1003 to provide images V1 and V2 with offset amounts. When eye 1021 views image V1 and eye 1023 views image V2, the offset amounts of image V1 and image V2 can cause eyes 1021 and 1023 to focus on focal plane Pa1, with the position of focal plane Pa1 (also referred to as the second position) being the same as the position of gaze convergence plane Pv1 (also referred to as the first position).

[0066] In real life, the focusing plane of a user's single eye is located at the same position as the convergence plane of the user's two eyes. However, through the image display method of this embodiment, when a user uses the electronic device 10 to view a three-dimensional image, it can achieve the same state as viewing with the eyes in real life, and can avoid the user from being affected by the visual convergence and accommodation conflict and feeling uncomfortable.

[0067] Please refer to Figure 8, which is a schematic diagram of the image display method of the third embodiment, wherein the image V1 and the image V2 are interlaced and partially overlapped in the figure, so the image T1, image T2 and image T3 in the image V1 are not drawn. In some embodiments, the image V1 (or image V2) can be a non-planar image. The above-mentioned non-planar image can be a deformed image, and the non-planar image can include images of any shape such as spherical, aspherical, symmetric, asymmetric, etc., but is not limited thereto. Figure 8 The image V1 (or image V2) may be a curved image, and the image V1 (or image V2) may have the same or different curvatures in the direction X, direction Y, or direction Z, but is not limited thereto.

[0068] To prevent distortion in the images viewed by the user through electronic device 10, the image display method of this embodiment utilizes an algorithm to calculate the required offset between images V1 and V2 based on the non-planar images via controller 108. When eye 1021 views image V1 and eye 1023 views image V2, the offset between images V1 and V2 ensures that the focal plane Pa1 on which eye 1021 or eye 1023 focuses is flat, and the visual convergence plane Pv1 on which eyes 1021 and 1023 converge is also flat. Therefore, even if images V1 and V2 provided by displays 1001 and 1003 are distorted, the images viewed by the user are normal, undistorted images.

[0069] According to the above instructions, please refer to Figure 9 , which is a flowchart of the steps of an image display method disclosed herein. The following steps may not be exhaustive, and other steps may be performed before, after, or between any of the steps shown. In addition, some steps may be performed in a different order. One of the image display methods disclosed herein may mainly include (but is not limited to): Figure 9 Steps shown:

[0070] Step S201: obtaining a first position of a user's gaze convergence plane through a gaze tracking component;

[0071] Step S203: using a display to provide an image, wherein the image is located on a virtual image plane, wherein the image has a misalignment between different viewing directions;

[0072] Step S205: providing a controller coupled to the gaze tracking element and the display, wherein the controller receives data of a first position of the gaze convergence plane obtained by the gaze tracking element, performs an algorithm based on the data to obtain a misalignment amount, and transmits display data including the misalignment amount to the display; and

[0073] Step S207: When a single eye of the user views an image, the single eye is focused on a focusing plane, a first distance is defined between a first position of the convergence plane and the single eye, a second distance is defined between a second position of the focusing plane and the single eye, a distance difference exists between the first distance and the second distance, and the distance difference satisfies the following relationship: da + (dv / 1.3052-0.2657*dv) > Δd > da – (dv / 1.1286+0.442*dv), where da represents the second distance, dv represents the first distance, and Δd represents the distance difference.

[0074] Also, please refer again to Figure 3 In some embodiments, the controller 108 may control subpixels Px1 through Px7 of the display 1001 to emit light beams Lb1 through Lb7 toward the eye 1021 at different time points, and the time points at which different subpixels emit light beams may have a time difference. For example, there may be a time difference between the time point at which subpixel Px1 emits light beam Lb1 and the time point at which subpixel Px2 emits light beam Lb2. When the time difference between the emission of light beams by different subpixels is sufficiently short, the brain will perceive light beams Lb1 through Lb7 as being received by the eye 1021 simultaneously.

[0075] Furthermore, each light beam can represent an image, and each image can be displayed by one or more corresponding sub-pixels, with different images being displayed by different sub-pixels. Extending the above principles, display 1001 can provide multiple images to eye 1021 at different times, and these images can be different from one another. When the time difference between the different images is sufficiently short, the brain can perceive that eye 1021 is viewing an image with a misalignment, thereby allowing eye 1021 to focus on focal point Ap1. The method for adjusting the focal plane of eye 1021 (or eye 1023) through algorithmic processing (to obtain the misalignment) by controller 108 can be similar to the above embodiment and will not be further described here.

[0076] Therefore, another image display method disclosed herein may mainly include (but is not limited to) Figure 10 The steps shown are:

[0077] Step S301: obtaining a first position of a user's gaze convergence plane through a gaze tracking component;

[0078] Step S303: using a display to provide a plurality of images, wherein the plurality of images are different from each other and the plurality of images are provided by the display at a plurality of time points respectively;

[0079] Step S305: The user receives multiple images through a single eye and perceives an image located on a virtual image plane, wherein the image has a misalignment between different viewing directions;

[0080] Step S307: providing a controller coupled to the gaze tracking element and the display, wherein the controller receives data of the first position of the gaze convergence plane obtained by the gaze tracking element, performs an algorithm based on the data to obtain a misalignment amount, and transmits display data including the misalignment amount to the display; and

[0081] Step S309: When the user's monocular eye views an image, the monocular eye is focused on a focusing plane, a first distance exists between a first position of the visual convergence plane and the monocular eye, a second distance exists between a second position of the focusing plane and the monocular eye, a distance difference exists between the first distance and the second distance, and the distance difference satisfies the following relationship: da+(dv / 1.3052-0.2657*dv)>Δd>da–(dv / 1.1286+0.442*dv), where da represents the second distance, dv represents the first distance, and Δd represents the distance difference.

[0082] In the disclosed image display method, a controller can be used to adjust the offset of the image provided by the display to adjust the position of the focal plane of a single eye, such that the focal plane is positioned differently from the virtual image plane, or positioned between the visual convergence plane and the virtual image plane, or positioned the same as the visual convergence planes of both eyes. This reduces the distance difference between the focal plane and the visual convergence plane, thereby alleviating the user's discomfort caused by the vergence-accommodation conflict.

[0083] The foregoing description is merely an example of the present disclosure and is not intended to limit the present disclosure. Persons skilled in the art will readily appreciate that the present disclosure is susceptible to various modifications and variations. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present disclosure are intended to be within the scope of protection of the present disclosure.

Claims

1. A method for displaying an image, characterized in that: include: Providing a display corresponding to a single eye of a user, the display providing image data, and the display providing an image on a virtual image plane according to the image data; Obtaining a first position of a gaze convergence plane of the user through a gaze tracking element, wherein the gaze convergence plane is a position where the user's eyes converge when viewing the image; A controller is provided, coupled to the gaze tracking element and the display, wherein the controller performs an algorithm processing based on data of the gaze convergence plane to obtain a misalignment amount; The controller transmits display data including the misalignment amount to the display; and When the display provides the image on the virtual image plane according to the display data including the misalignment amount, and the user views the image, the user's single eye focuses on a focusing plane. There is a first distance between the first position of the visual convergence plane and the monocular, a second distance between a second position of the focusing plane and the monocular, and a distance difference between the first distance and the second distance, and the distance difference satisfies the following relationship: Wherein da represents the second distance, dv represents the first distance, and Δd represents the distance difference.

2. The image display method according to claim 1, wherein: The second position of the focusing plane is different from the first position of the line-of-sight converging plane.

3. The image display method according to claim 2, wherein: The focusing plane is located between the line of sight converging plane and the virtual image plane.

4. The image display method according to claim 1, wherein: The second position of the focusing plane is the same as the first position of the line-of-sight converging plane.

5. The image display method according to claim 1, wherein: The image is a non-planar image.

6. The image display method according to claim 1, wherein: The invention also includes providing an electronic device, which includes the controller, the gaze tracking element, the display and an optical element, wherein the optical element is coupled to the controller and is arranged between the user's monocular eye and the display.

7. The image display method according to claim 6, wherein: The image provided by the display is formed on the virtual image surface through the optical element.

8. The image display method according to claim 6, wherein: The optical element includes at least one lens.

9. A method for displaying an image, characterized in that: include: Providing a display corresponding to a single eye of a user, the display providing a plurality of image data, and the display providing an image on a virtual image plane according to the plurality of image data, wherein the plurality of images are different from each other and the plurality of images are provided by the display at a plurality of time points respectively; Obtaining a first position of a gaze convergence plane of the user through a gaze tracking element, wherein the gaze convergence plane is a position where the user's eyes converge when viewing the image; A controller is provided, coupled to the gaze tracking element and the display, wherein the controller performs an algorithm processing based on data of the gaze convergence plane to obtain a misalignment amount; The controller transmits display data including the misalignment amount to the display; and When the display provides the image on the virtual image plane according to the display data including the misalignment amount, and the user views the image, the user's single eye focuses on a focusing plane. There is a first distance between the first position of the visual convergence plane and the monocular, a second distance between a second position of the focusing plane and the monocular, and a distance difference between the first distance and the second distance, and the distance difference satisfies the following relationship: Wherein da represents the second distance, dv represents the first distance, and Δd represents the distance difference.

Images