Image display method of electronic device

Abstract

The invention provides an image display method of an electronic device. A first image and a second image are provided by a display, wherein the first image, the second image and an environmental scene exist in a field of view of a user. When the user watches the first image, a first line-of-sight convergence surface of the two eyes of the user is located at a first position, and when the user watches the second image, a second line-of-sight convergence surface of the two eyes of the user is located at a second position. A first distance is arranged between the first position and the user, a second distance is arranged between the second position and the user, and the first distance is different from the second distance. When the user watches the first image, a first focusing surface focused by a single eye of the user is located at a third position, and the third position is different from the first position.

Description

[0001] This application is a divisional application of the invention patent application with the application date of June 11, 2021, application number 202110657102.0, and invention name “Image display method”. Technical Field

[0002] The invention relates to an image display method of an electronic device, in particular to an image display method of an electronic device using augmented reality technology. Background Art

[0003] Augmented reality (AR) display technology has been widely used in various fields. This technology can add images to the scenes of the real environment. However, in the existing image display method, the user cannot effectively overlap the image and the scene of the real environment when watching, resulting in blurring of the image or the scene of the real environment. Therefore, it is necessary to provide an improved solution for the display method of augmented reality. Summary of the invention

[0004] An embodiment of the present invention provides an image display method of an electronic device, which includes the following steps: providing a first image by a display, wherein when a user views the first image, a first sight convergence plane of the user's two eyes is located at a first position, and providing a second image by the display, wherein the first image, the second image, and an environmental scene exist in a visual field of the user, and when the user views the second image, a second sight convergence plane of the user's two eyes is located at a second position. There is a first distance between the first position of the first sight convergence plane and the user, and there is a second distance between the second position of the second sight convergence plane and the user, and the first distance is different from the second distance, wherein when the user views the first image, a first focusing plane of a single eye of the user is located at a third position, and the third position is different from the first position.

[0005] Another embodiment of the present invention provides an image display method of an electronic device, which includes the following steps: providing a first image by a display, wherein when a user views the first image, a first sight convergence plane of the user's two eyes is located at a first position, and providing a second image by the display, wherein the first image, the second image, and an environmental scene exist in a field of view of the user, and when the user views the second image, a second sight convergence plane of the user's two eyes is located at a second position. There is a first distance between the first position of the first sight convergence plane and the user, and there is a second distance between the second position of the second sight convergence plane and the user, and the first distance is different from the second distance, wherein when the user views the first image, a first focusing plane of a single eye of the user is located at a third position, wherein when the user views the second image, a second focusing plane of the single eye of the user is located at a fourth position, and the third position is different from the fourth position. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] Figure 1 FIG. 1 is a schematic diagram of an electronic device according to a first embodiment of the present invention.

[0007] Figure 2 Shown is a schematic diagram comparing different viewing states of users.

[0008] Figure 3 The figure shows the positional relationship of the convergence planes of the two eyes of a user viewing an image and an environment scene.

[0009] Figure 4 It is a schematic diagram showing the present invention for adjusting the position of the convergence plane of two eyes.

[0010] Figure 5 The figure shows the positional relationship between the convergence planes of the two eyes and the focusing plane of one eye when the user is viewing an image.

[0011] Figure 6 FIG. 4 is a schematic diagram showing a user viewing an image according to a second embodiment of the present invention.

[0012] Figure 7 FIG. 4 is a schematic diagram showing a user viewing state according to a second embodiment of the present invention.

[0013] Figure 8 FIG. 4 is a schematic diagram showing a user viewing an image according to a third embodiment of the present invention.

[0014] Fig. 9 FIG. 4 is a schematic diagram showing a user viewing state according to a fourth embodiment of the present invention.

[0015] Fig.10It is a schematic diagram showing the position of the focusing plane of a single eye according to the present invention.

[0016] Explanation of reference numerals: 10-electronic device; 100-display; 101-lens; 1021, 1023-eye; 104-optical element; 108-controller; 106, 110-sensing element; 112-glass; 114-pupil; Ap1, Ap2-focus; D1-D6, Di, Dr, Da, De-distance; Df, Dt-upper limit distance; Dn, Ds-lower limit distance; La1-La4, Lb1-Lb14-light beam; Pa r, Pax, Pa1, Pa2-focusing plane; Pe-plane; Pi, Pj, Pk-virtual image plane; Pr-image plane; Pv1, Pv2, Pvr, Pvx-line of sight convergence plane; Pxa-Pxd, Px1-Px14-sub-pixels; R1, R2-range; V1, V2, Vx-image; Vp1-Vp14-viewpoint; Vt1, Vt2-convergence point; X, Y-dashed box; (i)-(iii)-examples; Δd1, Δd2-distance difference. DETAILED DESCRIPTION

[0017] The present invention can be understood by referring to the following detailed description in conjunction with the accompanying drawings. It should be noted that in order to facilitate the reader's understanding and simplify the drawings, the multiple drawings in the present invention only depict a portion of the electronic device, and the specific components in the drawings are not drawn according to the actual scale. In addition, the number and size of each component in the drawings are only for illustration and are not intended to limit the scope of the present invention.

[0018] Certain words are used throughout the specification and claims of the present invention to refer to specific components. It should be understood by those skilled in the art that electronic equipment manufacturers may refer to the same components by different names. It is not intended to distinguish between components that have the same function but different names. In the following specification and claims, the words "including" and "comprising" are open-ended words and should therefore be interpreted as "including but not limited to...".

[0019] In addition, when an element is referred to as being "directly on" another element or film layer, "directly disposed on" another element or film layer, "directly connected to" another element or film layer, or "directly coupled to" another element or film layer, there are no intervening elements or film layers between the two.

[0020] Electrical connection can be direct or indirect. Electrical connection between two components can be direct contact to transmit electrical signals without any other components between them. Electrical connection between two components can be bridged by components between them to transmit electrical signals. Electrical connection can also be called coupling.

[0021] Although the terms first, second, third, etc. can be used to describe a variety of components, the components are not limited to these terms. These terms are only used to distinguish a single component from other components in the specification. The same terms may not be used in the claims, but may be replaced by first, second, third, etc. according to the order in which the components are declared in the claims. Therefore, in the following description, the first component may be the second component in the claims.

[0022] It should be noted that the embodiments listed below can replace, reorganize, and mix the technical features in several different embodiments to complete other embodiments without departing from the spirit of the present invention.

[0023] The electronic device of the present invention may include a display device, but is not limited thereto. The display device may include a touch display device, a curved display device, or a free shape display device, but is not limited thereto. The display device may be a bendable or flexible display device. The display device may, for example, include a light emitting diode, a liquid crystal, fluorescence, phosphorescence, other suitable display media, or a combination of the foregoing, but is not limited thereto. The light emitting diode may, for example, include an organic light emitting diode (OLED), an inorganic light emitting diode (LED), a sub-millimeter light emitting diode (mini-light-emitting diode, mini LED), a micro-light emitting diode (micro-light-emitting diode, micro-LED), a quantum dot (QDs) light emitting diode (which may be, for example, QLED, QDLED), other suitable materials, or any combination of the foregoing, but is not limited thereto. The concept or principle of the present invention may also be applied to a non-self-luminous liquid crystal display (LCD), but is not limited thereto.

[0024] The display device may be any combination of the above, but is not limited thereto. In addition, the appearance of the display device may be rectangular, circular, polygonal, a shape with curved edges or other suitable shapes. The display device may have peripheral systems such as a drive system, a control system, a light source system, and a shelf system to support the display device.

[0025] Please refer to Figure 1, which is a schematic diagram of an electronic device according to a first embodiment of the present invention. The electronic device 10 may be, for example, an augmented reality (AR) system or other types of three-dimensional image display systems, but is not limited thereto. For example, the electronic device 10 of this embodiment is used in a vehicle as an example, but the application of the electronic device 10 of the present invention is not limited thereto. In other embodiments, the augmented reality system may also be applied to glasses, and is not limited thereto.

[0026] like Figure 1 The electronic device 10 may include a display 100, an optical element 104, and a controller 108, but is not limited thereto. The electronic device 10 may also selectively include a sensing element 106 and a sensing element 110, but is not limited thereto. The controller 108 may be coupled to the display 100, the optical element 104, the sensing element 106, and the sensing element 110.

[0027] The display 100 can provide an image, which can be projected onto a glass 112 (such as a windshield) via an optical element 104. The image can form an image V1 (or can be called a first image) on a virtual image plane Pi outside the glass 112, and the user's two eyes (such as eye 1021 and eye 1023) can view the image V1 through the glass 112. Therefore, the image V1 outside the glass 112 and an environmental scene can exist in the user's field of vision. In addition, the display 100 can provide a left eye image for the eye 1021 and a right eye image for the eye 1023, wherein there can be a misalignment between the left eye image and the right eye image, so that the user finally views the image V1 as a three-dimensional image, but the present invention is not limited thereto. In addition, the electronic device 10 of this embodiment can project a single image V1 onto a single virtual image plane Pi, but the present invention is not limited thereto.

[0028] Please refer to Figure 2 , which is a schematic diagram comparing different user viewing states, wherein example (i) is a state of a user viewing an object in an environment scene, example (ii) is a state of a user viewing an existing augmented reality system, and example (iii) is a state of a user viewing an image display method using the present embodiment. Figure 2In the example (i), a first object in the environment scene (such as a road, a pedestrian, etc.) may be located on an image plane Pr, and the image generated by the augmented reality system may be located on a virtual image plane Pi. In example (i), when the user views the first object in the environment scene, the sight lines of both eyes (such as eye 1021 and eye 1023) converge on the image plane Pr, and a single eye (such as eye 1021 or eye 1023) also focuses on the image plane Pr. In other words, in example (i), the positions of the sight convergence plane Pvr of both eyes, the focusing plane Par of the single eye, and the image plane Pr of the first object in the environment scene are the same. However, in example (i), as shown in the dotted frame X, when the user views the first object in the environment scene, the image of the display viewed by the user is blurred.

[0029] In example (ii), an image Vx provided by an existing augmented reality system may be located on a virtual image plane Pi. When a user views image Vx, the sight lines of both eyes converge on the virtual image plane Pi, and one eye also focuses on the virtual image plane Pi. In other words, in example (ii), the positions of the sight convergence plane Pvx of both eyes, the focusing plane Pax of one eye, and the virtual image plane Pi of image Vx are the same. However, in example (ii), as shown in the dotted frame Y, when a user views image Vx, the first object in the environment scene within the dotted frame Y viewed by the user is blurred.

[0030] However, when the image Vx provided by the augmented reality system is used to mark the first object in the environment scene, due to the difference in the position of the convergence plane of the two eyes' sight lines, the user may not be able to clearly see the image Vx of the augmented reality system and the first object in the environment scene at the same time, or may cause the user to feel uncomfortable. Therefore, in the image display method of the present invention, by adjusting the position of the convergence plane of the two eyes' sight lines when the user views the augmented reality image V1, the shortcomings of the existing augmented reality system can be improved.

[0031] like Figure 2 In example (iii) of the present embodiment, in the image display method, when the user's eyes view the image V1, the sight lines of the user's eyes converge on a sight convergence plane Pv1 (or may be referred to as a first sight convergence plane) which may be located at a first position, and the first position of the sight convergence plane Pv1 is at a distance D1 (or may be referred to as a first distance) from the user. In addition, when the user views a first object in the environment scene, the sight lines of the user's eyes converge on a sight convergence plane Pv2 (or may be referred to as a second sight convergence plane) which may be located at a second position, and the second position of the sight convergence plane Pv2 is at a distance D2 (or may be referred to as a second distance) from the user.

[0032] Also, please refer to Figure 3, which shows a schematic diagram of the positional relationship of the convergence planes of the two eyes of a user viewing an image and an environmental scene. Figure 3 The distance Di in Figure 3 can be the distance D1 between the convergence plane Pv1 of the two eyes and the user when the user views the image V1, and Figure 3 The distance Dr in

[0033] can be the distance D2 between the convergence plane Pv2 of the two eyes and the user when the user views the first object in the environmental scene. As Figure 3 shown, the distance Di and the distance Dr can have a range R1, and the distance D1 and the distance D2 can fall within the range R1. When the distance D1 and the distance D2 fall within the range R1, the user can clearly view the image V1 and the first object in the environmental scene at the same time, or can effectively reduce the discomfort felt by the user. Figure 3 When the distance D1 and the distance D2 fall within the range R1, the distance D1 and the distance D2 can conform to a first relational expression: Dn < D1 < Df. The lower limit distance Dn = D2 + Δn, and the lower limit distance Dn (as -1 ) can be the shortest distance Di at which the user can clearly view the image V1 and the first object in the environmental scene at the same time. The upper limit distance Df = D2 + Δf, and the upper limit distance Df (as -1 ) can be the farthest distance Di at which the user can clearly view the image V1 and the first object in the environmental scene at the same time. In addition, Δn = (De / 2) * {tan[tan Figure 2 (2 * D2 / De) - δ]} - D2, and Δf = (De / 2) * {tan[tan

[0034] (2 * D2 / De) + δ]} - D2. Furthermore, De represents a distance between the two eyes (such as Figure 4 the distance De between the eye 1021 and the eye 1023 in Figure 4 ), δ represents the angular resolution of one eye corner of the two eyes, and δ = 0.02 degrees. Figure 1 The optical element 104 and the glass 112 in

[0035] are omitted for the sake of simplicity of the drawing. Figure 4In one example, the sub-pixel Pxa of the display 100 may emit a light beam La1 to the eye 1021, and the sub-pixel Pxb of the display 100 may emit a light beam La2 to the eye 1023, wherein the light beam La1 and the light beam La2 may intersect at a vergence point Vt1. Extending from the above principle, each image may be displayed by one or more corresponding sub-pixels, and different images may be displayed by different sub-pixels. The eye 1021 may view the image represented by the light beam La1, and the eye 1023 may view the image represented by the light beam La2. By displaying the images represented by the light beam La1 and the light beam La2 by different sub-pixels, a misalignment may be generated between the images represented by the light beam La1 and the light beam La2, thereby causing the two eyes to converge at the vergence point Vt1.

[0036] exist Figure 4 In another example, the sub-pixel Pxc of the display 100 may emit a light beam La3 to the eye 1021, and the sub-pixel Pxd of the display 100 may emit a light beam La4 to the eye 1023, wherein the light beam La3 and the light beam La4 may intersect at a convergence point Vt2. The eye 1021 may view the image represented by the light beam La3, and the eye 1023 may view the image represented by the light beam La4. By displaying the images represented by the light beam La3 and the light beam La4 by different sub-pixels, a misalignment may be generated between the images represented by the light beam La3 and the light beam La4, so that the two eyes converge at the convergence point Vt2, and the position of the convergence point Vt2 may be different from the position of the convergence point Vt1. In this way, by providing images to the eye 1021 and the eye 1023 by different sub-pixels, the position of the convergence plane of the sight lines of the two eyes may be adjusted.

[0037] Please refer again Figure 2 In the existing augmented reality system of example (ii), when the user views the image Vx, the position of the convergence plane Pvx of both eyes is the same as the position of the image Vx. Figure 2 In example (iii), compared to the existing augmented reality system, in the image display method of this embodiment, since the first position of the line of sight convergence plane Pv1 can be adjusted, the first position of the line of sight convergence plane Pv1 can be different from a third position of the image V1.

[0038] On the other hand, Figure 2In example (iii) of the present embodiment, in the image display method, when a single eye of a user (such as eye 1021 or eye 1023) views image V1, it can be focused on a focusing plane Pa1 (or can be called a first focusing plane), and a fourth position of the focusing plane Pa1 is the same as the third position of image V1, but the present invention is not limited thereto. In addition, there can be a distance D3 (or can be called a third distance) between the fourth position of the focusing plane Pa1 and the user.

[0039] Please refer to Figure 5 , which is a schematic diagram showing the positional relationship between the convergence planes of both eyes and the focusing plane of a single eye when the user views the image V1. Figure 5 The distance Di in the figure may be the distance D1 between the convergence plane Pv1 of the two eyes and the user when the user views the image V1, and Figure 5 The distance Da in the figure may be the distance D3 between the focusing surface Pa1 of a single eye and the user when the user views the image V1. Figure 5 As shown, the distance Di and the distance Da may have a range R2, and the distance D1 and the distance D3 may fall within the range R2. When the distance D1 and the distance D3 fall within the range R2, the distance difference between the position of the focusing plane Pa1 and the position of the visual convergence plane Pv1 can be reduced, thereby reducing the discomfort caused by the user's visual convergence-accommodation conflict.

[0040] When the distance D1 and the distance D3 fall within Figure 5 When the distance D1 and the distance D3 are within the range R2, the distance D1 and the distance D3 may satisfy a second relationship as follows:

[0041] D3+(D1 / 1.3052-0.2657*D1)<Δd1<D3-(D1 / 1.1286+0.442*D1)

[0042] There is a distance difference Δd1 between the distance D1 and the distance D3. When the distance difference Δd1 satisfies the second relational expression, the user's discomfort caused by the visual convergence accommodation conflict can be alleviated. In addition, in some embodiments, the second relational expression can be: 0≤Δd1<D3-(D1 / 1.1286+0.442*D1).

[0043] The display 100 may include light emitting diodes, liquid crystals, fluorescence, phosphor, other suitable display media or combinations thereof, but is not limited thereto. Light emitting diodes may include, for example, organic light-emitting diodes (OLED), inorganic light-emitting diodes (LED), sub-millimeter light emitting diodes (mini-light-emitting diodes, miniLED), micro-light-emitting diodes (micro-LED), quantum dots (QDs) light emitting diodes (such as QLED, QDLED), other suitable materials or any combination thereof, but is not limited thereto. The display 100 may also be a bendable or flexible electronic device. In addition, Figure 4 As shown, the surface of the display may include a plurality of lenses 101 , and the lenses 101 may have different shapes according to different optical requirements, but the present invention is not limited thereto.

[0044] The optical element 104 may include a mirror, a lens, or a combination thereof, but is not limited thereto. The optical element 104 may include an image surface shift system, but is not limited thereto. The image surface shift system may include a projector system, a light field technology element, a folding light path element, or a combination thereof, but is not limited thereto. The projection system may include a lens projector, a mirror, or a combination thereof, but is not limited thereto. The light field technology element may include a holographic optical element (HOE), an integral image element, or a combination thereof, but is not limited thereto. The light path folding element may include a multi-mirror and space element, but is not limited thereto.

[0045] The glass 112 may include a windshield, but is not limited thereto. The glass 112 may be wedge type, flat type, curve type, or a combination thereof, but is not limited thereto. The glass 112 may also have a film thereon, but is not limited thereto.

[0046] The sensing element 106 may include an eye tracking sensor, a head tracking sensor, a feature tracking sensor, or a combination thereof, but is not limited thereto.

[0047] The sensing element 110 may include an environment sensor, but is not limited thereto. The sensing element 110 may include a camera, a light field camera, a structured light camera, a feature detector, a lidar, a radar, or a combination thereof, but is not limited thereto.

[0048] The controller 108 may include a programmable program to perform algorithm processing, which may include, for example, a central processing unit (CPU), a system on chip (SoC) or an application specific integrated circuit (ASIC), but is not limited thereto. For example, the controller 108 may receive information obtained by the sensing element 106 and the sensing element 110, such as street scenes, passers-by, user's eye information, etc. Based on this information, the controller 108 may calculate the image information required by the display 100 through an algorithm. The controller 108 may transmit display data containing the image information to the display 100, and the display 100 may provide an image V1 according to the display data, thereby realizing the image display method of the present invention.

[0049] Other embodiments of the present invention will be described in detail below. To simplify the description, the same reference numerals are used to mark the same elements. In order to highlight the differences between the embodiments, the differences between the embodiments are described in detail below, and the repeated technical features are not repeated. In addition, these repeated technical features can be applied to the following embodiments.

[0050] Please refer to Figure 6 and Figure 7 , Figure 6 FIG. 1 is a schematic diagram showing a user viewing an image according to a second embodiment of the present invention. Figure 7 FIG. 1 is a schematic diagram of a user viewing state according to a second embodiment of the present invention. In some embodiments, the display 100 of the electronic device 10 can provide multiple images. Figure 6In addition to the image V1, the display may also provide an image V2 (or may be referred to as a second image), and the image V2 may be located on a virtual image plane Pj. The position of the virtual image plane Pj may be different from the position of the virtual image plane Pi, so the position of the image V2 may be different from the position of the image V1. The user's eyes may see the image V2 through the glass 112, and the image V2 and the surrounding scene may exist in the user's field of vision.

[0051] like Figure 7 When the user views the image V2, a line of sight convergence plane Pv3 (or a third line of sight convergence plane) of the user's two eyes may be located at a fifth position, and the fifth position of the line of sight convergence plane Pv3 may be aligned with the line of sight convergence plane Pv1 (e.g. Figure 2 ). When the user looks at a second object in the environment scene, a line of sight convergence plane Pv4 (or may be called a fourth line of sight convergence plane) of the two eyes may be located at a sixth position. The positions of the first object and the second object in the environment scene may be different, so Figure 7 The sixth position of the line of sight convergence surface Pv4 in Figure 2 In addition, the fifth position of the line of sight converging surface Pv3 is at a distance D4 (or may be referred to as the fourth distance) from the user, and the sixth position of the line of sight converging surface Pv4 is at a distance D5 (or may be referred to as the fifth distance) from the user.

[0052] In order to allow the user to clearly see the image V2 and the second object in the environment at the same time, or to effectively reduce the discomfort felt by the user, the distance D4 and the distance D5 can also be within Figure 3 Within the range R1. At this time, Figure 3 The distance Di in the figure can be the distance D4 between the line of sight convergence plane Pv3 of both eyes and the user when the user views the image V2, and Figure 3 The distance Dr in the figure may be the distance D5 between the line of sight convergence plane Pv4 and the user when the user is viewing the second object in the environment scene. Figure 3 When the distance D4 and the distance D5 are within the range R1, the distance D4 and the distance D5 can meet a third relationship: <D4<Dt。

[0053] In the third relational expression, the lower limit distance Ds = D5 + Δs, and the lower limit distance Ds (such as Figure 3 ) may be the shortest distance Di at which the user can clearly see the image V2 and the second object in the environment at the same time. The upper limit distance Dt = D5 + Δt, and the upper limit distance Dt (such as Figure 3 ) may be the farthest distance Di at which the user can clearly see the image V2 and the second object in the environment at the same time. In addition, Δs=(De / 2)*{tan[tan -1(2*D5 / De)-δ]}-D5, and Δt=(De / 2)*{tan[tan -1 (2*D5 / De)+δ]}-D5. Furthermore, De represents the distance between the two eyes (e.g. Figure 2 A distance De between the middle eye 1021 and the eye 1023), δ represents the individual eye corner identification rate of the two eyes, and δ = 0.02 degrees.

[0054] Therefore, when there are a first object and a second object in the environment, and the distance between the first object and the user is different from the distance between the second object and the user, the electronic device 10 can provide an image V1 corresponding to the first object and provide an image V2 corresponding to the second object. In addition, by adjusting the position of the convergence plane of the user's eyes when viewing the augmented reality images V1 and V2 through the image display method of this embodiment, the user can clearly view the image V1 and the first object in the environment at the same time, or clearly view the image V2 and the second object in the environment at the same time.

[0055] On the other hand, when the user's single eye (such as eye 1021 or eye 1023) views the image V2, it can be focused on a focus plane Pa2 (also referred to as a second focus plane), and a seventh position of the focus plane Pa2 is the same as the position of the image V2. Figure 6 ), so the focal plane Pa2 (such as Figure 7 ) is also at the seventh position of the focal plane Pa1 (such as Figure 2 In addition, there may be a distance D6 (or may be referred to as a sixth distance) between the seventh position of the focusing plane Pa2 and the user.

[0056] In order to reduce the discomfort caused by the conflict of visual convergence and accommodation, the distance D4 and the distance D6 can also be set within Figure 5 Within the range R2. At this time, Figure 5 The distance Di in the figure can be the distance D4 between the line of sight convergence plane Pv3 of both eyes and the user when the user views the image V2, and Figure 5 The distance Da in the figure can be the distance D6 between the focusing surface Pa2 of the single eye and the user when the user views the image V2. Figure 5 When the distance D4 and the distance D6 are within the range R2, the distance D4 and the distance D6 may satisfy a fourth relationship as follows:

[0057] D6+(D4 / 1.3052-0.2657*D4)<Δd2<D6-(D4 / 1.1286+0.442*D4)

[0058] There is a distance difference Δd2 between the distance D4 and the distance D6. In addition, in some embodiments, the fourth relationship may be: 0≤Δd2<D6-(D4 / 1.1286+0.442*D4).

[0059] In some embodiments, the image V1 and the image V2 may be displayed in different areas of the display 100, such as Figure 4 , image V1 and image V2 may be displayed by sub-pixels in different areas of the display 100, so that the user may have different visual convergence planes (such as convergence point Vt1 and convergence point Vt2) when viewing image V1 and image V2, but the present invention is not limited thereto. In some other embodiments, the display 100 may provide image V1 at a first time point and provide image V2 at a second time point, and the first time point and the second time point are different, but the present invention is not limited thereto. The above method may make the positions of the visual convergence planes of the two eyes of the user viewing image V1 and image V2 different, or may make the position of the focusing plane of a single eye of the user viewing image V1 and image V2 different, wherein the method for adjusting the position of the focusing plane may refer to the subsequent Fig.10 .

[0060] Please refer to Figure 8 , which is a schematic diagram of a user viewing an image according to the third embodiment of the present invention. Figure 8 ), the display 100 of the electronic device 10 can provide an image V3, and the image V3 can be located on a virtual image plane Pk, and the distances between different parts of the image V3 or the virtual image plane Pk and the user can be different. For example, the image V3 can include different image contents displayed by different areas (or sub-pixels) of the display 100. When the user views these different image contents, the user can have the convergence planes of the two eyes or the focusing planes of one eye at different distances, but the present invention is not limited thereto. In addition, the convergence planes of the two eyes and different objects in the environment scene can satisfy Figure 3 The range R1 in the range R2, or the convergence plane of the two eyes and the focusing plane of the single eye can satisfy Figure 5 Therefore, the user can clearly view different image contents and different objects in the environment at the same time, or the discomfort caused by the visual convergence and accommodation conflict of the user can be alleviated.

[0061] Please refer to Fig. 9 , which is a schematic diagram of the user's viewing state according to the fourth embodiment of the present invention. In some embodiments, when the distance D1 between the convergence plane Pv1 of the two eyes and the user and the distance D3 between the focusing plane Pa1 of one eye and the user are within Figure 5When the image is outside the range R2, or when it is necessary to reduce the distance difference between the position of the focusing plane Pa1 and the position of the line of sight convergence plane Pv1 to further reduce the discomfort caused by the user's visual convergence adjustment conflict, the position of the focusing plane Pa1 can be further adjusted in the image display method.

[0062] Different from the first embodiment (such as Figure 2 Example (iii)), in this embodiment (such as Fig. 9 ), when a single eye of the user (such as eye 1021 or eye 1023) views the image V1, it focuses on the focus plane Pa1, and the fourth position of the focus plane Pa1 may be different from the third position of the image V1, and the fourth position of the focus plane Pa1 may also be different from the first position of the line of sight convergence plane Pv1. Therefore, the fourth position of the focus plane Pa1 may be closer to the first position of the line of sight convergence plane Pv1, and the distance difference Δd1 between the distance D1 and the distance D3 may be further reduced.

[0063] The following is a description of the method for adjusting the focus position of a single eye in this embodiment. Fig.10 , which is a schematic diagram of adjusting the position of the focusing plane of a single eye according to the present invention. Fig.10 The eye 1021 is taken as an example, but this method can also be applied to the eye 1023. In addition, for the simplicity of the diagram, Fig.10 Omitted Figure 1 The optical element 104 and the glass 112 are shown in FIG.

[0064] exist Fig.10 In example (i), subpixel Px1, subpixel Px2, subpixel Px3, subpixel Px4, subpixel Px5, subpixel Px6 and subpixel Px7 of the display 100 can respectively emit light beams Lb1, light beam Lb2, light beam Lb3, light beam Lb4, light beam Lb5, light beam Lb6 and light beam Lb7 to view points (view point) Vp1, view point Vp2, view point Vp3, view point Vp4, view point Vp5, view point Vp6 and view point Vp7 on a side Pe where the eye 1021 is located, wherein light beams Lb1, light beam Lb2, light beam Lb3, light beam Lb4, light beam Lb5, light beam Lb6 and light beam Lb7 can be focused on a focal point (accommodation point) Ap1.

[0065] Furthermore, the light beams Lb3, Lb4 and Lb5 emitted by the sub-pixel Px3, the sub-pixel Px4 and the sub-pixel Px5 can enter the pupil 114 of the eye 1021 in different viewing directions. In other words, the eye 1021 can simultaneously view the light beams Lb3, Lb4 and Lb5 emitted by different sub-pixels. Extending from the above principle, each light beam can represent an image, each image can be displayed by one or more corresponding sub-pixels, and different images can be displayed by different sub-pixels. For example, an image provided by the display 100 can include images represented by the light beams Lb1 to Lb7 at the same time, and the eye 1021 can simultaneously view the images represented by the light beams Lb3, Lb4 and Lb5. By displaying the images represented by light beams Lb3, Lb4 and Lb5 by different sub-pixels, the images represented by light beams Lb3, Lb4 and Lb5 can be misaligned with each other in the same image, so that the eye 1021 can focus on the focal point Ap1.

[0066] Also in Fig.10 In example (ii), subpixel Px8, subpixel Px9, subpixel Px10, subpixel Px11, subpixel Px12, subpixel Px13 and subpixel Px14 of the display 100 may respectively emit light beams Lb8, light beam Lb9, light beam Lb10, light beam Lb11, light beam Lb12, light beam Lb13 and light beam Lb14 to viewpoints Vp8, viewpoint Vp9, viewpoint Vp10, viewpoint Vp11, viewpoint Vp12, viewpoint Vp13 and viewpoint Vp14 on the plane Pe where the eye 1021 is located, wherein light beams Lb8, light beam Lb9, light beam Lb10, light beam Lb11, light beam Lb12, light beam Lb13 and light beam Lb14 may be focused on another focus Ap2, and the positions of focus Ap2 and focus Ap1 are different.

[0067] Furthermore, the light beams Lb8, Lb9 and Lb10 emitted by the sub-pixel Px8, the sub-pixel Px9 and the sub-pixel Px10 can enter the pupil 114 of the eye 1021 in different visual directions. In other words, the eye 1021 can simultaneously view the light beams Lb8, Lb9 and Lb10 emitted by different sub-pixels. For example, an image provided by the display 100 can simultaneously include images represented by the light beams Lb8 to Lb14, and the eye 1021 can simultaneously view the images represented by the light beams Lb8, Lb9 and Lb10. By displaying the images represented by the light beams Lb8, Lb9 and Lb10 by different sub-pixels, the images represented by the light beams Lb8, Lb9 and Lb10 can be misaligned with each other in the same image, so that the eye 1021 can focus on the focal point Ap2.

[0068] like Fig.10 By displaying different images (such as an image including light beams Lb1-Lb7 and an image including light beams Lb8-Lb14) through different sub-pixels (such as sub-pixels Px1-Px7 and sub-pixels Px8-Px14), the image provided by the display 100 can have different misalignment amounts, thereby adjusting Fig. 9 For example, the controller 108 may calculate the image information (such as information about the amount of misalignment) required by the display 100 through an algorithm, and the controller 108 may transmit display data including the image information to the display 100, and the display 100 may provide an image V1 according to the display data, thereby realizing the method of adjusting the focus plane of the monocular eye.

[0069] In addition, Fig.10 For example, viewpoint Vp1, viewpoint Vp2, viewpoint Vp6 and viewpoint Vp7 (or viewpoint Vp11, viewpoint Vp12, viewpoint Vp13 and viewpoint Vp14) are located outside the pupil 114. These viewpoints (or the images they represent) allow the eye 1021 to see images while moving, that is, these viewpoints increase the dimension of the eye's movement range.

[0070] In the image display method of the present invention, the position of the line of sight convergence plane of the two eyes can be adjusted so that the position of the line of sight convergence plane and the position of the image are different. When the user views the augmented reality image, the line of sight convergence plane of the two eyes of the user is at a first distance from the user, and the focusing plane of one eye is at a third distance from the user. When the user views an object in the environment scene, the line of sight convergence plane of the two eyes is at a second distance from the user. By controlling the first distance and the second distance to Figure 3 Within the range R1, the user can clearly see the augmented reality image and the objects in the environment at the same time, or can effectively reduce the discomfort felt by the user. In addition, by controlling the first distance and the third distance to Figure 5 Within the range R2, the uncomfortable feeling of the user caused by the visual convergence and accommodation conflict can be alleviated.

[0071] The above description is only an embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An image display method of an electronic device, characterized in that: include: A display provides a first image, wherein when a user views the first image, a first visual convergence plane of two eyes of the user is located at a first position; and The display provides a second image, wherein the first image, the second image, and an environmental scene exist in a field of vision of the user, and when the user views the second image, a second visual convergence plane of the two eyes of the user is located at a second position; There is a first distance between the first position of the first line of sight convergence plane and the user, there is a second distance between the second position of the second line of sight convergence plane and the user, and the first distance is different from the second distance, and when the user views the first image, a first focusing plane of a single eye of the user is located at a third position, and the third position is different from the first position.

2. The image display method of the electronic device as claimed in claim 1, characterized in that: The first image and the second image are provided by different areas of the display.

3. The image display method of the electronic device as claimed in claim 1, characterized in that: The display provides the first image at a first time point and provides the second image at a second time point, and the first time point and the second time point are different.

4. The image display method of the electronic device as claimed in claim 3, characterized in that: When the monocular eye of the user views the second image, a second focusing plane focused by the monocular eye of the user is located at a fourth position, and the third position is different from the fourth position.

5. The image display method of the electronic device as claimed in claim 1, characterized in that: When the user looks at an object in the environment scene, a third sight convergence plane of the user's two eyes is located at a fifth position, There is a third distance between the fifth position and the user, and the third distance and the first distance satisfy a relationship: Dn <D1<Df, Where D1 represents the first distance, Dn = D2 + Δn, and Df = D2 + Δf, Where D2 represents the third distance, Δn=(De / 2)*{tan[tan -1 (2*D2 / De)-δ]}–D2, and Δf=(De / 2)*{tan[tan -1 (2*D2 / De)+δ]}–D2, and Wherein De represents a distance between the two eyes, δ represents a per-eye angle discrimination rate of the two eyes, and δ=0.02 degrees.

6. The image display method of the electronic device as claimed in claim 1, characterized in that: The display includes liquid crystal.

7. The image display method of an electronic device as claimed in claim 1, wherein: The display includes light emitting diodes.

8. The image display method of an electronic device as claimed in claim 1, wherein: The electronic device is used in a vehicle.

9. An image display method of an electronic device, characterized in that: include: A display provides a first image, wherein when a user views the first image, a first visual convergence plane of two eyes of the user is located at a first position; and The display provides a second image, wherein the first image, the second image, and an environmental scene exist in a field of vision of the user, and when the user views the second image, a second visual convergence plane of the two eyes of the user is located at a second position; There is a first distance between the first position of the first line of sight convergence plane and the user, there is a second distance between the second position of the second line of sight convergence plane and the user, and the first distance is different from the second distance, wherein when the user views the first image, a first focusing plane focused on one eye of the user is located at a third position, wherein when the user views the second image, a second focusing plane focused on one eye of the user is located at a fourth position, and the third position is different from the fourth position.

10. The image display method of the electronic device as claimed in claim 9, wherein: The first image and the second image are provided by different areas of the display.

11. The image display method of an electronic device as claimed in claim 9, wherein: The display provides the first image at a first time point and provides the second image at a second time point, and the first time point and the second time point are different.

12. The image display method of an electronic device as claimed in claim 9, wherein: When the user looks at an object in the environment scene, a third sight convergence plane of the user's two eyes is located at a fifth position, There is a third distance between the fifth position and the user, and the third distance and the first distance satisfy a relationship: Dn <D1<Df, Where D1 represents the first distance, Dn = D2 + Δn, and Df = D2 + Δf, Where D2 represents the third distance, Δn=(De / 2)*{tan[tan -1 (2*D2 / De)-δ]}–D2, and Δf=(De / 2)*{tan[tan -1 (2*D2 / De)+δ]}–D2, and Wherein De represents a distance between the two eyes, δ represents a per-eye angle discrimination rate of the two eyes, and δ=0.02 degrees.

13. The image display method of an electronic device as claimed in claim 9, wherein: The display includes liquid crystal.

14. The image display method of an electronic device as claimed in claim 9, wherein: The display includes light emitting diodes.

15. The image display method of an electronic device as claimed in claim 9, wherein: The electronic device is used in a vehicle.

Images