Augmented reality display device and method

Abstract

The present invention provides an augmented reality display device and an augmented reality display method. The augmented reality display device includes a virtual image display and a controller. The virtual image display is configured to provide a left-eye virtual image and a right-eye virtual image to a user's left and right eyes, respectively. The controller is electrically connected to the virtual image display and is configured to instruct the virtual image display to display a left-eye virtual marker and a right-eye virtual marker corresponding to a real marker in space in the left-eye virtual image and the right-eye virtual image, respectively. The controller also calculates the pupil distance between the left and right eyes based on the deviation of the left-eye virtual marker and the deviation of the right-eye virtual marker relative to the real marker.

Description

Technical Field

[0001] The present invention relates to a display device and method, and in particular to an augmented reality display device and method. Background Art

[0002] Interpupillary distance (IPD) varies significantly from person to person. People with larger IPDs often experience a more 3D perception of ordinary objects than those with smaller IPDs. For this reason, when using stereoscopic display products, such as augmented reality displays, virtual reality displays, or 3D televisions, the user's IPD must be entered into the software to achieve a more realistic 3D size and perception. This is especially true in augmented reality applications, where virtual images must be superimposed on real objects. Failure to enter the user's IPD can lead to errors in the superposition of the virtual image and real object, as well as uncertainty in the distortion grid correction process. This can result in different perceptions for people with larger or smaller IPDs.

[0003] Methods for detecting or adjusting pupillary distance typically involve facial contour scanning or mechanical adjustment. The former primarily requires external devices and is passive, while the latter can be achieved internally. However, when adjusting the actual hardware pupillary distance, the user can only observe the relative value of the optical quality. In other words, the user does not know whether the adjustment has reached the true optimal position, and there may be a certain amount of deviation. If the pupillary distance input required for back-end stereoscopic vision generation comes from this hardware adjustment device, this deviation is a serious problem, as it may result in an incorrect stereoscopic position being projected to the user during back-end stereoscopic vision generation. Summary of the Invention

[0004] The present invention is directed to an augmented reality display device capable of calculating pupil distance.

[0005] The present invention is directed to an augmented reality display method, which can calculate pupil distance.

[0006] One embodiment of the present invention provides an augmented reality display device, comprising a virtual image display and a controller. The virtual image display is configured to provide a left-eye virtual image and a right-eye virtual image to a user's left eye and right eye, respectively. The controller is electrically connected to the virtual image display and is configured to command the virtual image display to display a left-eye virtual marker and a right-eye virtual marker corresponding to a real marker in space in the left-eye virtual image and the right-eye virtual image, respectively. The controller also calculates the pupil distance between the left eye and the right eye based on the deviation of the left-eye virtual marker from the real marker and the deviation of the right-eye virtual marker from the real marker, and commands the virtual image display to display the correct left-eye virtual image and the right-eye virtual image based on the calculated pupil distance.

[0007] One embodiment of the present invention provides an augmented reality display method, comprising: providing a left-eye virtual image and a right-eye virtual image to the left and right eyes of a user, respectively, wherein the left-eye virtual image has a left-eye virtual marker corresponding to a real marker in space, and the right-eye virtual image has a right-eye virtual marker corresponding to the real marker; calculating the pupil distance between the left eye and the right eye based on the deviation of the left-eye virtual marker relative to the real marker and the deviation of the right-eye virtual marker relative to the real marker; and displaying the correct left-eye virtual image and the right-eye virtual image based on the calculated pupil distance.

[0008] In the augmented reality display device and method according to the embodiments of the present invention, a left-eye virtual marker and a right-eye virtual marker corresponding to a real marker in space are displayed in the left-eye virtual image and the right-eye virtual image, respectively. The pupil distances of the left and right eyes are calculated based on the deviation of the left-eye virtual marker and the right-eye virtual marker from the real marker. Therefore, the augmented reality display device and method according to the embodiments of the present invention can calculate the pupil distance, thereby facilitating the accurate display of stereoscopic images. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a structural diagram of an augmented reality display device according to an embodiment of the present invention;

[0010] Figure 2 The pixel offset between the left-eye virtual image and the right-eye virtual image generates images with different viewing angles for the left eye and the right eye;

[0011] Figure 3 Shows the different visual angles produced by the left eye when the object is at two different convergence distances;

[0012] Figure 4 It shows that when the convergence distance VD is different, the size of the virtual object seen by the human eye will also be different;

[0013] Figure 5A for Figure 1 Schematic diagram of a left-eye virtual marker, a right-eye virtual marker, and a real marker in space generated by an augmented reality display device;

[0014] Figure 5B A diagram showing the positions of the left-eye virtual marker, the right-eye virtual marker, and the real marker viewed by the user when the pupil distance set by the augmented reality display device is incorrect;

[0015] Figure 5C For Figure 5B Detailed schematic diagram of the virtual image and real mark viewed by the user in the case of ;

[0016] Figure 6 Show Figure 1 When the virtual image display shows the correct left-eye virtual image and right-eye virtual image, the left-eye virtual mark, the right-eye virtual mark and the real mark overlap with each other;

[0017] Figure 7 for Figure 1 Diagram of pupil distance adjustment architecture for augmented reality display devices;

[0018] Figure 8 for Figure 1 System flow chart of augmented reality display device;

[0019] Figure 9A for Figure 1 A schematic diagram of an application scenario of an augmented reality display device taking into account a user's dominant eye;

[0020] Figure 9B For Figure 9A A schematic diagram of the positions of the left-eye virtual marker, the right-eye virtual marker, and the real marker viewed by the user in an application scenario;

[0021] Figure 10 for Figure 1 A schematic diagram of another calculation method for an augmented reality display device when considering the user's dominant eye;

[0022] Figure 11 FIG. 4 is a flowchart of an augmented reality display method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0023] Reference will now be made in detail to exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Whenever possible, the same reference numerals are used in the drawings and the description to refer to the same or like parts.

[0024] Figure 1 This is a schematic diagram of the structure of an augmented reality display device according to an embodiment of the present invention. Figure 1The augmented reality display device 100 of this embodiment includes a virtual image display 200 and a controller 110. The virtual image display 200 is used to provide a left-eye virtual image and a right-eye virtual image to the user's left eye 50a and right eye 50b, respectively. In this embodiment, the virtual image display 200 includes a left-eye display 120a, a right-eye display 120b, and at least one light guide 130 (two light guides 130 are used as an example in this embodiment). Each of the left-eye display 120a and the right-eye display 120b is used to provide an image beam 122, and the light guide 130 guides the left image beam 122 and the right image beam 122 to the user's left eye 50a and right eye 50b, respectively, so that the left eye 50a and the right eye 50b respectively view the left-eye virtual image and the right-eye virtual image, wherein the left-eye virtual image and the right-eye virtual image are both virtual images that appear in front of the left eye 50a and the right eye 50b. In this embodiment, the left-eye display 120 a and the right-eye display 120 b may include a display panel, a light valve, a lens, an illumination light source, or a combination thereof, so that the left-eye display 120 a and the right-eye display 120 b may become projectors for projecting the image light beam 122 . The display panel may be, for example, an organic light emitting diode (OLED) display panel, a liquid crystal display (LCD) panel, or other appropriate display panels, and the light valve may be, for example, a liquid-crystal-on-silicon (LCOS) panel, a digital micro-mirror device (DMD), or other spatial light modulators.

[0025] Furthermore, the light guide 130 allows light 62 from external objects 60 to pass through and be transmitted to the left eye 50a and the right eye 50b, allowing the user to view the external objects 60 through the light guide 130. In this way, the user can simultaneously see the left-eye virtual image, the right-eye virtual image, and the external objects 60, achieving an augmented reality effect.

[0026] In this embodiment, the light guide 130 can be any optical element capable of guiding the image beam 122 toward the eye, such as a lens having a diffractive microstructure on its surface, a light guide plate, a prism, a semi-transmissive mirror, a light guide plate including micro-mirrors, or other optical elements. In this embodiment, the augmented reality display device 100 further includes a glasses frame 140, and the left-eye display 120a, the right-eye display 120b, and the light guide 130 are disposed on the glasses frame 140.

[0027] Figure 2 The pixel offset between the left-eye virtual image and the right-eye virtual image generates images with different viewing angles for the left eye and the right eye. Figure 3The figure shows that the object produces different visual angles for the left eye at two different convergence distances. Figure 2 It can be seen that the left eye virtual image 70a and the right eye virtual image 70b have different viewing angles, so that the left eye 50a and the right eye 50b can respectively watch the left eye virtual image 70a and the right eye virtual image 70b to form a stereoscopic visual image in the user's brain. Figure 3 As can be seen, different convergence distances D1 and D2 correspond to different viewing angles θ1 and θ2, respectively. Since the pixels per degree (PPD) of the left-eye display 120a and the right-eye display 120b are known, the viewing angle can be calculated from the pixel offset between the left-eye virtual image 70a and the right-eye virtual image 70b. The PPD refers to the number of pixels offset when the viewing angle is offset by 1 degree. When the line connecting the left eye 50a and the right eye 50b is perpendicular to the front, the offset pixel count ΔPixel and the offset viewing angle Δ(α / 2) are as follows:

[0028] ΔPixel=PPD×Δ(α / 2)…Equation (1)

[0029] Wherein, PPD is the number of pixels per degree mentioned above, and Δ(α / 2) is, for example, Figure 3 θ2 minus θ1 in θ.

[0030] In addition, the visual angle α / 2 and the interpupillary distance (IPD) conform to the following relationship:

[0031]

[0032] Wherein, IPD is the above-mentioned pupil distance, i.e., the distance from the pupil of the left eye 50a to the pupil of the right eye 50b, and VD is the above-mentioned vergence distance, i.e., the distance from the point where the sight lines of the two eyes meet to the midpoint between the two eyes. As can be seen from formula (2), if the viewing angle α / 2 and the vergence distance VD are known, the pupil distance IPD can be calculated. On the other hand, if the pupil distance IPD set in the virtual image display 200 is incorrect and deviates from the actual pupil distance, then the depth of the virtual object in the virtual image (i.e., the vergence distance VD) perceived by the left eye 50a and the right eye 50b when viewing the left eye virtual image and the right eye virtual image will also change and be inaccurate, and Figure 4 This shows that when the vergence distance VD varies, the size S of virtual objects perceived by the human eye will also vary. This can cause inaccurate virtual image display, such as incorrect displayed size. Furthermore, this can lead to inaccurate depth of virtual objects. Therefore, determining the user's pupillary distance (IPD) is crucial to the accuracy of virtual image display.

[0033] Figure 5A for Figure 1 Schematic diagram of the left eye virtual marker, the right eye virtual marker and the real marker in space generated by the augmented reality display device in FIG. Figure 5B The diagram is a position diagram of the left eye virtual marker, the right eye virtual marker, and the real marker viewed by the user when the pupil distance set by the augmented reality display device is incorrect. Figure 5C For Figure 5B Detailed diagram of the virtual image and real mark viewed by the user in the case of . Figure 1 and Figures 5A to 5C In this embodiment, the controller 110 is electrically connected to the virtual image display 200 and is configured to instruct the virtual image display 200 to display a left-eye virtual marker 72a and a right-eye virtual marker 72b corresponding to the real marker 61 in space in the left-eye virtual image 70a and the right-eye virtual image 70b, respectively. The controller 110 also calculates the pupil distances of the left eye 50a and the right eye 50b based on the deviation F1 of the left-eye virtual marker 72a relative to the real marker 61 and the deviation F2 of the right-eye virtual marker 72b relative to the real marker 61. In this embodiment, the controller 110 calculates the viewing angles of the left eye 50a and the right eye 50b when viewing the real marker 61 based on the number of pixels of deviation of the left-eye virtual marker 72a and the number of pixels of deviation of the right-eye virtual marker 72b relative to the real marker 61. The controller 110 also calculates the pupil distances based on the convergence distances and viewing angles of the left eye 50a and the right eye 50b when viewing the real marker.

[0034] Specifically, when the pupil distance set by the augmented reality display device 100 is incorrect, the user will see the following Figure 5BIn this embodiment, the left-eye virtual marker 72a, the right-eye virtual marker 72b, and the real marker 61 do not overlap. In this case, the controller 110 instructs the virtual image display 200 to display scales 74 in the left-eye virtual image 70a and the right-eye virtual image 70b. The displayed scales 74 are, for example, pixel offset numbers, allowing the user to visually determine how many pixels the left-eye virtual marker 72a and the right-eye virtual marker 72b are offset from the real marker 61. Furthermore, the user can input the values ​​of the deviation F1 (e.g., the number of offset pixels) of the left-eye virtual marker 72a and the deviation F2 (e.g., the number of offset pixels) of the right-eye virtual marker 72b from the real marker 61 into the controller 110 through the user interface. In this way, the controller 110 can convert the offset pixel count into the offset viewing angle Δ(α / 2) according to the above formula (1), and calculate the pupil distance IPD based on the viewing angle α / 2, the known convergence distance VD of the real marker 61, and formula (2). Then, the controller 110 commands the virtual image display 200 to display the correct left-eye virtual image and right-eye virtual image based on the calculated pupil distance IPD. At this time, if the virtual image display 200 displays the left-eye virtual marker 72a and the right-eye virtual marker 72b, it will be found that the left-eye virtual marker 72a, the right-eye virtual marker 72b, and the real marker 61 viewed by the human eye overlap with each other, as shown in FIG. Figure 6 The user interface mentioned above is, for example, a touch interface, a button, a voice control interface, or any interface that allows a user to operate the augmented reality display device.

[0035] In another embodiment, the above-mentioned scale 74 may not be displayed, but the user may move the left eye virtual mark 72a in the left eye virtual image 70a and the right eye virtual mark 72b in the right eye virtual image 70b to a position overlapping with the real mark 61 through the user interface, and the controller 110 records the moving distance of the left eye virtual mark 72a and the right eye virtual mark 72b (for example, how many pixels have been moved), and the controller 110 calculates the pupil distance between the left eye 50a and the right eye 50b based on the moving distance of the left eye virtual mark 72a and the right eye virtual mark 72b.

[0036] Alternatively, in another embodiment, the augmented reality display device 100 further includes an adjustment mechanism 150 connecting the left-eye display 120a and the right-eye display 120b for adjusting the positions of the left-eye display 120a and the right-eye display 120b. The adjustment mechanism 150 allows a user to adjust the positions of the left-eye display 120a and the right-eye display 120b so that the left-eye virtual marker 72a in the left-eye virtual image 70a and the right-eye virtual marker 72b in the right-eye virtual image 70b are moved to a position that overlaps with the real marker 61. Furthermore, the adjustment mechanism 150 is electrically connected to the controller 110, and the controller 110 calculates the pupil distance between the left eye 50a and the right eye 50b based on the distance moved by the left-eye display 120a and the right-eye display 120b. In other embodiments, the augmented reality display device 100 may not include the adjustment mechanism 150, and instead connect the left-eye display 120a and the right-eye display 120b using the portion of the glasses frame 140 corresponding to the position between the two eyes.

[0037] In one embodiment, the controller 110 is, for example, a central processing unit (CPU), a microprocessor (microprocessor), a digital signal processor (DSP), a programmable controller (PC), a programmable logic device (PLD), or other similar devices or combinations thereof, but the present invention is not limited thereto. Furthermore, in one embodiment, the various functions of the controller 110 may be implemented as multiple program codes. These program codes may be stored in a memory and executed by the controller 110. Alternatively, in one embodiment, the various functions of the controller 110 may be implemented as one or more circuits. The present invention is not limited to the implementation of the various functions of the controller 110 using software or hardware.

[0038] Figure 7 for Figure 1 The pupil distance adjustment architecture diagram of the augmented reality display device. Please refer to Figure 1 and Figure 7 The user can input the pupil distance he knows into the software of the loading controller 110 through the above user interface, or if the augmented reality display device 100 has an adjustment mechanism 150 (i.e. Figure 7 When the hardware in the left-eye display 120a and the right-eye display 120b are not adjusted, the adjustment mechanism 150 can also be used to preliminarily adjust the distance between the left-eye display 120a and the right-eye display 120b. The adjustment mechanism 150 inputs the value of the adjustment result into the software of the controller 110, and the software then converts this value into the pupil distance.

[0039] Then, the software of the loading controller 110 performs the above steps. Figures 5A to 5Cand Figure 6 to confirm the pupil distance for the user, i.e. Figures 5A to 5C In this way, the user can judge whether the left eye virtual mark 72a, the right eye virtual mark 72b and the real mark 61 overlap.

[0040] Figure 8 for Figure 1 Please refer to the system flow chart of the augmented reality display device. Figure 1 and Figure 8 Regarding the value of the user's pupil distance IPD, first step S105 is executed, and the user provides the pupil distance IPD through the user interface. Then, step S110 is executed to determine whether the augmented reality display device 100 includes the above-mentioned adjustment mechanism 150. If the judgment is yes, step S120 is executed to adjust the value of the hardware pupil distance IPD through the adjustment mechanism to adjust the optical quality of the optical machine, and then step S130 is executed. If the judgment of step S110 is no, step S120 is not executed, and the process jumps directly to step S130. Step S130 is to perform the above-mentioned Figures 5A to 5C and Figure 6 to confirm the pupil distance for the user, i.e. Figures 5A to 5C In this way, the user can determine whether the left eye virtual mark 72a, the right eye virtual image 70b and the real mark 61 overlap. If the judgment in step S130 is yes, the numerical correction of the pupil distance in the system is completed and the process ends. If the judgment in step S130 is no, the system returns to step S105, and at this time the user can use the above description to Figures 5A to 5C and Figure 6 The value of the pupil distance is adjusted by the paragraph. In addition, before generating a stereoscopic virtual image, the augmented reality display device 100 can also be spatially positioned, such as in step S140. In this way, for example, the relative position relationship between the augmented reality display device 100 and a real object in space can be obtained. This can be achieved using a depth sensor, a camera, or an eye tracker. Spatial positioning can obtain the above-mentioned convergence distance VD when viewing the real object 60, or the distance from the left eye 50a to the object 60, the distance from the right eye 50b to the object 60, or the distance between any two points in the real space, but does not include measuring the distance of the virtual image.

[0041] Figure 9A for Figure 1 Schematic diagram of an augmented reality display device when considering the user's dominant eye. Figure 9B For Figure 9A Schematic diagram of the positions of the left eye virtual marker, right eye virtual marker and real marker viewed by the user in the application scenario. Figure 1 、 Figure 9A and Figure 9B, considering that humans usually have a dominant eye and the head may tilt to one side when viewing an object 50 in the outside world, the augmented reality display device 100 can calculate the pupil distance in the following manner.

[0042] In this embodiment, the controller 110 is configured to calculate the left eye viewing angle α of the left eye 50a viewing the real mark 61 based on the number of pixels of deviation between the left eye virtual mark 72a and the real mark 61. L , and the right eye viewing angle α of the right eye viewing the real mark is calculated based on the number of pixels of the deviation between the right eye virtual mark 72b and the real mark 61 R , where the number of deviation pixels is obtained in the same way as described in Figures 5A to 5C and Figure 6 As in the paragraph above, the user can input the information by looking at the scale; or when the user moves the left eye virtual marker 72a and the right eye virtual marker 72b through the software to make them overlap with the real marker 61, the software records the number of pixels moved; or when the user adjusts the position of the left eye display 120a and the right eye display 120b through the adjustment mechanism 150 to make the left eye virtual marker 72a and the right eye virtual marker 72b overlap with the real marker 61, the adjustment distance is converted into the number of pixels moved. Among them, the number of pixels of deviation ΔPixelL of the left eye virtual marker 72a, the number of pixels of deviation ΔPixelR of the right eye virtual marker 72b, and the left eye offset angle of view Δα are L and right eye offset angle Δα R The conversion formula is as follows:

[0043]

[0044]

[0045] Then, the controller 110 is used to calculate the distance L from the left eye 50a to the real mark 61, the distance R from the right eye 50b to the real mark 61, the distance D from the midpoint M of the left eye 50a and the right eye 50b to the real mark 61, the left eye viewing angle α, and the distance L from the left eye 50a to the real mark 61. L and right eye viewing angle α R , calculate the pupil distance IPD, where the left eye viewing angle α L is the angle between the line from the left eye 50a to the real mark 61 and the line from the midpoint M to the real mark 61, and the right eye viewing angle α R is the angle between the line connecting the right eye 50b to the real mark 61 and the line connecting the midpoint M to the real mark 61. The calculation formula is as follows:

[0046]

[0047]

[0048]

[0049] By applying equations (5) to (7), the pupil distance IPD can be calculated.

[0050] Figure 10 for Figure 1 A schematic diagram of another calculation method for an augmented reality display device taking into account the user's dominant eye. Figure 1 and Figure 10 , Figure 10 The calculation method of Figure 9A The calculation method of the two is similar, and the difference lies in the different definition of the viewing angle. In this embodiment, the controller 110 is used to calculate the left eye viewing angle α' of the left eye 50a viewing the real mark 61 based on the deviation pixel number ΔPixelL of the left eye virtual mark 72a relative to the real mark 61. L , and the right eye viewing angle α′ of the right eye 50b viewing the real mark 61 is calculated based on the deviation pixel number ΔPixelR of the right eye virtual mark 72b relative to the real mark 61 R The controller 110 is used to calculate the distance L between the left eye 50a and the real mark 61, the distance R between the right eye 50b and the real mark 61, the vertical distance D between the real mark 61 and the line connecting the left eye and the right eye, and the left eye viewing angle α'. L and right eye viewing angle α' R , calculate the pupil distance IPD, where the left eye viewing angle α' L is the angle between the line from the left eye to the real mark 61 and the perpendicular line N from the line from the real mark 61 to the left eye and the right eye, and the right eye viewing angle α' R is the angle between the line connecting the right eye 50b and the real mark 61 and the vertical line N. The pupil distance IPD is calculated by the following formula:

[0051]

[0052]

[0053] IPD=IPD L +IPD R …Formula (10)

[0054] Among them, IPD L is the vertical distance from the left eye 50a to the vertical line N, and IPD R is the vertical distance from the right eye 50b to the vertical line N.

[0055] Figure 11 This is a flow chart of an augmented reality display method according to an embodiment of the present invention. Figure 1 、 Figures 5A to 5C and Figure 11The augmented reality display method of the present invention can be implemented using the augmented reality display device 100 of each of the above embodiments, and includes the following steps. First, step T110 is executed, which provides a left-eye virtual image 70a and a right-eye virtual image 70b to the user's left eye 50a and right eye 50b respectively, wherein the left-eye virtual image 70a has a left-eye virtual marker 72a corresponding to the real marker 61 in space, and the right-eye virtual image 70b has a right-eye virtual marker 72b corresponding to the real marker 61. Then, step T120 is executed, which calculates the pupil distance between the left eye 50a and the right eye 50b based on the deviation F1 of the left-eye virtual marker 72a relative to the real marker 61 and the deviation F2 of the right-eye virtual marker 72b relative to the real marker 61. The details of step T110 and step T120 have been described in detail in the above embodiments and will not be repeated here.

[0056] In summary, in the augmented reality display device and method of the embodiments of the present invention, a left-eye virtual marker and a right-eye virtual marker corresponding to a real marker in space are displayed in the left-eye virtual image and the right-eye virtual image, respectively. The pupil distance between the left and right eyes is calculated based on the deviation of the left-eye virtual marker and the deviation of the right-eye virtual marker relative to the real marker. Therefore, the augmented reality display device and method of the embodiments of the present invention can calculate the pupil distance to facilitate the correct display of stereoscopic images.

[0057] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An augmented reality display device, characterized in that: include: A virtual image display for providing a left-eye virtual image and a right-eye virtual image to the user's left eye and right eye respectively; as well as A controller is electrically connected to the virtual image display and is used to command the virtual image display to display a left-eye virtual marker and a right-eye virtual marker corresponding to a real marker in space in the left-eye virtual image and the right-eye virtual image, respectively, and to calculate the pupil distances of the left eye and the right eye based on the deviation of the left-eye virtual marker relative to the real marker and the deviation of the right-eye virtual marker relative to the real marker, and to command the virtual image display to display the correct left-eye virtual image and the right-eye virtual image based on the calculated pupil distances, wherein the augmented reality display device further includes the following features (1), (2) or (3): Feature (1): The controller is configured to calculate the viewing angles of the left eye and the right eye when viewing the real mark based on the number of pixels of deviation between the left eye virtual mark and the real mark and the number of pixels of deviation between the right eye virtual mark and the real mark, and to calculate the pupil distance based on the convergence distances of the left eye and the right eye when viewing the real mark and the viewing angles; Feature (2): The controller is used to calculate the left eye viewing angle of the left eye when viewing the real mark based on the number of pixels of deviation between the left eye virtual mark and the real mark, and to calculate the right eye viewing angle of the right eye when viewing the real mark based on the number of pixels of deviation between the right eye virtual mark and the real mark. The controller is used to calculate the pupil distance based on the distance from the left eye to the real mark, the distance from the right eye to the real mark, the distance from the midpoint of the left eye and the right eye to the real mark, the left eye viewing angle, and the right eye viewing angle, wherein the left eye viewing angle is the angle between the line from the left eye to the real mark and the line from the midpoint to the real mark, and the right eye viewing angle is the angle between the line from the right eye to the real mark and the line from the midpoint to the real mark. Feature (3): The controller is used to calculate the left eye viewing angle of the left eye when viewing the real mark based on the number of deviation pixels of the left eye virtual mark relative to the real mark, and calculate the right eye viewing angle of the right eye when viewing the real mark based on the number of deviation pixels of the right eye virtual mark relative to the real mark. The controller is used to calculate the pupil distance based on the distance from the left eye to the real mark, the distance from the right eye to the real mark, the vertical distance from the real mark to the line connecting the left eye and the right eye, the left eye viewing angle and the right eye viewing angle, wherein the left eye viewing angle is the angle between the line connecting the left eye to the real mark and the perpendicular line from the real mark to the line connecting the left eye and the right eye, and the right eye viewing angle is the angle between the line connecting the right eye to the real mark and the perpendicular line.

2. The augmented reality display device according to claim 1, wherein The controller is used to command the virtual image display to display scales in the left-eye virtual image and the right-eye virtual image, so that the user can input the numerical value of the deviation of the left-eye virtual marker relative to the real marker and the numerical value of the deviation of the right-eye virtual marker relative to the real marker into the controller through the user interface, and then the controller can calculate the pupil distance based on the numerical value.

3. The augmented reality display device according to claim 1, wherein: The user moves the left eye virtual marker in the left eye virtual image and the right eye virtual marker in the right eye virtual image to a position overlapping with the real marker through the user interface, and the controller calculates the pupil distance between the left eye and the right eye based on the distance moved by the left eye virtual marker and the right eye virtual marker.

4. The augmented reality display device according to claim 1, wherein The virtual image display includes a left-eye display and a right-eye display, which are used to provide the left-eye virtual image and the right-eye virtual image respectively, and the augmented reality display device also includes an adjustment mechanism, which connects the left-eye display and the right-eye display, and is used to adjust the positions of the left-eye display and the right-eye display. The adjustment mechanism allows the user to adjust the positions of the left-eye display and the right-eye display so that the left-eye virtual mark in the left-eye virtual image and the right-eye virtual mark in the right-eye virtual image are moved to a position where they overlap with the real mark. The adjustment mechanism is electrically connected to the controller, and the controller calculates the pupil distance between the left eye and the right eye based on the distance moved by the left-eye display and the right-eye display.

5. An augmented reality display method, characterized in that: include: Providing a left-eye virtual image and a right-eye virtual image to the left eye and right eye of the user, respectively, wherein the left-eye virtual image has a left-eye virtual marker corresponding to a real marker in space, and the right-eye virtual image has a right-eye virtual marker corresponding to the real marker; Calculating the pupil distance between the left eye and the right eye according to the deviation of the left eye virtual marker relative to the real marker and the deviation of the right eye virtual marker relative to the real marker; as well as The correct left-eye virtual image and right-eye virtual image are displayed according to the calculated pupil distance. The augmented reality display method further includes the following features (1), (2) or (3): Feature (1): Calculating the viewing angles of the left eye and the right eye when viewing the real mark based on the number of pixels of deviation between the left eye virtual mark and the real mark and the number of pixels of deviation between the right eye virtual mark and the real mark, and calculating the pupil distance based on the convergence distances of the left eye and the right eye when viewing the real mark and the viewing angle; Feature (2): The left eye viewing angle of the left eye when viewing the real mark is calculated based on the number of pixels of deviation between the left eye virtual mark and the real mark, and the right eye viewing angle of the right eye when viewing the real mark is calculated based on the number of pixels of deviation between the right eye virtual mark and the real mark, and the pupil distance is calculated based on the distance from the left eye to the real mark, the distance from the right eye to the real mark, the distance from the midpoint of the left eye and the right eye to the real mark, the left eye viewing angle, and the right eye viewing angle, wherein the left eye viewing angle is the angle between the line from the left eye to the real mark and the line from the midpoint to the real mark, and the right eye viewing angle is the angle between the line from the right eye to the real mark and the line from the midpoint to the real mark; Feature (3): The left eye viewing angle of the left eye when viewing the real mark is calculated based on the number of deviation pixels of the left eye virtual mark relative to the real mark, and the right eye viewing angle of the right eye when viewing the real mark is calculated based on the number of deviation pixels of the right eye virtual mark relative to the real mark, and the pupil distance is calculated based on the distance from the left eye to the real mark, the distance from the right eye to the real mark, the vertical distance from the real mark to the line connecting the left eye and the right eye, the left eye viewing angle and the right eye viewing angle, wherein the left eye viewing angle is the angle between the line connecting the left eye to the real mark and the perpendicular line from the real mark to the line connecting the left eye and the right eye, and the right eye viewing angle is the angle between the line connecting the right eye to the real mark and the perpendicular line.

6. The augmented reality display method according to claim 5, characterized in that: The system further includes displaying scales in the left-eye virtual image and the right-eye virtual image, so that the user can input the numerical value of the deviation of the left-eye virtual mark relative to the real mark and the numerical value of the deviation of the right-eye virtual mark relative to the real mark into the controller through the user interface, so that the controller can calculate the pupil distance accordingly.

7. The augmented reality display method according to claim 5, characterized in that: Also includes: allowing the user to move the left-eye virtual marker in the left-eye virtual image and the right-eye virtual marker in the right-eye virtual image to positions that overlap with the real marker through a user interface; as well as The pupil distance between the left eye and the right eye is calculated according to the moving distance of the left eye virtual marker and the right eye virtual marker.

8. The augmented reality display method according to claim 5, wherein: Also includes: Providing the left-eye virtual image and the right-eye virtual image respectively by using a left-eye display and a right-eye display; Using an adjustment mechanism connected to the left-eye display and the right-eye display to adjust the positions of the left-eye display and the right-eye display, wherein the adjustment mechanism allows the user to adjust the positions of the left-eye display and the right-eye display so that the left-eye virtual marker in the left-eye virtual image and the right-eye virtual marker in the right-eye virtual image are moved to a position that overlaps with the real marker; as well as The pupil distance between the left eye and the right eye is calculated according to the distance moved by the left eye display and the right eye display.

Images