Off-axis light engine parameter determination method and device, equipment and storage medium

By determining the light direction vector group of the near-eye display device and adjusting the off-axis light engine parameters, the problem of 3D FOV loss for AR glasses at non-infinity imaging distances is solved, improving the 3D display effect and improving the user experience.

CN118962976AActive Publication Date: 2024-11-15ZHUHAI MOJIE TECH CO LTD
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
CN202411139859.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-19
Publication Date
2024-11-15
Estimated Expiration
2044-08-19

AI Technical Summary

Technical Problem

At a specific imaging distance of non-infinity, the images displayed on the left and right lenses cannot overlap 100%, resulting in the loss of 3D FOV and affecting the 3D display effect.

Method used

By acquiring the image size of the near-eye display device at the imaging distance and the coordinates of the center point of the human eye pupil, we determine the light direction vector group of each corner and central image point of the image to the coupling area of ​​the optical waveguide, and then determine the off-axis light engine The projection light direction vector group is used, and the parameters of the projection lens and display are adjusted based on this to achieve the improvement of 3D FOV.

Benefits of technology

It effectively solves the problem of 3D FOV loss, improves the 3D display effect of the projected images of the near-eye display device, and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118962976A_ABST
    Figure CN118962976A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of near-to-eye display equipment, and provides an off-axis light engine parameter determination method and device, equipment and a storage medium, and the method comprises the steps: obtaining the image size of an image projected by the near-to-eye display equipment at a combined image distance, and a first coordinate corresponding to a human eye pupil center point at an optical waveguide coupling-out region; on the basis of the first coordinates and the image size, determining a first direction vector group corresponding to light transmitted from each corner image point and the center image point of the image to the center point of the pupil of the human eye at the optical waveguide coupling-out area; determining a second direction vector group corresponding to the projection light of the off-axis light engine based on the first direction vector group; and based on the second direction vector group, determining parameters of the off-axis light engine so as to realize that the 3D FOV corresponding to the near-eye display equipment reaches the FOV of the off-axis light engine based on the parameters. According to the embodiment of the invention, the 3D display effect of the image projected by the near-to-eye display equipment is improved, so that the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of near-eye display devices, and in particular to a method, device, equipment and storage medium for determining parameters of an off-axis light engine. Background Art

[0002] AR (Augmented Reality) glasses can project virtual images into the user's field of view to achieve perspective and fusion effects, and are used in a variety of application scenarios such as navigation, games, education, and medical treatment. At present, at a specific non-infinite image distance, the images displayed by the left and right lenses of AR glasses may not overlap 100%, resulting in a loss of 3D FOV (field of view), and the 3D display effect needs to be improved. Summary of the invention

[0003] The present application provides a method, apparatus, device and storage medium for determining parameters of an off-axis light engine, aiming to improve the 3D display effect of an image projected by a near-eye display device to enhance the user experience.

[0004] To achieve the above-mentioned object, the present application provides a method for determining parameters of an off-axis light engine, which is applied to a near-eye display device. The off-axis light engine includes a projection lens and a display screen. The method for determining parameters of the off-axis light engine includes:

[0005] Obtaining an image size corresponding to an image projected by a near-eye display device at a combined image distance, and obtaining a first coordinate corresponding to a center point of a human pupil at an optical waveguide outcoupling region of the near-eye display device;

[0006] Based on the first coordinates and the image size, determine a first direction vector group corresponding to light rays propagating from each corner image point and the center image point of the image to the center point of the pupil of the human eye at the optical waveguide outcoupling region;

[0007] Based on the first direction vector group, determining a second direction vector group corresponding to the projection light of the off-axis light engine;

[0008] Based on the second direction vector group, the parameters of the off-axis light engine are determined to achieve the 3D FOV corresponding to the near-eye display device reaching the FOV of the off-axis light engine based on the parameters, wherein the parameters include at least one of the second coordinates corresponding to the intersection of the optical axis of the projection lens and the display screen and the size of the display screen.

[0009] In addition, to achieve the above-mentioned purpose, the present application also provides an off-axis light engine parameter determination device, the off-axis light engine parameter determination device comprising a memory and a processor;

[0010] The memory is used to store computer programs;

[0011] The processor is used to execute the computer program and implement the steps of the above-mentioned off-axis light engine parameter determination method when executing the computer program.

[0012] In addition, to achieve the above-mentioned purpose, the present application also provides a near-eye display device, which includes an off-axis light engine, and the parameters of the off-axis light engine are determined by the off-axis light engine parameter determination device as mentioned above, and the 3D FOV corresponding to the near-eye display device reaches the FOV of the off-axis light engine.

[0013] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned method for determining off-axis light engine parameters are implemented.

[0014] The present application discloses a method, apparatus, device and storage medium for determining parameters of an off-axis light engine. The method obtains an image size corresponding to an image projected by a near-eye display device at a combined image distance and a first coordinate corresponding to a center point of a human eye pupil at an optical waveguide outcoupling region of the near-eye display device. Based on the first coordinate and the image size, a first direction vector group corresponding to light rays propagating from each corner image point and a center image point of the image to the center point of a human eye pupil at the optical waveguide outcoupling region is determined. Based on the first direction vector group, a second direction vector group corresponding to light rays projected by an off-axis light engine of the near-eye display device is determined. Based on the second direction vector group, parameters of the off-axis light engine (at least one of a second coordinate corresponding to an intersection of an optical axis of a projection lens and a display screen and a size of the display screen) are determined. Based on the parameters, a 3D FOV corresponding to the near-eye display device is realized to reach the FOV of the off-axis light engine, thereby solving the 3D FOV loss problem of the near-eye display device and improving the 3D display effect of the image projected by the near-eye display device, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0016] Figure 1 It is a schematic diagram of AR glasses;

[0017] Figure 2 It is a schematic diagram of AR glasses projecting virtual images;

[0018] Figure 3is a schematic flow chart of the steps of a method for determining parameters of an off-axis light engine provided in an embodiment of the present application;

[0019] Figure 4 It is a schematic diagram of a binocular image of a human eye formed by light projected by an AR glasses provided in an embodiment of the present application;

[0020] Figure 5 is a schematic diagram of an off-axis light engine provided in an embodiment of the present application;

[0021] Figure 6 is a schematic diagram of an AR glasses projecting light in a three-dimensional space provided in an embodiment of the present application;

[0022] Figure 7 is a schematic flow chart of the steps of determining a second direction vector group corresponding to the projection light of an off-axis light engine provided in an embodiment of the present application;

[0023] Figure 8 is a schematic flow chart of steps for determining parameters of an off-axis light engine provided by an embodiment of the present application;

[0024] Fig. 9 is a schematic diagram of determining the size of a display screen based on a minimum circumscribed rectangle provided in an embodiment of the present application;

[0025] Fig.10 This is a schematic diagram of an off-axis light engine provided by an embodiment of the present application, in which the optical axis is not perpendicular to the plane of the display screen;

[0026] Fig.11 It is a schematic block diagram of an off-axis light engine parameter determination device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0028] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0029] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0030] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0031] AR glasses are electronic devices that can display real scenes and virtual images superimposed on each other. Figure 1 As shown, the structure of AR glasses is similar to that of ordinary glasses, both of which have lenses, frames, temples and nose pads. The lenses of AR glasses are transparent, and the external environment can be clearly seen through the lenses; in addition, AR glasses can project virtual images to be displayed, allowing users to see the real scenes and virtual images of the outside world at the same time.

[0032] At present, at a specific non-infinite image distance d, the images displayed by the left and right lenses of AR glasses cannot be 100% completely overlapped, resulting in a loss of 3D FOV, such as Figure 2 shown. Figure 2 AR glasses include left and right eye optical waveguides and projection light engines PL and PR for the left and right eyes. VL and VR are two cameras placed in a specific position to simulate human eye imaging. According to the display principle of diffraction optical waveguides, the light projected by PL / PR and the same light received by VL / VR are 180 degrees rotated about an axis n1 / n2 perpendicular to the surface of the optical waveguide. The image FOV received by VL / VR is equal to the image FOV projected by PL / PR, both of which are θ. Figure 2 It can be seen from the figure that when the combined image distance d is determined, on the plane at a distance d in front of the user, the images ImgL and ImgR seen by the left and right eyes of the user cannot completely overlap, and only the middle part of the image can overlap. Therefore, binocular stereo vision can only be formed in this part of the FOV, which is called the 3DFOV area. Figure 2 The medium pink area reflects the 3D FOV area of ​​the left and right eyes respectively, with an angle of α.

[0033] from Figure 2 It is obvious that α<θ, that is, the 3D FOV of the displayed image is smaller than the FOV of the light engine. The AR glasses have the problem of 3D FOV loss and cannot fully utilize the pixels of the projection light engine display to achieve 3D display.

[0034] In order to solve the above problems, the embodiments of the present application provide a method, apparatus, device and storage medium for determining off-axis light engine parameters, which are used to solve the 3D FOV loss problem of near-eye display devices, improve the 3D display effect of images projected by near-eye display devices, and enhance the user experience.

[0035] See also Figure 3 , Figure 3 : is a flow chart of a method for determining off-axis light engine parameters provided by an embodiment of the present application. The method can be applied to a near-eye display device, or to an electronic device including an off-axis light engine parameter determination device. The present application does not specifically limit the application scenario of the method for determining off-axis light engine parameters. Among them, near-eye display devices include but are not limited to AR glasses, VR (Virtual Reality) glasses and other devices.

[0036] like Figure 3 As shown, the off-axis light engine parameter determination method in the present application specifically includes steps S101 to S104.

[0037] S101, obtaining an image size corresponding to an image projected by a near-eye display device at a combined image distance, and obtaining a first coordinate corresponding to a center point of a human pupil at an optical waveguide outcoupling region of the near-eye display device.

[0038] For example, if the near-eye display device is an AR glasses, the AR glasses include lenses, frames, temples, nose pads, left and right eye optical waveguides, and an off-axis light engine. The off-axis light engine includes a projection lens, a display screen, and a mechanical support structure. The display screen can be micro-LED (micro-Light-Emitting Diode), micro-OLED, etc.

[0039] (micro-Organic Light-Emitting Diode, micro organic light-emitting diode), LCOS (Liquid Crystal On Silicon,

[0040] Liquid crystal on silicon), DLP (Digital Light Processing, digital light processing device), etc.

[0041] For example, Figure 4As shown, AR glasses include left and right eye optical waveguides and off-axis light engines P1 / P2, and the frame, temples, etc. are not drawn in the figure. V1 / V2 are two cameras used to simulate human eye imaging, and s is the pupil distance. According to the display principle of diffraction light waveguides, the light projected by the off-axis light engine P1 / P2 and the same light received by the camera V1 / V2 are 180 degrees rotated about the axis n1 / n2 perpendicular to the surface of the optical waveguide (axis n1, n2 are known quantities). The image FOV received by V1 / V2 is equal to the image FOV projected by P1 / P2, which is θ.

[0042] like Figure 5 As shown, Figure 5 3D schematic diagram of the off-axis light engine, which includes a projection lens, a display screen, and a mechanical support structure (not shown). The optical center of the projection lens of the off-axis light engine is c, and the focal length of the projection lens is f. The optical axis of the off-axis light engine is perpendicular to the plane of the internal display screen, and the intersection point m of the off-axis light engine and the internal display screen does not coincide with the center point o' of the display screen.

[0043] Since the display process and imaging principle of the left and right lenses of AR glasses are the same, here we only take one side of the lens (such as the left lens) as an example to introduce the method of determining the off-axis light engine parameters.

[0044] like Figure 6 As shown, Figure 6 It is the representation of part of the light projected by AR glasses in three-dimensional space. The rectangle formed by q1, q2, q3, and q4 is the image area displayed on plane W at the combined image distance d. For the left lens, the rectangular area formed by q1, q2, q3, and q4 is the corresponding projected image area of ​​the left lens. The central image point of the projected image is recorded as o, and q1, q2, q3, and q4 are the image points at each corner of the projected image, that is, the image points at each corner of the projected image. The image size corresponding to the image projected by AR glasses at the combined image distance d is obtained, that is, the size of the rectangular area formed by q1, q2, q3, and q4 is obtained.

[0045] The center point of the pupil of the human eye at the optical waveguide outcoupling area is denoted as c', that is, Figure 4 The optical center of the middle camera V1 is used to obtain the coordinates of the center point c' of the human eye pupil at the optical waveguide outcoupling area. For the convenience of distinguishing the description, the coordinates of the center point c' of the human eye pupil at the optical waveguide outcoupling area are referred to as the first coordinates below.

[0046] S102: Based on the first coordinates and the image size, determine a first direction vector group corresponding to light rays propagating from each corner image point and the center image point of the image to the center point of the pupil of a human eye at the optical waveguide outcoupling region.

[0047] When the combined image distance d and the image size corresponding to the projected image at the combined image distance d are determined, the various direction vectors of the light from the four corner image points q1, q2, q3, q4 of the projected image and the central image point o to the center point c' of the pupil of the human eye at the optical waveguide outcoupling area can be obtained. and and Form a first direction vector group.

[0048] S103: Determine a second direction vector group corresponding to the projection light of the off-axis light engine based on the first direction vector group.

[0049] Since the light projected by the off-axis light engine and the same light received by the camera are 180 degrees rotated about the axis perpendicular to the waveguide surface, the direction vectors corresponding to the imaging light can be used to and Calculate the reverse vector of the projection light in the off-axis light engine, that is, Figure 5 As shown in and and Form a second direction vector group.

[0050] In some embodiments, Figure 7 As shown, step S103 may include sub-step S1031 and sub-step S1032.

[0051] S1031, determining a rotation matrix for rotating 180 degrees around an axis perpendicular to the optical waveguide;

[0052] S1032. Multiply each direction vector in the first direction vector group by the rotation matrix to obtain each corresponding direction vector in the second direction vector group.

[0053] Exemplarily, a rotation matrix of 180 degrees around an axis n1 perpendicular to the optical waveguide is obtained, which is recorded as Rn1(π).

[0054] S104. Based on the second direction vector group, determine the parameters of the off-axis light engine, so as to achieve, based on the parameters, that the 3D FOV corresponding to the near-eye display device reaches the FOV of the off-axis light engine, wherein the parameters include at least one of a second coordinate corresponding to the intersection of the optical axis of the projection lens and the display screen and a size of the display screen.

[0055] For example, and The coordinates of the intersection point m between the optical axis of the off-axis light engine projection lens and the display screen and the size of the off-axis light engine display screen are calculated. For the convenience of distinguishing descriptions, the coordinates of the intersection point m are referred to as second coordinates below.

[0056] In some embodiments, Figure 8 As shown, step S104 may include sub-steps S1041 to S1043.

[0057] S1041, determining a plane equation of a plane corresponding to the display screen;

[0058] S1042, determining the coordinates of the intersection points of each direction vector and the plane according to each direction vector in the second direction vector group and the plane equation;

[0059] S1043. Determine the parameters of the off-axis light engine based on the coordinates of each of the intersection points.

[0060] Exemplarily, the plane equation of the plane corresponding to the display screen is determined based on the focal length f of the projection lens of the off-axis light engine and the rotation matrix Rn1(π).

[0061] In some embodiments, determining the plane equation of the plane corresponding to the display screen includes: obtaining the focal length of the projection lens, and determining a rotation matrix that rotates 180 degrees around an axis perpendicular to the optical waveguide; based on the focal length, the rotation matrix, and the first direction vector in the first direction vector group, determining that the plane equation is Ax+By+Cz+D=0, where the first direction vector is the direction vector corresponding to the light propagating from the central image point to the first position; wherein [A, B, C] is the rotation matrix multiplied by the unit vector of the first direction vector, and D is the focal length.

[0062] That is, the direction vector in the first direction vector group Denote as the first direction vector, calculate The corresponding unit vector is recorded as [A, B, C], and the plane equation of the plane corresponding to the display screen is Ax+By+Cz+D=0, where the specific value of D is the focal length f of the projection lens.

[0063] After obtaining the plane equation Ax+By+Cz+D=0 of the plane corresponding to the display screen, based on and And the plane equation Ax+By+Cz+D=0, we can calculate and The coordinates of the intersection point with the plane corresponding to the display screen, for example Figure 5 The coordinates of points q1′, q2′, q3′, q4′ and m shown in .

[0064] In some embodiments, determining the coordinates of the intersection points of each direction vector and the plane according to each direction vector in the second direction vector group and the plane equation includes:

[0065] According to the formula Calculate the coordinates of each of the intersection points; wherein (x0, y0, z0) are the coordinates corresponding to the optical center of the projection lens, (m, n, p) are the unit vectors corresponding to any direction vector in the second direction vector group, and (x, y, z) are the coordinates of the intersection point of any direction vector and the plane.

[0066] Exemplarily, the coordinates (x0, y0, z0) corresponding to the optical center c of the projection lens may be (0, 0, 0).

[0067] If confirmed The corresponding unit vector is (m1, n1, p1), then we can calculate The coordinates of the intersection point q1′ with the plane corresponding to the display screen are (x1, y1, z1):

[0068]

[0069] If confirmed The corresponding unit vector is (m2, n2, p2), then we can calculate The coordinates of the intersection point q2′ with the plane corresponding to the display screen are (x2, y2, z2):

[0070]

[0071] If confirmed The corresponding unit vector is (m3, n3, p3), then we can calculate The coordinates of the intersection point q3′ with the plane corresponding to the display screen are (x3, y3, z3):

[0072]

[0073] If confirmed The corresponding unit vector is (m4, n4, p4), then we can calculate The coordinates of the intersection point q4′ with the plane corresponding to the display screen are (x4, y4, z4):

[0074]

[0075] If confirmed The corresponding unit vector is (m5, n5, p5), then we can calculate The coordinates of the intersection point m with the plane corresponding to the display screen are (x5, y5, z5):

[0076]

[0077] In some embodiments, determining the parameters of the off-axis light engine based on the coordinates of each of the intersections includes: determining the size of the display screen according to the coordinates corresponding to each corner point of the display screen.

[0078] For example, The intersection points q1′, q2′, q3′, q4′ with the plane corresponding to the display screen are used as the corner points of the display screen. After obtaining the coordinates of q1′, q2′, q3′, q4′, the size of the display screen is determined according to the coordinates of q1′, q2′, q3′, q4′.

[0079] In some embodiments, the corner points of the display screen include a first corner point, a second corner point, a third corner point, and a fourth corner point, and determining the size of the display screen according to the coordinates corresponding to the corner points of the display screen includes: determining a corresponding minimum enclosing rectangle according to the coordinates of the first corner point, the coordinates of the second corner point, the coordinates of the third corner point, and the coordinates of the fourth corner point; and determining the size of the minimum enclosing rectangle as the size of the display screen.

[0080] For example, Fig. 9 As shown, the minimum circumscribed rectangle of the four points q1′, q2′, q3′, and q4′ in the corresponding plane of the display screen is obtained to obtain the minimum circumscribed rectangle size, which is the actual minimum size required for the display screen. It can be understood that the size of the display screen can be larger than the minimum circumscribed rectangle size.

[0081] After the AR glasses are set based on the second coordinate corresponding to the determined intersection m of the optical axis of the projection lens and the display screen and the size of the display screen, the 3D FOV corresponding to the AR glasses can reach the FOV of the off-axis light engine.

[0082] like Figure 4 As shown, on the plane W at the combined image distance d, the images ImgL (blue thick line) and ImgR (yellow thick line) seen by the user's left and right eyes completely overlap, so the off-axis light engine can form a binocular stereo image in the entire FOV. Figure 4 The middle pink area reflects the 3D FOV area seen by the left eye, and its angle α = θ. Therefore, the 3D FOV is equal to the off-axis light engine FOV, and the display pixels of the off-axis light engine are fully utilized.

[0083] In the above-mentioned embodiment, the optical axis of the off-axis light engine is perpendicular to the plane of the display screen inside it. In other embodiments, the optical axis of the off-axis light engine may not be perpendicular to the plane of the display screen. Fig.10 As shown, more optimization freedom is introduced to facilitate the design of a light engine for better projection effects.

[0084] In the present application, by obtaining the image size corresponding to the image projected by the near-eye display device at the combined image distance and the first coordinate corresponding to the center point of the human eye pupil at the optical waveguide outcoupling area of ​​the near-eye display device, based on the first coordinate and the image size, a first direction vector group corresponding to the light rays propagating from each corner image point and the center image point of the image to the center point of the human eye pupil at the optical waveguide outcoupling area is determined, based on the first direction vector group, a second direction vector group corresponding to the projection light rays of the off-axis light engine of the near-eye display device is determined, and then based on the second direction vector group, the parameters of the off-axis light engine (at least one of the second coordinate corresponding to the intersection of the optical axis of the projection lens and the display screen and the size of the display screen) are determined, so as to achieve the FOV of the off-axis light engine corresponding to the near-eye display device based on the parameters, thereby solving the 3D FOV loss problem of the near-eye display device, improving the 3D display effect of the image projected by the near-eye display device, and thus improving the user experience.

[0085] See also Fig.11 , Fig.11 It is a schematic block diagram of an off-axis light engine parameter determination device provided in an embodiment of the present application. The off-axis light engine parameter determination device can be arranged in a near-eye display device to execute the foregoing off-axis light engine parameter determination method.

[0086] like Fig.11 As shown, the off-axis light engine parameter determination device 300 may include a processor 310 and a memory 320, wherein the processor 310 and the memory 320 are connected via a bus, such as an I2C (Inter-integrated Circuit) bus.

[0087] Specifically, the processor 310 may be a micro-controller unit (MCU), a central processing unit (CPU), or a digital signal processor (DSP).

[0088] Specifically, the memory 320 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB disk, or a mobile hard disk, etc. The memory 320 stores various computer programs for the processor 310 to execute.

[0089] The processor 310 is used to run a computer program stored in the memory, and implement the following steps when executing the computer program:

[0090] Obtaining an image size corresponding to an image projected by a near-eye display device at a combined image distance, and obtaining a first coordinate corresponding to a center point of a human pupil at an optical waveguide outcoupling region of the near-eye display device;

[0091] Based on the first coordinates and the image size, determine a first direction vector group corresponding to light rays propagating from each corner image point and the center image point of the image to the center point of the pupil of the human eye at the optical waveguide outcoupling region;

[0092] Based on the first direction vector group, determining a second direction vector group corresponding to the projection light of the off-axis light engine;

[0093] Based on the second direction vector group, the parameters of the off-axis light engine are determined to achieve the 3D FOV corresponding to the near-eye display device reaching the FOV of the off-axis light engine based on the parameters, wherein the parameters include at least one of the second coordinates corresponding to the intersection of the optical axis of the projection lens and the display screen and the size of the display screen.

[0094] In some embodiments, when the processor 310 determines the parameters of the off-axis light engine based on the second direction vector group, it is configured to implement:

[0095] Determining a plane equation of a plane corresponding to the display screen;

[0096] Determine the coordinates of the intersection points of each direction vector and the plane according to each direction vector in the second direction vector group and the plane equation;

[0097] Based on the coordinates of each of the intersection points, the parameters of the off-axis light engine are determined.

[0098] In some embodiments, when implementing the determining of the plane equation of the plane corresponding to the display screen, the processor 310 is configured to implement:

[0099] Obtaining the focal length of the projection lens, and determining a rotation matrix for rotating 180 degrees around an axis perpendicular to the optical waveguide;

[0100] Based on the focal length, the rotation matrix and a first direction vector in the first direction vector group, determining that the plane equation is Ax+By+Cz+D=0, where the first direction vector is a direction vector corresponding to a light ray propagating from the central image point to the first position;

[0101] Among them, [A, B, C] is the unit vector of the rotation matrix multiplied by the first direction vector, and D is the focal length.

[0102] In some embodiments, when the processor 310 implements the step of determining the coordinates of the intersections of each direction vector and the plane according to each direction vector in the second direction vector group and the plane equation, it is configured to implement:

[0103] According to the formula Calculating the coordinates of each of the intersection points;

[0104] Among them, (x0, y0, z0) are the coordinates corresponding to the optical center of the projection lens, (m, n, p) are the unit vectors corresponding to any direction vector in the second direction vector group, and (x, y, z) are the coordinates of the intersection of any direction vector and the plane.

[0105] In some embodiments, the intersection points of each direction vector in the second direction vector group and the plane include each corner point of the display screen, and the processor 310, when implementing the determination of the parameters of the off-axis light engine based on the coordinates of each of the intersection points, is configured to implement:

[0106] The size of the display screen is determined according to the coordinates corresponding to each corner point of the display screen.

[0107] In some embodiments, the corner points of the display screen include a first corner point, a second corner point, a third corner point, and a fourth corner point. When the processor 310 determines the size of the display screen according to the coordinates corresponding to the corner points of the display screen, it is configured to implement:

[0108] Determine a corresponding minimum circumscribed rectangle according to the coordinates of the first corner point, the coordinates of the second corner point, the coordinates of the third corner point, and the coordinates of the fourth corner point;

[0109] The size of the minimum circumscribed rectangle is determined as the size of the display screen.

[0110] In some embodiments, when the processor 310 implements the step of determining the second direction vector group corresponding to the projection light of the off-axis light engine based on the first direction vector group, it is configured to implement:

[0111] determining a rotation matrix for a 180 degree rotation about an axis perpendicular to the optical waveguide;

[0112] Each direction vector in the first direction vector group is multiplied by the rotation matrix to obtain each corresponding direction vector in the second direction vector group.

[0113] The off-axis light engine parameter determination device 300 can execute the off-axis light engine parameter determination method provided in the embodiment of the present application, and therefore can achieve the beneficial effects that can be achieved by the off-axis light engine parameter determination method provided in the embodiment of the present application. For details, please refer to the previous embodiments and will not be repeated here.

[0114] The embodiment of the present application also provides a near-eye display device, which includes but is not limited to AR glasses, VR glasses and other devices. The near-eye display device includes an off-axis light engine, wherein the off-axis light engine includes a projection lens and a display screen, and the parameters of the off-axis light engine are determined by an off-axis light engine parameter determination device. For example, the off-axis light engine parameter determination device can be Fig.11 The off-axis light engine parameter determination device 300 is shown. When the near-eye display device uses the off-axis light engine, the 3D FOV corresponding to the near-eye display device reaches the FOV of the off-axis light engine. Therefore, the beneficial effects that can be achieved by the off-axis light engine parameter determination method provided in the embodiment of the present application can be achieved, as detailed in the previous embodiment, which will not be repeated here.

[0115] The embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for determining parameters of an off-axis light engine as described above are implemented.

[0116] The computer-readable storage medium may be an internal storage unit of the off-axis light engine parameter determination device or the near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the off-axis light engine parameter determination device or the near-eye display device. The computer-readable storage medium may also be an external storage device of the off-axis light engine parameter determination device or the near-eye display device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital card (Secure Digital Card, SDCard), a flash card (Flash Card), etc., equipped on the off-axis light engine parameter determination device or the near-eye display device.

[0117] Since the computer program stored in the storage medium can execute any of the off-axis light engine parameter determination methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any of the off-axis light engine parameter determination methods provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0118] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0119] The above description is only a specific implementation mode of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or substitutions within the technical scope disclosed in the present application, and these modifications or substitutions should be included in the protection scope of the present application.

Claims

1. A method for determining parameters of an off-axis light engine, characterized in that: The off-axis light engine includes a projection lens and a display screen, and the off-axis light engine parameter determination method includes: Obtaining an image size corresponding to an image projected by a near-eye display device at a combined image distance, and obtaining a first coordinate corresponding to a center point of a human pupil at an optical waveguide outcoupling region of the near-eye display device; Based on the first coordinates and the image size, determine a first direction vector group corresponding to light rays propagating from each corner image point and the center image point of the image to the center point of the pupil of the human eye at the optical waveguide outcoupling region; Based on the first direction vector group, determining a second direction vector group corresponding to the projection light of the off-axis light engine; Based on the second direction vector group, the parameters of the off-axis light engine are determined to achieve, based on the parameters, a 3D field of view FOV corresponding to the near-eye display device reaching the FOV of the off-axis light engine, wherein the parameters include at least one of a second coordinate corresponding to the intersection of the optical axis of the projection lens and the display screen and a size of the display screen.

2. The off-axis light engine parameter determination method according to claim 1, wherein: The determining the parameters of the off-axis light engine based on the second direction vector group includes: Determining a plane equation of a plane corresponding to the display screen; Determine the coordinates of the intersection points of each direction vector and the plane according to each direction vector in the second direction vector group and the plane equation; Based on the coordinates of each of the intersection points, the parameters of the off-axis light engine are determined.

3. The off-axis light engine parameter determination method according to claim 2, wherein: Determining the plane equation of the plane corresponding to the display screen includes: Obtaining the focal length of the projection lens, and determining a rotation matrix for rotating 180 degrees around an axis perpendicular to the optical waveguide; Based on the focal length, the rotation matrix and a first direction vector in the first direction vector group, determining that the plane equation is Ax+By+Cz+D=0, where the first direction vector is a direction vector corresponding to a light ray propagating from the central image point to the first position; Among them, [A, B, C] is the unit vector of the rotation matrix multiplied by the first direction vector, and D is the focal length.

4. The method for determining off-axis light engine parameters according to claim 3, wherein: Determining the coordinates of the intersection points of each direction vector and the plane according to each direction vector in the second direction vector group and the plane equation includes: According to the formula Calculating the coordinates of each of the intersection points; Among them, (x0, y0, z0) are the coordinates corresponding to the optical center of the projection lens, (m, n, p) are the unit vectors corresponding to any direction vector in the second direction vector group, and (x, y, z) are the coordinates of the intersection of any direction vector and the plane.

5. The off-axis light engine parameter determination method according to claim 2, wherein: The intersection points of each direction vector in the second direction vector group and the plane include corner points of the display screen, and determining the parameters of the off-axis light engine based on the coordinates of each of the intersection points includes: The size of the display screen is determined according to the coordinates corresponding to each corner point of the display screen.

6. The method for determining off-axis light engine parameters according to claim 5, wherein: The corner points of the display screen include a first corner point, a second corner point, a third corner point, and a fourth corner point, and determining the size of the display screen according to the coordinates corresponding to the corner points of the display screen includes: Determine a corresponding minimum circumscribed rectangle according to the coordinates of the first corner point, the coordinates of the second corner point, the coordinates of the third corner point, and the coordinates of the fourth corner point; The size of the minimum circumscribed rectangle is determined as the size of the display screen.

7. The method for determining off-axis light engine parameters according to any one of claims 1 to 6, characterized in that: The determining, based on the first direction vector group, a second direction vector group corresponding to the projection light of the off-axis light engine comprises: determining a rotation matrix for a 180 degree rotation about an axis perpendicular to the optical waveguide; Each direction vector in the first direction vector group is multiplied by the rotation matrix to obtain each corresponding direction vector in the second direction vector group.

8. A device for determining parameters of an off-axis light engine, characterized in that: The off-axis light engine parameter determination device includes a memory and a processor; The memory is used to store computer programs; The processor is configured to execute the computer program and implement the steps of the off-axis light engine parameter determination method according to any one of claims 1 to 7 when executing the computer program.

9. A near-eye display device, characterized in that: The near-eye display device comprises an off-axis light engine, the parameters of which are determined by the apparatus according to claim 8, and the 3D FOV corresponding to the near-eye display device reaches the FOV of the off-axis light engine.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the off-axis light engine parameter determination method according to any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Projection display and method for projecting a whole image

    CN104321680B

  • Head Mounted Display Calibration Using Direct Geometry Modeling

    CN105320271B

  • Large-field angle large-exit pupil augment reality display system

    CN106997100A

  • Method for improving edge image quality of large viewing angle VR optical system

    CN108957744A

  • Methods, devices, terminal equipment, and storage media for optical distortion correction

    CN110874135B