Active calibration assembly method of waveguide AR optical module

By calculating the trapezoidal distortion and ghosting of the waveguide AR optical module and adjusting the six degrees of freedom of microscopic display, the problem of ghosting during assembly is solved, the image quality and stability are improved, and more efficient calibration is achieved process.

CN119087677AActive Publication Date: 2024-12-06GUANGZHOU GUDONG INTELLIGENT TECHNOLOGY CO LTD

Patent Information

Application Number
CN202411271463.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-11
Publication Date
2024-12-06
Estimated Expiration
2044-09-11

AI Technical Summary

Technical Problem

The waveguide AR optical module is prone to ghosting during assembly, which affects the image display effect. The existing technology is complex in the measurement and analysis of modulation transfer function, and it is impossible to fully capture the imaging quality factors of the entire field of view.

Method used

By acquiring the initial calibration image of the waveguide AR optical module, calculating the trapezoidal distortion and ghosting, adjusting the six degrees of freedom of microscopic to optimize the calibration, reducing the calculation complexity, and improving calibration accuracy and efficiency.

Benefits of technology

The image quality and stability of the waveguide AR optical module are significantly improved, and more direct and reliable correction results are achieved through comprehensive evaluation of distortion conditions and precise measurement of ghosting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119087677A_ABST
    Figure CN119087677A_ABST
Patent Text Reader

Abstract

The invention discloses an active calibration assembly method for a waveguide AR optical module, and the method comprises the steps: obtaining an initial calibration image of the waveguide AR optical module, and the initial calibration image comprises a black-and-white grid region, a black-and-white stripe region and a white ground region; calculating the trapezoidal distortion of the waveguide AR light module based on the direction angles of the upper, lower, left and right positions of the black and white lattice area; adjusting six degrees of freedom of the micro-display based on the trapezoidal distortion, so that the five degrees of freedom except translation between the micro-display and the optical machine reach the optimal state; calculating the ghosting amount of the waveguide AR light module based on the light intensity data of the black and white stripe area and the light intensity data of the white ground area; and the translational degree of freedom between the micro display and the optical machine is adjusted based on the ghosting amount, so that the translational degree of freedom between the micro display and the optical machine reaches an optimal state. According to the scheme, the influence caused by non-uniformity of the image can be resisted, and the calibration efficiency and precision are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of waveguide AR optical module assembly, and in particular to an active calibration assembly method, computing equipment and storage medium of a waveguide AR optical module. Background Art

[0002] Waveguide AR (augmented reality) optical modules are the core components of augmented reality devices, usually including waveguides (with high refractive index and specific optical properties for guiding, focusing and projecting light), microdisplays (for generating virtual images), lens systems (for optically adjusting virtual images in waveguides), sensors or processors, etc. These components work together to seamlessly integrate virtual images and real scenes.

[0003] The manufacturing and assembly precision of waveguide AR optical modules is high, especially to achieve a light output with a visual angle of 0, which means that the light emitted from any point on the microdisplay must be parallel so as to correspond to the infinitely distant object observed by the human eye. In order to meet this precise optical requirement, online active calibration technology is required during the assembly process. However, due to the influence of processing and assembly processes, the AR module is prone to ghosting in the pupil expansion direction of the waveguide, which seriously affects the display effect of the image.

[0004] In the prior art, a Chinese patent document with publication number CN115951500A discloses an AR module assembly method based on active alignment technology, which collects the MTF value of the horizontal direction of the specific field of view of the AR module during the AA process at a predetermined exit pupil distance, divides the severity of the ghosting of the AR module into different levels based on the MTF value, and adopts the corresponding fixed focus logic based on the severity of the ghosting of the AR module to obtain the best fixed focus position. The measurement and analysis of the modulation transfer function in this technical solution is relatively complex, relying on a specific human eye-like camera and algorithm to evaluate the MTF value, but for the waveguide optical module, the imaging quality corresponding to each field of view position is different, and the acquisition of the MTF at each position only depends on a very small area of ​​information. In the case of poor uniformity of the entire field of view, it may not be enough to fully capture all factors affecting the imaging quality of the AR module. Summary of the invention

[0005] In order to solve the problems existing in the background technology, this scheme proposes an active calibration and assembly method for a waveguide AR optical module. By calculating the trapezoidal distortion and ghosting amount of the waveguide AR optical module to adjust the six degrees of freedom of the microdisplay, the computational complexity in the active calibration and assembly process can be reduced, and the calibration accuracy and assembly efficiency of the waveguide AR optical module can be improved.

[0006] According to a first aspect of the present invention, there is provided an active calibration assembly method for a waveguide AR optical module, comprising: acquiring an initial calibration image of the waveguide AR optical module, the initial calibration image comprising a black and white grid area, a black and white stripe area and a white background area; calculating the amount of trapezoidal distortion of the waveguide AR optical module based on the directional angles of four positions of the black and white grid area, namely, up, down, left and right; adjusting the six degrees of freedom of the microdisplay based on the amount of trapezoidal distortion, so that the five degrees of freedom except the translation between the microdisplay and the optical machine reach an optimal state; calculating the amount of ghosting of the waveguide AR optical module based on the light intensity data of the black and white stripe area and the light intensity data of the white background area; adjusting the translational degree of freedom between the microdisplay and the optical machine based on the ghosting amount, so that the translational degree of freedom between the microdisplay and the optical machine reaches an optimal state.

[0007] The above technical solution can optimize and adjust different distortions and optical problems by adjusting the six degrees of freedom of the microdisplay (including translation and rotation, etc.). After precise calibration, the image quality and stability of the waveguide AR optical module can be significantly improved.

[0008] Optionally, in the active calibration assembly method of the waveguide AR optical module provided by the present invention, the waveguide AR optical module includes a microdisplay, an optical machine, a waveguide plate and a camera. The microdisplay is placed in a mechanical structure with six degrees of freedom including x translation, y translation, z translation, rotation along ox, rotation along oy, and rotation along oz. The translation direction between the microdisplay and the optical machine is the z translation direction.

[0009] Optionally, in the active calibration assembly method of the waveguide AR optical module provided by the present invention, the black and white grid areas are distributed at four positions above, below, left and right of the image edge, each position is provided with multiple rows or columns of black and white grids, the black and white stripe area has a rectangular distribution of light intensity or a cosine distribution of light intensity, and the white background area is located on the upper and lower sides of the black and white stripe area.

[0010] Optionally, in the active calibration and assembly method of the waveguide AR optical module provided by the present invention, corner point detection is performed on the upper, lower, left and right positions of the black and white grid area to extract the corner point position coordinates of each edge line; straight line fitting is performed on the edge lines based on the corner point position coordinates, and the direction angle of each fitting straight line is calculated and averaged to obtain the upper direction angle, lower direction angle, left direction angle and right direction angle respectively; the average direction angle of the upper direction angle, lower direction angle, left direction angle and right direction angle is calculated as the trapezoidal distortion of the waveguide AR optical module.

[0011] The above technical solution calculates and analyzes the directional angles of all four sides, which can comprehensively evaluate the distortion of the entire display area, rather than just a single direction or a partial area, and helps to more comprehensively adjust and optimize the entire module.

[0012] Optionally, in the active calibration assembly method of the waveguide AR optical module provided by the present invention, the calculation range of the black and white stripe area and the white background area is determined based on the relative positions of the black and white grid area, the black and white stripe area and the white background area; the light intensity distribution curve is obtained based on the light intensity data within the calculation range; the light intensity peak value of the black and white stripe area and the light intensity peak value of the white background area are determined based on the light intensity distribution curve; and the ghosting amount of the waveguide AR optical module is calculated based on the light intensity peak value of the black and white stripe area and the light intensity peak value of the white background area.

[0013] The above technical solution can very accurately measure and calculate the degree of ghosting by measuring the peak light intensity of the black and white stripe area and the white background area, making the correction result more direct and reliable.

[0014] Optionally, in the active calibration and assembly method of the waveguide AR optical module provided by the present invention, the coordinates of the four intersection points of the boundary line in the black and white grid area and the starting point coordinates and the ending point coordinates of the black and white stripe area are determined; the calculation range of the black and white stripe area used for ghosting amount calculation is determined according to the x-direction coordinates of the intersection points, the starting point coordinates and the ending point coordinates; the calculation range of the white background area used for ghosting amount calculation is determined according to the y-direction coordinates of the intersection points and the y-direction coordinates of the starting point and the ending point.

[0015] The above technical solution can compensate for the error caused by image distortion by leaving margins in the x and y directions, ensuring that the calculated area truly and effectively represents the target area, thereby improving the measurement accuracy.

[0016] Optionally, in the active calibration assembly method of the waveguide AR optical module provided by the present invention, the light intensity data within the calculation range of the black and white stripe area and the white background area is averaged in the y direction to obtain a distribution curve of the x-coordinate and the light intensity average.

[0017] Optionally, in the active calibration assembly method of the waveguide AR optical module provided by the present invention, the difference ratio between the light intensity peak value of the white background area and the light intensity peak value of the black and white stripe area is calculated in each light intensity distribution period of the light intensity distribution curve; and the average value of the difference ratio in each light intensity distribution period in the light intensity distribution curve is calculated as the ghosting amount of the waveguide AR optical module.

[0018] The above technical solution compares the peak light intensity of the black and white stripe area with the white background area, which can more clearly distinguish the light and dark contrast in the image, which helps to better understand the performance of the optical module and its accuracy in responding to different light intensities.

[0019] According to a third aspect of the present invention, there is provided a computing device comprising: at least one processor; and a memory storing program instructions, wherein the program instructions are configured to be suitable for execution by at least one processor, and the program instructions include instructions for executing the active calibration assembly method of the above-mentioned waveguide AR optical module.

[0020] According to a fourth aspect of the present invention, a readable storage medium storing program instructions is provided. When the program instructions are read and executed by a computing device, the computing device executes the above-mentioned active calibration assembly method of the waveguide AR optical module.

[0021] According to the active calibration and assembly method of the waveguide AR optical module provided by the present invention, the trapezoidal distortion of the waveguide AR optical module is calculated based on multiple direction angles of the black and white grid area, and the trapezoidal distortion is minimized by adjusting the freedom of the microdisplay, thereby resisting the influence of image non-uniformity; the ghosting amount is calculated using the light intensity data of the black and white stripe area and the white background area, which can reduce the calculation complexity of the ghosting amount, and then adjust the key degree of freedom (translation) between the microdisplay and the optical machine based on the ghosting amount, so that this adjustment is more targeted and precise, thereby achieving precise calibration of the waveguide AR optical module.

[0022] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings: Figure 1 A block diagram of a computing device 100 according to an embodiment of the present invention is shown; Figure 2 The schematic diagram of the structure of the waveguide AR optical module is shown; Figure 3 A schematic flow chart of a method 300 for calculating the ghosting amount of a waveguide AR optical module according to an embodiment of the present invention is shown; Figure 4 A schematic diagram of an initial calibration image according to an embodiment of the present invention is shown; Figure 5 A schematic diagram of a light intensity distribution curve according to an embodiment of the present invention is shown; DETAILED DESCRIPTION

[0024] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0025] Figure 1 FIG. 1 shows a block diagram of a computing device 100 according to an embodiment of the present invention. Figure 1 As shown, computing device 100 may include memory 106 and processor 104. Memory bus 108 may be used for communication between processor 104 and system memory 106.

[0026] Memory 106 may include operating system 120, applications 122, and program data 124. Applications 122 may be arranged to be executed on the operating system by one or more processors 104 using program data 124. Applications 122 include program instructions for implementing various user desired functions.

[0027] When the computing device 100 starts running, the processor 104 reads and executes the program instructions of the operating system 120 from the memory 106. The application 122 runs on the operating system 120 and uses the interfaces provided by the operating system 120 and the underlying hardware to implement various functions desired by the user. When the user starts the application 122, the application 122 is loaded into the memory 106, and the processor 104 reads and executes the program instructions of the application 122 from the memory 106.

[0028] The computing device 100 also includes a storage device 132 and an output device 142 connected to a storage interface bus 134. An interface bus 140 facilitates communication from various interface devices (eg, output device 142, peripheral interface 144, and communication device 146) via the bus / interface controller 130.

[0029] The peripheral interface 144 may include a serial interface controller 154 and a parallel interface controller 156, which may be configured to facilitate communication via one or more I / O ports 158 and external devices such as input devices (e.g., keyboards, mice, pens, voice input devices, touch input devices) or other peripherals (e.g., printers, scanners, etc.). The communication device 146 may include a network controller 160, which may be arranged to facilitate communication with one or more other computing devices 162 via a network communication link via one or more communication ports 164. In the computing device 100 according to the present invention, the application 122 includes instructions for executing the active calibration assembly method 300 of the waveguide AR optical module of the present invention.

[0030] Figure 2 FIG. 1 shows a schematic diagram of the structure of a waveguide AR optical module. Figure 2 As shown, the waveguide AR optical module includes a microdisplay (OLED microdisplay), an optical machine, a waveguide sheet, and a camera. The microdisplay is placed in a mechanical structure with 6 degrees of freedom to drive the microdisplay to achieve 6 degrees of freedom, including translation in the x direction, translation in the y direction, translation in the z direction, rotation along ox, rotation along oy, and rotation along oz, where the z translation direction is the translation direction between the microdisplay and the optical machine. By controlling the relative position of the microdisplay and the optical machine, the active calibration process of the waveguide AR optical module is achieved.

[0031] In order to improve the efficiency and calibration accuracy of the active calibration assembly of the waveguide AR optical module, this scheme proposes an active calibration assembly method for the waveguide AR optical module, which can resist the influence of image non-uniformity and improve the calibration efficiency and accuracy.

[0032] Figure 3 FIG. 3 is a flow chart showing an active calibration assembly method 300 of a waveguide AR optical module according to an embodiment of the present invention. Figure 3 As shown, the method starts at step S310, where an initial calibration image of the waveguide AR optical module is acquired, and the initial calibration image includes a black and white grid area, a black and white stripe area, and a white background area.

[0033] Before making fine adjustments, Figure 1 The positions shown are standard. The microdisplay, optical machine and camera are roughly placed in the correct relative positions by visual inspection. The initial calibration image of the waveguide AR optical module is obtained by controlling the microdisplay to display a specific calibration image. The calibration image is designed to be an easily recognizable pattern, which may include grid lines, cross lines, color blocks, etc., so as to ensure that the microdisplay can display images or information in the best state by analyzing and adjusting the clarity and position error of the image.

[0034] Figure 4 FIG. 4 shows a schematic diagram of an initial calibration image according to an embodiment of the present invention. Figure 4 As shown, the initial calibration image includes 1 black and white grid area, 2 white background areas and 3 black and white stripe areas.

[0035] The black and white grid areas are distributed at four positions on the edge of the image, top, bottom, left, and right, and each position can be set with multiple rows or columns as needed. Figure 4 As shown, the black and white grids at each position have three rows or three columns, corresponding to the data on the four straight lines, such as the U1~U4 rows at the upper position, the D1~D4 rows at the lower position, the L1~L4 columns at the left position, and the R1~R4 columns at the right position.

[0036] The black and white stripe area can take the form of a rectangular change in light intensity, such as Figure 4 As shown, in this mode, the light intensity of black and white stripes is clearly distinguished. The black stripes correspond to low light intensity, close to 0, and the white stripes correspond to high light intensity, close to the maximum value. The light intensity of the white part and the black part is very different and there is no transition area. The light intensity cosine distribution can also be used. This form provides a smooth transition of light intensity and changes in the form of a cosine function. It is often used for modulation transfer function (MTF) measurement.

[0037] The embodiment of the present invention uses the form of light intensity rectangular changes to analyze the light intensity data of the black and white stripe area. The white background area is located on the upper and lower sides of the black and white stripe area, and the number and relative position of the white background area and the black and white stripe area can be adjusted as needed. After obtaining the image projected by the micro-display optical machine and the waveguide, the image feature quantity can be calculated. In the embodiment of the present invention, the image feature quantity includes the trapezoidal distortion amount and the ghosting amount.

[0038] Then, step S320 is executed to calculate the trapezoidal distortion of the waveguide AR optical module based on the direction angles of four positions of the upper, lower, left and right of the black and white grid area.

[0039] Keystone distortion is a geometric distortion that occurs during image projection, causing lines or boundaries that should be parallel to become trapezoidal instead of parallel, mimicking the perspective effect seen by the human eye or camera at different angles. Correction of keystone distortion can be corrected by adjusting the six degrees of freedom of the microdisplay to ensure that the geometry of the projected image remains visually correct.

[0040] Specifically, first, corner point detection is performed on the four positions of the upper, lower, left, and right of the black and white grid area to extract the coordinates of the corner points of each edge line. Figure 4 Taking the U1~U4 lines in the figure as an example, a corner detection algorithm is used, such as Hariis corner detector, FAST (Features from Accelerated Segment Test) corner detector, SIFT (Scale-Invariant Feature Transform) feature detection and other methods to extract the position coordinates of each corner point, which are used for subsequent straight line fitting.

[0041] Based on the coordinates of the corner points, the edges are fitted with straight lines, and the direction angles of each fitted line are calculated and averaged to obtain the upper direction angle, lower direction angle, left direction angle and right direction angle. For example, the positions of each point on U1, U2, U3 and U4 are fitted with straight lines (x is the independent variable, y is the dependent variable, and the unit is pixel). The slope of the fitted line reflects the direction of the boundary in the image. The direction angle can be calculated by taking the inverse tangent function of the slope of the line. The direction angles of each fitted line are recorded as u_1, u_2, u_3 and u_4, and the average value of the four angles, u_angle=(u_1+u_2+u_3+u_4) / 4, is the upper direction angle.

[0042] Similarly, the above processing is performed on the D1-D4 line, the L1-L4 line and the R1-R4 line respectively to obtain the lower direction angle d_angle, the left direction angle l_angle and the right direction angle r_angle respectively.

[0043] Finally, the average direction angle of the upper direction angle, the lower direction angle, the left direction angle and the right direction angle is calculated as the trapezoidal distortion of the waveguide AR optical module. That is, the trapezoidal distortion is equal to (u_angle+d_angle+l_angle+r_angle) / 4.

[0044] Then, step S330 is executed to adjust the six degrees of freedom of the micro-display based on the amount of keystone distortion, so that the five degrees of freedom except the translation between the micro-display and the optical machine reach the optimal state.

[0045] By minimizing the average direction angle, visual distortion in different directions can be reduced. When the keystone distortion is minimized, it means that after adjusting the six degrees of freedom of the microdisplay, the five degrees of freedom other than the translation between the microdisplay and the optomechanical machine have reached the optimal state. Next, we need to continue adjusting the translational degree of freedom between the microdisplay and the optomechanical machine.

[0046] In step S340 , the ghosting amount of the waveguide AR optical module is calculated based on the light intensity data of the black and white stripe area and the light intensity data of the white background area.

[0047] In order to handle the situation where the boundary is curved instead of straight line due to image distortion, the calculation range of the black and white stripe area and the white background area can be determined based on the relative positions of the black and white grid area, the black and white stripe area and the white background area.

[0048] First, determine the coordinates of the four intersection points of the boundary lines in the black and white grid area and the coordinates of the starting point and the ending point of the black and white stripe area. Figure 4 As shown, the coordinates of the intersection of line U④ and line L④ are (x A ,y A ), the coordinates of the intersection of line U④ and line R① are (x B ,yB ), the coordinates of the intersection of line D① and line R① are (x C ,y C ), the coordinates of the intersection of line L④ and line D① are (x D ,y D ), the coordinates of the starting point and the ending point of the black and white stripe area are (x s ,y s )、(x e ,y e ).

[0049] In order to ensure the calculation accuracy, the area selection range of the black and white stripe area will leave margins in both the x and y directions. The calculation range of the black and white stripe area can be determined according to the distortion amount of the waveguide AR optical module and the x-direction coordinates of the intersection, the starting point coordinates, and the ending point coordinates.

[0050] Specifically, the coordinates of the four intersection points of the boundary lines in the black and white grid area and the starting point coordinates and the ending point coordinates of the black and white stripe area are determined; the calculation range of the black and white stripe area used for ghosting amount calculation is determined according to the x-direction coordinates of the intersection points, the starting point coordinates and the ending point coordinates.

[0051] For example, the calculation range of the black and white stripe area is: [x_start_fringe:x_end_fringe,y_start_fring:y_end_fringe], which means selecting the area with x-coordinates between x_start_fringe and x_end_fringe and y-coordinates between y_start_fring and y_end_fringe.

[0052] x_start_fringe=round[x A +a1(x s -x A )]; x_end_fringe=round[x e +a2(x B –x e )]; y_start_fringe=round[y s +a3(y e –y s )]; y_end_fringe=round[y e -a4(y e –y s )]; Among them, round() means rounding off, which is used to convert the calculated floating-point coordinates into integer coordinates to select pixel areas. a1, a2, a3, and a4 are any values ​​in [0,1] and are parameters for controlling the distortion margin. They can compensate for the error caused by image distortion and ensure that the calculated area truly and effectively represents the target area. The setting principle is to ensure that the calculation area is expanded as much as possible without infringing the white background area, which helps to prevent out-of-bounds errors.

[0053] When selecting the white background area, a certain margin will also be left in both the x and y directions. The calculation range of the white background area used for ghosting calculation can be determined based on the y-direction coordinates of the intersection point, the starting point, and the end point.

[0054] The calculation range of the white background area is selected as: [x_start_white:x_end_white,y_start_white:y_end_white].

[0055] Figure 4 There are two white background areas in the image shown, so there are two area ranges. For the upper white background area, the area range is: x_start_white=x_start_fringe, x_end_white=x_end_fringe, y_start_white=round[y A +a5(y s –y A )],y_end_white =round[y s -a6(y s –y A )]; For the lower white area, the area range is: x_start_white=x_start_fringe, x_end_white=x_end_fringe, y_start_white=round[y e +a7(y D –y e )],y_end_white =round[y D -a8(y D –y e )].

[0056] Among them, round() means rounding off, which is used to convert the calculated floating-point coordinates into integer coordinates for selecting pixel areas. a1, a2, a3, and a4 are any values ​​in [0,1] and are parameters for controlling the distortion margin. They can compensate for the error caused by image distortion and ensure that the calculated area truly and effectively represents the target area. The setting principle is to ensure that the calculation area is expanded as much as possible without infringing the black and white stripe area and the black and white grid area, which helps to prevent out-of-bounds errors.

[0057] Then, the light intensity distribution curve is obtained based on the light intensity data within the calculation range. In order to reduce the influence of noise, the light intensity data in the black and white stripe area [x_start_fringe:x_end_fringe,y_start_fring:y_end_fringe] can be averaged in the y direction to obtain the light intensity distribution curve of the x coordinate and the mean light intensity, recorded as x_I ave .

[0058] Similarly, in order to reduce the influence of noise, the light intensity data in the white background area [x_start_white:x_end_white,y_start_white:y_end_white] can be averaged in the y direction to obtain the light intensity distribution curve of the x coordinate and the mean light intensity.

[0059] The light intensity peak values ​​of the black and white stripe area and the white background area are determined based on the light intensity distribution curve. Figure 5 FIG. 2 shows a schematic diagram of a light intensity distribution curve according to an embodiment of the present invention. Figure 5 As shown, the light intensity area of ​​black and white stripes is periodic. Figure 5 Three complete cycles are shown (the area between each two dashed lines). The brightest point in each cycle is called the peak point, and its x-direction coordinate and light intensity value are recorded as x and y, respectively. max and I max For the white background area, you can select only the upper white background area or the lower white background area, or you can select all of them. Figure 5 The x-direction coordinate of the white background area light intensity curve is x max The light intensity at this time is recorded as I white_max .

[0060] Finally, the ghosting amount of the waveguide AR optical module is calculated based on the light intensity peak of the black and white stripe area and the light intensity peak of the white background area.

[0061] Specifically, the difference ratio between the peak light intensity of the white background area and the peak light intensity of the black and white stripe area is calculated in each light intensity distribution period of the light intensity distribution curve, and the average value of the difference ratio of each light intensity distribution period in the light intensity distribution curve is calculated to obtain the ghosting amount of the waveguide AR optical module.

[0062] That is, the calculation formula for the ghosting amount is: error_double=mean[(I white_max1 -I max1 ) / I white_max1 ,(I white_max2 -I max2 ) / I white_max2 ,(I white_max3 -I max3 ) / I white_max3 ]; in, (I white_max1 -I max1 ) / I white_max1 ,(I white_max2 -I max2 ) / I white_max2 ,(I white_max3 -I max3 ) / I white_max3 ] represent all cycles respectively ( Figure 5 The three periods shown in the figure correspond to the data sequence of the calculated amount, and mean() represents the mean calculation of the data sequence.

[0063] Finally, step S350 is executed to adjust the translational freedom between the micro-display and the optical machine based on the ghosting amount, so that the translational freedom between the micro-display and the optical machine reaches an optimal state.

[0064] According to the preset step size, the translation distance between the microdisplay and the optical machine, that is, the translation distance in the z direction, can be gradually moved. After each adjustment of the translation distance, the ghosting amount is calculated again, and fine-tuning is continued until the ghosting amount is minimized. When the minimum ghosting amount is reached, the translation distance between the microdisplay and the optical machine is recorded, and the active calibration assembly of the waveguide AR optical module is completed.

[0065] According to the active calibration and assembly method of the waveguide AR optical module provided by the present invention, the trapezoidal distortion of the waveguide AR optical module is calculated based on multiple direction angles of the black and white grid area, and the trapezoidal distortion is minimized by adjusting the freedom of the microdisplay, thereby resisting the influence of image non-uniformity; the ghosting amount is calculated using the light intensity data of the black and white stripe area and the white background area, which can reduce the calculation complexity of the ghosting amount, and then adjust the key degree of freedom (translation) between the microdisplay and the optical machine based on the ghosting amount, so that this adjustment is more targeted and precise, thereby achieving precise calibration of the waveguide AR optical module.

[0066] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0067] As used herein, unless otherwise specified, the use of ordinal numbers "first," "second," "third," etc. to describe common objects merely indicates that different instances of similar objects are involved, and is not intended to imply that the objects so described must have a given order in time, space, order, or in any other manner.

Claims

1. An active calibration assembly method for a waveguide AR optical module, characterized in that: include: Acquire an initial calibration image of the waveguide AR optical module, wherein the initial calibration image includes a black and white grid area, a black and white stripe area, and a white background area; Calculate the trapezoidal distortion of the waveguide AR optical module based on the directional angles of the four positions of the upper, lower, left and right of the black and white grid area; Adjusting the six degrees of freedom of the micro-display based on the amount of trapezoidal distortion, so that the five degrees of freedom except the translation between the micro-display and the optical machine reach an optimal state; Calculate the ghosting amount of the waveguide AR optical module based on the light intensity data of the black and white stripe area and the light intensity data of the white background area; The degree of freedom of translation between the micro-display and the optical machine is adjusted based on the ghosting amount, so that the degree of freedom of translation between the micro-display and the optical machine reaches an optimal state.

2. The active calibration assembly method of the waveguide AR optical module according to claim 1, characterized in that: The waveguide AR optical module includes a microdisplay, an optical machine, a waveguide plate and a camera. The microdisplay is placed in a mechanical structure with 6 degrees of freedom including x translation, y translation, z translation, rotation along ox, rotation along oy, and rotation along oz. The translation direction between the microdisplay and the optical machine is the z translation direction.

3. The active calibration assembly method of the waveguide AR optical module according to claim 1, characterized in that: The black and white grid area is distributed at four positions of the upper, lower, left and right sides of the image edge, and each position is provided with multiple rows or columns of black and white grids. The black and white stripe area has a rectangular distribution of light intensity or a cosine distribution of light intensity, and the white background area is located at the upper and lower sides of the black and white stripe area.

4. The active calibration assembly method of the waveguide AR optical module according to claim 2, characterized in that: The step of calculating the trapezoidal distortion amount of the waveguide AR optical module based on the directional angles of four positions of the upper, lower, left and right of the black and white grid area includes: Perform corner point detection on the four positions of the upper, lower, left and right of the black and white grid area to extract the coordinates of the corner points of each edge line; Perform straight line fitting on the edge lines based on the corner point position coordinates, calculate the direction angle of each fitting straight line and take the average, and obtain the upper direction angle, the lower direction angle, the left direction angle and the right direction angle respectively; The average direction angle of the upper direction angle, the lower direction angle, the left direction angle and the right direction angle is calculated as the trapezoidal distortion amount of the waveguide AR optical module.

5. The active calibration assembly method of the waveguide AR optical module according to claim 1, characterized in that: The step of calculating the ghosting amount of the waveguide AR optical module based on the light intensity data of the black and white stripe area and the light intensity data of the white background area comprises: Determine the calculation range of the black and white stripe area and the white background area based on the relative positions of the black and white grid area, the black and white stripe area and the white background area; A light intensity distribution curve is obtained based on the light intensity data within the calculation range; Determine the peak light intensity of the black and white stripe area and the peak light intensity of the white background area based on the light intensity distribution curve; The ghosting amount of the waveguide AR optical module is calculated based on the light intensity peak value of the black and white stripe area and the light intensity peak value of the white background area.

6. The active calibration assembly method of the waveguide AR optical module according to claim 5, characterized in that: The step of determining the calculation range of the black and white stripe area and the white background area based on the relative positions of the black and white grid area, the black and white stripe area and the white background area comprises: Determine the coordinates of the four intersection points of the boundary lines in the black and white grid area and the coordinates of the starting point and the ending point of the black and white stripe area; Determine the calculation range of the black and white stripe area used for ghosting amount calculation according to the x-direction coordinates of the intersection point, the starting point coordinates and the ending point coordinates; The calculation range of the white background area used for ghosting amount calculation is determined according to the y-direction coordinates of the intersection point, the starting point, and the ending point.

7. The active calibration assembly method of the waveguide AR optical module according to claim 5, characterized in that: The step of obtaining a light intensity distribution curve based on light intensity data within a calculation range comprises: The light intensity data within the calculation range of the black and white stripe area and the white background area are calculated in the y direction to obtain the distribution curve of the x-coordinate and the light intensity mean.

8. The active calibration assembly method of the waveguide AR optical module according to claim 7, characterized in that: The step of calculating the ghosting amount of the waveguide AR optical module based on the light intensity peak value of the black and white stripe area and the light intensity peak value of the white background area comprises: The difference ratio between the peak light intensity of the white background area and the peak light intensity of the black and white stripe area is calculated in each light intensity distribution period of the light intensity distribution curve; The average value of the difference ratios in each light intensity distribution period in the light intensity distribution curve is calculated as the ghosting amount of the waveguide AR optical module.

9. A computing device comprising: At least one processor and a memory storing program instructions, wherein the program instructions are configured to be suitable for execution by the at least one processor, and the program instructions include instructions for executing the active calibration assembly method of the waveguide AR optical module as described in any one of claims 1-8.

10. A readable storage medium storing program instructions, when the program instructions are read and executed by a computing device, the computing device executes the active calibration assembly method of the waveguide AR optical module according to any one of claims 1-8.

Citation Information

Patent Citations

  • AR module assembly method based on active alignment technology

    CN115951500A

  • Projected image trapezoid calibration method based on naked eye 3D helmet display and 3D helmet

    CN109541808A

  • Image processing device, image processing method and projector

    JP2013186332A

  • Passive head worn display

    US10681316B1

  • Mounting System For Glasses Frames

    US20140345090A1

Cited By

  • Image processing method for AR / VR active alignment

    CN121391995A

  • An image processing method for AR / VR active alignment

    CN121391995B