AR module binocular image combination adjusting system

Abstract

The utility model provides an AR module binocular image combination adjusting system. The AR module binocular image combination adjusting system comprises a base, a calibration mechanism, an AR waveguide binocular module, a position adjusting mechanism, a first shooting unit, a second shooting unit and a first processing unit. The base is used for arranging the calibration mechanism, the AR waveguide binocular module and the position adjusting mechanism, the calibration mechanism is provided with a first shooting unit and a second shooting unit which are used for simulating two eyes of a person, and the calibration mechanism is used for calibrating the relative position of the first shooting unit and the second shooting unit; the first processing unit is connected with the first shooting unit and the second shooting unit, and the position adjusting mechanism is connected with the AR waveguide binocular module. The AR module binocular image combination adjusting system provided by the utility model enables the AR waveguide binocular module to meet the binocular image combination requirement. The comfort and the overall immersion of the user wearing the AR waveguide glasses are improved, and the visual fatigue of the user is reduced.

Description

Technical Field

[0001] The utility model belongs to the technical field of binocular imaging, and in particular relates to an AR module binocular imaging adjustment system. Background Art

[0002] Augmented reality (AR) and virtual reality (VR) technologies have developed rapidly in recent years, providing users with an immersive experience by overlaying virtual information or constructing fully virtual environments within their field of view. AR glasses, a typical AR device, overlay virtual information on real scenes, enabling users to perceive virtual objects simultaneously with the real world, thereby enhancing the experience. However, to achieve this experience, the accuracy of binocular convergence is crucial.

[0003] Binocular convergence is the process of combining the virtual images seen by the left and right eyes into a single virtual image. The accuracy of binocular convergence directly impacts user comfort, visual fatigue, and overall immersion. Accurate binocular convergence can reduce visual fatigue and discomfort, improve user comfort, and make virtual objects appear more realistic.

[0004] In AR glasses, achieving binocular alignment requires precise binocular registration of virtual images. This involves adjusting the position and angle of the virtual images seen by the left and right eyes to ensure they blend seamlessly within the user's field of view. The accuracy of binocular registration directly impacts the quality of binocular alignment. Therefore, developing a binocular alignment adjustment technology for AR modules is crucial for improving the user experience of AR glasses. Utility Model Content

[0005] In order to meet the needs of the existing technology, the utility model provides an AR module binocular image adjustment system.

[0006] The utility model provides an AR module binocular image adjustment system, comprising a base, a calibration mechanism, a first shooting unit, a second shooting unit, an AR waveguide binocular module, a first processing unit, and a position adjustment mechanism; wherein the first shooting unit and the second shooting unit simulate human eyes;

[0007] The base is used to set the calibration mechanism, AR waveguide binocular module and position adjustment mechanism;

[0008] The calibration mechanism is provided with a first shooting unit and a second shooting unit;

[0009] The first shooting unit and the second shooting unit are connected to the first processing unit;

[0010] The position adjustment mechanism is connected to the AR waveguide binocular module.

[0011] Furthermore, the calibration mechanism includes a lifting adjustment structure, a support plate, a first pitch rotation platform, a second pitch rotation platform, a calibration plate and a second processing unit;

[0012] The bottom end of the lifting adjustment structure is connected to the base, and the top end of the lifting adjustment structure is connected to the support plate;

[0013] The first position of the support plate is fixed to the first pitch rotation platform, and the second position of the support plate is fixed to the second pitch rotation platform; wherein the first position and the second position are in the same horizontal plane and the horizontal separation distance corresponds to the pupil distance;

[0014] A first shooting unit is provided on the first tilt-rotating platform, and a second shooting unit is provided on the second tilt-rotating platform;

[0015] The second processing unit is connected to the first shooting unit and the second shooting unit;

[0016] The third position of the support plate is used to set the calibration plate.

[0017] Furthermore, the calibration plate has a calibration pattern, which includes a first cross and a second cross, wherein the intersection of the first cross and the intersection of the second cross are in the same horizontal plane and the horizontal spacing distance corresponds to the pupil distance, and the third position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit.

[0018] Furthermore, the AR waveguide binocular module is detachably connected to a fourth position of the support plate; wherein the fourth position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit;

[0019] Furthermore, the position adjustment mechanism includes a first position adjustment mechanism and a second position adjustment mechanism;

[0020] The bottom end of the first position adjustment mechanism is connected to the base, and the top end of the first position adjustment mechanism is connected to the AR waveguide binocular module;

[0021] The bottom end of the second position adjustment mechanism is connected to the base, and the top end of the second position adjustment mechanism is connected to the AR waveguide binocular module.

[0022] Furthermore, the AR waveguide binocular module includes: a module bracket, a first waveguide plate, a second waveguide plate, a first optical-mechanical module, and a second optical-mechanical module;

[0023] The first optical-mechanical module includes a first module bracket, a first optical-mechanical unit, and a first prism;

[0024] The second optical-mechanical module includes a second module bracket, a second optical-mechanical unit, and a second prism;

[0025] The first waveguide plate and the second waveguide plate are fixed on one side of the module bracket respectively, and the first module bracket and the second module bracket are placed on the opposite side of the module bracket respectively. The first module bracket is provided with a first optical machine and a first prism, and the second module bracket is provided with a second optical machine and a second prism;

[0026] A first glue injection hole is provided on the first module bracket, a second glue injection hole is provided on the second module bracket, a third glue injection hole is provided on the module bracket at the position of the first glue injection hole and is connected to the first glue injection hole, and a fourth glue injection hole is provided on the module bracket at the position of the second glue injection hole and is connected to the second glue injection hole;

[0027] The first module bracket is provided with a first transfer hole, and the second module bracket is provided with a second transfer hole.

[0028] Furthermore, the first position adjustment mechanism includes a first turntable, a first Z-axis lifting platform, a first Y-axis goniometer, a first X-axis goniometer, a first Y-axis slide rail for providing a first slider, and a first X-axis slide rail for providing a first slider, which are sequentially connected from bottom to top; the first turntable is connected to the base, and the first slider of the first X-axis slide rail is connected to the first adapter hole via a first adapter assembly;

[0029] Furthermore, the second position adjustment mechanism includes a second turntable, a second Z-axis lifting platform, a second Y-axis goniometer, a second X-axis goniometer, a second Y-axis slide rail with a second slider, and a second X-axis slide rail with a second slider, which are connected in sequence from bottom to top; the first turntable is connected to the base, and the second slider of the second X-axis slide rail is connected to the second adapter hole through a second adapter assembly.

[0030] Furthermore, the first adapter assembly includes a first adapter plate and a first threaded rod;

[0031] One end of the first adapter plate is connected to the first slider of the first X-axis slide rail, one end of the first threaded rod is connected to the first adapter hole, and the other end of the first adapter plate is connected to the other end of the first threaded rod.

[0032] Furthermore, the second adapter assembly includes a second adapter plate and a second threaded rod;

[0033] One end of the second adapter plate is connected to the second slider of the second X-axis slide rail, one end of the second threaded rod is connected to the second adapter hole, and the other end of the second adapter plate is connected to the other end of the second threaded rod.

[0034] Compared with the prior art, the technical solution of the utility model has the following beneficial effects:

[0035] The present invention provides an AR module binocular image adjustment system, comprising a base, a calibration mechanism, an AR waveguide binocular module, a position adjustment mechanism, a first shooting unit, a second shooting unit, and a first processing unit. The base is used to set the calibration mechanism, the AR waveguide binocular module, and the position adjustment mechanism. The calibration mechanism is provided with a first shooting unit and a second shooting unit for simulating human eyes. The calibration mechanism is used to calibrate the relative positions of the first shooting unit and the second shooting unit. The first processing unit is connected to the first shooting unit and the second shooting unit. The position adjustment mechanism is connected to the AR waveguide binocular module. The first processing unit processes a first shot image corresponding to a first virtual image output and displayed by the AR waveguide binocular module obtained by the first shooting unit and a second shot image corresponding to a second virtual image output and displayed by the AR waveguide binocular module obtained by the second shooting unit to obtain a deviation value. Based on the deviation value, the AR waveguide binocular module is adjusted through the position adjustment mechanism so that the AR waveguide binocular module meets the binocular image requirement. The user's comfort and overall immersion when wearing AR waveguide glasses are improved, and the user's visual fatigue is reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0037] Figure 1 This is a schematic diagram of the overall structure of a first example of the AR module binocular image adjustment system of the present invention;

[0038] Figure 2 This is a schematic diagram of the overall structure of a second example of the AR module binocular image adjustment system of the present invention;

[0039] Figure 3 This is a schematic diagram of the overall structure of a third example of the AR module binocular image adjustment system of the present invention;

[0040] Figure 4 A schematic diagram of a partial structure of an exemplary calibration structure;

[0041] Figure 5 A schematic structural diagram of a calibration plate for an exemplary calibration structure;

[0042] Figure 6 Schematic diagram of the connection between an exemplary AR waveguide binocular module and a first adapter component and a second adapter component at a first angle;

[0043] Figure 7Schematic diagram of the connection between an exemplary AR waveguide binocular module and a first adapter component and a second adapter component at a second angle;

[0044] Figure 8 is a structural diagram of an exemplary first position adjustment mechanism;

[0045] Figure 9 Schematic diagram of the structure of the second position adjustment mechanism as an example.

[0046] Among them, 1-base, 2-calibration mechanism, 2-1-lifting adjustment structure, 2-2-support plate, 2-3-calibration plate, 2-4-first pitch rotation stage, 2-5-second pitch rotation stage, 3-AR waveguide binocular module, 3-1-module bracket, 3-2-first waveguide plate, 3-3-second waveguide plate, 3-4-first module bracket, 3-5-first optical machine, 3-6-first prism, 3-7-second module bracket, 3-8-second optical machine, 3-9-second prism, 3-10-first glue injection hole, 3-11-second glue injection hole, 4-1-first position adjustment mechanism, 4-1-1-first turntable, 4-1-2-first Z-axis lifting platform, 4 -1-3-First Y-axis oscillator, 4-1-4-First X-axis oscillator, 4-1-5-First Y-axis slide rail, 4-1-6-First X-axis slide rail, 4-1-7-First slider, 4-2-Second position adjustment mechanism, 4-2-1-Second turntable, 4-2-2-Second Z-axis lifting platform, 4-2-3-Second Y-axis oscillator, 4-2-4-Second X-axis oscillator, 4-2-5-Second Y-axis slide rail, 4-2-6-Second X-axis slide rail, 4-2-7-Second slider, 5-First shooting unit, 6-Second shooting unit, 7-1-First adapter plate, 7-2-First threaded rod, 8-1-Second adapter plate, 8-2-Second threaded rod. DETAILED DESCRIPTION

[0047] The following will be combined with the embodiments of the present invention to clearly and completely describe the technical solutions of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present invention.

[0048] In this document, the terms "first", "second" and other similar words are not intended to imply any order, quantity and importance, but are merely used to distinguish different elements. In this document, the terms "one", "an" and other similar words are not intended to indicate that there is only one of the things described, but rather that the relevant description is only for one of the things described, and the things described may have one or more. In this document, the terms "comprise", "include" and other similar words are intended to indicate logical relationships, and cannot be regarded as indicating relationships in spatial structure. For example, "A includes B" is intended to indicate that B logically belongs to A, and does not mean that B is spatially located inside A. In addition, the meanings of the terms "comprise", "include" and other similar words should be regarded as open, not closed. For example, "A includes B" is intended to indicate that B belongs to A, but B does not necessarily constitute the whole of A, and A may also include other elements such as C, D, and E.

[0049] In this document, the terms "embodiment," "present embodiment," "preferred embodiment," and "one embodiment" do not imply that the description applies only to a specific embodiment, but rather that the description may also apply to one or more other embodiments. Those skilled in the art should understand that any description of a particular embodiment herein may be substituted, combined, or otherwise combined with the description of one or more other embodiments. New embodiments resulting from such substitution, combination, or other combination are readily conceivable by those skilled in the art and fall within the scope of protection of this utility model.

[0050] In the description herein, “a plurality of” means at least two, for example, two, three, etc., unless otherwise clearly and specifically defined.

[0051] like Figure 1-Figure 3 As shown, the present invention provides an AR module binocular image adjustment system, including a base 1, a calibration mechanism 2, an AR waveguide binocular module 3, a position adjustment mechanism, a first shooting unit 5, a second shooting unit 6 and a first processing unit.

[0052] The base 1 is used to set the calibration mechanism 2, the AR waveguide binocular module 3 and the position adjustment mechanism.

[0053] The calibration mechanism 2 is fixedly mounted on the base 1. The calibration mechanism 2 is provided with a first photographing unit 5 and a second photographing unit 6. The calibration mechanism 1 is used to calibrate the relative positions of the first photographing unit and the second photographing unit.

[0054] The AR waveguide binocular module 3 is detachably mounted on the base. The longitudinal distance between the AR waveguide binocular module 3 and the first and / or second imaging units 5 and 6, mounted on the base 1, is equal to the exit pupil distance of the AR waveguide binocular module. When activated, the AR waveguide binocular module 3 displays a first virtual image and a second virtual image.

[0055] The bottom end of the position adjustment mechanism is fixedly arranged on the base, and the position adjustment mechanism is connected to the AR waveguide binocular module arranged on the base.

[0056] The first and second capturing units are connected to the first processing unit. The first and second capturing units simulate human eyes. The first capturing unit is configured to capture a first virtual image to obtain a first captured image, and transmit the first captured image to the first processing unit. The second capturing unit is configured to capture a second virtual image to obtain a second captured image, and transmit the second captured image to the first processing unit.

[0057] The first processing unit receives the first captured image and the second captured image for calculation and processing, and obtains a deviation value between the first captured image and the second captured image.

[0058] Based on the deviation value, the AR waveguide binocular module is adjusted through the position adjustment mechanism so that the AR waveguide binocular module meets the binocular imaging requirements.

[0059] Exemplarily, the first shooting unit and the second shooting unit may adopt existing CCD cameras.

[0060] The first processing unit may be an existing computer.

[0061] For example, Figure 4 as well as Figure 5 As shown, the calibration mechanism 2 may include a lifting adjustment structure 2-1, a support plate 2-2, a calibration plate 2-3, a first pitch rotation platform 2-4, a second pitch rotation platform 2-5, and a second processing unit. The lifting adjustment structure, the support plate, the calibration plate, the first pitch rotation platform, the second pitch rotation platform, and the second processing unit may be existing components. It should be noted that the second processing unit and the first processing unit may use the same computer or different computers.

[0062] The bottom end of the lifting adjustment structure 2-1 is connected to the base 1, and the top end of the lifting adjustment structure 2-1 is connected to the support plate 2-2.

[0063] The first position of the support plate 2-2 is fixed to the first pitch rotation platform 2-4, and the second position of the support plate 2-2 is fixed to the second pitch rotation platform 2-5. The first position and the second position are in the same horizontal plane and the horizontal distance between them corresponds to the pupil distance.

[0064] A first photographing unit 5 is provided on the first tilt-rotating platform 2 - 4 , and a second photographing unit 6 is provided on the second tilt-rotating platform 2 - 5 .

[0065] The second processing unit is connected to the first shooting unit and the second shooting unit.

[0066] The third position of the support plate 2-2 is used to set the calibration plate 2-3 with a calibration pattern, and the calibration plate 2-3 can be detachably connected to the third position of the support plate 2-2. Figure 5 As shown, the calibration pattern of the calibration plate 2-3 includes a first cross and a second cross, wherein the intersection of the first cross and the intersection of the second cross are in the same horizontal plane and the horizontal spacing distance corresponds to the pupil distance, and the third position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit.

[0067] For example, Figure 6 as well as Figure 7 As shown, the above-mentioned AR waveguide binocular module includes: a module bracket 3-1, a first waveguide plate 3-2, a second waveguide plate 3-3, a first optomechanical module and a second optomechanical module.

[0068] The first optical-mechanical module includes a first module bracket 3 - 4 , a first optical-mechanical unit 3 - 5 and a first prism 3 - 6 .

[0069] The second optical-mechanical module includes a second module bracket 3-7, a second optical-mechanical unit 3-8 and a second prism 3-9.

[0070] The first waveguide plate 3-2 and the second waveguide plate 3-3 are fixed on one side of the module bracket 3-1, and the first module bracket 3-4 and the second module bracket 3-7 are placed on the opposite side of one side of the module bracket 3-1. The first optical machine 3-5 and the first prism 3-6 are set in the first module bracket 3-4, and the second optical machine 3-8 and the second prism 3-9 are set in the second module bracket 3-7.

[0071] A first glue injection hole 3-10 is set on the first module bracket 3-4, a second glue injection hole 3-11 is set on the second module bracket 3-7, a third glue injection hole connected to the first glue injection hole is set at the position of the first glue injection hole of the module bracket 3-1, and a fourth glue injection hole connected to the second glue injection hole is set at the position of the second glue injection hole of the module bracket 3-1.

[0072] The first module bracket is provided with a first transfer hole, and the second module bracket is provided with a second transfer hole.

[0073] The module bracket of the AR waveguide binocular module can be detachably connected to the fourth position of the support plate; wherein the fourth position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit.

[0074] For example, the position adjustment mechanism may include a first position adjustment mechanism 4-1 and a second position adjustment mechanism 4-2 (eg Figure 1-Figure 3 shown).

[0075] The bottom end of the first position adjustment mechanism is connected to the base, and the top end of the first position adjustment mechanism is connected to the AR waveguide binocular module. The bottom end of the second position adjustment mechanism is connected to the base, and the top end of the second position adjustment mechanism is connected to the AR waveguide binocular module (such as Figure 3 shown).

[0076] For specific examples,

[0077] like Figure 8 As shown, the first position adjustment mechanism 4-1 includes, from bottom to top, a first turntable 4-1-1, a first Z-axis lifting platform 4-1-2, a first Y-axis oscillator 4-1-3, a first X-axis oscillator 4-1-4, a first Y-axis slide 4-1-5 on which a first slider 4-1-7 is provided, and a first X-axis slide 4-1-6 on which the first slider 4-1-7 is provided. The first turntable is connected to the base, and the first slider 4-1-7 of the first X-axis slide 4-1-6 is connected to the first adapter hole of the AR waveguide binocular module in the above example via a first adapter assembly.

[0078] like Figure 9 As shown, the second position adjustment mechanism 4-2 includes a second turntable 4-2-1, a second Z-axis lifting platform 4-2-2, a second Y-axis goniometer 4-2-3, a second X-axis goniometer 4-2-4, a second Y-axis slide rail 4-2-5 with a second slider 4-2-7, and a second X-axis slide rail 4-2-6 with a second slider 4-2-7, which are connected in sequence from bottom to top; the second turntable is connected to the base, and the second slider 4-2-7 of the second X-axis slide rail 4-2-6 is connected to the second adapter hole of the AR waveguide binocular module of the above example through a second adapter component.

[0079] For example, Figure 6 As shown, the first adapter assembly may include a first adapter plate 7-1 and a first threaded rod 7-2, and the second adapter assembly may include a second adapter plate 8-1 and a second threaded rod 8-2.

[0080] One end of the first adapter plate 7-1 is connected to the first slider 4-1-7 of the first X-axis slide rail 4-1-6, one end of the first threaded rod 7-2 is connected to the first adapter hole in the AR waveguide binocular module, and the other end of the first adapter plate 7-1 is connected to the other end of the first threaded rod 7-2.

[0081] One end of the second adapter plate 8-1 is connected to the second slider 4-2-7 of the second X-axis slide rail 4-2-6, one end of the second threaded rod 8-2 is connected to the second adapter hole in the AR waveguide binocular module, and the other end of the second adapter plate 8-1 is connected to the other end of the second threaded rod 8-2.

[0082] Exemplarily, the AR module binocular image adjustment system is used to perform an AR module binocular image adjustment method, including the following steps:

[0083] S1 uses a calibration mechanism to calibrate the relative positions of the first shooting unit and the second shooting unit, wherein the first shooting unit and the second shooting unit are used to simulate human eyes.

[0084] Exemplarily, the method specifically includes the following steps:

[0085] S1-1 sets the calibration plate at the corresponding position of the support plate.

[0086] S1-2 The first pitch rotation platform on the support plate connected by the lifting adjustment mechanism drives the first shooting unit to shoot the calibration pattern of the calibration plate from multiple positions to obtain the first calibration image, and the second pitch rotation platform on the support plate connected by the lifting adjustment mechanism drives the second shooting unit to shoot the calibration pattern of the calibration plate from multiple positions to obtain the second calibration image.

[0087] S1-3 The first photographing unit sends the first calibration image to the second processing unit, and the second photographing unit sends the second calibration image to the second processing unit.

[0088] S1-4: The second processing unit receives the first calibration image and the second calibration image, processes the first calibration image and the second calibration image using a calibration algorithm, and displays a first shooting state parameter of the first shooting unit and a second shooting state parameter of the second shooting unit.

[0089] The calibration algorithm mentioned here can use an existing algorithm, such as Zhang Zhengyou calibration algorithm.

[0090] The first shooting state parameters here include internal parameters of the first shooting unit and external parameters of the first shooting unit. Examples of the internal parameters of the first shooting unit here include focal length, principal point coordinates, and distortion coefficient. Examples of the external parameters of the first shooting unit here include pitch rotation angle and horizontal rotation angle.

[0091] The second shooting state parameters here include internal parameters of the second shooting unit and external parameters of the second shooting unit. Examples of the internal parameters of the second shooting unit here include focal length, principal point coordinates, and distortion coefficient. Examples of the external parameters of the second shooting unit here include pitch rotation angle and horizontal rotation angle.

[0092] S1-5 adjusts the first pitch rotation stage based on the first shooting state parameter so that the cross intersection in the first calibration image is located at the set position of the coordinate system of the first shooting unit, and adjusts the second pitch rotation stage based on the second shooting state parameter so that the cross intersection in the second calibration image is located at the set position of the coordinate system of the second shooting unit.

[0093] Here, the coordinate systems of the first and second camera units are set to the same. The setting position of the coordinate system of the first and second camera units is related to the combined image distance of the AR waveguide binocular module. For example, when the combined image distance of the AR waveguide binocular module is infinity, the setting position of the coordinate system of the first and second camera units can be located at the center of the coordinate system. At this time, the optical axes of the first and second camera units are set parallel.

[0094] S2 fixes the AR waveguide binocular module, wherein a longitudinal spacing distance between the AR waveguide binocular module and the first shooting unit and / or the second shooting unit is equal to the exit pupil distance of the AR waveguide binocular module.

[0095] For example,

[0096] Remove the calibration plate from the support plate.

[0097] Set the module bracket of the AR waveguide binocular module at the corresponding position of the support plate.

[0098] S3 starts the AR waveguide binocular module, and the AR waveguide binocular module displays the first virtual image and the second virtual image.

[0099] For example,

[0100] The first optical engine is started, and the first optical engine couples the image light source into the first waveguide plate, and the light is totally reflected and propagated through the first waveguide plate and coupled out to display the first virtual image. The second optical engine is started, and the second optical engine couples the image light source into the second waveguide plate, and the light is totally reflected and propagated through the second waveguide plate and coupled out to display the second virtual image.

[0101] S4: using the first shooting unit to shoot the first virtual image to obtain a corresponding first shot image; using the second shooting unit to shoot the second virtual image to obtain a corresponding second shot image.

[0102] For example,

[0103] The first virtual image is photographed by the first CCD camera to obtain a corresponding first photographed image, and the second virtual image is photographed by the second CCD camera to obtain a corresponding second photographed image.

[0104] S5: The first processing unit performs image preprocessing operations on the first captured image and the second captured image to obtain a first preprocessed image and a second preprocessed image respectively. The image preprocessing operations include image denoising, image contrast enhancement, and image edge detection.

[0105] For example, Gaussian filtering may be used for image denoising, histogram equalization may be used for image contrast enhancement, and Canny algorithm may be used for image edge detection.

[0106] The first processing unit is used to perform calculation processing on the first captured image and the second captured image to obtain a deviation value between the first captured image and the second captured image.

[0107] For example,

[0108] The first processing unit uses a feature point extraction algorithm to extract feature points in the same area of ​​the first preprocessed image and the second preprocessed image. The feature points extracted from the first preprocessed image and the feature points extracted from the second preprocessed image are represented by different marking graphics, and the pixel coordinates of the feature points are recorded.

[0109] The first processing unit uses a matching algorithm to match feature points in the same area of ​​the first pre-processed image and the second pre-processed image.

[0110] The first processing unit performs matrix operations based on the pixel coordinates of the matching corresponding feature points to obtain deviation values ​​of feature points in the same area of ​​the first preprocessed image and the second preprocessed image, wherein the deviation values ​​include position deviation values ​​and angle deviation values.

[0111] Exemplarily, the feature point extraction algorithm may adopt the SIFT algorithm or the SURF algorithm.

[0112] The above matching algorithm may adopt SIFT algorithm or SURF algorithm.

[0113] The above matrix operation examples include the following operations:

[0114] 1. Express the pixel coordinates of the corresponding feature points using homogeneous coordinates. The first feature point among the corresponding feature points is expressed as (x, y, 1), and the second feature point among the corresponding feature points is expressed as (x', y', 1). Perform the following matrix operation:

[0115]

[0116] get:

[0117] x′=x+t x , y′=y+t y (2)

[0118] tx Indicates the x-direction offset value, t y Indicates the y-direction offset value.

[0119] 2. The pixel coordinates of the first feature point among the matched feature points are expressed as (x, y), and the pixel coordinates of the second feature point among the matched feature points are expressed as (x', y'). The following matrix operations are performed:

[0120]

[0121] get:

[0122] x′=x cos(θ)−y sin(θ), y′=x sin(θ)+y cos(θ) (4) The rotation angle offset value θ is calculated by equation (4).

[0123] S6 adjusts the AR waveguide binocular module through the position adjustment mechanism based on the deviation value, so that the AR waveguide binocular module meets the binocular imaging requirements.

[0124] For example,

[0125] The deviation value is compared with the set threshold of the AR waveguide binocular module. If the deviation value is within the design threshold of the AR waveguide binocular module, the relative position of the first module bracket and the module bracket is fixed by dispensing glue in the first and third glue injection holes, and the relative position of the second module bracket and the module bracket is fixed by dispensing glue in the second and fourth glue injection holes.

[0126] If the deviation value exceeds the design threshold of the AR waveguide binocular module, the first module bracket of the first optical-mechanical module is moved by the first position adjustment mechanism and / or the second module bracket of the second optical-mechanical module is moved by the second position adjustment mechanism, and the above steps S4-S6 are repeated until the deviation value is within the set threshold range of the AR waveguide binocular module.

[0127] The setting threshold of the AR waveguide binocular module here can be set based on user needs.

[0128] The above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit the same. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field can still modify or replace the specific implementation methods of the present invention. Any modifications or equivalent replacements that do not depart from the spirit and scope of the present invention are within the scope of protection of the claims of the present invention to be approved.

Claims

1. An AR module binocular image adjustment system, characterized in that: The system comprises a base, a calibration mechanism, a first shooting unit, a second shooting unit, an AR waveguide binocular module, a first processing unit, and a position adjustment mechanism; wherein the first shooting unit and the second shooting unit simulate human eyes; The base is used to set the calibration mechanism, AR waveguide binocular module and position adjustment mechanism; The calibration mechanism is provided with a first shooting unit and a second shooting unit; The first shooting unit and the second shooting unit are connected to the first processing unit; The position adjustment mechanism is connected to the AR waveguide binocular module.

2. The AR module binocular image adjustment system according to claim 1, characterized in that: The calibration mechanism includes a lifting adjustment structure, a support plate, a first pitch rotation platform, a second pitch rotation platform, a calibration plate and a second processing unit; The bottom end of the lifting adjustment structure is connected to the base, and the top end of the lifting adjustment structure is connected to the support plate; The first position of the support plate is fixed to the first pitch rotation platform, and the second position of the support plate is fixed to the second pitch rotation platform; wherein the first position and the second position are in the same horizontal plane and the horizontal separation distance corresponds to the pupil distance; A first shooting unit is provided on the first tilt-rotating platform, and a second shooting unit is provided on the second tilt-rotating platform; The second processing unit is connected to the first shooting unit and the second shooting unit; The third position of the support plate is used to set the calibration plate.

3. The AR module binocular image adjustment system according to claim 2, characterized in that: The calibration plate has a calibration pattern, which includes a first cross and a second cross, wherein the intersection of the first cross and the intersection of the second cross are in the same horizontal plane and the horizontal spacing distance corresponds to the pupil distance, and the third position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit.

4. The AR module binocular image adjustment system according to claim 2, characterized in that: The AR waveguide binocular module is detachably connected to a fourth position of the support plate; wherein the fourth position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit.

5. The AR module binocular image adjustment system according to claim 1, characterized in that: The position adjustment mechanism includes a first position adjustment mechanism and a second position adjustment mechanism; The bottom end of the first position adjustment mechanism is connected to the base, and the top end of the first position adjustment mechanism is connected to the AR waveguide binocular module; The bottom end of the second position adjustment mechanism is connected to the base, and the top end of the second position adjustment mechanism is connected to the AR waveguide binocular module.

6. The AR module binocular image adjustment system according to claim 5, characterized in that: The AR waveguide binocular module includes: a module bracket, a first waveguide plate, a second waveguide plate, a first optical-mechanical module, and a second optical-mechanical module; The first optical-mechanical module includes a first module bracket, a first optical-mechanical unit, and a first prism; The second optical-mechanical module includes a second module bracket, a second optical-mechanical unit, and a second prism; The first waveguide plate and the second waveguide plate are fixed on one side of the module bracket respectively, and the first module bracket and the second module bracket are placed on the opposite side of the module bracket respectively. The first module bracket is provided with a first optical machine and a first prism, and the second module bracket is provided with a second optical machine and a second prism; A first glue injection hole is provided on the first module bracket, a second glue injection hole is provided on the second module bracket, a third glue injection hole is provided on the module bracket at the position of the first glue injection hole and is connected to the first glue injection hole, and a fourth glue injection hole is provided on the module bracket at the position of the second glue injection hole and is connected to the second glue injection hole; The first module bracket is provided with a first transfer hole, and the second module bracket is provided with a second transfer hole.

7. The AR module binocular image adjustment system according to claim 6, characterized in that: The first position adjustment mechanism includes a first turntable, a first Z-axis lifting platform, a first Y-axis goniometer, a first X-axis goniometer, a first Y-axis slide rail with a first slider, and a first X-axis slide rail with a first slider, which are connected in sequence from bottom to top; the first turntable is connected to the base, and the first slider of the first X-axis slide rail is connected to the first adapter hole through a first adapter assembly.

8. The AR module binocular image adjustment system according to claim 6, characterized in that: The second position adjustment mechanism includes a second turntable, a second Z-axis lifting platform, a second Y-axis goniometer, a second X-axis goniometer, a second Y-axis slide rail with a second slider, and a second X-axis slide rail with a second slider, which are connected in sequence from bottom to top; the second turntable is connected to the base, and the second slider of the second X-axis slide rail is connected to the second adapter hole through a second adapter assembly.

9. The AR module binocular image adjustment system according to claim 7, characterized in that: The first adapter assembly includes a first adapter plate and a first threaded rod; One end of the first adapter plate is connected to the first slider of the first X-axis slide rail, one end of the first threaded rod is connected to the first adapter hole, and the other end of the first adapter plate is connected to the other end of the first threaded rod.

10. The AR module binocular image adjustment system according to claim 8, characterized in that: The second adapter assembly includes a second adapter plate and a second threaded rod; One end of the second adapter plate is connected to the second slider of the second X-axis slide rail, one end of the second threaded rod is connected to the second adapter hole, and the other end of the second adapter plate is connected to the other end of the second threaded rod.

Images