A binocular fusion imaging system for a far-field imaging AR module
By designing a binocular image merging system for a distant-view AR module, the problem of binocular registration in augmented reality glasses during distant-view imaging was solved, enabling accurate synthesis of virtual images and improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- BEI JING ZHI GE GUANG DIAN KE JI YOU XIAN GONG SI
- Filing Date
- 2025-08-11
- Publication Date
- 2026-07-03
AI Technical Summary
Existing augmented reality glasses cannot achieve accurate binocular registration when imaging distant scenes, which affects the user experience.
Design a binocular image merging system for a distant imaging AR module, including a base, a distant calibration mechanism, a position adjustment mechanism, a first shooting unit and a second shooting unit, to achieve precise binocular registration of virtual images by calibrating and adjusting their relative positions.
It achieves precise binocular registration of virtual images at infinity, improving user comfort and immersion, and reducing visual fatigue.
Smart Images
Figure CN224459891U_ABST
Abstract
Description
Technical Field
[0001] This utility model belongs to the field of binocular fusion imaging technology, specifically relating to a binocular fusion imaging system for a far-field imaging AR module. Background Technology
[0002] Augmented reality (AR) and virtual reality (VR) technologies have developed rapidly in recent years, providing users with immersive experiences by overlaying virtual information onto their field of vision or constructing fully virtual environments. Augmented reality (AR) glasses, as a typical AR device, enhance the real-world experience by overlaying virtual information onto real-world scenes, allowing users to perceive virtual objects simultaneously in the real world. However, the accuracy of binocular image merging is crucial for achieving this experience.
[0003] Binocular merging refers to the process of combining the virtual images seen by the left and right eyes into a single virtual image. The accuracy of binocular merging directly affects user comfort, visual fatigue, and overall immersion. Accurate binocular merging can reduce visual fatigue and discomfort, improve user comfort, and make virtual objects appear more realistic.
[0004] In augmented reality (AR) glasses, achieving binocular image merging requires precise binocular registration of the virtual image. Precise binocular registration of the virtual image involves adjusting the position and angle of the virtual image seen by the left and right eyes to perfectly blend it within the user's field of vision.
[0005] However, when augmented reality (AR) glasses perform distant imaging, such as when the virtual image of the AR glasses is projected at infinity, accurate binocular registration of the virtual image cannot be achieved. Therefore, developing a binocular merging technology for AR modules for distant imaging is of great significance for improving the user experience of AR glasses. Utility Model Content
[0006] In order to overcome the shortcomings of the prior art, this utility model provides a binocular image merging system for a far-field imaging AR module.
[0007] This utility model is achieved through the following technical solution:
[0008] This utility model provides a binocular image merging system for a distant imaging AR module, including a base, a distant calibration mechanism, a first shooting unit, a second shooting unit, a first processing unit, and a position adjustment mechanism; wherein, the first shooting unit and the second shooting unit simulate human eyes;
[0009] The base is used to set up the far-view calibration mechanism, the position adjustment mechanism, and the AR waveguide binocular module for far-view imaging;
[0010] The distant view calibration mechanism is provided with a first shooting unit and a second shooting unit; the distant view calibration mechanism includes a calibration component and a second processing unit, the calibration component includes a calibration plate and a head-up display module for distant view imaging;
[0011] The first imaging unit and the second imaging unit are connected to the first processing unit, and the first imaging unit and the second imaging unit are connected to the second processing unit; the position adjustment mechanism is connected to the AR waveguide binocular module for distant imaging.
[0012] Furthermore, the vision calibration mechanism also includes a lifting and adjusting structure, a support plate, a first pitch rotary table, and a second pitch rotary table;
[0013] The bottom end of the lifting and adjusting structure is connected to the base, and the top end of the lifting and adjusting structure is connected to the support plate;
[0014] The first position of the support plate is fixed to the first pitch rotary table, and the second position of the support plate is fixed to the second pitch rotary table; wherein the first position and the second position are on the same horizontal plane and the horizontal interval corresponds to the interpupillary distance;
[0015] A first imaging unit is provided on the first pitch rotation platform, and a second imaging unit is provided on the second pitch rotation platform;
[0016] The third position of the support plate is used to set the calibration plate or a head-up display module for distant imaging.
[0017] Furthermore, the calibration plate has a calibration pattern, which includes a first cross and a second cross, wherein the intersection of the first cross and the intersection of the second cross are on the same horizontal plane and the horizontal interval corresponds to the interpupillary distance, and the third position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit.
[0018] The head-up display module for distant imaging includes a projection optical engine and a head-up display waveguide.
[0019] Furthermore, the fourth position of the support plate is detachably connected to an AR waveguide binocular module for distant imaging; wherein, the fourth position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit.
[0020] Furthermore, the position adjustment mechanism includes a first position adjustment mechanism and a second position adjustment mechanism;
[0021] The bottom end of the first position adjustment mechanism is connected to the base, and the top end of the first position adjustment mechanism is connected to the first AR waveguide monocular module in the AR waveguide binocular module for distant imaging.
[0022] The bottom end of the second position adjustment mechanism is connected to the base, and the top end of the second position adjustment mechanism is connected to the second AR waveguide monocular module in the AR waveguide binocular module for distant imaging.
[0023] Furthermore, the first position adjustment mechanism includes a first turntable, a first Z-axis lifting platform, a first Y-axis tilting device, a first X-axis tilting device, a first Y-axis slide rail with a first slider, and a first X-axis slide rail with a first slider connected sequentially from bottom to top; the first turntable is connected to the base, and the first slider of the first X-axis slide rail is connected to the first AR waveguide monocular module in the AR waveguide binocular module for distant imaging through a first adapter component.
[0024] Furthermore, the second position adjustment mechanism includes a second turntable, a second Z-axis lifting platform, a second Y-axis tilting device, a second X-axis tilting device, a second Y-axis slide rail with a second slider, and a second X-axis slide rail with a second slider connected sequentially from bottom to top; the first turntable is connected to the base, and the second slider of the second X-axis slide rail is connected to the second AR waveguide monocular module in the AR waveguide binocular module for distant imaging through a second adapter component.
[0025] Furthermore, the first adapter assembly includes a first adapter plate and a first threaded rod;
[0026] One end of the first adapter plate is connected to the first slider of the first X-axis slide rail, one end of the first threaded rod is connected to the first AR waveguide monocular module in the AR waveguide binocular module for distant imaging, and the other end of the first adapter plate is connected to the other end of the first threaded rod.
[0027] Furthermore, the second adapter assembly includes a second adapter plate and a second threaded rod;
[0028] One end of the second adapter plate is connected to the second slider of the second X-axis slide rail, one end of the second threaded rod is connected to the second AR waveguide monocular module in the AR waveguide binocular module for distant imaging, and the other end of the second adapter plate is connected to the other end of the second threaded rod.
[0029] Compared with the prior art, the technical solution of this utility model has the following beneficial effects:
[0030] This utility model provides a binocular image combining system for a distant-view imaging AR module, including a base, a distant-view calibration mechanism, a position adjustment mechanism, a first imaging unit, a second imaging unit, and a first processing unit. The distant-view calibration mechanism includes a calibration component and a second processing unit. The calibration component includes a calibration plate and a head-up display module for distant-view imaging. The base is used to house the distant-view calibration mechanism, the position adjustment mechanism, and the AR waveguide binocular module for distant-view imaging. The distant-view calibration mechanism houses the first and second imaging units, which simulate human eyes. The first and second imaging units are connected to the first processing unit, and the position adjustment mechanism is connected to the AR waveguide binocular module for distant-view imaging. After calibrating the relative positions of the first and second imaging units using a distant-view calibration mechanism, the first processing unit processes the first image (corresponding to the first virtual image output and displayed by the AR waveguide binocular module for distant-view imaging) acquired by the first imaging unit and the second image (corresponding to the second virtual image output and displayed by the AR waveguide binocular module for distant-view imaging) acquired by the second imaging unit to obtain a deviation value. Based on the deviation value, the AR waveguide binocular module for distant-view imaging is adjusted by a position adjustment mechanism to ensure that the AR waveguide binocular module for distant-view imaging meets the binocular image matching requirements. For example, when the virtual image of the AR waveguide binocular module is imaged at infinity, precise binocular registration of the virtual image is achieved. Attached Figure Description
[0031] To more clearly illustrate the technical solutions in the embodiments of this utility model or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this utility model. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0032] Figure 1 This is a schematic diagram of the overall structure of the first example of the binocular image fusion system for a distant imaging AR module of the present invention.
[0033] Figure 2 This is a schematic diagram of the overall structure of a second example of the binocular image fusion system for a distant imaging AR module according to the present invention.
[0034] Figure 3 This is a schematic diagram of the overall structure of the third example of the binocular image fusion system for a distant imaging AR module of this utility model.
[0035] Figure 4 This is a schematic diagram of the overall structure of the fourth example of the binocular image merging system for the AR module of the present invention for distant imaging.
[0036] Figure 5 A partial structural diagram of the calibration structure is provided as an example.
[0037] Figure 6 A schematic diagram of the calibration plate for example calibration structure;
[0038] Figure 7 A schematic diagram of a head-up display module for distant imaging, as an example;
[0039] Figure 8 This is a schematic diagram illustrating the connection between an AR waveguide binocular module for distant imaging and a first and second adapter components at a first angle.
[0040] Figure 9 This is a schematic diagram illustrating the connection between an AR waveguide binocular module for distant imaging and a first and second adapter assembly at a second angle.
[0041] Figure 10 This is a schematic diagram of the first position adjustment mechanism as an example;
[0042] Figure 11 This is a schematic diagram of the second position adjustment mechanism as an example.
[0043] Among them, 1-base, 2-far-view calibration mechanism, 2-1-lifting adjustment structure, 2-2-support plate, 2-3-1-calibration plate, 2-3-2-head-up display module for far-view imaging, 2-4-first pitch rotary stage, 2-5-second pitch rotary stage, 3-AR waveguide binocular module for far-view imaging, 3-1-module bracket, 3-2-first waveguide sheet, 3-3-second waveguide sheet, 3-4-first module bracket, 3-5-first optical engine, 3-6-first prism, 3-7-second module bracket, 3-8-second optical engine, 3-9-second prism, 3-10-first glue injection hole, 3-11-second glue injection hole, 4-1-first position adjustment mechanism, 4-1-1-first turntable 4-1-2-First Z-axis lifting platform, 4-1-3-First Y-axis tilting device, 4-1-4-First X-axis tilting device, 4-1-5-First Y-axis slide rail, 4-1-6-First X-axis slide rail, 4-1-7-First slider, 4-2-Second position adjustment mechanism, 4-2-1-Second turntable, 4-2-2-Second Z-axis lifting platform, 4-2-3-Second Y-axis tilting device, 4-2-4-Second X-axis tilting device, 4-2-5-Second Y-axis slide rail, 4-2-6-Second X-axis slide rail, 4-2-7-Second slider, 5-First shooting unit, 6-Second shooting unit, 7-1-First adapter plate, 7-2-First threaded rod, 8-1-Second adapter plate, 8-2-Second threaded rod. Detailed Implementation
[0044] The technical solution of this utility model will be clearly and completely described below with reference to its embodiments. Obviously, the described embodiments are only some embodiments of this utility model, and not all embodiments. Based on the embodiments of this utility model, all other embodiments obtained by those skilled in the art without creative effort are within the protection scope of this utility model.
[0045] In this document, the terms "first," "second," and other similar words are not intended to imply any order, quantity, or importance, but are merely used to distinguish different elements. The terms "one," "a," and other similar words are not intended to indicate the existence of only one of the stated things, but rather that the description refers only to one of the stated things, which may have one or more. The terms "comprising," "including," and other similar words are intended to indicate a logical relationship, not a spatial relationship. For example, "A includes B" means that logically B belongs to A, not that spatially B is located inside A. Furthermore, the meanings of the terms "comprising," "including," and other similar words should be considered open-ended, not closed. For example, "A includes B" means that B belongs to A, but B does not necessarily constitute all of A; A may also include other elements such as C, D, and E.
[0046] In this document, the terms "embodiment," "this embodiment," "preferred embodiment," and "one embodiment" do not imply that the description applies only to one specific embodiment, but rather that such description may also be applicable to one or more other embodiments. Those skilled in the art will understand that any description made herein relating to one embodiment can be substituted, combined, or otherwise incorporated with the descriptions in one or more other embodiments. Such substitutions, combinations, or other incorporations resulting in new embodiments are readily conceived by those skilled in the art and fall within the protection scope of this utility model.
[0047] In this description, "multiple" means at least two, such as two, three, etc., unless otherwise explicitly specified.
[0048] like Figures 1-4 As shown, this utility model provides a binocular image merging system for a distant imaging AR module, including a base 1, a distant calibration mechanism 2, a position adjustment mechanism, a first shooting unit 5, a second shooting unit 6, and a first processing unit.
[0049] The base 1 is used to set up the distant view calibration mechanism 2, the position adjustment mechanism, and the AR waveguide binocular module 3 for distant view imaging.
[0050] The distant view calibration mechanism 2 is fixedly mounted on the base 1, and the distant view calibration mechanism 2 is equipped with a first shooting unit 5 and a second shooting unit 6. The distant view calibration mechanism 1 is used to calibrate the relative positions of the first shooting unit and the second shooting unit.
[0051] The AR waveguide binocular module 3 for distant imaging is detachably mounted on the base. The longitudinal distance between the AR waveguide binocular module 3 for distant imaging and the first imaging unit 5 and / or the second imaging unit 6 mounted on the base 1 is equal to the exit pupil distance of the AR waveguide binocular module. The AR waveguide binocular module 3 for distant imaging displays a first virtual image and a second virtual image when activated.
[0052] The bottom end of the position adjustment mechanism is fixedly mounted on the base, and the position adjustment mechanism is connected to the AR waveguide binocular module for distant imaging mounted on the base.
[0053] The first and second imaging units are connected to the first processing unit. The first and second imaging units simulate human eyes. The first imaging unit captures a first virtual image to obtain a first captured image and sends the first captured image to the first processing unit. The second imaging unit captures a second virtual image to obtain a second captured image and sends the second captured image to the first processing unit.
[0054] The first processing unit receives the first captured image and the second captured image, performs calculations and processing, and obtains the deviation value between the first captured image and the second captured image.
[0055] Based on the deviation value, the AR waveguide binocular module used for distant imaging is adjusted by the position adjustment mechanism so that the AR waveguide binocular module used for distant imaging meets the binocular image merging requirements.
[0056] For example, the first and second shooting units described above can be existing CCD cameras.
[0057] The first processing unit mentioned above can be an existing computer.
[0058] For example, such as Figures 5-7 As shown, the aforementioned distant-view calibration mechanism 2 may include a lifting and adjusting structure 2-1, a support plate 2-2, a calibration assembly, a first pitch rotary table 2-4, a second pitch rotary table 2-5, and a second processing unit. The calibration assembly includes a calibration plate 2-3-1 and a head-up display module 2-3-2 for distant-view imaging. The lifting and adjusting structure, support plate, calibration plate, head-up display module for distant-view imaging, first pitch rotary table, second pitch rotary table, and second processing unit can all utilize existing components. It should be noted that the second processing unit and the first processing unit can use the same computer or different computers.
[0059] The bottom end of the lifting and adjusting structure 2-1 is connected to the base 1, and the top end of the lifting and adjusting structure 2-1 is connected to the support plate 2-2.
[0060] A first pitch rotary table 2-4 is fixed at a first position of the support plate 2-2, and a second pitch rotary table 2-5 is fixed at a second position of the support plate 2-2. The first and second positions are on the same horizontal plane, and the horizontal distance between them corresponds to the interpupillary distance.
[0061] The first shooting unit 5 is set on the first pitch and rotation stage 2-4, and the second shooting unit 6 is set on the second pitch and rotation stage 2-5.
[0062] The second processing unit is connected to the first and second shooting units.
[0063] The third position of the support plate 2-2 is used to mount a calibration plate 2-3-1 with a calibration pattern or a head-up display module 2-3-2 for distant imaging. The calibration plate 2-3-1 or the head-up display module 2-3-2 for distant imaging can be detachably connected to the third position of the support plate 2-2. For example, as shown... Figure 6 As shown, the calibration pattern of calibration plate 2-3-1 includes a first cross and a second cross, wherein the intersection of the first cross and the intersection of the second cross are on the same horizontal plane and the horizontal interval corresponds to the interpupillary distance. The third position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit. Figure 7 As shown, the head-up display module 2-3-2 for distant imaging includes an optical engine and a head-up display module for distant imaging.
[0064] For example, such as Figure 8 as well as Figure 9 As shown, the aforementioned AR waveguide binocular module for distant imaging includes a module support 3-1, a first AR waveguide monocular module, and a second AR waveguide monocular module. The first AR waveguide monocular module includes a first waveguide sheet 3-2 and a first optomechanical module, and the second AR waveguide monocular module includes a second waveguide sheet 3-3 and a second optomechanical module.
[0065] The first optical engine module includes a first module bracket 3-4, a first optical engine 3-5, and a first prism 3-6.
[0066] The second optical engine module includes a second module bracket 3-7, a second optical engine 3-8, and a second prism 3-9.
[0067] The first waveguide plate 3-2 and the second waveguide plate 3-3 are fixed on one side of the module bracket 3-1 respectively. The first module bracket 3-4 and the second module bracket 3-7 are placed on the opposite side of the module bracket 3-1 respectively. The first module bracket 3-4 is equipped with the first optical engine 3-5 and the first prism 3-6. The second module bracket 3-7 is equipped with the second optical engine 3-8 and the second prism 3-9.
[0068] The first module bracket 3-4 is provided with a first injection hole 3-10, the second module bracket 3-7 is provided with a second injection hole 3-11, the module bracket 3-1 is provided with a third injection hole communicating with the first injection hole at the position of the first injection hole, and the module bracket 3-1 is provided with a fourth injection hole communicating with the second injection hole at the position of the second injection hole.
[0069] The first module bracket is provided with a first adapter hole, and the second module bracket is provided with a second adapter hole.
[0070] The module bracket can be detachably connected to the fourth position of the support plate; wherein the fourth position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit.
[0071] For example, the above-mentioned position adjustment mechanism may include a first position adjustment mechanism 4-1 and a second position adjustment mechanism 4-2 (e.g., Figures 1-4 (As shown).
[0072] The bottom end of the first position adjustment mechanism is connected to the base, and the top end of the first position adjustment mechanism is connected to the first AR waveguide monocular module in the AR waveguide binocular module for distant imaging. The bottom end of the second position adjustment mechanism is connected to the base, and the top end of the second position adjustment mechanism is connected to the second AR waveguide monocular module in the AR waveguide binocular module for distant imaging.
[0073] For specific examples,
[0074] like Figure 10 As shown, the first position adjustment mechanism 4-1 includes, from bottom to top, a first turntable 4-1-1, a first Z-axis lifting platform 4-1-2, a first Y-axis tilter 4-1-3, a first X-axis tilter 4-1-4, a first Y-axis slide rail 4-1-5 with a first slider 4-1-7, and a first X-axis slide rail 4-1-6 with a first slider 4-1-7. The first turntable is connected to the base, and the first slider 4-1-7 of the first X-axis slide rail 4-1-6 is connected to the first adapter hole of the first AR waveguide monocular module in the AR waveguide binocular module for distant imaging described above through a first adapter assembly.
[0075] like Figure 11As shown, the second position adjustment mechanism 4-2 includes a second turntable 4-2-1, a second Z-axis lifting platform 4-2-2, a second Y-axis tilter 4-2-3, a second X-axis tilter 4-2-4, a second Y-axis slide rail 4-2-5 with a second slider 4-2-7, and a second X-axis slide rail 4-2-6 with a second slider 4-2-7 connected sequentially from bottom to top. The second turntable is connected to the base, and the second slider 4-2-7 of the second X-axis slide rail 4-2-6 is connected to the second adapter hole of the second AR waveguide monocular module in the AR waveguide binocular module for distant imaging described above through a second adapter assembly.
[0076] For example, such as Figure 8 As shown, the first adapter assembly may include a first adapter plate 7-1 and a first threaded rod 7-2, and the second adapter assembly may include a second adapter plate 8-1 and a second threaded rod 8-2.
[0077] One end of the first adapter plate 7-1 is connected to the first slider 4-1-7 of the first X-axis slide rail 4-1-6, one end of the first threaded rod 7-2 is connected to the first adapter hole of the first AR waveguide monocular module in the AR waveguide binocular module for distant imaging, and the other end of the first adapter plate 7-1 is connected to the other end of the first threaded rod 7-2.
[0078] One end of the second adapter plate 8-1 is connected to the second slider 4-2-7 of the second X-axis slide rail 4-2-6, one end of the second threaded rod 8-2 is connected to the second adapter hole of the second AR waveguide monocular module in the AR waveguide binocular module for distant imaging, and the other end of the second adapter plate 8-1 is connected to the other end of the second threaded rod 8-2.
[0079] For example, the method for adjusting the binocular image of a distant imaging AR module using the binocular image merging system described above includes the following steps:
[0080] S1 uses a distant calibration mechanism to calibrate the relative positions of the first and second shooting units, wherein the first and second shooting units are used to simulate human eyes.
[0081] For example, the specific steps include the following:
[0082] S1-1:
[0083] Set the calibration plate in the corresponding position on the support plate.
[0084] The first calibration image is obtained by capturing the calibration pattern of the calibration board through the first imaging unit, and the first calibration image displays the first cross pattern.
[0085] The first imaging unit sends the first calibration image to the second processing unit, which receives and displays the first calibration image.
[0086] Based on the first calibration image, the position of the first imaging unit is changed by adjusting the first pitch rotation stage, so that the intersection of the first cross pattern in the first calibration image is located at the center of the first calibration image.
[0087] S1-2:
[0088] The calibration plate on the support plate was replaced with a head-up display module for distant imaging.
[0089] The head-up display module is activated to display the projected image, which shows the third cross pattern and covers the shooting range of the first and second shooting units.
[0090] The first imaging unit captures the third cross pattern and records the first coordinate of the intersection point of the third cross pattern, sending it to the second processing unit for display. By adjusting the second tilt and rotation stage to change the position of the second imaging unit, the second coordinate of the intersection point of the third cross pattern captured by the second imaging unit is made to be the same as the first coordinate, indicating that the optical axes of the first and second imaging units are now in a parallel position.
[0091] S1-3:
[0092] The head-up display module for distant imaging, which is mounted on the support plate, is replaced with a calibration plate.
[0093] The second calibration image is obtained by capturing the calibration pattern on the calibration board using the second imaging unit. The second calibration image displays the second cross pattern.
[0094] The second imaging unit sends the second calibration image to the second processing unit, which receives and displays the second calibration image.
[0095] The position of the second imaging unit is changed based on the second calibration image, so that the intersection of the cross pattern of the second cross in the second calibration image is located at the center of the image of the second calibration image.
[0096] S1-4:
[0097] The calibration plate on the support plate was replaced again with a head-up display module for distant imaging.
[0098] The head-up display module is activated to display the projected image, which shows the third cross pattern and covers the shooting range of the first and second shooting units.
[0099] The first and second shooting units capture the third cross pattern. The first shooting unit sends the first coordinate of the intersection of the third cross pattern to the second processing unit for display. The second shooting unit sends the second coordinate of the intersection of the third cross pattern to the second processing unit for display. If the first and second coordinates are the same, the position calibration of the first and second shooting units is completed. If the first and second coordinates are different, the above steps S1-2 to S1-4 are repeated until the position calibration of the first and second shooting units is completed.
[0100] S2 is a fixed AR waveguide binocular module for distant imaging, wherein the longitudinal distance between the AR waveguide binocular module for distant imaging and the first imaging unit and / or the second imaging unit is equal to the exit pupil distance of the AR waveguide binocular module.
[0101] For example,
[0102] Remove the calibration components from the support plate.
[0103] The module bracket for the AR waveguide binocular module used for distant imaging is set in the corresponding position on the support plate.
[0104] S3 activates the AR waveguide binocular module for distant imaging, which displays a first virtual image and a second virtual image.
[0105] For example,
[0106] The first optical engine is activated, and an image light source is coupled into the first waveguide plate. The light source propagates through total internal reflection in the first waveguide plate and is then coupled out to display the first virtual image. The second optical engine is activated, and the image light source is coupled into the second waveguide plate. The light source propagates through total internal reflection in the second waveguide plate and is then coupled out to display the second virtual image.
[0107] S4 uses the first shooting unit to capture the first virtual image to obtain the first captured image, and uses the second shooting unit to capture the second virtual image to obtain the second captured image.
[0108] For example,
[0109] A first captured image is obtained by capturing a first virtual image using a first CCD camera, and a second captured image is obtained by capturing a second virtual image using a second CCD camera.
[0110] The first processing unit S5 performs image preprocessing operations on the first captured image and the second captured image to obtain a first preprocessed image and a second preprocessed image. The image preprocessing operations include image denoising, image contrast enhancement, and image edge detection.
[0111] For example, image denoising can be performed using Gaussian filtering, image contrast enhancement can be performed using histogram equalization, and image edge detection can be performed using the Canny algorithm.
[0112] The first processing unit performs calculations on the first captured image and the second captured image to obtain the deviation value between the first captured image and the second captured image.
[0113] For example,
[0114] The first processing unit uses a feature point extraction algorithm to extract feature points in the same region of the first preprocessed image and the second preprocessed image. The feature points extracted in the first preprocessed image and the feature points extracted in the second preprocessed image are represented by different marker graphics, and the pixel coordinates of the feature points are recorded.
[0115] The first processing unit uses a matching algorithm to match feature points in the same region of the first preprocessed image and the second preprocessed image.
[0116] The first processing unit performs matrix operations based on the pixel coordinates of the matched feature points to obtain the deviation values of the feature points in the same region between the first preprocessed image and the second preprocessed image. The deviation values include positional deviation values and angular deviation values.
[0117] For example, the above feature point extraction algorithm can be the SIFT algorithm or the SURF algorithm.
[0118] The matching algorithms mentioned above can be SIFT or SURF.
[0119] The matrix operation examples above include the following operations:
[0120] 1. Represent the pixel coordinates of the matched feature points using homogeneous coordinates. Let the first feature point among the matched feature points be (x, y, 1), and the second feature point among the matched feature points be (x', y', 1). Perform the following matrix operations:
[0121]
[0122] get:
[0123] x′=x+t x y′=y+t y (2)
[0124] t x t represents the offset value in the x-direction. y This represents the offset value in the y-direction.
[0125] 2. The pixel coordinates of the first feature point among the matched feature points are represented as (x, y), and the pixel coordinates of the second feature point among the matched feature points are represented as (x', y'). The following matrix operation is performed:
[0126]
[0127] get:
[0128] x′=x cos(θ)-y sin(θ), y′=x sin(θ)+y cos(θ) (4)
[0129] The rotation angle offset value θ is calculated using equation (4).
[0130] S6 adjusts the AR waveguide binocular module used for distant imaging through a position adjustment mechanism based on the deviation value, so that the AR waveguide binocular module used for distant imaging meets the binocular image merging requirements.
[0131] For example,
[0132] The deviation value is compared with the set threshold of the AR waveguide binocular module used for distant imaging. If the deviation value is within the design threshold of the AR waveguide binocular module used for distant imaging, the relative position of the first module bracket and the module bracket is fixed by dispensing glue through the first and third glue holes, and the relative position of the second module bracket and the module bracket is fixed by dispensing glue through the second and fourth glue holes.
[0133] If the deviation value exceeds the design threshold of the AR waveguide binocular module used for distant imaging, the first module support of the first optomechanical module is moved by the first position adjustment mechanism and / or the second module support of the second optomechanical module is moved by the second position adjustment mechanism, and the above steps S4-S6 are repeated until the deviation value is within the set threshold range of the AR waveguide binocular module used for distant imaging.
[0134] The threshold values for the AR waveguide binocular module used for distant imaging can be set based on user needs.
[0135] The above embodiments are only used to illustrate the technical solution of this utility model and are not intended to limit it. Although the utility model has been described in detail with reference to the above embodiments, those skilled in the art can still make modifications or equivalent substitutions to the specific implementation of this utility model. Any modifications or equivalent substitutions that do not depart from the spirit and scope of this utility model are within the protection scope of the claims of this utility model pending approval.
Claims
1. A binocular image combining system for a long-range imaging AR module, characterized in that, It includes a base, a distant viewing calibration mechanism, a first shooting unit, a second shooting unit, a first processing unit, and a position adjustment mechanism; wherein, the first shooting unit and the second shooting unit simulate human eyes; The base is used to set up the far-view calibration mechanism, the position adjustment mechanism, and the AR waveguide binocular module for far-view imaging; The distant view calibration mechanism is provided with a first shooting unit and a second shooting unit; the distant view calibration mechanism includes a calibration component and a second processing unit, the calibration component includes a calibration plate and a head-up display module for distant view imaging; The first imaging unit and the second imaging unit are connected to the first processing unit, and the first imaging unit and the second imaging unit are connected to the second processing unit; the position adjustment mechanism is connected to the AR waveguide binocular module for distant imaging.
2. The binocular image merging system for a distant imaging AR module according to claim 1, characterized in that, The vision calibration mechanism also includes a lifting and adjusting structure, a support plate, a first pitch rotary table, and a second pitch rotary table. The bottom end of the lifting and adjusting structure is connected to the base, and the top end of the lifting and adjusting structure is connected to the support plate; The first position of the support plate is fixed to the first pitch rotary table, and the second position of the support plate is fixed to the second pitch rotary table; wherein the first position and the second position are on the same horizontal plane and the horizontal interval corresponds to the interpupillary distance; A first imaging unit is provided on the first pitch rotation platform, and a second imaging unit is provided on the second pitch rotation platform; The third position of the support plate is used to set the calibration plate or a head-up display module for distant imaging.
3. The binocular image combining system for long-range imaging AR module according to claim 2, characterized in that, The calibration plate has a calibration pattern, which includes a first cross and a second cross. The intersection of the first cross and the intersection of the second cross are on the same horizontal plane and the horizontal interval corresponds to the interpupillary distance. The third position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit. The head-up display module for distant imaging includes a projection optical engine and a head-up display waveguide.
4. The binocular image combining system for long-range imaging AR module according to claim 2, wherein, The fourth position of the support plate is detachably connected to an AR waveguide binocular module for distant imaging; wherein the fourth position is located in front of the shooting lens of the first shooting unit and / or the second shooting unit.
5. The binocular image merging system for a distant imaging AR module according to claim 1, characterized in that, The position adjustment mechanism includes a first position adjustment mechanism and a second position adjustment mechanism; The bottom end of the first position adjustment mechanism is connected to the base, and the top end of the first position adjustment mechanism is connected to the first AR waveguide monocular module in the AR waveguide binocular module for distant imaging. The bottom end of the second position adjustment mechanism is connected to the base, and the top end of the second position adjustment mechanism is connected to the second AR waveguide monocular module in the AR waveguide binocular module for distant imaging.
6. The binocular image merging system for a distant imaging AR module according to claim 5, characterized in that, The first position adjustment mechanism includes, from bottom to top, a first turntable, a first Z-axis lifting platform, a first Y-axis tilting device, a first X-axis tilting device, a first Y-axis slide rail with a first slider, and a first X-axis slide rail with a first slider; the first turntable is connected to the base, and the first slider of the first X-axis slide rail is connected to the first AR waveguide monocular module in the AR waveguide binocular module for distant imaging through a first adapter component.
7. The binocular image merging system for a distant imaging AR module according to claim 5, characterized in that, The second position adjustment mechanism includes, from bottom to top, a second turntable, a second Z-axis lifting platform, a second Y-axis tilter, a second X-axis tilter, a second Y-axis slide rail with a second slider, and a second X-axis slide rail with a second slider; the second turntable is connected to the base, and the second slider of the second X-axis slide rail is connected to the second AR waveguide monocular module in the AR waveguide binocular module for distant imaging through a second adapter component.
8. The binocular image combining system for long-range imaging AR module according to claim 6, wherein, The first adapter assembly includes a first adapter plate and a first threaded rod; One end of the first adapter plate is connected to the first slider of the first X-axis slide rail, one end of the first threaded rod is connected to the first AR waveguide monocular module in the AR waveguide binocular module for distant imaging, and the other end of the first adapter plate is connected to the other end of the first threaded rod.
9. The binocular image combining system for long-range imaging AR module according to claim 7, wherein, The second adapter assembly includes a second adapter plate and a second threaded rod; One end of the second adapter plate is connected to the second slider of the second X-axis slide rail, one end of the second threaded rod is connected to the second AR waveguide monocular module in the AR waveguide binocular module for distant imaging, and the other end of the second adapter plate is connected to the other end of the second threaded rod.