Coupling position adjustment method and device, control equipment and storage medium

By using symmetrically distributed markers and image acquisition devices in augmented reality display devices, the position of the optomechanical system or image acquisition device is monitored and adjusted, thus solving the problem of mismatch between the waveguide coupling area and the optomechanical system size, and achieving accurate alignment and performance optimization at specific locations.

CN121596551APending Publication Date: 2026-03-03APPOTRONICS CORP LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411141167.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-19
Publication Date
2026-03-03

AI Technical Summary

Technical Problem

In augmented reality display devices, when the size of the waveguide's coupling region does not match that of the optomechanical system, the coupling efficiency, uniformity, and contrast of the coupling region become inconsistent, making it difficult to accurately control the optomechanical system or image acquisition device to be aligned with a specific coupling or coupling position.

Method used

By using multiple symmetrically distributed markers fixedly connected to the component to be adjusted in the coupling position adjustment system, and using an image acquisition device to capture images of the markers, the matching between the center of symmetry and the target area is monitored. Combined with the adjustment of the displacement component, the component to be adjusted is ensured to be aligned with the target position.

Benefits of technology

This enables the accurate alignment of optomechanical or image acquisition devices with specific coupling-in or coupling-out positions, improves the accuracy of waveguide performance testing, and contributes to the optimization of waveguide performance and the enhancement of display performance of display devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121596551A_ABST
    Figure CN121596551A_ABST
Patent Text Reader

Abstract

The invention discloses a coupling position adjusting method and device, control equipment and a storage medium, and the method comprises the steps: obtaining an image, shot by an image collection device, of each marker in a target region in a process of controlling a to-be-adjusted assembly to move; if the symmetric center of the images of each group of symmetrically distributed markers is matched with the central position of the target area, determining that the to-be-adjusted assembly directly faces the central position of the target area, and controlling the to-be-adjusted assembly to stop moving, the symmetric center of each group of symmetrically distributed markers being the center of the to-be-adjusted assembly; and obtaining a position difference value between the central position of the target area and the target position, and controlling the to-be-adjusted assembly to move to the position directly facing the target position based on the position difference value. Therefore, when the to-be-adjusted assembly is an optical machine, the to-be-adjusted assembly can be aligned to the specific coupling-in position of the coupling-in area, and when the to-be-adjusted assembly is an image acquisition device, the to-be-adjusted assembly can be aligned to the specific coupling-out position of the coupling-out area, so that the accuracy during waveguide performance testing is ensured, and optimization of waveguide performance is facilitated.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of optical display technology, and in particular to a coupling position adjustment method, apparatus, control device, and storage medium. Background Technology

[0002] In related technologies, augmented reality (AR) display devices mainly consist of two parts: the first part is an optical engine that outputs image light carrying the displayed image, and the second part is a waveguide that guides the image light to the human eye. If the size of the coupling region of the waveguide is larger than the size of the exit pupil of the optical engine, the coupling efficiency of the waveguide coupling region may vary when the optical engine couples into the waveguide at different coupling positions in the coupling region of the waveguide. The performance (such as efficiency, uniformity, and contrast) of the image light coupled out at different coupling positions in the waveguide coupling region will also be different. Sometimes it is necessary to obtain the coupling performance of a specific coupling position in the waveguide coupling region. In this case, how to accurately control the optical engine to align with a specific coupling position in the coupling region, or control the camera to align with a specific coupling position in the coupling region, becomes a problem to be solved. Summary of the Invention

[0003] This application proposes a coupling position adjustment method, apparatus, control device, and storage medium.

[0004] In a first aspect, embodiments of this application provide a coupling position adjustment method applied to a coupling position adjustment system. The coupling position adjustment system includes multiple markers, an image acquisition device, and a displacement component. The multiple markers are fixedly connected to a component to be adjusted, and the component to be adjusted faces a target region on a waveguide. The displacement component is used to move the component to be adjusted to different positions facing the target region. Each marker is equidistant from the center of the component to be adjusted. The multiple markers include multiple sets of symmetrically distributed markers, with the center of symmetry of each set of symmetrically distributed markers being the center of the component to be adjusted. The component to be adjusted is at least one of an optomechanical system and the image acquisition device. The method includes: controlling the displacement component... During the movement of the component to be adjusted, a marker image captured by the image acquisition device is acquired. The marker image includes an image of each marker in the target area. If the center of symmetry of the image of each group of symmetrically distributed markers in the marker image matches the center position of the target area, the current center position of the component to be adjusted facing the target area is determined, and the component to be adjusted is controlled to stop moving. The position difference between the center position of the target area and the target position in the target area is acquired, and the component to be adjusted is controlled to move horizontally on the target plane where the component to be adjusted is located based on the position difference, so that the component to be adjusted is facing the target position, and the target plane is parallel to the plane where the waveguide is located.

[0005] Secondly, embodiments of this application provide a coupling position adjustment device applied to a coupling position adjustment system. The coupling position adjustment system includes multiple markers, an image acquisition device, and a displacement component. The multiple markers are fixedly connected to the component to be adjusted, and the component to be adjusted faces a target area on a waveguide. The displacement component is used to move the component to be adjusted to different positions facing the target area. The distance between each marker and the center of the component to be adjusted is equal. The multiple markers include multiple sets of symmetrically distributed markers, and the center of symmetry of each set of symmetrically distributed markers is the center of the component to be adjusted. The component to be adjusted is at least one of an optomechanical system and the image acquisition device. The coupling position adjustment device includes: an image acquisition module, used to control the displacement component to move the component to be adjusted... During the adjustment of the component movement, the image acquisition device captures a marker image, which includes an image of each marker in the target area. A stop-movement control module is used to determine that the component to be adjusted is facing the center of the target area if the center of symmetry of the image of each group of symmetrically distributed markers in the target area is located at the center of the target area, and then controls the component to be adjusted to stop moving. A movement control module is used to acquire the position difference between the center of the target area and the target position in the target area, and based on the position difference, controls the component to be adjusted to move horizontally on the target plane where the component is located, so that the component to be adjusted is facing the target position, and the target plane is parallel to the plane where the waveguide is located.

[0006] Thirdly, embodiments of this application provide a control device, including: one or more processors; a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to perform the methods described above.

[0007] Fourthly, embodiments of this application provide a computer-readable storage medium storing program code that can be invoked by a processor to execute the methods described above.

[0008] The solution provided in this application involves imaging multiple markers fixedly connected to the component to be adjusted within the target area of ​​the waveguide. Since these markers comprise multiple sets of symmetrically distributed markers, with the center of symmetry of each set serving as the center of the component to be adjusted, the component can be aligned with the center of the target area by monitoring the position of the center of symmetry of each set of markers against the center of the target area during the controlled movement of the component. Based on the positional difference between the center of the target area and the target position, the component can be aligned with the target position within the target area. Thus, when the component to be adjusted is an optomechanical device, it can be aligned with a specific coupling position within the coupling area; when it is an image acquisition device, it can be aligned with a specific coupling position within the coupling area, ensuring accuracy during waveguide performance testing and contributing to waveguide performance optimization. Attached Figure Description

[0009] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0010] Figure 1 A structural block diagram of a coupling position adjustment system provided in an embodiment of this application is shown.

[0011] Figure 2 A flowchart illustrating a coupling position adjustment method provided in an embodiment of this application is shown.

[0012] Figure 3 A schematic diagram of coupling position adjustment provided in an embodiment of this application is shown.

[0013] Figure 4 A flowchart illustrating a coupling position adjustment method provided in another embodiment of this application is shown.

[0014] Figure 5 This illustration shows an image of multiple markers in the coupling region provided in an embodiment of this application.

[0015] Figure 6 A flowchart illustrating a coupling position adjustment method provided in another embodiment of this application is shown.

[0016] Figure 7 This illustration shows an image of multiple markers in the coupling region provided in an embodiment of this application.

[0017] Figure 8 A structural block diagram of a coupling position adjustment device provided in an embodiment of this application is shown.

[0018] Figure 9 A structural block diagram of a control device provided in an embodiment of this application is shown.

[0019] Figure 10 A structural block diagram of a computer-readable storage medium provided in an embodiment of this application is shown. Detailed Implementation

[0020] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of the present application, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present application without creative effort are within the scope of protection of the present application.

[0021] It should be noted that some processes described in the specification, claims, and accompanying drawings of this application include multiple operations that appear in a specific order. These operations may not be performed in the order they appear herein, or they may be performed in parallel. Operation numbers such as S110, S120, etc., are merely used to distinguish different operations and do not represent any execution order. Furthermore, these processes may include more or fewer operations, and these operations may be performed sequentially or in parallel. Also, the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover non-exclusive inclusion, such that a process, method, system, product, or server that includes a series of steps or sub-modules is not necessarily limited to those steps or sub-modules that are explicitly listed, but may include other steps or sub-modules that are not explicitly listed or that are inherent to such process, method, product, or device.

[0022] Please see Figure 1 , Figure 1 A structural block diagram of a coupling position adjustment system according to an embodiment of this application is shown. The coupling position adjustment system provided in this embodiment includes at least a plurality of markers 10, an image acquisition device 20, and a displacement component 30, wherein the plurality of markers 10 are fixedly connected to the component to be adjusted.

[0023] In this embodiment, the component to be adjusted is facing the target area on the waveguide 40. The component to be adjusted is at least one of the optomechanical 50 and the image acquisition device 20: if the component to be adjusted is the optomechanical 50, the target area is the coupling-in area 41 on the waveguide 40; if the component to be adjusted is the image acquisition device 20, the target area is the coupling-out area 42 on the waveguide 40. Among them, waveguide 40 includes, but is not limited to, diffractive waveguide 40, the coupling region 41 and coupling region 42 on the surface of waveguide 40 are composed of micro-nano structures, and the micro-nano structures include, but are not limited to, gratings, metasurfaces or other diffractive elements; optomechanical system 50 includes, but is not limited to, optomechanical system 50 formed based on digital micromirror device (DMD), liquid crystal on silicon (LCOS) and organic light-emitting display (OLED); image acquisition device 20 includes, but is not limited to, charge-coupled device camera (CCD), complementary metal oxide semiconductor (CMOS) camera, imaging brightness meter and other measurement devices.

[0024] And, as Figure 1 As shown, when the component to be adjusted is the optomechanical system 50, multiple markers 10 are fixedly connected to the optomechanical system 50. At this time, the image acquisition device 20 in the coupling position adjustment system is the first image acquisition device 21 facing the coupling in region. The coupling position adjustment system also has multiple markers 10 fixedly connected to the first image acquisition device 21. When the component to be adjusted is the image acquisition device 20, the image acquisition device 20 to be adjusted is the second image acquisition device 22 facing the coupling out region 42. Multiple markers 10 are fixedly connected to the second image acquisition device 22. When the component to be adjusted is both the optomechanical system 50 and the image acquisition device 20, the image acquisition device 20 to be adjusted is the second image acquisition device 22 facing the coupling out region 42. Furthermore, the coupling position adjustment system also includes the first image acquisition device 21 facing the coupling in region. Multiple markers 10 are fixedly connected to the optomechanical system 50, the first image acquisition device 21, and the second image acquisition device 22.

[0025] In some implementations, if the size of the coupling region 41 of the waveguide 40 is larger than the size of the exit pupil of the optomechanical 50, the coupling efficiency of the coupling region 42 of the waveguide 40 may differ when the optomechanical 50 couples into the waveguide 40 at different coupling positions in the coupling region 41 of the waveguide 40. The performance of the coupled image light (such as efficiency, uniformity, and contrast) at different coupling positions of the coupling region 42 of the waveguide 40 will also be different. Sometimes it is necessary to obtain the coupling performance at a specific coupling position of the coupling region 42 of the waveguide 40 to facilitate the simulation and testing of the coupling performance and coupling performance at different positions of the waveguide 40.

[0026] Optionally, to ensure that the image light emitted from the optical engine 50 can be accurately coupled into the waveguide 40 from a specific coupling position, and that the image acquisition device 20 can accurately acquire the image light coupled out from a specific coupling position of the waveguide 40, a displacement component 30 is connected to the component to be adjusted in the coupling position adjustment system. The component to be adjusted can be moved to different positions facing the target area, such that when the component to be adjusted is the optical engine 50, it can move the optical engine 50 to face a specific coupling position in the coupling area 41; and when the component to be adjusted is the image acquisition device 20, it can move the image acquisition device 20 to face a specific coupling position in the coupling area 42.

[0027] Furthermore, the coupling position adjustment system also includes a deflection component 60, which is rotatably connected to the optomechanism 50 and the image acquisition device 20. For the optomechanism 50, the deflection component 60 adjusts its horizontal azimuth and elevation angles, while the displacement component 30 displaces the optomechanism 50 in the x, y, and z dimensions within the space of the coupling position adjustment system, aligning the center of the optomechanism 50 with the center of the coupling region 41 of the waveguide 40. For the waveguide 40, the deflection component 60 adjusts its horizontal azimuth and elevation angles. For the image acquisition device 20, the displacement component 30 displaces the image acquisition device 20 in the x, y, and z dimensions within the space of the control system, aligning the center of the image acquisition device 20 with the center of the coupling region 42 of the waveguide 40. The methods for achieving the horizontal azimuth and pitch angles include, but are not limited to, using a rotary table or tilting device that can be adjusted manually or electrically; the methods for achieving the displacement adjustment include, but are not limited to, using a three-dimensional xyz displacement stage that can be adjusted manually or electrically.

[0028] In this embodiment, the coupling position adjustment system may further include a control device (not shown). The control device is connected to both the image acquisition device 20 and the displacement component 30. When the image acquisition device 20 is connected to the control device, it can perform certain image processing and analysis. The control device is used to acquire the marker image captured by the image acquisition device 20 during the process of controlling the displacement component 30 to move the component to be adjusted. The marker image includes the imaging of each marker 10 in the target area. Furthermore, during the displacement control process, the distance between the image acquisition device 20 and the plane where the waveguide 40 is located, i.e., the exit pupil distance (EyeRelief), is kept within a suitable range. The exit pupil distance can be at least 18mm to 22mm, and is generally set to 20mm in experiments.

[0029] Optionally, since the distance between each marker 10 and the center of the component to be adjusted is equal when multiple markers 10 are fixedly connected to the component to be adjusted, and the multiple markers 10 include multiple sets of symmetrically distributed markers 10, the center of symmetry of each set of symmetrically distributed markers 10 is the center of the component to be adjusted. In this case, after acquiring the marker image captured by the image acquisition device 20, if it is detected that the center of symmetry of the imaging of each set of symmetrically distributed markers 10 in the marker image matches the center position of the target area, then the current center position of the component to be adjusted facing the target area is determined. At this time, the control device controls the displacement component 30 to stop the movement of the component to be adjusted. The markers 10 can be objects with bright colors or light sources, such as light-emitting diodes (LEDs). Typically, a DC driving power supply can be used to light each LED, and its driving current and voltage must be within the rated voltage and current range of the LED to avoid burning it out. Furthermore, to avoid overexposure of the image when the image acquisition device 20 captures the marker image, the driving voltage and current should be as small as possible; for example, the voltage can be set to 3V and the current to 0.02A, without any restrictions.

[0030] Furthermore, when determining the current center position of the component to be adjusted after the displacement component 30 has moved, it is only necessary to obtain the position difference between the center position of the target area and the target position in the target area, and control the component to be adjusted to move horizontally in the plane parallel to the waveguide 40 based on the position difference, so that the moved component to be adjusted is facing the target position. Based on this, when the target position is a specific coupling position in the coupling area 41, it can be ensured that the image light emitted from the optomechanical 50 after the displacement component 30 has moved can be accurately coupled into the waveguide 40 from the specific coupling position; when the target position is a specific coupling position in the coupling area 42, it can be ensured that the image acquisition device 20 after the displacement component 30 has moved can accurately acquire the image light coupled out from the specific coupling position of the waveguide 40.

[0031] In some embodiments, the component to be adjusted is an optomechanical system 50, the target area is the coupling region 41 of the waveguide 40, the optomechanical system 50 is located on the first side of the coupling region 41, and the image acquisition device 20 (the first image acquisition device 21 in the figure) is located on the second side of the coupling region 41. Furthermore, multiple markers 10 are fixedly connected to the optomechanical system 50, and the distance between the multiple markers 10 and the center of the optomechanical system 50 is equal. The multiple markers 10 include multiple sets of symmetrically distributed markers 10, with the center of symmetry of each set of symmetrically distributed markers 10 being the center of the optomechanical system 50. At this time, the image of each marker 10 fixedly connected to the optomechanical system 50 in the marker image captured by the image acquisition device 20 is a real image in the coupling region 41. That is, the image formed by each marker 10 in the coupling region 41 is a real image formed by the intersection of the ambient light (or emitted light) reflected by the marker 10 and the light transmitted through the coupling region 41 after it hits the coupling region 41.

[0032] In some embodiments, the component to be adjusted is an image acquisition device 20 (the second image acquisition device 22 in the figure), and the target area is the coupling region 42 of the waveguide 40. Multiple markers 10 are fixedly connected to the image acquisition device 20, and the distance between the multiple markers 10 and the center of the image acquisition device 20 is equal. The multiple markers 10 include multiple sets of symmetrically distributed markers 10, with the center of symmetry of each set of symmetrically distributed markers 10 being the center of the image acquisition device 20. At this time, in the marker image captured by the image acquisition device 20, the image formed by each marker 10 fixedly connected to the image acquisition device 20 in the coupling region 42 is a virtual image (or a mirror image). That is, the coupling region 42 of the waveguide 40 is regarded as a plane mirror. The image formed by each marker 10 in the coupling region 42 is formed by the reflection of ambient light (or emitted light) from the marker 10 onto the coupling region 42, and the virtual image formed by the intersection of the backward extensions of the reflected light rays behind the mirror.

[0033] In this embodiment, if the component to be adjusted is an optomechanical system 50 and the target area is the coupling region 41 of the waveguide 40, by monitoring whether the distance between the image of each marker 10 and the center of the field of view of the image acquisition device 20 is equal, the central axis of the optomechanical system 50 (or the image acquisition device 20) can be made perpendicular to the plane where the waveguide 40 is located when the optomechanical system 50 (or the image acquisition device 20) is deflected, so as to facilitate waveguide 40 performance testing for different coupling positions on the waveguide 40. Furthermore, by monitoring whether the position of the symmetry center of each group of symmetrically distributed markers 10 matches the center position of the target area during the movement of the component to be adjusted, the component to be adjusted can be aligned with the center position of the coupling region 41. Based on the position difference between the center position of the coupling region 41 and the target position, the optomechanical system 50 can be aligned with a specific coupling position of the coupling region 41 to perform waveguide 40 performance testing, which helps to optimize the performance of the waveguide 40.

[0034] Please see Figure 2 , Figure 2 A flowchart illustrating a coupling position adjustment method according to an embodiment of this application is shown, applied to the aforementioned coupling position adjustment system. The following will be combined with... Figure 2 The coupling position adjustment method provided in the embodiments of this application will be described in detail. This coupling position adjustment method may include the following steps:

[0035] Step S210: During the process of controlling the displacement component to move the component to be adjusted, the marker image captured by the image acquisition device is obtained. The marker image includes the image of each marker in the target area.

[0036] In this embodiment, during the process of the control device controlling the displacement component to move the component to be adjusted, the image acquisition device captures the marker images corresponding to multiple markers in the target area. The marker images include the image of each marker in the target area. Each marker is equidistant from the center of the component to be adjusted. The multiple markers include multiple sets of symmetrically distributed markers, and the center of symmetry of each set of symmetrically distributed markers is the center of the component to be adjusted.

[0037] Step S220: If the center of symmetry of the imaging of each group of symmetrically distributed markers in the marked image matches the center position of the target area, then determine the current center position of the component to be adjusted facing the target area, and control the component to be adjusted to stop moving.

[0038] In this embodiment, if the center of symmetry of the imaging of each group of symmetrically distributed markers in the marker image captured by the image acquisition device matches the center position of the target area, then since the center of symmetry of each group of symmetrically distributed markers is the center of the component to be adjusted, it can be determined that the center of the component to be adjusted matches the center position of the target area. The component to be adjusted is currently facing the center position of the target area, and the control device controls the displacement component to drive the component to be adjusted to stop moving.

[0039] Step S230: Obtain the position difference between the center position of the target area and the target position in the target area, and control the component to be adjusted to move horizontally on the target plane where the component to be adjusted is located based on the position difference, so that the component to be adjusted is facing the target position and the target plane is parallel to the plane where the waveguide is located.

[0040] Optionally, by obtaining the position difference between the center position of the target area and the target position in the target area, the control device controls the displacement component to drive the component to be adjusted to move horizontally in the plane parallel to the waveguide where the component to be adjusted is located, so that the component to be adjusted after the movement is facing the target position.

[0041] like Figure 3 As shown, Figure 3A schematic diagram of coupling position adjustment provided in an embodiment of this application is shown. In this embodiment, after the component to be adjusted is aligned with the center position of the target area 43, the position difference (Δx, Δy) between the center position of the target area 43 and the target position in the target area 43 is calculated. Based on the position difference, the control device controls the displacement component to move the component to be adjusted accurately to the target position, so that the component to be adjusted after movement can face the target position.

[0042] Based on this, when the target position is a specific coupling position in the coupling region, it can be ensured that the image light emitted by the optomechanical system after the displacement component is moved can be coupled into the waveguide from the specific coupling position; when the target position is a specific coupling position in the coupling region, it can be ensured that the image acquisition device after the displacement component is moved can detect the coupled image of the waveguide at the specific coupling position.

[0043] In this embodiment, images are captured of multiple markers fixedly connected to the component to be adjusted within the target region of the waveguide. Since these markers comprise multiple sets of symmetrically distributed markers, with the center of symmetry of each set serving as the center of the component to be adjusted, the component can be aligned with the center of the target region by monitoring the position of the center of symmetry of each set of symmetrically distributed markers during the controlled movement of the component. Thus, based on the positional difference between the center of the target region and the target position, the component to be adjusted can be moved to the target position aligned with the target region, ensuring the accuracy of waveguide performance testing at different coupling-in and coupling-out positions and contributing to waveguide performance optimization.

[0044] Please see Figure 4 , Figure 4 A flowchart illustrating a coupling position adjustment method according to another embodiment of this application is shown. The following will be combined with... Figure 4 The coupling position adjustment method provided in the embodiments of this application will be described in detail. This coupling position adjustment method may include the following steps:

[0045] Step S310: During the process of controlling the deflection component to drive the optical engine to deflect, the marked image captured by the image acquisition device is obtained. The central axis of the image acquisition device is perpendicular to the plane where the waveguide is located.

[0046] In this embodiment, if the component to be adjusted is an optomechanical device and the target area is the coupling area of ​​the waveguide, before the control device controls the displacement component to drive the optomechanical device to move, the control device is also used to acquire the marker image captured by the image acquisition device during the process of controlling the deflection component to drive the optomechanical device to deflect. The marker image includes the imaging of each marker in the coupling area of ​​the waveguide.

[0047] Step S320: If the distance between the image of each marker in the field of view of the image acquisition device and the center of the field of view is equal, then determine that the central axis of the optical engine is currently perpendicular to the plane where the waveguide is located, and control the optical engine to stop deflecting.

[0048] In this embodiment, based on the marker image captured by the image acquisition device, if it is detected that the distance between the image of each marker in the field of view of the image acquisition device and the center of the field of view is equal, then it can be determined that the center of symmetry of each group of symmetrically distributed markers currently fixed on the optical engine after the optical engine deflection matches the center of the image acquisition device.

[0049] Optionally, since the distances between the multiple markers and the center of the optomechanism are equal when the multiple markers are fixedly connected to it, if the horizontal plane where the optomechanism is located is not parallel to the horizontal plane where the image acquisition device is located after the optomechanism is deflected, the central axis of the image acquisition device and the central axis of the optomechanism cannot coincide. In this case, the imaging positions of the multiple markers fixedly connected to the optomechanism within the field of view of the image acquisition device will shift, and the distances between the images of the multiple markers and the center of the field of view will not be equal. Therefore, if it is detected that the distance between the image of each marker within the field of view of the image acquisition device and the center of the field of view is equal, it can be determined that the central axis of the image acquisition device and the central axis of the optomechanism coincide.

[0050] like Figure 5 As shown, Figure 5 This illustration shows an image of multiple markers in a coupling region according to an embodiment of this application. In this embodiment, the number of markers fixedly connected to the optomechanism can be four, six, eight, etc., and the number of markers is even. The multiple markers include multiple sets of symmetrically distributed markers, and the center of symmetry of each set of symmetrically distributed markers is the center of the optomechanism.

[0051] Optionally, when the image acquisition device captures a marker image, the marker image includes the imaging 11 of multiple markers in the coupling region 41 of the waveguide. The shape of the coupling region 41 includes, but is not limited to, a circle. Since the distance between the multiple markers and the center of the optomechanism is equal, if the distance between the imaging 11 of each marker captured by the image acquisition device and the center of the field of view is equal, then the imaging position of the multiple markers has not shifted, and it can be determined that the central axis of the image acquisition device coincides with the central axis of the optomechanism.

[0052] Optionally, since the image acquisition device remains stationary during the optical engine deflection process, and the central axis of the image acquisition device is perpendicular to the plane where the waveguide is located, when the central axis of the image acquisition device coincides with the central axis of the optical engine, it can be determined that the central axis of the optical engine is currently perpendicular to the plane where the waveguide is located, and the control device controls the deflection component to drive the optical engine to stop deflecting.

[0053] Step S330: During the process of controlling the displacement component to drive the optical engine to move, the control displacement component drives the image acquisition device to move synchronously so that the central axis of the image acquisition device is aligned with the central axis of the optical engine, and the marked image captured by the image acquisition device is acquired.

[0054] In this embodiment, while the control device controls the displacement component to move the optomechanism, the control device also controls the displacement component to move the image acquisition device synchronously. This ensures that the central axis of the image acquisition device coincides with the central axis of the optomechanism during the movement of the optomechanism, allowing the acquisition device to capture the marker images. By ensuring that the central axis of the image acquisition device at the coupling area coincides with the central axis of the optomechanism, the image acquisition device aligned with the optomechanism accurately captures images of multiple markers fixedly connected to the optomechanism in the coupling area during the movement of the optomechanism by the displacement component. This allows for accurate determination of the optomechanism's current position relative to the coupling area.

[0055] Step S340: If the center of symmetry of the imaging of each group of symmetrically distributed markers in the marker image matches the center position of the coupled region, then determine the current center position of the optomechanism facing the coupled region, and control the optomechanism to stop moving. The central axis of the optomechanism is perpendicular to the plane where the waveguide is located.

[0056] In this embodiment, after the control device controls the displacement component to move the optical engine, if the center of symmetry of the imaging of each group of symmetrically distributed markers in the marked image matches the center position of the coupled region, since the center of symmetry of each group of symmetrically distributed markers fixedly connected to the optical engine is the center of the optical engine, it can be determined that the optical engine is currently facing the center position of the coupled region after the movement. At this time, the control device controls the displacement component to stop moving the optical engine.

[0057] Step S350: Obtain the position difference between the center position of the target area and the target position in the target area, and control the component to be adjusted to move horizontally on the target plane where the component to be adjusted is located based on the position difference, so that the component to be adjusted is facing the target position and the target plane is parallel to the plane where the waveguide is located.

[0058] In this embodiment, by obtaining the position difference between the center position of the coupling region and the target position within the coupling region, the control device controls the displacement component to move the optomechanism horizontally in the plane parallel to the waveguide, based on the position difference. This ensures that the moved optomechanism is directly facing the target position within the coupling region. Therefore, when the target position is a specific coupling position within the coupling region, it can be guaranteed that the image light emitted from the optomechanism after being moved by the displacement component can be coupled into the waveguide from that specific coupling position.

[0059] In this embodiment, images are captured of multiple markers fixedly connected to the component to be adjusted within the target area of ​​the waveguide. Since these markers comprise multiple sets of symmetrically distributed markers, with the center of symmetry of each set serving as the center of the component to be adjusted, the component can be aligned with the center of the target area by monitoring the position of the center of symmetry of each set of symmetrically distributed markers during the controlled movement of the component. Based on the positional difference between the center of the target area and the target position, the component to be adjusted can be moved to the target position aligned with the target area, ensuring the accuracy of waveguide performance testing at different coupling-in and coupling-out positions. This contributes to waveguide performance optimization and ultimately improves the display performance of the display device.

[0060] Please see Figure 6 , Figure 6 A flowchart illustrating a coupling position adjustment method according to another embodiment of this application is shown. The following will be combined with... Figure 6 The coupling position adjustment method provided in the embodiments of this application will be described in detail. This coupling position adjustment method may include the following steps:

[0061] Step S410: During the process of controlling the deflection component to drive the image acquisition device to deflect, the marked image captured by the image acquisition device is obtained.

[0062] In this embodiment, before the control device controls the displacement component to move the component to be adjusted, the control device also needs to control the deflection component to deflect the image acquisition device so that the central axis of the image acquisition device can be perpendicular to the plane where the waveguide is located. Specifically, during the process of the control device controlling the deflection component to deflect the image acquisition device, the control device acquires the marker image captured by the image acquisition device. The marker image includes the image of each marker in the target area.

[0063] In this embodiment, when the component to be adjusted is an optomechanical device, it is necessary to control the deflection component to drive the image acquisition device to deflect so that the central axis of the image acquisition device is perpendicular to the plane where the waveguide is located. This is so that the imaging of multiple markers fixedly connected to the optomechanical device in the coupling region, captured by the image acquisition device, can accurately determine whether the optomechanical device is currently facing the coupling region, thereby ensuring the accuracy of measuring the coupling performance of a specific coupling position in the coupling region.

[0064] In this embodiment, when the component to be adjusted is an image acquisition device, it is necessary to control the deflection component to drive the image acquisition device to deflect. This allows for the determination of whether the central axis of the image acquisition device is perpendicular to the plane of the waveguide, based on the imaging of multiple markers fixedly connected to the image acquisition device in the coupling region captured by the image acquisition device. Thus, during the movement of the image acquisition device by the control displacement component, it can be ensured that when the central axis of the image acquisition device is perpendicular to the plane of the waveguide, the projected image formed by the image light acquired by the image acquisition device will not be distorted. This ensures that the image acquisition device can accurately measure the coupling performance at a specific coupling position in the coupling region.

[0065] Step S420: If the image of the target marker within the field of view of the image acquisition device is located on the central axis of the field of view, then determine that the central axis of the image acquisition device is currently perpendicular to the plane where the waveguide is located, and control the image acquisition device to stop deflecting. The target marker includes two sets of symmetrically distributed markers among multiple sets of markers, where the straight line containing two markers in one set of markers is perpendicular to the straight line containing two markers in the other set of markers.

[0066] In this embodiment, if the image of the target marker within the field of view of the image acquisition device is located on the central axis of the field of view during the deflection process of the image acquisition device, it can be determined that the central axis of the image acquisition device is currently perpendicular to the plane where the waveguide is located. The control device then controls the deflection component to stop the image acquisition device from deflecting. The target marker includes two symmetrically distributed groups of markers, where the straight lines containing two markers in one group are perpendicular to the straight lines containing two markers in the other group.

[0067] In some implementations, since multiple markers are fixedly connected to the image acquisition device, the distances between the markers and the center of the image acquisition device are equal. If the image acquisition device deflects and its central axis is no longer perpendicular to the plane where the waveguide is located, the imaging positions of the multiple markers within the field of view of the image acquisition device will shift, and the distances between the images of the multiple markers and the center of the field of view will not be equal. Therefore, if it is detected that the distance between the imaging of each marker within the field of view of the image acquisition device and the center of the field of view is equal, it can be determined that the central axis of the image acquisition device is currently perpendicular to the plane where the waveguide is located.

[0068] like Figure 7 As shown, Figure 7 This illustration shows an image of multiple markers in the coupling region according to an embodiment of this application. In this embodiment, the number of markers fixedly connected to the image acquisition device can be four, six, eight, etc., and the number of markers is even. The multiple markers include multiple sets of symmetrically distributed markers, and the center of symmetry of each set of symmetrically distributed markers is the center of the image acquisition device.

[0069] Optionally, when the image acquisition device captures a marker image, the marker image includes the imaging 11 of multiple markers in the coupling region 42 of the waveguide. The shape of the coupling region 42 includes, but is not limited to, a square. If the imaging 11 of the target marker is located on the central axis of the field of view, since the target marker is two sets of symmetrically distributed markers in multiple sets of markers, and the straight line of two markers in one set of markers is perpendicular to the straight line of two markers in the other set of markers, it can be determined that the central axis of the image acquisition device coincides with the central axis of the optomechanical system.

[0070] In some implementations, since the distance between the multiple markers and the center of the image acquisition device is equal, if the distance between the image 11 of each marker captured by the image acquisition device and the center of the field of view is equal, then the imaging position of the multiple markers has not shifted, and it can be determined that the central axis of the image acquisition device is perpendicular to the plane where the waveguide is located.

[0071] Step S430: During the process of controlling the displacement component to move the component to be adjusted, the marker image captured by the image acquisition device is obtained. The marker image includes the image of each marker in the target area.

[0072] In this embodiment, the specific implementation of step S430 can be found in the content of the foregoing embodiments, and will not be repeated here.

[0073] Step S440: Obtain the centroid position of the image of each marker in the target area within the field of view of the image acquisition device.

[0074] In this embodiment, the shape of the image of the marker captured by the image acquisition device in the target area may be distorted, and the brightness of the marker image may be unevenly distributed. To ensure the accuracy of obtaining the position of the image of each marker in the target area within the field of view of the image acquisition device, and to determine whether the center of symmetry of the image of each group of symmetrically distributed markers matches the center position of the target area: when the image acquisition device captures the image of each group of symmetrically distributed markers in the target area, it uses the centroid position of each marker in the target area and the position of the center of symmetry of each group of symmetrically distributed markers.

[0075] Specifically, when the image of a marker exhibits an irregular shape and its brightness is unevenly distributed, common localization methods include centroid localization, Gaussian localization, and maximum likelihood estimation. Centroid localization calculates the centroid of the marker image by performing a brightness-weighted calculation based on the coordinates of each pixel in the image and its corresponding brightness value. Specifically, it calculates the sum of the products of the brightness values ​​and coordinates of all pixels in the image, then divides by the sum of the pixel coordinates to obtain the centroid position. Gaussian localization fits the marker's image data using a Gaussian function and then calculates the peak position of the Gaussian function to obtain the centroid position. Maximum likelihood estimation selects the most likely location of the image center within the possible coordinate range of the pixels in the marker's image as the centroid position.

[0076] Step S450: If, based on the centroid position of the image of each marker in the target area, the center of symmetry of the image of each group of symmetrically distributed markers matches the center position of the target area, then the center position of the component to be adjusted currently facing the target area is determined, and the component to be adjusted is controlled to stop moving.

[0077] In this embodiment, if the center of symmetry of the imaging of each group of symmetrically distributed markers is determined to match the center position of the target area based on the centroid position of each marker in the target area, then the center position of the component to be adjusted is currently facing the target area, and the control device controls the moving component to stop moving the component to be adjusted.

[0078] In some implementations, the component to be adjusted is an image acquisition device, and the target area is the coupling region of the waveguide. If it is detected that the center of symmetry of the imaging of each group of symmetrically distributed markers matches the center position of the coupling region during the movement of the image acquisition device, then it is determined that the image acquisition device is currently facing the center position of the coupling region, and the control device controls the moving component to stop the image acquisition device from moving.

[0079] Step S460: Obtain the position difference between the center position of the target area and the target position in the target area, and control the component to be adjusted to move horizontally on the target plane where the component to be adjusted is located based on the position difference, so that the component to be adjusted is facing the target position and the target plane is parallel to the plane where the waveguide is located.

[0080] In this embodiment, by obtaining the position difference between the center position of the coupling region and the target position within the coupling region, the control device controls the displacement component to move the image acquisition device horizontally in a plane parallel to the waveguide, based on the position difference. This ensures that the moved image acquisition device is directly facing the target position within the coupling region. Therefore, when the target position is a specific coupling point within the coupling region, it guarantees that the image acquisition device, after being moved by the displacement component, can receive the image light coupled from that specific coupling point of the waveguide.

[0081] In this embodiment, images of multiple markers fixedly connected to the component to be adjusted are captured in the target area of ​​the waveguide. Since the multiple markers include multiple sets of symmetrically distributed markers, and the center of symmetry of each set of symmetrically distributed markers is the center of the component to be adjusted, by obtaining the centroid position of the image of each marker in the target area, it is determined whether the center of symmetry of the image of each set of symmetrically distributed markers matches the center position of the target area. This ensures the positioning accuracy of the component to be adjusted during its movement. Thus, based on the positional difference between the center position of the target area and the target position, when the component to be adjusted is moved to the target position directly opposite the target area using the center position of the target area as a reference, the accuracy of waveguide performance testing at different coupling-in and coupling-out positions on the waveguide can be guaranteed, thereby contributing to the optimization of waveguide performance and improving the display performance of the display device.

[0082] Please see Figure 8 , Figure 8 This diagram illustrates a structural block diagram of a coupling position adjustment device according to an embodiment of the present application, which is applied to a coupling position adjustment system. The coupling position adjustment device 500 of this embodiment includes at least: an image acquisition module 510, a stop-movement control module 520, and a movement control module 530.

[0083] The image acquisition module 510 is used to acquire the marker image captured by the image acquisition device during the process of the control displacement component driving the component to be adjusted to move. The marker image includes the imaging of each marker in the target area.

[0084] The stop-move control module 520 is used to determine the center position of the component to be adjusted facing the center of the target area if the center of symmetry of the imaging of each group of symmetrically distributed markers in the target area is located at the center position of the target area, and to control the component to be adjusted to stop moving.

[0085] The motion control module 530 is used to obtain the position difference between the center position of the target area and the target position in the target area, and control the component to be adjusted to move horizontally in the target plane where the component to be adjusted is located based on the position difference, so that the component to be adjusted is facing the target position and the target plane is parallel to the plane where the waveguide is located.

[0086] In some implementations, the component to be adjusted is an optomechanical system, the target area is the coupling region of the waveguide, the optomechanical system is located on the first side of the coupling region, the image acquisition device is located on the second side of the coupling region, and the stop movement control module 520 can be specifically used to: if the center of symmetry of the imaging of each group of symmetrically distributed markers in the marker image matches the center position of the coupling region, then determine the current center position of the optomechanical system facing the coupling region, and control the optomechanical system to stop moving, with the central axis of the optomechanical system perpendicular to the plane where the waveguide is located.

[0087] Optionally, the coupling position adjustment system also includes a deflection component, with the optomechanic rotatably connected to the deflection component. The coupling position adjustment device 500 also includes a deflection control module, which can be specifically used to: acquire the marker image captured by the image acquisition device during the process of controlling the deflection component to drive the optomechanic to deflect, with the central axis of the image acquisition device perpendicular to the plane where the waveguide is located; if the distance between the image of each marker in the field of view of the image acquisition device and the center of the field of view is equal, then determine that the central axis of the optomechanic is currently perpendicular to the plane where the waveguide is located, and control the optomechanic to stop deflecting.

[0088] In some embodiments, the central axis of the image acquisition device coincides with the central axis of the optical engine. The image acquisition module 510 can be specifically used to: control the displacement component to drive the optical engine to move, and control the displacement component to drive the image acquisition device to move synchronously, so that the central axis of the image acquisition device coincides with the central axis of the optical engine, and acquire the marked image captured by the image acquisition device.

[0089] In other embodiments, the component to be adjusted is an image acquisition device, and the target area is the coupling region of the waveguide; the stop movement control module 520 can be specifically used to: if the center of symmetry of the imaging of each group of symmetrically distributed markers matches the center position of the coupling region, then determine the current center position of the image acquisition device facing the coupling region, and control the image acquisition device to stop moving, with the central axis of the image acquisition device perpendicular to the plane where the waveguide is located.

[0090] In some embodiments, the image acquisition module 510 may also be specifically used to: acquire the centroid position of the image of each marker in the target area within the field of view of the image acquisition device; the stop movement control module 520 may be specifically used to: if, based on the centroid position of the image of each marker in the target area, it is determined that the center of symmetry of the image of each group of symmetrically distributed markers matches the center position of the target area, then the center position of the component to be adjusted currently facing the target area is determined, and the component to be adjusted is controlled to stop moving.

[0091] Optionally, the coupling position adjustment system also includes a deflection component, with the optomechanic rotatably connected to the deflection component. The coupling position adjustment device 500 also includes a deflection control module, which can be specifically used to: acquire the marker image captured by the image acquisition device during the process of controlling the deflection component to drive the image acquisition device to deflect; if the image of the target marker in the field of view of the image acquisition device is located on the central axis of the field of view, then determine that the central axis of the image acquisition device is currently perpendicular to the plane where the waveguide is located, and control the image acquisition device to stop deflecting. The target marker includes two sets of symmetrically distributed markers among multiple sets of markers, where the straight line containing two markers in one set of markers is perpendicular to the straight line containing two markers in the other set of markers.

[0092] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device and module can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0093] In the several embodiments provided in this application, the coupling between modules can be electrical, mechanical, or other forms of coupling.

[0094] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0095] In summary, this embodiment of the application images multiple markers fixedly connected to the component to be adjusted within the target area of ​​the waveguide. Since these markers comprise multiple sets of symmetrically distributed markers, with the center of symmetry of each set serving as the center of the component to be adjusted, by monitoring whether the position of the center of symmetry of each set of symmetrically distributed markers matches the center of the target area during the controlled movement of the component to be adjusted, the component to be adjusted can be aligned with the center of the target area. Based on the positional difference between the center of the target area and the target position, the component to be adjusted can be aligned with the target position within the target area. Thus, when the component to be adjusted is an optomechanical device, it can be aligned with a specific coupling position within the coupling area; when the component to be adjusted is an image acquisition device, it can be aligned with a specific coupling position within the coupling area, thereby ensuring accuracy during waveguide performance testing and contributing to waveguide performance optimization.

[0096] The following will combine Figure 9 The present application provides a control device, which is the same as the control device described in the previous embodiments.

[0097] See Figure 9 , Figure 9 The diagram shows a structural block diagram of a control device 600 provided in an embodiment of this application. The above-described method provided in this embodiment of the application can be executed by the control device 600.

[0098] The control device 600 in this embodiment may include one or more of the following components: processor 601, memory 602, and one or more application programs, wherein the one or more application programs may be stored in memory 602 and configured to be executed by one or more processors 601, and the one or more programs are configured to perform the methods as described in the foregoing method embodiments.

[0099] Processor 601 may include one or more processing cores. Processor 601 connects to various parts within the control device 600 using various interfaces and lines, and performs various functions and processes data of the control device 600 by running or executing instructions, programs, code sets, or instruction sets stored in memory 602, and by calling data stored in memory 602. Optionally, processor 601 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). Processor 601 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the displayed content; and the modem handles wireless communication. It is understood that the aforementioned modem can also be integrated into processor 601 and implemented using a separate communication chip.

[0100] The memory 602 may include random access memory (RAM) or read-only memory (ROM). The memory 602 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 602 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as touch functionality, sound playback functionality, image playback functionality, etc.), and instructions for implementing the various method embodiments described below. The data storage area may also store data created by the control device 600 during use (such as the various correspondences described above).

[0101] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device and module can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0102] In the several embodiments provided in this application, the coupling or direct coupling or communication connection between the modules shown or discussed may be an indirect coupling or communication connection through some interface, device or module, and may be electrical, mechanical or other forms.

[0103] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0104] Please refer to Figure 10 , Figure 10 A structural block diagram of a computer-readable storage medium provided in an embodiment of this application is shown. The computer-readable storage medium 700 stores program code that can be called by a processor to execute the methods described in the above method embodiments.

[0105] The computer-readable storage medium 700 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 700 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 700 has storage space for program code 710 that performs any of the method steps described above. This program code can be read from or written to one or more computer program products. The program code 710 may, for example, be compressed in a suitable form.

[0106] In some embodiments, a computer program product or computer program is provided, the computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a control device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, causing the control device to perform the steps in the above-described method embodiments.

[0107] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for adjusting the coupling position, characterized in that, An application is made in a coupling position adjustment system, the coupling position adjustment system comprising multiple markers, an image acquisition device, and a displacement component. The multiple markers are fixedly connected to a component to be adjusted, the component to be adjusted facing a target region on a waveguide. The displacement component is used to move the component to be adjusted to different positions facing the target region. Each marker is equidistant from the center of the component to be adjusted. The multiple markers include multiple sets of symmetrically distributed markers, the center of symmetry of each set of symmetrically distributed markers being the center of the component to be adjusted. The component to be adjusted is at least one of an optomechanical system and the image acquisition device. The method includes: During the process of controlling the displacement component to move the component to be adjusted, the marker image captured by the image acquisition device is obtained, and the marker image includes an image of each marker in the target area; If the center of symmetry of the imaging of each group of symmetrically distributed markers in the marked image matches the center position of the target region, then the center position of the component to be adjusted is determined to be facing the center of the target region, and the component to be adjusted is controlled to stop moving. The position difference between the center position of the target area and the target position in the target area is obtained, and the component to be adjusted is controlled to move horizontally on the target plane where the component to be adjusted is located based on the position difference, so that the component to be adjusted is facing the target position, and the target plane is parallel to the plane where the waveguide is located.

2. The method according to claim 1, characterized in that, The component to be adjusted is the optomechanical system, the target area is the coupling region of the waveguide, the optomechanical system is located on the first side of the coupling region, and the image acquisition device is located on the second side of the coupling region. If the center of symmetry of the imaging of each group of symmetrically distributed markers in the marked image matches the center position of the target region, then the center position of the component to be adjusted is determined to be facing the center of the target region, and the component to be adjusted is controlled to stop moving, including: If the center of symmetry of the imaging of each group of symmetrically distributed markers in the marked image matches the center position of the coupling region, then the optical engine is determined to be currently facing the center position of the coupling region, and the optical engine is controlled to stop moving. The central axis of the optical engine is perpendicular to the plane where the waveguide is located.

3. The method according to claim 2, characterized in that, The coupling position adjustment system further includes a deflection component, and the optomechanic is rotatably connected to the deflection component; Before acquiring the marker image captured by the image acquisition device during the process of controlling the displacement component to move the component to be adjusted, the method further includes: During the process of controlling the deflection component to drive the optomechanical deflection, the marked image captured by the image acquisition device is obtained, and the central axis of the image acquisition device is perpendicular to the plane where the waveguide is located; If the distance between the image of each marker within the field of view of the image acquisition device and the center of the field of view is equal, then it is determined that the central axis of the optical engine is currently perpendicular to the plane where the waveguide is located, and the optical engine is controlled to stop deflecting.

4. The method according to claim 3, characterized in that, The central axis of the image acquisition device coincides with the central axis of the optomechanical system. The process of acquiring the marker image captured by the image acquisition device during the control of the displacement component to move the component to be adjusted includes: During the process of controlling the displacement component to drive the optical engine to move, the displacement component is controlled to drive the image acquisition device to move synchronously, so that the central axis of the image acquisition device is kept coincident with the central axis of the optical engine, and the mark image captured by the image acquisition device is acquired.

5. The method according to claim 1, characterized in that, The component to be adjusted is the image acquisition device, and the target area is the coupling region of the waveguide; If the center of symmetry of the imaging of each group of symmetrically distributed markers in the marked image matches the center position of the target region, then the center position of the component to be adjusted is determined to be facing the center of the target region, and the component to be adjusted is controlled to stop moving, including: If the center of symmetry of the imaging of each group of symmetrically distributed markers matches the center position of the coupling region, then the image acquisition device is currently facing the center position of the coupling region, and the image acquisition device is controlled to stop moving. The central axis of the image acquisition device is perpendicular to the plane where the waveguide is located.

6. The method according to any one of claims 1 to 5, characterized in that, Before determining the center position of the component to be adjusted relative to the center of the target region and controlling the component to be adjusted to stop moving if the center of symmetry of the imaging of each group of symmetrically distributed markers in the marked image matches the center position of the target region, the method further includes: Obtain the centroid position of the image of each marker in the target area within the field of view of the image acquisition device; If the center of symmetry of the imaging of each group of symmetrically distributed markers in the marked image matches the center position of the target region, then the center position of the component to be adjusted facing the target region is determined, and the component to be adjusted is controlled to stop moving, including: If, based on the centroid position of the image of each marker in the target area, it is determined that the center of symmetry of the image of each group of symmetrically distributed markers matches the center position of the target area, then the center position of the component to be adjusted is determined to be facing the target area, and the component to be adjusted is controlled to stop moving.

7. The method according to any one of claims 1 to 5, characterized in that, The coupling position adjustment system further includes a deflection component, and the image acquisition device is rotatably connected to the deflection component; Before acquiring the marker image captured by the image acquisition device during the process of controlling the displacement component to move the component to be adjusted, the method further includes: During the process of controlling the deflection component to drive the image acquisition device to deflect, the marked image captured by the image acquisition device is acquired; If the image of the target marker within the field of view of the image acquisition device is located on the central axis of the field of view, then it is determined that the central axis of the image acquisition device is currently perpendicular to the plane where the waveguide is located, and the image acquisition device is controlled to stop deflecting. The target marker includes two sets of symmetrically distributed markers among the multiple sets of symmetrically distributed markers, wherein the straight line containing two markers in one set of markers is perpendicular to the straight line containing two markers in the other set of markers.

8. A coupling position adjustment device, characterized in that, An application is made in a coupling position adjustment system, the coupling position adjustment system comprising multiple markers, an image acquisition device, and a displacement component. The multiple markers are fixedly connected to a component to be adjusted, the component to be adjusted facing a target region on a waveguide. The displacement component is used to move the component to be adjusted to different positions facing the target region. Each marker is equidistant from the center of the component to be adjusted. The multiple markers include multiple sets of symmetrically distributed markers, the center of symmetry of each set of symmetrically distributed markers being the center of the component to be adjusted. The component to be adjusted is at least one of an optomechanical system and the image acquisition device. The coupling position adjustment device includes: The image acquisition module is used to acquire the marker image captured by the image acquisition device during the process of controlling the displacement component to move the component to be adjusted. The marker image includes an image of each marker in the target area. The stop-movement control module is used to determine the center position of the component to be adjusted facing the center of the target area if the center of symmetry of the imaging of each group of symmetrically distributed markers in the target area is located at the center position of the target area, and control the component to be adjusted to stop moving. The motion control module is used to obtain the position difference between the center position of the target area and the target position in the target area, and control the component to be adjusted to move horizontally on the target plane where the component to be adjusted is located based on the position difference, so that the component to be adjusted is facing the target position, and the target plane is parallel to the plane where the waveguide is located.

9. A control device, characterized in that, The control device includes: One or more processors; Memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs being configured to perform the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores program code that can be invoked by a processor to perform the method as described in any one of claims 1 to 7.