Optical-mechanical assembly method and device, electronic equipment and readable storage medium

Abstract

The application discloses an optical machine assembly method and device, electronic equipment and a readable storage medium, which are applied to an assembly control system. The assembly control system is used for controlling an assembly optical machine. The assembly optical machine comprises a first component, a second component and a third component. The optical machine assembly method comprises the following steps: acquiring a first imaging picture of the assembly optical machine when the first component and the second component are controlled to be assembled; detecting whether the first component and the second component are assembled according to the first imaging picture; controlling the third component to be assembled after it is detected that the first component and the second component are assembled, and acquiring a second imaging picture of the assembly optical machine in the assembly process of the third component; and controlling the assembly optical machine to be assembled by controlling the third component to be adjusted according to the second imaging picture. The application solves the technical problem that it is difficult to balance the assembly efficiency and assembly accuracy.

Description

Technical Field

[0001] This application relates to the field of optical technology, and in particular to an optomechanical assembly method, apparatus, electronic device, and readable storage medium. Background Technology

[0002] With the continuous development of technology, micro-projection technology is gradually becoming more widespread. At the same time, the optical engine, which provides image elements in micro-projection technology, is also facing higher requirements. In order to meet user needs such as easy portability and miniaturized product design, micro-optical engines are widely used.

[0003] Currently, equipment manufacturers typically assemble the various components of an optical engine manually, using techniques such as micro-tooling positioning or manual six-axis assembly positioning. However, due to the small size of micro-optical engines, operational or tooling errors are easily introduced during the manual assembly of their components. Furthermore, the limitations of manual assembly capabilities restrict the assembly efficiency of micro-optical engines, leading to technical defects such as excessively long assembly times or low precision after assembly. Therefore, it is currently difficult to balance assembly efficiency and accuracy in optical engine assembly. Summary of the Invention

[0004] The main objective of this application is to provide an optomechanical assembly method, apparatus, electronic device, and readable storage medium, aiming to solve the technical problem that the existing technology is currently unable to balance assembly efficiency and assembly accuracy.

[0005] To achieve the above objectives, this application provides an optomechanical assembly method applied to an assembly control system. The assembly control system controls the assembly of an optomechanical component to be assembled, the component comprising a first part, a second part, and a third part. The optomechanical assembly method includes:

[0006] When the first component and the second component are assembled, the first imaging image of the optical engine to be assembled is acquired;

[0007] Based on the first imaging image, detect whether the first component and the second component have been assembled.

[0008] After detecting that the first component and the second component have been assembled, the third component is controlled to be assembled, and a second imaging image of the optical engine to be assembled is acquired during the assembly of the third component.

[0009] Based on the second imaging image, the third component is adjusted to control the assembly of the optical engine to be assembled.

[0010] To achieve the above objectives, this application also provides an optomechanical assembly apparatus applied to an assembly control system. The assembly control system controls the assembly of an optomechanical component to be assembled, the component comprising a first component, a second component, and a third component. The optomechanical assembly apparatus includes:

[0011] The first acquisition module is used to acquire a first imaging image of the optical engine to be assembled when controlling the first component and the second component to be assembled.

[0012] The detection module is used to detect whether the first component and the second component have been assembled based on the first imaging image;

[0013] The second acquisition module is used to control the third component to be assembled after detecting that the first component and the second component have been assembled, and to acquire the second imaging image of the optical engine to be assembled during the assembly of the third component;

[0014] An assembly module is used to control the third component to adjust the second imaging image to complete the assembly of the optical engine to be assembled.

[0015] This application also provides an electronic device, the electronic device comprising: at least one processor and a memory communicatively connected to the at least one processor, the memory storing instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the steps of the optomechanical assembly method described above.

[0016] This application also provides a computer-readable storage medium storing a program for implementing an optomechanical assembly method, wherein when the program for the optomechanical assembly method is executed by a processor, it implements the steps of the optomechanical assembly method as described above.

[0017] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the optomechanical assembly method described above.

[0018] This application provides an optical engine assembly method, apparatus, electronic device, and readable storage medium, applied to an assembly control system. The assembly control system is used to control the assembly of an optical engine to be assembled, the optical engine to be assembled including a first component, a second component, and a third component. Specifically, when controlling the first component and the second component to assemble, a first imaging image of the optical engine to be assembled is acquired; based on the first imaging image, it is detected whether the first component and the second component have been assembled; after detecting that the first component and the second component have been assembled, the third component is controlled to assemble, and a second imaging image of the optical engine to be assembled is acquired during the assembly of the third component; based on the second imaging image, adjustments are made by controlling the third component to control the assembly of the optical engine to be assembled to be completed.

[0019] In assembling the optical engine to be assembled, this application first assembles the first and second components of the optical engine and acquires a first imaging image during the assembly process. Then, it detects whether the first and second components are assembled successfully through the first imaging image. After the first and second components are assembled, the assembly control system controls the assembly of the third component and acquires a second imaging image of the optical engine to be assembled during the assembly process. Finally, the second imaging image controls the assembly of the optical engine to be assembled. Since the first, second, and third components of the optical engine to be assembled are all assembled under the control of the assembly control system, the purpose of automatically assembling the optical engine to be assembled can be achieved through the assembly control system. At the same time, the determination of whether each component of the optical engine to be assembled is completed depends on the assembly control system's judgment of the imaging images during the assembly process. Therefore, the purpose of automatically assembling and detecting the optical engine to be assembled through the assembly control system is achieved.

[0020] Because the assembly control system can automatically complete the assembly and testing of the optical engine to be assembled, compared with the traditional method of manual assembly and visual inspection by operators, the assembly control system has stronger stability and can avoid assembly and testing errors caused by human limitations. Thus, it achieves the goal of quickly and automatically assembling the optical engine to be assembled under the control of the assembly control system, and objectively detecting whether the components of the optical engine to be assembled have been assembled.

[0021] Based on this, this application, during the assembly of the optical engine to be assembled, utilizes an assembly control system for assembly and testing. This system enables rapid and automated assembly of the various components of the optical engine and allows for objective detection of whether each component is fully assembled, thereby controlling the assembly of the optical engine to be assembled. This is in contrast to assembling the components manually. Therefore, it overcomes the limitations of manual assembly capabilities, which restricts the assembly efficiency of micro-optical engines, leading to excessively long assembly times or low precision after assembly. Thus, it balances both assembly efficiency and accuracy in optical engine assembly. Attached Figure Description

[0022] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0023] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 This is a schematic flowchart of the optomechanical assembly method provided in Embodiment 1 of this application;

[0025] Figure 2 This is a schematic diagram illustrating a scenario in which the optical-mechanical assembly method provided in Embodiment 1 of this application determines the assembly completion status of the third component by jointly using pixel grayscale values ​​and grayscale value distribution curves.

[0026] Figure 3 This is a schematic diagram of the assembly control system of the optomechanical assembly method provided in Embodiment 1 of this application;

[0027] Figure 4 This is a schematic flowchart of the optomechanical assembly method provided in Embodiment 2 of this application;

[0028] Figure 5 This is a schematic diagram of the optomechanical assembly device provided in Embodiment 3 of this application;

[0029] Figure 6 This is a schematic diagram of the structure of the electronic device provided in Embodiment 4 of this application.

[0030] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0031] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0032] Example 1

[0033] First, it should be understood that the assembly of micro-optical engines is usually carried out manually. Taking the assembly of AR (Augmented Reality) optical engines as an example, there are two main manual operation methods: 1) Positioning through micro-tools: The tooling uses a plug-in type, and each optical component is directly placed into the slot. The tooling is used for basic positioning. However, due to the small size of the optical engine, the above assembly method will have large tooling and operation errors during the assembly process, making it difficult to achieve the imaging quality required by users; 2) Placing the various components of the optical engine on a manual six-axis, and relying on the operator's visual inspection to check whether the optical engine is assembled. However, this assembly method will still have large assembly errors due to human intervention. At the same time, since manual inspection is subjective, the products assembled by the above assembly method will have defects in assembly accuracy, and the assembly efficiency is limited. In summary, the current optical engine assembly method using manual intervention is difficult to balance assembly accuracy and assembly efficiency. Therefore, there is an urgent need for a method that can balance the assembly accuracy and assembly efficiency of optical engines.

[0034] This application provides an optomechanical assembly method applied to an assembly control system. The assembly control system controls the assembly of an optomechanical component to be assembled, which includes a first component, a second component, and a third component. In an embodiment of the optomechanical assembly method of this application, refer to... Figure 1 The optomechanical assembly method includes:

[0035] Step S10: When the first component and the second component are being assembled, the first imaging image of the optical engine to be assembled is acquired.

[0036] Step S20: Based on the first imaging image, detect whether the first component and the second component have been assembled.

[0037] Step S30: After detecting that the first component and the second component have been assembled, control the third component to be assembled, and acquire the second imaging image of the optical engine to be assembled during the assembly of the third component;

[0038] Step S40: Based on the second imaging image, adjust the third component by controlling it to complete the assembly of the optical engine to be assembled.

[0039] In this embodiment, it should be noted that, although Figure 1 The logical order is shown, but in some cases, the steps shown or described may be performed in a different order than that shown here. The optomechanical assembly method is applied to an assembly control system, which is deployed on an assembly control device. The assembly control device is used to assemble the optomechanical component to be assembled and to detect the assembly process. Specifically, it can be an AR device or a VR (Virtual Reality) device, etc. The optomechanical component to be assembled is used to characterize the optomechanical component waiting to be assembled. Specifically, it can be a micro-optical mechanism or a medium-sized optomechanical mechanism, etc. The first component, the second component, and the third component refer to the components of the optomechanical component to be assembled. Specifically, they can be an imaging component, a lens, or an illumination component, etc. For example, in one implementable manner, the first component can be an imaging component, the second component can be a lens, and the third component can be an illumination component. By first completing the AA (Active Alignment) between the imaging component and the lens, then performing the AA between the illumination component and the imaging component, and finally performing the AA between the illumination component and the lens, the assembly of the optomechanical component to be assembled is finally completed.

[0040] Additionally, it should be noted that during the assembly of the first and second components, the optical machine to be assembled will form a first imaging image through the first or second component. The first or second component can be an imaging element. The first imaging image formed based on the imaging element can be used to evaluate whether the components are assembled successfully, that is, to detect whether the relative positions of the first and second components meet production requirements. Specifically, the detection method can be to detect the pixels and resolution of the image through a vision system to determine the clarity of the first imaging image. If the clarity meets the requirements, the assembly of the first and second components is determined to be complete. For example, in one feasible approach, assuming the preset resolution threshold of the vision system is A and the resolution of the first imaging image is B, the assembly of the first and second components is determined to be complete when B > A.

[0041] Additionally, it should be noted that the assembly of the optical engine to be assembled is completed after the first and second components are assembled and the third component is assembled. The assembly of the third component includes the assembly of the third component and the first component, as well as the assembly of the third component and the second component. The second imaging screen is used to determine whether the third component is assembled. For example, in one feasible approach, assuming that the third component is detected to be assembled, that is, the first, second, and third components are all assembled, the optical engine to be assembled is determined to be assembled. During the assembly of the first and second components, and during the assembly of the third component, if the first and second imaging screens determine that the first and second components, or the third component, are not assembled, the assembly control system can issue corresponding control commands to control the six-axis of the corresponding component to adaptively adjust the position of the component, and after adjustment, continue to detect whether the component is assembled.

[0042] As an example, steps S10 to S30 include: controlling the assembly between the imaging component and the lens, and acquiring a first imaging image formed by the imaging component during the assembly of the imaging component and the lens through the vision module of the assembly control system, wherein the vision module may specifically be a vision subsystem in the assembly control system; if the resolution of the first imaging image is detected to be greater than a first preset resolution threshold, it is determined that the assembly between the first component and the second component is complete; if the resolution of the first imaging image is detected to be less than or equal to the first preset resolution threshold, it is determined that the assembly between the first component and the second component is not complete; after detecting that the assembly between the first component and the second component is complete, the system... The assembly control system controls the assembly of the imaging component and the illumination component, and acquires a second imaging image by the imaging component through the vision module. It detects whether the resolution of the second imaging image is greater than a second preset resolution threshold. If the resolution of the second imaging image is greater than the second preset resolution threshold, it is determined that no assembly adjustment is needed between the imaging component and the illumination component, thus determining that the optical engine to be assembled is complete. If the resolution of the second imaging image is less than or equal to the second preset resolution threshold, it is determined that the imaging component and the illumination component are not fully assembled, and then assembly adjustment is performed between the imaging component and the illumination component to control the completion of the optical engine assembly.

[0043] In this embodiment of the application, during the assembly process of the optical engine to be assembled, the assembly control system first controls the assembly between the imaging component and the lens. A first image generated by the imaging component during this assembly process is used to detect whether the assembly between the imaging component and the lens is complete. Once the assembly between the imaging component and the lens is confirmed, the assembly control system controls the assembly between the imaging component and the illumination component. A second image generated by the imaging component during this assembly process is used to detect whether the assembly between the imaging component and the illumination component is complete. Upon detection that the assembly between the imaging component and the illumination component is complete, the assembly control system determines that the optical engine to be assembled is finished. That is, the assembly is completed through the assembly control system and the imaging component... The imaging screen sequentially completes the assembly of the imaging component and lens, as well as the imaging component and illumination component. This achieves the goal of automatically assembling the optical engine to be assembled through the assembly control system. At the same time, the determination of whether each component of the optical engine to be assembled has been completed depends on the judgment of the imaging screen during the assembly process by the assembly control system. Therefore, the goal of automatically assembling and detecting the optical engine to be assembled through the assembly control system is achieved. This overcomes the technical defects caused by the limitation of manual assembly capabilities, which restricts the assembly efficiency of micro-optical engines and leads to excessively long assembly time or low accuracy after assembly. Thus, it balances the assembly efficiency and assembly accuracy of optical engines.

[0044] In one feasible approach, when the assembly control system detects that the imaging component and lens, or the imaging component and illumination component are not fully assembled, the assembly control system can generate control commands to control the six axes of the corresponding components to adaptively adjust the relative positions of the components until the imaging component and lens, as well as the imaging component and illumination component, are fully assembled. It is understood that after the imaging component and lens, as well as the imaging component and illumination component, are fully assembled, the relative positions of the illumination component and lens can meet the production tolerance requirements. Then, after all the components of the optical engine to be assembled are fully assembled, it is determined that the optical engine to be assembled is complete. The six axes can be the X-axis, Y-axis, Z-axis, Tip axis, Tilt axis, and R-axis, respectively.

[0045] The step of detecting whether the first component and the second component are fully assembled based on the first imaging image includes:

[0046] Step A10: Determine the imaging quality pixels in the first imaging image;

[0047] Step A20: Determine whether the first component and the second component are assembled based on the first pixel grayscale value of the imaging quality pixel.

[0048] In this embodiment, it should be noted that when determining whether the first component and the second component are assembled, the overall clarity of the image cannot reflect the quality of the local area. For example, the first image may meet production requirements in terms of overall resolution, but there may be colored bands around the edges. In this case, if the first component and the second component are determined to be assembled, the final assembled optical engine will still not meet the user's needs. Therefore, when determining whether the first component and the second component are assembled, pixel grayscale values ​​are introduced. The image quality of the local area of ​​the image is accurately determined by the pixel grayscale values. That is, the assembly control system sets a preset pixel grayscale value threshold in advance. The determination of whether the first component and the second component are assembled is completed by the relationship between the preset pixel grayscale value threshold and the pixel grayscale values. The imaging quality pixels are used to characterize the image quality of the image. Specifically, there may be one or more. When there are multiple imaging quality pixels, if the first pixel grayscale value of a preset number of pixels among the multiple imaging quality pixels exceeds the preset pixel grayscale threshold, it is determined that the first component and the second component are not assembled.

[0049] As an example, steps A10 to A20 include: extracting imaging quality pixels in the first imaging frame according to a preset extraction rule, wherein the preset extraction rule specifies the positions of the pixels to be extracted in the first imaging frame; if the first pixel grayscale value of the imaging quality pixel is detected to be greater than a preset pixel grayscale value threshold, it is determined that the imaging component and the lens are not fully assembled; if the first pixel grayscale value of the imaging quality pixel is detected to be less than or equal to the preset pixel grayscale value threshold, it is determined that the imaging component and the lens are fully assembled. Since pixel grayscale values ​​can reflect the imaging quality of the first imaging frame at the pixel level, and the relationship between the first pixel grayscale value of the imaging quality pixel in the first imaging frame and the preset pixel grayscale value threshold can be used to accurately determine whether the imaging component and the lens are fully assembled, this lays the foundation for balancing assembly efficiency and assembly accuracy during the assembly process of the optical engine to be assembled.

[0050] The step of determining whether the first component and the second component are fully assembled based on the first pixel grayscale value of the imaging quality pixel includes:

[0051] Step B10: Determine whether the imaging quality of the first imaging image meets the first preset imaging conditions based on the first pixel grayscale value of the imaging quality pixel.

[0052] Step B20: If yes, then determine that the assembly between the first component and the second component is complete;

[0053] Step B30: If not, after adjusting the first component and / or the second component, obtain the third imaging image of the optical engine to be assembled;

[0054] Step B40: Use the third imaging image as the first imaging image and return to the execution step: Determine whether the imaging quality of the first imaging image meets the first preset imaging condition based on the first pixel grayscale value of the imaging quality pixel.

[0055] In this embodiment, it should be noted that determining whether the lens and imaging component are assembled successfully using the first pixel grayscale value of a single imaging quality pixel or a single region's imaging quality pixel is insufficient to guarantee that the overall imaging quality requirements are met. Therefore, the first pixel grayscale value is used to characterize the overall imaging quality of the first image, and the assembly success of the first and second components is determined by assessing whether the imaging quality meets the first preset imaging conditions. The imaging quality of the first image can be characterized by the average pixel grayscale value of multiple regions. For example, in one feasible approach, assuming the multiple regions include a top-left region, a bottom-left region, a top-right region, and a bottom-right region, then for any region, all pixels within that region are considered imaging quality pixels, and all... The average grayscale value of the first pixel of the imaging quality pixel is calculated. The average grayscale value of the pixels in each region is calculated. The first preset imaging condition can be that there is no color band in all regions, that is, the average grayscale value of the pixels in all regions is less than a certain preset average grayscale value threshold. When the average grayscale value of the pixels in the upper left corner region, the lower left corner region, the upper right corner region, and the lower right corner region is detected to be less than the preset average grayscale value threshold, it is determined that the imaging quality of the first imaging image meets the first preset imaging condition. After the imaging quality of the first imaging image does not meet the first preset imaging condition, the angle of the first component and / or the second component can be adjusted through the six axes corresponding to the first component and / or the second component. The first component and the second component are determined to meet the first preset imaging condition based on the imaging image (third imaging image) formed by the imaging component after each adjustment.

[0056] As an example, steps B10 to B40 include: taking all pixels in the upper left, upper right, lower left, and lower right regions of the first image as image quality pixels, and calculating the average pixel grayscale values ​​of the upper left, upper right, lower left, and lower right regions based on the first pixel grayscale values ​​of the image quality pixels; and determining whether the image quality of the first image meets the first preset imaging conditions based on the average pixel grayscale values ​​of the upper left, upper right, lower left, and lower right regions; in the upper left, upper right, lower left, and lower right regions... When the average pixel grayscale value of the lower corner region and the lower right corner region is greater than the first preset imaging condition, it is determined that the imaging quality of the first imaging image does not meet the first preset imaging condition, and the first component and / or the second component are adjusted. After adjusting the first component and / or the second component, the third imaging image of the optical engine to be assembled is acquired through the vision module. The third imaging image is used as the first imaging image, and the execution step is returned: Based on the first pixel grayscale value of the imaging quality pixel, it is determined whether the imaging quality of the first imaging image meets the first preset imaging condition.

[0057] The step of controlling the third component to adjust according to the second imaging image to control the assembly of the optical engine to be assembled includes:

[0058] Step C10: Determine the image quality pixel area in the second imaging frame;

[0059] Step C20: Detect whether the third component has been assembled based on the second pixel grayscale value of the imaging quality pixel area;

[0060] Step C30: If yes, then the optical engine to be assembled is confirmed to be assembled.

[0061] Step C40: If not, then based on the imaging uniformity of the second imaging image, the assembly position of the third component is iteratively adjusted until the assembly of the third component is detected to be complete.

[0062] In this embodiment, it should be noted that after the first and second components are assembled, the assembly of the third component is completed to control the assembly of the optical engine to be assembled. During the assembly of the third component, the main impact on the uniformity and clarity of the image is the effect on the image uniformity. The uniformity of the second image is determined by the second pixel grayscale value of the image quality pixel area. The image uniformity is used to characterize the uniformity of the image and can be determined by the pixel brightness values ​​of different imaging areas. The image quality pixel area is used to characterize the pixel area for judging the image quality and can be the four corners of the second image. The second preset imaging condition can be that the pixel grayscale difference in the four corner areas of the second image reaches the minimum. That is, when the pixel grayscale difference in the four corner areas of the second image is the minimum, the assembly of the third component is determined to be complete. When the pixel grayscale difference in the four corner areas of the second image does not reach the minimum, the image uniformity of the second image is determined by the four corner areas (image quality pixel areas) of the second image, and the assembly position of the third component is adjusted.

[0063] As an example, steps C10 to C30 include: extracting an imaging quality pixel region from the second imaging image; detecting whether the third component is assembled based on the second pixel grayscale value of the imaging quality pixel region, wherein the detection method can specifically be a method of detecting the relationship between the second pixel grayscale value and a preset second preset pixel grayscale value threshold. For example, if the second pixel grayscale value is greater than the preset second preset pixel grayscale value threshold, it is determined that the third component is assembled; if the second pixel grayscale value is less than or equal to the preset second preset pixel grayscale value threshold, it is determined that the third component is not assembled; if the third component is detected to be assembled, it is determined that the optical engine to be assembled is assembled; if the third component is detected to be not assembled, the assembly position of the third component is iteratively adjusted according to the imaging uniformity of the second imaging image until the assembly of the third component is detected to be completed.

[0064] The step of iteratively adjusting the assembly position of the third component based on the imaging uniformity of the second imaging image until the assembly of the third component is detected includes:

[0065] Step D10: Determine whether the imaging uniformity of the second imaging image meets the second preset imaging condition based on the second pixel gray value of the imaging quality pixel area.

[0066] If the step D20 is correct, then the optical engine to be assembled is confirmed to be assembled.

[0067] Step D30: If not, after adjusting the third component, obtain the fourth imaging image of the optical engine to be assembled;

[0068] Step D40: Use the fourth imaging image as the second imaging image and return to the execution step: Determine whether the imaging uniformity of the second imaging image meets the second preset imaging condition based on the second pixel grayscale value of the imaging quality pixel area.

[0069] As an example, steps D10 to D40 include: determining the pixel grayscale difference values ​​of the four corner regions of the second imaging image based on the second pixel grayscale value of the imaging quality pixel region; determining that the second preset imaging condition is met when the pixel grayscale difference is at its minimum; and determining that the second preset imaging condition is not met when the pixel grayscale difference is not at its minimum. If the second preset imaging condition is met, the assembly position between the illumination component and the imaging component is adjusted, and a fourth imaging image generated by the imaging component is obtained after the adjustment. The fourth imaging image is used as the second imaging image, and the process returns to the execution step: determining whether the imaging uniformity of the second imaging image meets the second preset imaging condition based on the second pixel grayscale value of the imaging quality pixel region.

[0070] The step of detecting whether the third component is assembled based on the second pixel grayscale value of the imaging quality pixel region includes:

[0071] Step E10: Based on the second pixel grayscale value of the imaging quality pixel region, detect whether the pixel grayscale difference corresponding to the second imaging image is the minimum grayscale difference.

[0072] If the grayscale distribution curve constructed by the grayscale value of the second pixel satisfies the third preset imaging condition, then the assembly of the third component is determined to be complete.

[0073] Step E30: If not, then it is determined that the third component has not been fully assembled.

[0074] In this embodiment, it should be noted that determining whether the third component is assembled by using pixel grayscale difference and minimum grayscale difference has certain flaws. For example, when the pixel grayscale difference is the minimum grayscale difference, the pixel grayscale values ​​at different positions of the second imaging image are not uniform. Therefore, in order to further avoid the uniformity problem in the assembly process of the third component, a grayscale value distribution curve is introduced to further determine the pixel uniformity of the image. The grayscale value distribution curve is used to characterize the distribution of grayscale values ​​of different pixels in the image. For example, in one feasible method, it is assumed that the grayscale value distribution curve is an energy Gaussian curve. If the energy Gaussian curve is at a completely symmetrical position in the center, the second imaging image is determined to be uniform. The third preset imaging condition is that the curve is completely symmetrical.

[0075] In one feasible approach, refer to Figure 2, Figure 2 This is a scene diagram illustrating how the assembly completion status of the third component is determined by jointly using pixel grayscale values ​​and grayscale distribution curves. In this diagram, the pixel grayscale differences in the four corner regions a, b, c, and d are calculated, and the assembly positions between the lighting component and the imaging component are adjusted based on these pixel grayscale differences, thereby achieving the assembly completion of the lighting component and the imaging component (the third component).

[0076] In one feasible approach, refer to Figure 3 , Figure 3 The diagram illustrates the assembly control system, where ① represents the first optomechanical product and ② represents the second optomechanical product.

[0077] As an example, steps E10 to E30 include: detecting whether the pixel grayscale difference corresponding to the second imaging image is the minimum grayscale difference based on the second pixel grayscale value of the imaging quality pixel region; when the pixel grayscale difference corresponding to the second imaging image is detected to be the minimum grayscale difference, obtaining a grayscale value distribution curve constructed from the second pixel grayscale value, and detecting whether the grayscale value distribution curve is completely symmetrical; if the grayscale value distribution curve is detected to be completely symmetrical, then determining that the illumination component and the imaging component are assembled; when the pixel grayscale difference corresponding to the second imaging image is detected not to be the minimum grayscale difference, then determining that the third component is not assembled.

[0078] This application provides an optical engine assembly method applied to an assembly control system. The assembly control system controls the assembly of an optical engine to be assembled, which includes a first component, a second component, and a third component. Specifically, when the first and second components are being assembled, a first imaging image of the optical engine to be assembled is acquired. Based on the first imaging image, it is detected whether the first and second components have been assembled. After the first and second components are detected to be assembled, the third component is controlled to be assembled, and a second imaging image of the optical engine to be assembled is acquired during the assembly of the third component. Based on the second imaging image, adjustments are made by controlling the third component to control the assembly of the optical engine to be assembled to be completed.

[0079] In this embodiment, when assembling the optical engine to be assembled, the first and second components of the optical engine to be assembled are first assembled, and a first imaging image is acquired during the assembly of the first and second components. Then, the first imaging image is used to detect whether the first and second components are assembled. After the first and second components are assembled, the assembly control system controls the assembly of the third component, and a second imaging image of the optical engine to be assembled is acquired during the assembly of the third component. Finally, the second imaging image is used to control the assembly of the optical engine to be assembled. Since the first, second, and third components of the optical engine to be assembled are all assembled under the control of the assembly control system, the purpose of automatically assembling the optical engine to be assembled can be achieved through the assembly control system. At the same time, the determination of whether each component of the optical engine to be assembled is completed depends on the assembly control system's judgment of the imaging image during the assembly process. Therefore, the purpose of automatically assembling and detecting the optical engine to be assembled through the assembly control system is achieved.

[0080] Because the assembly control system can automatically complete the assembly and testing of the optical engine to be assembled, compared with the traditional method of manual assembly and visual inspection by operators, the assembly control system has stronger stability and can avoid assembly and testing errors caused by human limitations. Thus, it achieves the goal of quickly and automatically assembling the optical engine to be assembled under the control of the assembly control system, and objectively detecting whether the components of the optical engine to be assembled have been assembled.

[0081] Based on this, the embodiments of this application, during the assembly of the optomechanism to be assembled, utilize an assembly control system for assembly and testing. This enables rapid and automatic assembly of the various components of the optomechanism to be assembled, and allows for objective detection of whether the assembly of each component is complete, thereby controlling the assembly of the optomechanism to be assembled. This is achieved instead of assembling the components manually. Therefore, it overcomes the limitations of manual assembly capabilities, which restricts the assembly efficiency of micro-optical mechanisms, leading to excessively long assembly times or low accuracy after assembly. Thus, it balances both assembly efficiency and accuracy in optomechanism assembly.

[0082] Example 2

[0083] Furthermore, referring to Figure 4 In another embodiment of this application, content that is the same as or similar to that in Embodiment 1 described above can be referred to the above description and will not be repeated hereafter. Based on this, after the step of iteratively adjusting the assembly position of the third component according to the imaging uniformity of the second imaging image until the assembly of the third component is detected to be complete, the optomechanical assembly method further includes:

[0084] Step F10: Obtain the fifth imaging image of the optical engine to be assembled;

[0085] Step F20: Detect whether the degree of change between the fifth imaging frame and the imaging process frame is less than the fourth preset imaging condition, wherein the imaging process frame includes the first imaging frame and / or the second imaging frame;

[0086] Step F30: If yes, then the optical engine to be assembled is confirmed to be assembled.

[0087] Step F40: If not, iteratively adjust the optical engine to be assembled until it is determined that the optical engine to be assembled is completed.

[0088] In this embodiment, it should be noted that after the first, second, and third components are all assembled, the optical engine to be assembled may still be affected by other factors, resulting in failure to meet the usage requirements. Therefore, after the third component is assembled, the changes in the imaging images during the assembly process and the imaging images after the third component is assembled can be compared to determine whether assembly errors were introduced during different stages of the assembly process, resulting in the optical engine to be assembled failing to meet the usage requirements. The imaging process images are used to represent the imaging images during the assembly process. Specifically, they can be the imaging images after the first and second components are assembled, i.e., the first imaging image, or the imaging image after the third component is assembled, i.e., the second imaging image. The fourth preset imaging condition is used to represent that the degree of change in the imaging image is less than a preset change threshold.

[0089] As an example, steps F10 to F40 include: acquiring a fifth imaging image of the optical engine to be assembled; detecting whether the degree of change between the fifth imaging image and the imaging process image is less than a fourth preset imaging condition, wherein the imaging process image includes the first imaging image and / or the second imaging image; if the degree of change between the fifth imaging image and the imaging process image is detected to be less than a preset degree of change threshold, then determining that the optical engine to be assembled is assembled; if the degree of change between the fifth imaging image and the imaging process image is detected to be greater than or equal to the preset degree of change threshold, then iteratively adjusting the components of the optical engine to be assembled until determining that the optical engine to be assembled is assembled.

[0090] This application provides a method for adjusting an optical engine to be assembled. Specifically, it acquires a fifth imaging image of the optical engine to be assembled; detects whether the degree of change between the fifth imaging image and the imaging process image is less than a fourth preset imaging condition, wherein the imaging process image includes the first imaging image and / or the second imaging image; if yes, it determines that the optical engine to be assembled is complete; if not, iteratively adjusts the optical engine to be assembled until it is determined that the optical engine to be assembled is complete. In this application embodiment, when adjusting the optical engine to be assembled, the degree of change between the fifth imaging image after the third component is assembled and the imaging process image is compared to determine whether there is a sudden change in the imaging quality of the optical engine to be assembled during the assembly process. When a sudden change in imaging quality occurs, the relative positions of the components of the optical engine to be assembled are finely adjusted to achieve the assembly of the optical engine to be assembled, thereby ensuring that the assembled optical engine meets the user's needs. Therefore, it further improves the assembly accuracy of the optical engine.

[0091] Example 3

[0092] This application also provides an optomechanical assembly apparatus applied to an assembly control system. The assembly control system is used to control the assembly of an optomechanical component to be assembled. The optomechanical component to be assembled includes a first component, a second component, and a third component. (Refer to...) Figure 5 The optomechanical assembly device includes:

[0093] The first acquisition module 101 is used to acquire the first imaging image of the optical engine to be assembled when controlling the first component and the second component to be assembled.

[0094] The detection module 102 is used to detect whether the first component and the second component have been assembled based on the first imaging image;

[0095] The second acquisition module 103 is used to control the third component to be assembled after detecting that the first component and the second component have been assembled, and to acquire the second imaging image of the optical engine to be assembled during the assembly of the third component;

[0096] Assembly module 104 is used to control the third component to make adjustments based on the second imaging image, so as to control the assembly of the optical engine to be assembled to be completed.

[0097] Optionally, the detection module 102 is further configured to:

[0098] Determine the imaging quality pixels in the first imaging frame;

[0099] Based on the first pixel grayscale value of the imaging quality pixel, determine whether the first component and the second component have been assembled.

[0100] Optionally, the detection module 102 is further configured to:

[0101] Based on the first pixel grayscale value of the imaging quality pixel, determine whether the imaging quality of the first imaging image meets the first preset imaging condition.

[0102] If so, then the assembly between the first component and the second component is complete;

[0103] If not, after adjusting the first component and / or the second component, obtain the third imaging image of the optical engine to be assembled;

[0104] The third imaging image is used as the first imaging image, and the execution step is returned: based on the first pixel grayscale value of the imaging quality pixel, it is determined whether the imaging quality of the first imaging image meets the first preset imaging condition.

[0105] Optionally, the assembly module 104 is further configured to:

[0106] Determine the image quality pixel area in the second imaging frame;

[0107] Based on the grayscale value of the second pixel in the imaging quality pixel region, it is determined whether the third component has been assembled.

[0108] If so, then the optical engine to be assembled is confirmed to be assembled.

[0109] If not, the assembly position of the third component is iteratively adjusted according to the imaging uniformity of the second imaging image until the assembly of the third component is detected to be complete.

[0110] Optionally, the assembly module 104 is further configured to:

[0111] Based on the second pixel grayscale value of the imaging quality pixel region, determine whether the imaging uniformity of the second imaging image meets the second preset imaging condition.

[0112] If so, then the optical engine to be assembled is confirmed to be assembled.

[0113] If not, after adjusting the third component, obtain the fourth imaging image of the optical engine to be assembled;

[0114] The fourth imaging image is used as the second imaging image, and the execution steps are returned: Based on the second pixel grayscale value of the imaging quality pixel area, it is determined whether the imaging uniformity of the second imaging image meets the second preset imaging condition.

[0115] Optionally, the assembly module 104 is further configured to:

[0116] Based on the second pixel grayscale value of the imaging quality pixel region, detect whether the pixel grayscale difference corresponding to the second imaging image is the minimum grayscale difference.

[0117] If so, then when the gray value distribution curve constructed by the gray value of the second pixel satisfies the third preset imaging condition, it is determined that the third component is assembled.

[0118] If not, then the third component is determined to be incompletely assembled.

[0119] Optionally, the optomechanical assembly apparatus is further used for:

[0120] Acquire the fifth imaging image of the optical engine to be assembled;

[0121] Detect whether the degree of change between the fifth imaging frame and the imaging process frame is less than the fourth preset imaging condition, wherein the imaging process frame includes the first imaging frame and / or the second imaging frame;

[0122] If so, then the optical engine to be assembled is confirmed to be assembled.

[0123] If not, the optical engine to be assembled is iteratively adjusted until it is determined that the optical engine to be assembled is completed.

[0124] The optomechanical assembly apparatus provided by this invention, employing the optomechanical assembly method described in the above embodiments, solves the technical problem of balancing assembly efficiency and assembly accuracy. Compared with the prior art, the beneficial effects of the optomechanical assembly apparatus provided by this invention are the same as those of the optomechanical assembly method described in the above embodiments, and other technical features of this optomechanical assembly apparatus are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0125] Example 4

[0126] This invention provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the optomechanical assembly method in the first embodiment described above.

[0127] The following is for reference. Figure 6 The diagram illustrates a structural schematic of an electronic device suitable for implementing embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 6The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0128] like Figure 6 As shown, the electronic device may include a processing unit 1001 (e.g., a central processing unit, a graphics processor, etc.) that can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the electronic device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus.

[0129] Typically, the following systems can be connected to I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. The communication devices allow electronic devices to communicate wirelessly or wiredly with other devices to exchange data. Although electronic devices with various systems are shown in the figures, it should be understood that it is not required to implement or possess all the systems shown. More or fewer systems may be implemented alternatively.

[0130] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1009, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.

[0131] The electronic device provided by this invention, employing the optomechanical assembly method described in the above embodiments, solves the technical problem of balancing assembly efficiency and assembly accuracy. Compared with the prior art, the beneficial effects of the electronic device provided by this invention are the same as those of the optomechanical assembly method described in the above embodiments, and other technical features of this electronic device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0132] It should be understood that various parts of this disclosure can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.

[0133] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

[0134] Example 5

[0135] This embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon, which are used to execute the optomechanical assembly method described above.

[0136] The computer-readable storage medium provided in this embodiment of the invention may be, for example, a USB flash drive, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0137] The aforementioned computer-readable storage medium may be included in an electronic device or may exist independently without being assembled into an electronic device.

[0138] The aforementioned computer-readable storage medium carries one or more programs that, when executed by an electronic device, cause the electronic device to: acquire a first imaging image of the optical engine to be assembled while controlling the first component and the second component to assemble; detect, based on the first imaging image, whether the first component and the second component have been assembled; control the third component to assemble after detecting that the first component and the second component have been assembled, and acquire a second imaging image of the optical engine to be assembled during the assembly of the third component; and control the third component to make adjustments based on the second imaging image to control the optical engine to be assembled to be assembled completely.

[0139] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0140] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0141] The modules described in the embodiments of this disclosure can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0142] The computer-readable storage medium provided by this invention stores computer-readable program instructions for executing the above-described optomechanical assembly method, solving the technical problem of balancing assembly efficiency and assembly accuracy. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in the embodiments of this invention are the same as those of the optomechanical assembly method provided in the above embodiments, and will not be repeated here.

[0143] Example 6

[0144] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the optomechanical assembly method described above.

[0145] The computer program product provided in this application solves the technical problem of balancing assembly efficiency and assembly accuracy. Compared with the prior art, the beneficial effects of the computer program product provided in this embodiment are the same as those of the optomechanical assembly method provided in the above embodiments, and will not be repeated here.

[0146] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent scope of this application.

Claims

1. A method for assembling an optomechanical system, characterized in that, An assembly control system is applied, which controls the assembly of an optical engine to be assembled, the optical engine to be assembled including a first component, a second component, and a third component, and the optical engine assembly method includes: When the first component and the second component are assembled, the first imaging image of the optical engine to be assembled is acquired; Based on the first image, it is determined whether the first component and the second component have been fully assembled. The step of detecting whether the first component and the second component are fully assembled based on the first imaging image includes: Image quality pixels are determined in the upper left, upper right, lower left and lower right regions of the first image; Calculate the average first pixel grayscale value of all the imaging quality pixels in the upper left corner region, the upper right corner region, the lower left corner region, and the lower right corner region, and determine whether the average value satisfies the first preset imaging condition. If so, then the assembly between the first component and the second component is complete; If not, after adjusting the first component and / or the second component, obtain the third imaging image of the optical engine to be assembled; The third imaging image is used as the first imaging image, and the execution step is returned: Based on the first pixel grayscale value of the imaging quality pixel, it is determined whether the imaging quality of the first imaging image meets the first preset imaging condition. After detecting that the first component and the second component have been assembled, the third component is controlled to be assembled, and a second imaging image of the optical engine to be assembled is acquired during the assembly of the third component. Determine the image quality pixel area in the second imaging frame; Based on the second pixel grayscale value of the imaging quality pixel region, detect whether the pixel grayscale difference corresponding to the second imaging image is the minimum grayscale difference. If so, then when the gray value distribution curve constructed by the gray value of the second pixel satisfies the third preset imaging condition, it is determined that the third component is assembled. If not, then it is determined that the third component has not been fully assembled; If so, then the optical engine to be assembled is confirmed to be assembled. If not, the assembly position of the third component is iteratively adjusted according to the imaging uniformity of the second imaging image until the assembly of the third component is detected to be complete.

2. The optomechanical assembly method as described in claim 1, characterized in that, The step of iteratively adjusting the assembly position of the third component based on the imaging uniformity of the second imaging image until the assembly of the third component is detected includes: Based on the second pixel grayscale value of the imaging quality pixel region, determine whether the imaging uniformity of the second imaging image meets the second preset imaging condition. If so, then the optical engine to be assembled is confirmed to be assembled. If not, after adjusting the third component, obtain the fourth imaging image of the optical engine to be assembled; The fourth imaging image is used as the second imaging image, and the execution steps are returned: Based on the second pixel grayscale value of the imaging quality pixel area, it is determined whether the imaging uniformity of the second imaging image meets the second preset imaging condition.

3. The optomechanical assembly method as described in claim 1, characterized in that, After the step of iteratively adjusting the assembly position of the third component based on the imaging uniformity of the second imaging image until the assembly of the third component is detected to be complete, the optomechanical assembly method further includes: Acquire the fifth imaging image of the optical engine to be assembled; Detect whether the degree of change between the fifth imaging frame and the imaging process frame is less than the fourth preset imaging condition, wherein the imaging process frame includes the first imaging frame and / or the second imaging frame; If so, then the optical engine to be assembled is confirmed to be assembled. If not, the optical engine to be assembled is iteratively adjusted until it is determined that the optical engine to be assembled is completed.

4. An electronic device, characterized in that, The electronic device includes: At least one processor; A memory that is communicatively connected to the at least one processor; The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the steps of the optomechanical assembly method according to any one of claims 1 to 3.

5. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a program for implementing the optomechanical assembly method, which is executed by a processor to implement the steps of the optomechanical assembly method as described in any one of claims 1 to 3.

Images