Optical coupling control method, device and computer-readable storage medium

By setting up multiple visual recognition devices in the automated optical coupling device, monitoring and feedback processing status in real time, the problems of low coupling accuracy and high defect rate are solved, and efficient coupling of optical devices and PCB boards are achieved.

CN114693601BActive Publication Date: 2025-08-26SHENZHEN AFALIGHT CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210187682.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-02-28
Publication Date
2025-08-26
Estimated Expiration
2042-02-28

AI Technical Summary

Technical Problem

The existing automated optical coupling devices have problems such as low coupling accuracy and high product failure rate in the coupling process between optical devices and PCB boards, mainly because a single detection point cannot fully detect error accumulation in multiple processes and the limitations of visual detection in a single motion direction.

Method used

Multiple visual recognition devices are set up at different detection points of the automated optical coupling device, and the current processing process is acquired in real time, and the corresponding visual recognition device is triggered for feature analysis, determining the processing status, and output processing abnormality prompts when abnormal, realizing dynamic monitoring and feedback.

Benefits of technology

Through machine vision monitoring at multiple detection points, processing abnormalities can be fully identified, coupling accuracy can be improved, product defect rate can be reduced, and production efficiency can be improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114693601B_ABST
    Figure CN114693601B_ABST
Patent Text Reader

Abstract

The present application provides an optical coupling control method, device, and computer-readable storage medium. The method includes: acquiring the current processing step performed by an automated optical coupling device in real time; triggering a target visual recognition device among multiple visual recognition devices based on the current processing step; performing feature analysis on the visual recognition image to determine the processing status of the current processing step; and outputting a processing abnormality prompt when the processing status is abnormal. Through the implementation of the present application scheme, multiple detection points are combined with machine vision to achieve dynamic monitoring and feedback, which can comprehensively identify coupling abnormalities in different processing steps, effectively improve the coupling accuracy of the automated optical coupling device, and reduce product defect rates.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of product processing technology, and in particular to an optical coupling control method, device, and computer-readable storage medium. Background Art

[0002] Automated optical coupling equipment is used to couple optical devices to PCB boards. In actual applications, the dispensing head dispenses glue at the die-bonding position identified by the PCB board, then vacuum-suctions the optical device and places it on the die-bonding position corresponding to the laser / photodetector on the PCB board. A UV lamp is then used to illuminate the dispensing position to cure the glue, thus completing the entire coupling and die-bonding process.

[0003] In the field of product processing, detecting the processing status of products is an important task. Currently, related technologies only have a single detection point for processing status detection, which usually occurs during the process of aligning the optical device and the PCB board. However, on the one hand, the overall processing flow of optical coupling involves multiple processes, and processing deviations can occur in different processes. Detecting only a single process still cannot avoid error accumulation. On the other hand, the motion control of a single process usually involves multiple motion planes. A single detection point can usually only achieve visual inspection of a single motion direction of the device and cannot achieve comprehensive inspection. Therefore, it can be seen that the coupling accuracy of existing automated optical coupling equipment is low and the product defect rate is high. Summary of the Invention

[0004] The embodiments of the present application provide an optical coupling control method, device, and computer-readable storage medium, which can at least solve the problems of low coupling accuracy and high product defect rate of the automated optical coupling equipment provided in the related art.

[0005] In a first aspect, an embodiment of the present application provides an optical coupling control method, which is applied to an automated optical coupling device, wherein different detection points of the automated optical coupling device are respectively provided with multiple visual recognition devices, and the optical coupling control method includes:

[0006] Acquiring in real time the current processing step performed by the automated optical coupling device;

[0007] triggering a target visual recognition device among the plurality of visual recognition devices based on the current processing step;

[0008] Performing feature analysis on the visual recognition image to determine the processing status of the current processing step;

[0009] When the processing state is processing abnormality, a processing abnormality prompt is output.

[0010] A second aspect of an embodiment of the present application provides an optical coupling control device, which is applied to an automated optical coupling device. Different detection points of the automated optical coupling device are respectively provided with multiple visual recognition devices. The optical coupling control device includes:

[0011] An acquisition module, configured to acquire in real time the current processing step performed by the automated optical coupling device;

[0012] A triggering module, configured to trigger a target visual recognition device among the plurality of visual recognition devices based on the current processing step;

[0013] a determination module, configured to perform feature analysis on the visual recognition image to determine the processing status of the current processing step;

[0014] The prompt module is used to output a processing abnormality prompt when the processing status is processing abnormality.

[0015] A third aspect of an embodiment of the present application provides an electronic device, comprising: a memory, a processor, and a bus; the bus is used to realize connection and communication between the memory and the processor; the processor is used to execute a computer program stored in the memory; when the processor executes the computer program, it implements each step of the optical coupling control method provided in the first aspect of the embodiment of the present application.

[0016] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the optical coupling control method provided in the first aspect of the embodiment of the present application are implemented.

[0017] As can be seen from the above, according to the optical coupling control method, device, and computer-readable storage medium provided by the present application, the current processing step performed by the automated optical coupling equipment is acquired in real time; a target visual recognition device among multiple visual recognition devices is triggered based on the current processing step; feature analysis is performed on the visual recognition image to determine the processing status of the current processing step; and when the processing status is abnormal, a processing abnormality prompt is output. Through the implementation of the present application, multiple detection points are combined with machine vision to achieve dynamic monitoring and feedback, which can fully identify coupling abnormalities in different processing steps, effectively improve the coupling accuracy of the automated optical coupling equipment, and reduce product defect rates. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A schematic diagram of a basic flow chart of an optical coupling control method provided in the first embodiment of the present application;

[0019] Figure 2 A detailed flowchart of an optical coupling control method provided in the second embodiment of the present application;

[0020] Figure 3 A schematic diagram of a program module of an optical coupling control device provided in a third embodiment of the present application;

[0021] Figure 4 This is a schematic structural diagram of an electronic device provided in the fourth embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to make the purpose, features, and advantages of the invention of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts shall fall within the scope of protection of this application.

[0023] A machine vision system is an automated machine that can mimic certain human activities. It uses a machine vision device to convert captured objects into image signals, which are then transmitted to a dedicated image processing system. The image system then calculates the signals to extract the target's features. The system then controls the device's actions based on the resulting analysis to complete a specific function. It can generally perform tasks such as production and assembly, and can be used to replace humans in environments where humans are not adaptable.

[0024] Existing automated optical coupling equipment utilizes machine vision to locate and identify the positions of the optical component and the PCB. A dispensing head dispenses glue at the identified die-bonding location on the PCB. A vacuum suction device (the suction surface) then places the optical component onto the corresponding position of the laser / photodetector on the PCB (the die-bonding location). UV light then illuminates the dispensing location to cure the glue, completing the coupling and die-bonding process. However, this equipment has two main drawbacks:

[0025] First, products displaying coupling anomaly alarms require manual, real-time marking, which is inefficient. Because the coupling detection device is located on the side, facing the direction where the jumper is inserted into the fiber, the machine vision system cannot detect coupling anomalies caused by offsets in the X and Z directions. Therefore, manual, real-time marking of abnormal products with a marker is required to distinguish them. Otherwise, it is difficult to distinguish products with coupling anomalies.

[0026] Second, due to inherent machine errors, not only are there deviations in the position of the optical components and PCB trays, but there are also machine errors due to vacuum pick-and-place deviations, vacuum suction movement errors, and dispensing position errors. The cumulative error value is relatively large. In other words, if the movement error value in a single direction is 1, the error in the placement of the optical component and PCB on the carrier is 1, the position error of the optical component and PCB during loading is 1, and the total error in the movement of the vacuum nozzle and dispensing head is 1. Ignoring other errors and without mutual compensation, the total error value reaches 18. Furthermore, since the machine trajectory is three-dimensional, each machine also has errors in its three-dimensional movement. Furthermore, the optical components and PCBs on the tray inherently have three-dimensional spatial offsets (X, Y, and Z). Due to the extremely high coupling precision requirements for optical components, existing technologies cannot provide real-time monitoring and feedback to compensate for these errors in the presence of these various machine errors. The cumulative error value is very large, resulting in poor coupling precision and high product defect rates.

[0027] In order to solve the problems of low coupling accuracy and high product defective rate of the automated optical coupling equipment provided in the related art, the first embodiment of the present application provides an optical coupling control method, which is applied to the automated optical coupling equipment. Different detection points of the automated optical coupling equipment are respectively provided with multiple visual recognition devices. In a preferred implementation, the multiple visual recognition devices include: a first visual recognition device arranged opposite to the front of the optical device, a second visual recognition device arranged opposite to the back of the optical device, a third visual recognition device arranged opposite to the side of the PCB board, a fourth visual recognition device arranged opposite to the front of the PCB board, and a fifth visual recognition device arranged on the vacuum suction moving device.

[0028] like Figure 1 This is a basic flow chart of the optical coupling control method provided in this embodiment. The optical coupling control method includes the following steps:

[0029] Step 101: Acquire the current processing procedure performed by the automated optical coupling equipment in real time.

[0030] Specifically, the automated optical coupling equipment of this embodiment includes a vacuum suction and movement device, an optical device material movement device, a visual recognition device, a mobile glue dispensing device, a UV curing device, a PCB material movement device, a clip control device, and a display output module. The visual recognition device typically comprises a ring light source and a CCD camera. The overall optical coupling process involves multiple processing steps, such as material movement, glue dispensing, and UV curing. This embodiment captures the current processing step in real time for dynamic monitoring.

[0031] Step 102: trigger a target visual recognition device among the multiple visual recognition devices based on the current processing step.

[0032] Specifically, each processing step corresponds to a different visual inspection point. Taking the third visual recognition device as an example, it is arranged on the side of the PCB board and is used to perform alignment monitoring of the material movement process. In actual applications, each processing step has a sequential timing. In this embodiment, the target visual recognition device is triggered to enter the working state according to the adaptability of the current processing step. Compared with all visual recognition devices being maintained in the working state, it can effectively save power consumption and avoid processing performance loss caused by invalid data. It should be understood that in actual applications, when each process performs processing monitoring, the corresponding target visual recognition device can be one or more, and this embodiment does not make a sole limitation on this.

[0033] In one implementation of this embodiment, the above-mentioned step of triggering a target visual recognition device among multiple visual recognition devices based on the current processing step includes: obtaining a processing accuracy index required by the automated optical coupling equipment; according to the processing accuracy index, determining a target visual recognition device from multiple visual recognition devices with different usage priorities associated with the current processing step; and triggering the target visual recognition device.

[0034] Specifically, in the related art, a single detection point is usually configured by default for a processing procedure, and this detection point corresponds to a visual recognition device. However, in actual applications, a single visual recognition device has certain detection limitations, and there may be certain correlations between different processing procedures. In this case, the visual recognition device set at the detection point of the associated processing procedure can, to a certain extent, make up for the detection limitations of the default visual recognition device of the current processing procedure. Therefore, this embodiment can use the visual recognition device configured by default for each processing procedure as a visual recognition device with a high usage priority, while the visual recognition device configured by default for the associated processing procedure can be used as a visual recognition device with a secondary usage priority for the current processing procedure. It should be noted that there may be multiple associated processing procedures for the current processing procedure. Furthermore, the secondary usage priorities of multiple associated processing procedures can be further subdivided.

[0035] Furthermore, in one implementation of the present embodiment, the above-mentioned step of determining the target visual recognition device from multiple visual recognition devices with different usage priorities associated with the current processing process based on the processing accuracy index includes: comparing the processing accuracy index with a preset index threshold; when the processing accuracy index is less than or equal to the index threshold, obtaining the main visual recognition device as the target visual recognition device from multiple visual recognition devices with different usage priorities associated with the current processing process; when the processing accuracy index is greater than the index threshold, obtaining the main visual recognition device and the auxiliary visual recognition device as the target visual recognition device from multiple visual recognition devices with different usage priorities associated with the current processing process.

[0036] It should be understood that the primary visual recognition device in this embodiment is the default high-priority visual recognition device configured for the current processing step, while the auxiliary visual recognition device is the default low-priority visual recognition device configured for the associated processing step. The required processing accuracy varies across different processing tasks. High processing accuracy requires a more comprehensive visual recognition device, enabling visual monitoring from multiple angles to ensure processing accuracy. Low processing accuracy requires only the default visual recognition device for the inspection point. Using a single visual recognition device simplifies the monitoring process and improves overall product processing efficiency.

[0037] Step 103: Perform feature analysis on the visual recognition image to determine the processing status of the current processing step.

[0038] Specifically, this embodiment performs feature analysis on the visual recognition image collected by the visual recognition device to determine the processing status of the current processing step. The types of processing status may include: material position status and coupling status, among which the material position status includes the optical device placement status, PCB board placement status, and glue dispensing position status. The coupling status mainly refers to the spatial position status between the optical lens and the laser / photodetector during coupling.

[0039] Step 104: When the processing status is abnormal, output a processing abnormality prompt.

[0040] Specifically, this embodiment provides an abnormality prompt when a processing abnormality is identified in each processing step, thereby allowing processing adjustments to be made in a timely manner to ensure the accuracy of the coupled processing.

[0041] In one implementation of this embodiment, after the aforementioned step of determining the processing status of the current processing step, it also includes: when the processing status is a processing abnormality, obtaining corresponding processing correction parameters based on the feature analysis data; and controlling the automated optical coupling equipment to continue executing the current processing step based on the processing correction parameters.

[0042] Specifically, in this embodiment, when processing abnormalities occur, the system can automatically perform correction operations based on image feature analysis data to obtain processing correction parameters, and then control the automated optical coupling equipment to perform processing corrections in real time to correct the processing errors of the current processing step.

[0043] In another implementation of this embodiment, after the aforementioned step of determining the processing status of the current processing step, it also includes: when the processing status is a processing abnormality, obtaining the associated processing steps of the current processing step; determining the processing compensation parameters corresponding to the associated processing steps based on the feature analysis data corresponding to the current processing step; adjusting the default processing parameters of the associated processing steps based on the processing compensation parameters to obtain actual processing parameters; and controlling the automated optical coupling equipment to execute the associated processing steps according to the actual processing parameters.

[0044] Specifically, in actual applications, different processing steps are executed sequentially, and there is a certain correlation between adjacent processing steps. If the current processing step has a processing abnormality, in addition to using the previous implementation method to perform processing corrections in real time in the current processing step, in this implementation method, it is also possible not to choose to perform correction control in the current processing step, but to compensate for the default processing parameters of the subsequent associated processing steps to eliminate the processing errors of the current processing step. Taking the optical device movement step as an example, the PCB movement step is its associated step. If there is an optical device movement deviation in the optical device movement step, it may cause the subsequent alignment to be offset. In this implementation method, it is possible not to choose to perform real-time corrections on the optical device movement step, but to compensate and adjust the default processing parameters of the subsequent PCB movement step, and correct the optical device movement deviation during the execution of the PCB movement step. Therefore, it is equivalent to omitting a special processing correction action, which can effectively improve the efficiency of coupled processing.

[0045] In one implementation of the present embodiment, the aforementioned step of outputting a processing abnormality prompt when the processing status is a processing abnormality includes: when the processing status is a processing abnormality, counting the number of abnormalities of the current processing step in a historical time period; if the number of abnormalities exceeds a preset threshold, locating the cause of the equipment abnormality based on feature analysis data; and outputting a processing abnormality prompt in combination with the cause of the equipment abnormality.

[0046] Specifically, this embodiment takes into account that hardware failures of the automated optical coupling equipment may continuously lead to processing anomalies in a specific process. Therefore, when a processing anomaly occurs, this embodiment can count the number of anomalies that occur in a historical time period. If the number of anomalies is small, it means that it is an accidental anomaly unrelated to the hardware. If the number of anomalies is large, it means that the equipment may have a hardware failure. The hardware anomaly of the equipment can then be located based on the image feature analysis data, and a processing anomaly prompt carrying hardware anomaly information can be output accordingly. In addition to instructing engineers that an anomaly has occurred, the engineer can also be instructed to repair the equipment failure in a timely manner to avoid frequent processing anomalies in the future and improve processing efficiency.

[0047] Based on the technical solution of the embodiment of the present application described above, the current processing step performed by the automated optical coupling equipment is acquired in real time; a target visual recognition device among multiple visual recognition devices is triggered based on the current processing step; feature analysis is performed on the visual recognition image to determine the processing status of the current processing step; and when the processing status is abnormal, a processing abnormality prompt is output. Through the implementation of the solution of the present application, multiple detection points are combined with machine vision to achieve dynamic monitoring and feedback, which can comprehensively identify coupling abnormalities in different processing steps, effectively improve the coupling accuracy of the automated optical coupling equipment, and reduce product defect rates.

[0048] Figure 2 The method in is a refined optical coupling control method provided in the second embodiment of the present application, and the optical coupling control method includes:

[0049] Step 201: Acquire the current processing step performed by the automated optical coupling device and the required processing accuracy index in real time.

[0050] Step 202: According to the processing accuracy index, a target visual recognition device is determined from a plurality of visual recognition devices with different usage priorities associated with the current processing step.

[0051] Step 203: trigger the target visual recognition device to collect visual recognition images.

[0052] Step 204: Perform feature analysis on the visual recognition image to determine the processing status of the current processing step.

[0053] Step 205: When the processing status is abnormal, obtain the associated processing steps of the current processing step.

[0054] Step 206: Determine the machining compensation parameters corresponding to the associated machining process based on the feature analysis data corresponding to the current machining process.

[0055] Step 207: Adjust the default processing parameters of the associated processing steps based on the processing compensation parameters to obtain actual processing parameters.

[0056] Step 208: Control the automated optical coupling equipment to execute the associated processing steps according to the actual processing parameters.

[0057] It should be understood that the size of the serial numbers of the steps in this embodiment does not mean the order in which the steps are executed. The order in which the steps are executed should be determined by their functions and internal logic, and should not constitute a sole limitation on the implementation process of the embodiments of this application.

[0058] Based on the technical solution of the above-mentioned embodiment of the present application, N reference points are used in combination with an intelligent machine vision system to realize dynamic monitoring and feedback. It can not only automatically identify and judge the coupling anomalies caused by the offset in the X and Z directions between the optical lens and the laser or the optical lens and the photodetector, so there is no need for manual marking, it is more convenient to detect the optical coupling in real time, and greatly improve the efficiency of the production line. At the same time, it can feedback data in real time to compensate for the offset value, improve the movement accuracy of the machine, and thus significantly improve the quality of the product. In addition, the present application is applicable not only to the sending end, but also to the receiving end. At the same time, the real-time detection method of the reference point can be extended to various product production equipment that require real-time detection and feedback information.

[0059] Figure 3 The third embodiment of the present application provides an optical coupling control device. The optical coupling control device can be used in an automated optical coupling device, where multiple visual recognition devices are provided at different detection points of the automated optical coupling device. Figure 3 As shown, the optical coupling control device mainly includes:

[0060] An acquisition module 301 is used to acquire the current processing step performed by the automated optical coupling device in real time;

[0061] A triggering module 302 is configured to trigger a target visual recognition device among the multiple visual recognition devices based on the current processing step;

[0062] The determination module 303 is used to perform feature analysis on the visual recognition image to determine the processing status of the current processing step;

[0063] The prompt module 304 is used to output a processing abnormality prompt when the processing status is processing abnormality.

[0064] In some embodiments of this embodiment, the multiple visual identification devices include: a first visual identification device arranged opposite to the front of the optical device, a second visual identification device arranged opposite to the back of the optical device, a third visual identification device arranged opposite to the side of the PCB board, a fourth visual identification device arranged opposite to the front of the PCB board, and a fifth visual identification device arranged on the vacuum suction moving device.

[0065] In some implementations of this embodiment, the optical coupling control device also includes: a correction module, which is used to obtain corresponding processing correction parameters based on feature analysis data when the processing state is processing abnormality; and control the automated optical coupling equipment to continue executing the current processing step based on the processing correction parameters.

[0066] In some other implementations of this embodiment, the optical coupling control device also includes: a compensation module, which is used to: obtain the associated processing process of the current processing process when the processing state is a processing abnormality; determine the processing compensation parameters corresponding to the associated processing process based on the feature analysis data corresponding to the current processing process; adjust the default processing parameters of the associated processing process based on the processing compensation parameters to obtain actual processing parameters; and control the automated optical coupling equipment to execute the associated processing process according to the actual processing parameters.

[0067] In some implementations of this embodiment, the prompt module is specifically used to: when the processing status is processing abnormality, count the number of abnormalities of the current processing step in the historical time period; if the number of abnormalities exceeds the preset threshold, locate the cause of the equipment abnormality based on the feature analysis data; and output a processing abnormality prompt in combination with the cause of the equipment abnormality.

[0068] In some implementations of this embodiment, the trigger module is specifically used to: obtain the processing accuracy index required by the automated optical coupling equipment; determine the target visual recognition device from multiple visual recognition devices with different usage priorities associated with the current processing process based on the processing accuracy index; and trigger the target visual recognition device.

[0069] Furthermore, in some implementations of this embodiment, when the trigger module executes the above-mentioned step of determining the target visual recognition device from multiple visual recognition devices with different usage priorities associated with the current processing process based on the processing accuracy index, it is specifically used to: compare the processing accuracy index with a preset index threshold; when the processing accuracy index is less than or equal to the index threshold, obtain the main visual recognition device as the target visual recognition device from multiple visual recognition devices with different usage priorities associated with the current processing process; when the processing accuracy index is greater than the index threshold, obtain the main visual recognition device and the auxiliary visual recognition device as the target visual recognition device from multiple visual recognition devices with different usage priorities associated with the current processing process.

[0070] It should be noted that the optical coupling control methods in the first and second embodiments can be implemented based on the optical coupling control device provided in this embodiment. Ordinary technicians in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of the optical coupling control device described in this embodiment can refer to the corresponding process in the aforementioned method embodiment and will not be repeated here.

[0071] The optical coupling control device provided in this embodiment acquires the current processing step being performed by the automated optical coupling equipment in real time; triggers a target visual recognition device among multiple visual recognition devices based on the current processing step; performs feature analysis on the visual recognition image to determine the processing status of the current processing step; and outputs a processing abnormality prompt when the processing status indicates a processing abnormality. Through the implementation of this application solution, dynamic monitoring and feedback are achieved by combining multiple detection points with machine vision, enabling comprehensive identification of coupling abnormalities in different processing steps, effectively improving the coupling accuracy of the automated optical coupling equipment and reducing product defect rates.

[0072] See also Figure 4 , Figure 4 This is an electronic device provided in the fourth embodiment of the present application. This electronic device can be used to implement the optical coupling control method in the above embodiments. Figure 4 As shown, the electronic device mainly includes:

[0073] Memory 401, processor 402, bus 403, and a computer program stored in memory 401 and executable on processor 402. Memory 401 and processor 402 are connected via bus 403. When processor 402 executes the computer program, the optical coupling control method described in the aforementioned embodiment is implemented. The number of processors may be one or more.

[0074] The memory 401 can be a high-speed random access memory (RAM) memory or a non-volatile memory such as a disk memory. The memory 401 is used to store executable program codes. The processor 402 is coupled to the memory 401 .

[0075] Furthermore, the embodiment of the present application also provides a computer-readable storage medium, which can be provided in the electronic device in the above embodiments. The computer-readable storage medium can be the above Figure 4 Memory in the illustrated embodiment.

[0076] The computer-readable storage medium stores a computer program that, when executed by a processor, implements the optical coupling control method described in the aforementioned embodiment. Furthermore, the computer-readable storage medium may be a USB flash drive, a mobile hard drive, a read-only memory (ROM), RAM, a magnetic disk, or an optical disk, among other media capable of storing program code.

[0077] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0078] Modules described as separate components may or may not be physically separate, and components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed across multiple network modules. Some or all of these modules may be selected to achieve the purpose of this embodiment based on actual needs.

[0079] In addition, the functional modules in the various embodiments of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into a single module. The above-mentioned integrated modules may be implemented in the form of hardware or software functional modules.

[0080] If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a readable storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the present application. The aforementioned readable storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

[0081] It should be noted that for the aforementioned method embodiments, for ease of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

[0082] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0083] The above is a description of the optical coupling control method, device, and computer-readable storage medium provided in this application. For those skilled in the art, based on the ideas of the embodiments of this application, there may be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. An optical coupling control method, applied to an automated optical coupling device, characterized in that: The automated optical coupling device is provided with a plurality of visual recognition devices at different detection points, and the optical coupling control method includes: Acquiring in real time the current processing step performed by the automated optical coupling device; triggering a target visual recognition device among the plurality of visual recognition devices based on the current processing step; Performing feature analysis on the visual recognition image to determine the processing status of the current processing step; When the processing state is abnormal, outputting a processing abnormality prompt; and, when the processing status is processing abnormality, obtaining the associated processing steps of the current processing step; Determining machining compensation parameters corresponding to the associated machining process based on the feature analysis data corresponding to the current machining process; Adjusting the default processing parameters of the associated processing steps based on the processing compensation parameters to obtain actual processing parameters; Controlling the automated optical coupling device to perform the associated processing steps according to the actual processing parameters; The step of triggering a target visual recognition device among the plurality of visual recognition devices based on the current processing step includes: Obtaining the processing accuracy index required by the automated optical coupling equipment; Comparing the machining accuracy index with a preset index threshold; When the processing accuracy index is less than or equal to the index threshold, obtaining a primary visual recognition device as a target visual recognition device from a plurality of visual recognition devices associated with the current processing step and having different usage priorities; When the processing accuracy index is greater than the index threshold, simultaneously obtaining a primary visual recognition device and an auxiliary visual recognition device from a plurality of visual recognition devices associated with the current processing step and having different usage priorities as target visual recognition devices; The target visual recognition device is triggered.

2. The optical coupling control method according to claim 1, wherein: The multiple visual recognition devices include: a first visual recognition device arranged opposite to the front of the optical device, a second visual recognition device arranged opposite to the back of the optical device, a third visual recognition device arranged opposite to the side of the PCB board, a fourth visual recognition device arranged opposite to the front of the PCB board, and a fifth visual recognition device arranged on the vacuum suction moving device.

3. The optical coupling control method according to claim 1, wherein: After the step of determining the processing status of the current processing step, the method further includes: When the processing state is abnormal, obtaining corresponding processing correction parameters according to the feature analysis data; The automated optical coupling equipment is controlled to continue executing the current processing step according to the processing correction parameter.

4. The optical coupling control method according to claim 1, wherein: The step of outputting a processing abnormality prompt when the processing state is processing abnormality includes: When the processing status is processing abnormality, counting the number of abnormalities of the current processing step in a historical time period; If the number of abnormalities exceeds a preset threshold, locating the cause of the device abnormality based on the feature analysis data; Output processing abnormality prompt based on the cause of the equipment abnormality.

5. An optical coupling control device, applied to automated optical coupling equipment, characterized in that: The automated optical coupling device is provided with a plurality of visual recognition devices at different detection points, and the optical coupling control device includes: An acquisition module, configured to acquire in real time the current processing step performed by the automated optical coupling device; a trigger module, configured to obtain a processing accuracy index required by the automated optical coupling device; compare the processing accuracy index with a preset index threshold; when the processing accuracy index is less than or equal to the index threshold, obtain a primary visual recognition device as a target visual recognition device from a plurality of visual recognition devices with different usage priorities associated with the current processing step; when the processing accuracy index is greater than the index threshold, simultaneously obtain a primary visual recognition device and an auxiliary visual recognition device as target visual recognition devices from a plurality of visual recognition devices with different usage priorities associated with the current processing step; and trigger the target visual recognition device; a determination module, configured to perform feature analysis on the visual recognition image to determine the processing status of the current processing step; A prompt module, configured to output a processing abnormality prompt when the processing state is processing abnormality; And, a compensation module is used to obtain the associated processing process of the current processing process when the processing state is a processing abnormality; determine the processing compensation parameters corresponding to the associated processing process based on the feature analysis data corresponding to the current processing process; adjust the default processing parameters of the associated processing process based on the processing compensation parameters to obtain actual processing parameters; and control the automated optical coupling equipment to execute the associated processing process according to the actual processing parameters.

6. An electronic device, characterized in that: include: Memory, processor, and bus; The bus is used to realize the connection and communication between the memory and the processor; The processor is configured to execute a computer program stored in the memory; When the processor executes the computer program, the steps of the method according to any one of claims 1 to 4 are implemented.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.

Citation Information

Patent Citations

  • Vision-based large structural member mobile manipulator multi-coordinate machining center realizing method

    CN105182905A