A target transfer method, device, equipment and storage medium

By obtaining and sorting the marking coordinates of the Mini LED chip on the transfer device and generating a position information table, the problem of position deviation of the Mini LED chip during the transfer process is solved, and efficient and high-precision transfer is achieved.

CN114240164BActive Publication Date: 2024-11-08合肥欣奕华智能机器股份有限公司
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111555213.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-17
Publication Date
2024-11-08
Estimated Expiration
2041-12-17

AI Technical Summary

Technical Problem

During the Mini LED chip transfer process, the Mini LED chip produces nonlinear stretching on the carrier device, resulting in position deviation, which in turn affects the transfer accuracy and efficiency.

Method used

By obtaining the relative mark coordinates of the target to be transferred under the coordinate system of the transfer device, sorting them based on these coordinates, generating a position information table, and transferring them in sequence according to the table, ensuring high-precision target transfer.

Benefits of technology

It effectively avoids chip deviation problems caused by residual vibration of the transfer device, and achieves efficient and high-precision Mini LED chip transfer.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114240164B_ABST
    Figure CN114240164B_ABST
Patent Text Reader

Abstract

The embodiments of the present application provide a target transfer method, device, equipment and storage medium, which relate to the field of sorting technology. The method includes: the target transfer system obtains the coordinates of the relative marks of multiple targets to be transferred in the coordinate system of the transfer device, and then sorts the multiple targets to be transferred based on the coordinates corresponding to the multiple targets to be transferred to obtain a position information table. Finally, the multiple targets to be transferred are transferred in sequence according to the position information table. When the target to be transferred on the carrying device produces nonlinear stretching or part of the target to be transferred is missing, the target transfer method in the embodiment of the present application avoids the deviation of the target to be transferred from the specified transfer position due to the violent residual vibration of the transfer device after the transfer instruction movement is completed, thereby realizing efficient and high-precision transfer of the target to be transferred.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of sorting technology, and in particular to a target transfer method, device, equipment and storage medium. Background Art

[0002] In the field of Mini LED, after the Mini LED chips are manufactured, they will be transferred in large quantities. Specifically, a large number (usually tens of thousands to hundreds of thousands) of Mini LED chips will be transferred to the target substrate or driver circuit board through high-precision transfer equipment to form an LED array. Figure 1 As shown, when the transfer device transfers the Mini LED chip, the Mini LED chip needs to be loaded into a carrier device and then transferred from the carrier device to a target substrate or a driver circuit board.

[0003] However, after loading the Mini LED chips into the carrier, each Mini LED chip will be stretched nonlinearly, which will cause the actual position of the Mini LED chip to deviate from the original position. Figure 2 At this time, transferring the Mini LED chip from the carrier to the target substrate or driver circuit board will cause the transfer device to generate severe residual vibration after the transfer instruction movement is completed, causing the chip to deviate from the specified transfer position, thereby affecting the accuracy of chip transfer. Summary of the invention

[0004] The embodiments of the present application provide a target transfer method, device, equipment and storage medium for solving the problems of low chip transfer efficiency and low precision.

[0005] On the one hand, an embodiment of the present application provides a target transfer method, the method comprising:

[0006] Obtaining the relative marked coordinates of each of the multiple objects to be transferred in the transfer device coordinate system;

[0007] Based on the coordinates corresponding to the multiple targets to be transferred, the multiple targets to be transferred are sorted to obtain a position information table;

[0008] The multiple targets to be transferred are transferred in sequence according to the location information table.

[0009] Optionally, the step of sorting the multiple targets to be transferred based on the coordinates corresponding to the multiple targets to be transferred to obtain the position information table includes:

[0010] Selecting one target to be transferred from the plurality of targets to be transferred as a reference target;

[0011] Based on the coordinates of the reference target and the coordinates corresponding to the other targets to be transferred, the coordinates of the targets to be transferred that belong to the same group as the reference target are added to the position information table, and a reference model corresponding to the reference target is established;

[0012] Based on the reference model, the next adjacent group of targets to be transferred is determined in sequence, the coordinates of the determined targets to be transferred are added to the position information table, and the next adjacent reference model is determined.

[0013] Optionally, based on the coordinates of the reference target and the coordinates corresponding to the other targets to be transferred, the coordinates of the targets to be transferred that belong to the same group as the reference target are added to the position information table, and a reference model corresponding to the reference target is established, including:

[0014] Iterate the following steps until the iteration stop condition is met:

[0015] Taking the coordinates of the reference target as a reference position, determining a target screening area based on a first lateral distance and a first longitudinal distance, wherein the first lateral distance is determined based on a lateral reference distance, and the first longitudinal distance is determined based on a longitudinal reference distance;

[0016] Based on the coordinates corresponding to the other targets to be transferred, respectively, determining whether there is at least one target to be transferred in the target screening area;

[0017] If so, determining the target closest to the reference target from the at least one target to be transferred, adding the coordinates of the target to the position information table, and adding the coordinates of the target to the reference model as reference coordinates in the reference model, and using the target as the reference target;

[0018] Otherwise, a virtual target is created, the coordinates of the virtual target are added to the reference model as reference coordinates in the reference model, and the virtual target is used as the reference target.

[0019] Optionally, the determining, based on the reference model, a next group of adjacent targets to be transferred in sequence, adding the coordinates of the determined targets to be transferred to the position information table, and determining a next adjacent reference model comprises:

[0020] Iterate the following steps until the iteration stop condition is met:

[0021] For each reference coordinate in the reference model, the following steps are performed respectively:

[0022] Taking a reference coordinate as a reference position, determining a target screening area based on a second lateral distance and a second longitudinal distance, wherein the second lateral distance is determined based on the lateral reference distance, and the second longitudinal distance is determined based on the longitudinal reference distance;

[0023] Based on the coordinates corresponding to the other targets to be transferred, respectively, determining whether there is at least one target to be transferred in the target screening area;

[0024] If yes, then adding the coordinates of the target that is closest to the one reference coordinate in the longitudinal direction among the at least one target to be transferred to the position information table, and adding the coordinates of the target to the next reference model as the reference coordinates in the next reference model;

[0025] otherwise, creating a virtual target, and adding the coordinates of the virtual target to the next reference model as reference coordinates in the next reference model;

[0026] The next reference model is used as the reference model.

[0027] Optionally, the horizontal reference distance and the vertical reference distance are determined in the following manner:

[0028] Selecting N characteristic targets from the multiple targets to be transferred; wherein N is an integer greater than 0;

[0029] For the N characteristic targets, the following steps are performed respectively:

[0030] Based on the distance between each target and a characteristic target, the other targets to be transferred are sorted, and the targets to be transferred that are ranked in the top M positions are selected; where M is an integer greater than 0;

[0031] Based on the coordinates of the one characteristic target and the coordinates of the M targets to be transferred, determining a sub-transverse distance array and a sub-longitudinal distance array of the one characteristic target, wherein the sub-transverse distance array or the sub-longitudinal distance array is not empty;

[0032] The horizontal reference distance and the vertical reference distance are determined based on the sub-horizontal distance arrays and the sub-longitudinal distance arrays corresponding to the N characteristic targets.

[0033] Optionally, the determining of the sub-transverse distance array and the sub-longitudinal distance array of the one characteristic target based on the coordinates of the one characteristic target and the coordinates of the M targets to be transferred includes:

[0034] For the M targets to be transferred, the following steps are performed respectively:

[0035] Based on the coordinates of the one characteristic target and the coordinates of the one to-be-transferred target, determining the lateral distance and the longitudinal distance between the one characteristic target and the one to-be-transferred target;

[0036] If the horizontal distance is greater than or equal to the vertical distance, then adding the horizontal distance to the sub-horizontal distance array;

[0037] If the horizontal distance is smaller than the vertical distance, the vertical distance is added to the sub-vertical distance array.

[0038] Optionally, the determining the horizontal reference distance and the vertical reference distance based on the sub-horizontal distance arrays and the sub-longitudinal distance arrays corresponding to the N characteristic targets respectively includes:

[0039] Merging the sub-lateral distance arrays corresponding to the N characteristic targets to obtain a target lateral distance array, and removing the lateral distances in the target lateral distance array that are greater than the lateral distance threshold;

[0040] Taking the average value of each lateral distance retained in the target lateral distance array as the lateral reference distance;

[0041] Merge the sub-longitudinal distance arrays corresponding to the N characteristic targets to obtain a target longitudinal distance array, and remove the longitudinal distances in the target longitudinal distance array that are greater than the longitudinal distance threshold;

[0042] The average value of each longitudinal distance retained in the target longitudinal distance array is used as the longitudinal reference distance.

[0043] Optionally, before obtaining the coordinates of the relative marks of the multiple objects to be transferred in the transfer device coordinate system, the method further includes:

[0044] Controlling the carrying device in the transfer device to perform multiple movements relative to the visual system along a preset route until a movement stop condition is met, and obtaining the relative marked coordinates of each of the multiple objects to be transferred in the transfer device coordinate system;

[0045] Obtaining the visual field center of the visual system and the coordinates of the visual field center in the transfer device coordinate system;

[0046] wherein, after each movement, the coordinates of the mark on the carrying device, the mark coordinates in the coordinate system of the transfer device, and the coordinates of each target to be transferred within the field of view of the visual system relative to the center of the field of view are determined;

[0047] Based on the mark coordinates, the field of view center coordinates and the coordinates of each target to be transferred relative to the field of view center, the coordinates of each target to be transferred relative to the mark in the transfer device coordinate system are determined.

[0048] On the one hand, an embodiment of the present application provides a target transfer device, the device comprising:

[0049] An acquisition module, used for acquiring the coordinates of the relative marks of each of the multiple objects to be transferred in the transfer device coordinate system;

[0050] A sorting module, used for sorting the multiple targets to be transferred based on the coordinates corresponding to the multiple targets to be transferred, and obtaining a position information table;

[0051] A transfer module is used to transfer the multiple targets to be transferred in sequence according to the location information table.

[0052] Optionally, the sorting module is specifically used to:

[0053] Selecting one target to be transferred from the plurality of targets to be transferred as a reference target;

[0054] Based on the coordinates of the reference target and the coordinates corresponding to the other targets to be transferred, the coordinates of the targets to be transferred that belong to the same group as the reference target are added to the position information table, and a reference model corresponding to the reference target is established;

[0055] Based on the reference model, the next adjacent group of targets to be transferred is determined in sequence, the coordinates of the determined targets to be transferred are added to the position information table, and the next adjacent reference model is determined.

[0056] Optionally, the sorting module is specifically used to:

[0057] Iterate the following steps until the iteration stop condition is met:

[0058] Taking the coordinates of the reference target as a reference position, determining a target screening area based on a first lateral distance and a first longitudinal distance, wherein the first lateral distance is determined based on a lateral reference distance, and the first longitudinal distance is determined based on a longitudinal reference distance;

[0059] Based on the coordinates corresponding to the other targets to be transferred, respectively, determining whether there is at least one target to be transferred in the target screening area;

[0060] If so, determining the target closest to the reference target from the at least one target to be transferred, adding the coordinates of the target to the position information table, and adding the coordinates of the target to the reference model as reference coordinates in the reference model, and using the target as the reference target;

[0061] Otherwise, a virtual target is created, the coordinates of the virtual target are added to the reference model as reference coordinates in the reference model, and the virtual target is used as the reference target.

[0062] Optionally, the sorting module is specifically used to:

[0063] Iterate the following steps until the iteration stop condition is met:

[0064] For each reference coordinate in the reference model, the following steps are performed respectively:

[0065] Taking a reference coordinate as a reference position, determining a target screening area based on a second lateral distance and a second longitudinal distance, wherein the second lateral distance is determined based on the lateral reference distance, and the second longitudinal distance is determined based on the longitudinal reference distance;

[0066] Based on the coordinates corresponding to the other targets to be transferred, respectively, determining whether there is at least one target to be transferred in the target screening area;

[0067] If yes, then adding the coordinates of the target that is closest to the one reference coordinate in the longitudinal direction among the at least one target to be transferred to the position information table, and adding the coordinates of the target to the next reference model as the reference coordinates in the next reference model;

[0068] otherwise, creating a virtual target, and adding the coordinates of the virtual target to the next reference model as reference coordinates in the next reference model;

[0069] The next reference model is used as the reference model.

[0070] Optionally, a distance determination module is further included, and the distance determination module is specifically used to:

[0071] The horizontal reference distance and the vertical reference distance are determined in the following manner:

[0072] Selecting N characteristic targets from the multiple targets to be transferred; wherein N is an integer greater than 0;

[0073] For the N characteristic targets, the following steps are performed respectively:

[0074] Based on the distance between each target and a characteristic target, the other targets to be transferred are sorted, and the targets to be transferred that are ranked in the top M positions are selected; where M is an integer greater than 0;

[0075] Based on the coordinates of the one characteristic target and the coordinates of the M targets to be transferred, determining a sub-transverse distance array and a sub-longitudinal distance array of the one characteristic target, wherein the sub-transverse distance array or the sub-longitudinal distance array is not empty;

[0076] The horizontal reference distance and the vertical reference distance are determined based on the sub-horizontal distance arrays and the sub-longitudinal distance arrays corresponding to the N characteristic targets.

[0077] Optionally, the distance determination module is specifically used to:

[0078] For the M targets to be transferred, the following steps are performed respectively:

[0079] Based on the coordinates of the one characteristic target and the coordinates of the one to-be-transferred target, determining the lateral distance and the longitudinal distance between the one characteristic target and the one to-be-transferred target;

[0080] If the horizontal distance is greater than or equal to the vertical distance, then adding the horizontal distance to the sub-horizontal distance array;

[0081] If the horizontal distance is smaller than the vertical distance, the vertical distance is added to the sub-vertical distance array.

[0082] Optionally, the distance determination module is specifically used to:

[0083] Merging the sub-lateral distance arrays corresponding to the N characteristic targets to obtain a target lateral distance array, and removing the lateral distances in the target lateral distance array that are greater than the lateral distance threshold;

[0084] Taking the average value of each lateral distance retained in the target lateral distance array as the lateral reference distance;

[0085] Merge the sub-longitudinal distance arrays corresponding to the N characteristic targets to obtain a target longitudinal distance array, and remove the longitudinal distances in the target longitudinal distance array that are greater than the longitudinal distance threshold;

[0086] The average value of each longitudinal distance retained in the target longitudinal distance array is used as the longitudinal reference distance.

[0087] Optionally, the acquisition module is further used for:

[0088] Before obtaining the coordinates of the multiple targets to be transferred respectively in the coordinate system of the transfer device relative to the mark, the carrying device in the transfer device is controlled to perform multiple movements relative to the visual system according to a preset route until the movement stop condition is met, thereby obtaining the coordinates of the multiple targets to be transferred respectively in the coordinate system of the transfer device relative to the mark;

[0089] Obtaining the visual field center of the visual system and the coordinates of the visual field center in the transfer device coordinate system;

[0090] wherein, after each movement, the coordinates of the mark on the carrying device, the mark coordinates in the coordinate system of the transfer device, and the coordinates of each target to be transferred within the field of view of the visual system relative to the center of the field of view are determined;

[0091] Based on the mark coordinates, the field of view center coordinates and the coordinates of each target to be transferred relative to the field of view center, the coordinates of each target to be transferred relative to the mark in the transfer device coordinate system are determined.

[0092] On the one hand, an embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned target transfer method when executing the program.

[0093] On the one hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program executable by a computer device. When the program is run on the computer device, the computer device executes the steps of the above-mentioned target transfer method.

[0094] In an embodiment of the present application, the target transfer system obtains the coordinates of the relative marks of each of the multiple targets to be transferred in the coordinate system of the transfer device, and then sorts the multiple targets to be transferred based on the coordinates corresponding to each of the multiple targets to be transferred to obtain a position information table. Finally, the multiple targets to be transferred are transferred in sequence according to the position information table. When the target to be transferred on the carrier device produces nonlinear stretching or part of the target to be transferred is missing, the target transfer method in the embodiment of the present application avoids the deviation of the target to be transferred from the specified transfer position due to the violent residual vibration of the transfer device after the transfer instruction movement is completed, thereby realizing efficient and high-precision transfer of the target to be transferred. BRIEF DESCRIPTION OF THE DRAWINGS

[0095] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0096] Figure 1 A schematic diagram of a Mini LED chip arrangement structure provided in an embodiment of the present application;

[0097] Figure 2 A schematic diagram of a Mini LED chip arrangement structure provided in an embodiment of the present application;

[0098] Figure 3 A schematic diagram of a system architecture provided for an embodiment of the present application;

[0099] Figure 4 A flowchart of a target transfer method provided in an embodiment of the present application;

[0100] Figure 5 A schematic diagram of a structure of a target to be transferred provided in an embodiment of the present application;

[0101] Figure 6 A schematic diagram of a structure of a target to be transferred provided in an embodiment of the present application;

[0102] Figure 7 A schematic diagram of a process for adding a location information table provided in an embodiment of the present application;

[0103] Figure 8 A schematic diagram of a process for obtaining a reference model provided in an embodiment of the present application;

[0104] Fig. 9 A schematic diagram of the structure of a target screening area provided in an embodiment of the present application;

[0105] Fig.10 A schematic diagram of the structure of a target screening area provided in an embodiment of the present application;

[0106] Fig.11 A schematic diagram of the structure of a target screening area provided in an embodiment of the present application;

[0107] Fig.12 A schematic diagram of the structure of a target screening area provided in an embodiment of the present application;

[0108] Fig.13 A schematic diagram of a process for obtaining a next reference model provided in an embodiment of the present application;

[0109] Fig.14 A schematic diagram of the structure of a target screening area provided in an embodiment of the present application;

[0110] Fig.15 A schematic diagram of the structure of a target screening area provided in an embodiment of the present application;

[0111] Fig.16 A schematic diagram of a structure of a target to be transferred provided in an embodiment of the present application;

[0112] Fig.17 A schematic diagram of the structure of a target screening area provided in an embodiment of the present application;

[0113] Fig.18A schematic diagram of the structure of a target screening area provided in an embodiment of the present application;

[0114] Fig.19 A schematic diagram of the structure of a target screening area provided in an embodiment of the present application;

[0115] Fig. 20 A schematic diagram of the structure of a target screening area provided in an embodiment of the present application;

[0116] Fig.21 A schematic diagram of a structure of a target to be transferred provided in an embodiment of the present application;

[0117] Fig. 22 A schematic diagram of a structure of a target to be transferred provided in an embodiment of the present application;

[0118] Fig.23 A schematic diagram of the structure of a target transfer device provided in an embodiment of the present application;

[0119] Fig.24 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0120] In order to make the purpose, technical solution and beneficial effects of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0121] refer to Figure 3 , which is a system architecture diagram applicable to an embodiment of the present application, and the system architecture at least includes a terminal device 301 and a target transfer system 302.

[0122] The terminal device 301 is installed with a target application for target transfer, which may be a pre-installed client, a web application, or a small program embedded in other applications, etc. The terminal device 301 may be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc., and may also be built into a transfer device, but is not limited thereto.

[0123] The target transfer system 302 is the background server of the target application and provides services for the target application. The target transfer system 302 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms, and can also be built into the transfer device.

[0124] The terminal device 301 is connected to the target transfer system 302, and may be directly or indirectly connected via wired or wireless communication, which is not limited in the present application.

[0125] The terminal device 301 sends a target transfer instruction to the target transfer system 302, and the target transfer system 302 obtains the coordinates of the multiple targets to be transferred on the carrier device in the coordinate system of the transfer device, and sorts the multiple targets to be transferred based on the corresponding coordinates of the multiple targets to be transferred, and obtains a position information table. Finally, the multiple targets to be transferred are transferred in sequence according to the position information table.

[0126] based on Figure 3 The system architecture diagram, the present application embodiment provides a process of a target transfer method, such as Figure 4 As shown, the process of this method is Figure 4 The target transfer system 302 shown executes the following steps:

[0127] Step S401, obtaining the relative marked coordinates of each of a plurality of objects to be transferred in the transfer device coordinate system.

[0128] like Figure 5 As shown, the transfer device coordinate system is a 2D plane coordinate system consisting of an X-axis and a Y-axis.

[0129] Specifically, a plurality of objects to be transferred are placed on a carrying device of the transfer equipment, and the coordinates of the center positions of the objects to be transferred on the carrying device relative to the mark in the coordinate system of the transfer equipment are obtained.

[0130] Step S402: sorting the multiple targets to be transferred based on the coordinates corresponding to the multiple targets to be transferred, and obtaining a position information table.

[0131] Will Figure 5 The various targets to be transferred are sorted, and the coordinates corresponding to the various targets to be transferred are saved in the position information table. The obtained position information table is shown in Table 1.

[0132] Table 1.

[0133] (2,5) (3,4.5) (4,4.5) (5,4.5) (2.1,4) (3.1,3.4) (4.1,3.5) (5.1,3.5) (2.2,3) (3.2,2.5) (4.3,2.5) (5.2,2.5) (2.3,2) (3.3,1.5) (4.4,1.6) (5.3,1.6)

[0134] Step S403, transferring multiple targets to be transferred in sequence according to the location information table.

[0135] Specifically, the targets to be transferred in the plurality of target groups to be transferred are transferred in sequence according to the order of the X axis from small to large in the transfer device coordinate system.

[0136] For example, the targets to be transferred in Table 1 are transferred in the order of the first column, the second column, the third column and the fourth column, and the targets to be transferred corresponding to the coordinates are transferred.

[0137] In an embodiment of the present application, the target transfer system obtains the coordinates of the relative marks of each of the multiple targets to be transferred in the coordinate system of the transfer device, and then sorts the multiple targets to be transferred based on the coordinates corresponding to each of the multiple targets to be transferred to obtain a position information table. Finally, the multiple targets to be transferred are transferred in sequence according to the position information table. When the target to be transferred on the carrier device produces nonlinear stretching or part of the target to be transferred is missing, the target transfer method in the embodiment of the present application avoids the deviation of the target to be transferred from the specified transfer position due to the violent residual vibration of the transfer device after the transfer instruction movement is completed, thereby realizing efficient and high-precision transfer of the target to be transferred.

[0138] Optionally, before the above step S401, due to the limited field of view of the visual system, only the coordinates of some of the objects to be transferred relative to the mark in the coordinate system of the transfer device can be obtained each time through the field of view of the visual system. Therefore, the carrying device in the transfer device is controlled to perform multiple movements relative to the visual system according to the preset route until the movement stop condition is met, and the coordinates of all the objects to be transferred relative to the mark in the coordinate system of the transfer device are obtained.

[0139] Specifically, the preset route may be an S-shaped route or other preset routes. The transfer device includes a carrying device, a visual system and a target transfer system, and the carrying device also includes a mark. The target transfer system can directly obtain the coordinates of the mark in the transfer device coordinate system, but cannot directly obtain the coordinates of the target to be transferred on the carrying device in the transfer device coordinate system. When the carrying device moves, the mark and the target to be transferred move accordingly by a corresponding distance, but the visual system remains fixed.

[0140] For two consecutive movements of the carrying device, the field of view of the visual system may have a partial overlap area or may have no overlap area.

[0141] When the carrying device moves twice consecutively and the visual system's field of view has a partially overlapping area, the coordinates of all the objects to be transferred are obtained in the coordinate system of the transfer device, which includes the following steps:

[0142] Each time the carrying device moves, the coordinates of the relative marks of each target to be transferred in the visual field of the visual system in the transfer device coordinate system are obtained, and then the coordinates of the relative marks of each target to be transferred in the transfer device coordinate system that are repeatedly obtained in any overlapping area are removed.

[0143] For each movement of the carrying device, the coordinates of each target to be transferred within the field of view of the visual system are obtained in the coordinate system of the transfer device, which includes the following steps:

[0144] Step S501, obtaining the field of view center of the visual system, the coordinates of the field of view center in the transfer device coordinate system.

[0145] Specifically, since the visual system remains fixed, the coordinates of the center of the visual field of the visual system are also fixed. Before the carrying device moves, the coordinates of the center of the visual field of the visual system are determined.

[0146] First, obtain the mark coordinates of the mark on the carrier in the transfer device coordinate system, then determine the offset of the field of view center relative to the mark, add the mark and the offset of the field of view center relative to the mark, and then determine the field of view center coordinates in the transfer device coordinate system.

[0147] Step S502, determining the marking coordinates of the marking on the carrying device in the transfer device coordinate system.

[0148] Step S503, determining the relative coordinates of each target to be transferred within the field of view of the visual system relative to the center of the field of view.

[0149] Step S504, based on the mark coordinates, the field of view center coordinates and the coordinates of each target to be transferred relative to the field of view center, the coordinates of each target to be transferred relative to the mark in the transfer device coordinate system are determined.

[0150] Specifically, the coordinates of the center of the field of view and the coordinates of each target to be transferred relative to the center of the field of view are added to determine the coordinates of each target to be transferred in the coordinate system of the transfer device, and then the coordinates of each target to be transferred in the coordinate system of the transfer device are subtracted from the coordinates of the mark in the coordinate system of the transfer device to obtain the coordinates of each target to be transferred relative to the mark in the coordinate system of the transfer device.

[0151] For example, if Figure 6 As shown, the carrying device moves along an S-shaped route. After the carrying device moves for the first time, the field of view of the visual system is area A. There are three targets to be transferred in area A, namely, target 1 to be transferred, target 2 to be transferred, and target 3 to be transferred.

[0152] Determine the coordinates of the visual system's field of view center in the transfer device coordinate system as (Xc, Yc). After the first move, the coordinates of the mark in the transfer device coordinate system are (Xb1, Yb1). At this time, the coordinates of the target 1 to be transferred, the target 2 to be transferred, and the target 3 to be transferred relative to the field of view center are (X1, Y1), (X2, Y2), (X31, Y31). Then, the coordinates of the target 1 to be transferred, the target 2 to be transferred, and the target 3 to be transferred relative to the mark in the transfer device coordinate system are (Xc+X1-Xb1, Yc+Y1-Yb1), (Xc+X2-Xb1, Yc+Y2-Yb1), (Xc+X31-Xb1, Yc+Y31-Yb1).

[0153] After the carrying device moves for the second time, the visual system's field of view is area B, and there are two targets to be transferred in area B, namely target 3 to be transferred and target 4 to be transferred.

[0154] Determine the coordinates of the visual system's field of view center in the transfer device coordinate system as (Xc, Yc). After the second move, the coordinates of the mark in the transfer device coordinate system are (Xb2, Yb2). At this time, the coordinates of the target 3 to be transferred and the target 4 to be transferred relative to the field of view center are (X32, Y32) and (X4, Y4). Then, the coordinates of the target 3 to be transferred and the target 4 to be transferred relative to the mark in the transfer device coordinate system are (Xc+X32-Xb2, Yc+Y32-Yb2) and (Xc+X4-Xb2, Yc+Y4-Yb2).

[0155] Since the relative positions of the mark and the target to be transferred remain unchanged each time the transfer device moves, the difference between the coordinates of the target to be transferred 3 in area A in the mark coordinate system (Xc+X31-Xb1, Yc+Y31-Yb1) and the coordinates of the target to be transferred 3 in area B in the mark coordinate system (Xc+X32-Xb2, Yc+Y32-Yb2) is less than a certain threshold, and the coordinates of the target to be transferred 3 in area B are removed. The final result is the coordinates of the targets to be transferred 1, 2 and 3 in area A relative to the mark in the transfer device coordinate system, and the coordinates of the target to be transferred 4 in area B relative to the mark in the transfer device coordinate system.

[0156] Repeat the above process to obtain the relative marked coordinates of all the targets to be transferred in the transfer device coordinate system.

[0157] In the embodiment of the present application, since the target transfer system directly obtains the coordinates of the mark in the transfer device coordinate system, the coordinates of each target to be transferred on the carrier device relative to the mark in the transfer device coordinate system are obtained through calculation, which facilitates subsequent sorting calculations.

[0158] Optionally, in the above step S402, based on the coordinates corresponding to the multiple targets to be transferred, the multiple targets to be transferred are sorted to obtain a position information table, including the following steps: Figure 7 As shown:

[0159] Step S701, selecting a target to be transferred from multiple targets to be transferred as a reference target.

[0160] Specifically, according to the coordinates of the multiple targets to be transferred relative to each other in the transfer device coordinate system, the target to be transferred with the smallest y coordinate can be selected as the reference target, or the target to be transferred with the largest y coordinate can be selected as the reference target.

[0161] Step S702, based on the coordinates of the reference target and the corresponding coordinates of other targets to be transferred, the coordinates of the targets to be transferred that belong to the same group as the reference target are added to the position information table, and a reference model corresponding to the reference target is established.

[0162] If the target to be transferred with the smallest y coordinate is selected as the reference target, the largest y coordinate is determined from the y coordinates of all targets to be transferred as the iteration stop threshold, and the iteration stop condition is that the y coordinate of the reference target is greater than the iteration stop threshold.

[0163] If the target to be transferred with the largest y coordinate is selected as the reference target, the smallest y coordinate is determined from the y coordinates of all targets to be transferred as the iteration stop threshold, and the iteration stop condition is that the y coordinate of the reference target is less than the iteration stop threshold.

[0164] Iterate the following steps until the iteration stop condition is met, such as Figure 8 As shown:

[0165] Step S801, taking the coordinates of the reference target as the reference position, and determining the target screening area based on a first horizontal distance and a first vertical distance, wherein the first horizontal distance is determined based on the horizontal reference distance, and the first vertical distance is determined based on the vertical reference distance.

[0166] The horizontal reference distance is set to dx, the vertical reference distance is set to dy, the first horizontal distance determined by the horizontal reference distance and the vertical reference distance is set to dx, and the first vertical distance is set to dy.

[0167] If the target to be transferred with the smallest y coordinate is selected as the reference target, the coordinates of the reference target are (Xr, Yr), the first horizontal distance is dx, and the first vertical distance is dy. Therefore, the x-coordinate range of the target screening area is determined to be [Xr-0.5dx, Xr+0.5dx], and the y-coordinate range is [Yr+0.5dy, Yr+1.5dy]. Fig. 9 shown.

[0168] If the target to be transferred with the largest y coordinate is selected as the reference target, the coordinates of the reference target are (Xr, Yr), the first horizontal distance is dx, and the first vertical distance is dy. Therefore, the x-coordinate range of the target screening area is determined to be [Xr-0.5dx, Xr+0.5dx], and the y-coordinate range is [Yr-1.5dy, Yr-0.5dy]. Fig.10 shown.

[0169] Step S802, based on the coordinates corresponding to the other targets to be transferred, determine whether there is at least one target to be transferred in the target screening area, if so, execute step S803; otherwise, execute step S804.

[0170] Step S803, determine the target closest to the reference target from at least one target to be transferred, add the target's coordinates to the location information table, add the target's coordinates to the reference model as reference coordinates in the reference model, and use the target as the reference target.

[0171] Step S804, creating a virtual target, adding the coordinates of the virtual target to the reference model as reference coordinates in the reference model, and using the virtual target as a reference target.

[0172] Specifically, based on the coordinates of the reference target and the longitudinal reference distance, the coordinates of the virtual target are determined.

[0173] If the target to be transferred with the smallest y coordinate is selected as the reference target, the coordinates of the reference target are (Xr, Yr), the longitudinal reference distance is dy, and the coordinates of the virtual target are (Xr, Yr+dy).

[0174] If the target to be transferred with the largest y coordinate is selected as the reference target, the coordinates of the reference target are (X, Yr), the longitudinal reference distance is dy, and the coordinates of the virtual target are (Xr, Yr-dy).

[0175] For example, if Fig.11 As shown, multiple targets to be transferred are included, among which the coordinates of target 1 to be transferred, target 2 to be transferred, target 3 to be transferred, target 4 to be transferred, and target 5 to be transferred are respectively (X1, Y1), (X2, Y2), (X3, Y3), (X4, Y4), and (X5, Y5).

[0176] Target 1 to be transferred with the smallest y coordinate is selected from multiple targets to be transferred as the reference target, and the coordinates (X1, Y1) of target 1 to be transferred are added to the position information table. At the same time, the coordinates (X1, Y1) of target 1 to be transferred are added to the reference model as the reference coordinates in the reference model.

[0177] Taking the coordinates (X1, Y1) of the target 1 to be transferred as the reference position, determine the x-coordinate range of the target screening area as [X1-0.5dx, X1+0.5dx], and the y-coordinate range as [Y1+0.5dy, Y1+1.5dy], such as Fig.11 shown.

[0178] There is a target 2 to be transferred in the target screening area. Target 2 to be transferred is taken as the target, the coordinates (X2, Y2) of target 2 to be transferred are added to the position information table, and the coordinates (X2, Y2) of target 2 to be transferred are added to the reference model as the reference coordinates in the reference model. At the same time, target 2 to be transferred is taken as the reference target for the next iteration.

[0179] After taking the target 2 to be transferred as the reference target, the coordinates (X2, Y2) of the target 2 to be transferred are used as the reference position, and the x-coordinate range of the target screening area is determined to be [X2-0.5dx, X2+0.5dx], and the y-coordinate range is [Y2+0.5dy, Y2+1.5dy]. The target screening area is determined as follows Fig.12 As shown. There is no target to be transferred in the target screening area, so a virtual target is created with the coordinates of (X2, Y2+dy). The coordinates of the virtual target (X2, Y2+dy) are added to the reference model as the reference coordinates in the reference model. At the same time, the virtual target is used as the reference target for the next iteration.

[0180] Iterate in sequence, and when the y coordinate of the reference target is greater than the iteration stop threshold, the iteration stops. At this time, the obtained position information table includes the coordinates corresponding to the target 1 to be transferred, the target 2 to be transferred, the target 3 to be transferred, the target 4 to be transferred, and the target 5 to be transferred, which are (X1, Y1), (X2, Y2), (X3, Y3), (X4, Y4), (X5, Y5). The reference coordinates in the reference model are (X1, Y1), (X2, Y2), (X2, Y2+dy), (X3, Y3), (X4, Y4), (X5, Y5).

[0181] In the embodiment of the present application, an iterative method is adopted to add the coordinates of the target to be transferred that belongs to the same group as the reference target to the position information table through the reference target, and establish a reference model corresponding to the reference target. When determining the reference model, if there is no target to be transferred in the target screening area, a virtual target is created, and the coordinates of the virtual target are added to the reference model, thereby avoiding the loss of the target to be transferred due to the fact that the target to be transferred that originally belongs to the next group of targets to be transferred cannot be added to the position information table.

[0182] Determine the number of targets to be transferred that belong to the same group as the reference target, and select the maximum longitudinal distance from the longitudinal distances of the two adjacent targets to be transferred, and determine whether the number of targets to be transferred is greater than or equal to the number setting value and whether the maximum longitudinal distance is less than the distance setting value. If so, it means that the reference model is an available model, and the next adjacent group of targets to be transferred can be determined based on the reference model; if not, it means that the reference model is an unavailable model, and the reference model is re-determined, and the targets to be transferred that belong to the same group as the reference target are re-determined. If all the targets to be transferred are traversed and no available reference model is found, an alarm is issued.

[0183] Step S703: based on the reference model, determine the next group of adjacent targets to be transferred in sequence, add the coordinates of the determined targets to be transferred to the position information table, and determine the next adjacent reference model.

[0184] When obtaining the next group of targets to be transferred adjacent to the right side of the reference model, the maximum x coordinate is determined from the x coordinates of all targets to be transferred as the iteration stop threshold, and the iteration stop condition is that the x coordinates of the reference coordinates in the next reference model are all greater than the iteration stop threshold.

[0185] When obtaining the next adjacent group of targets to be transferred on the left side of the reference model, the minimum x coordinate is determined from the x coordinates of all targets to be transferred as the iteration stop threshold, and the iteration stop condition is that the x coordinates of the reference coordinates in the next reference model are all less than the iteration stop threshold.

[0186] Iterate the following steps until the iteration stop condition is met:

[0187] For each reference coordinate in the reference model, perform the following steps respectively, such as Fig.13 As shown:

[0188] Step S1301, taking a reference coordinate as a reference position, based on a second horizontal distance and a second vertical distance, determining a target screening area, wherein the second horizontal distance is determined based on a horizontal reference distance, and the second vertical distance is determined based on a vertical reference distance.

[0189] The horizontal reference distance is set to dx, the vertical reference distance is set to dy, the second horizontal distance determined by the horizontal reference distance and the vertical reference distance is set to dx, and the second vertical distance is set to 5dy.

[0190] When obtaining the next set of targets to be transferred on the right side of the reference model, the reference coordinates are (Xs, Ys), the x-coordinate range of the target screening area is [Xs+0.5dx, Xs+1.5dx], and the y-coordinate range is [Ys-2.5dy, Ys+2.5dy]. Fig.14 shown.

[0191] When obtaining the next set of targets to be transferred on the left side of the reference model, the reference coordinates are (Xs, Ys), the x-coordinate range of the target screening area is [Xs-1.5dx, Xs-0.5dx], and the y-coordinate range is [Ys-2.5dy, Ys+2.5dy]. Fig.15 shown.

[0192] Step S1302, based on the coordinates corresponding to the other targets to be transferred, determine whether there is at least one target to be transferred in the target screening area, if so, execute step S1303; otherwise, execute step S1304.

[0193] Step S1303, adding the coordinates of the target that is closest to a reference coordinate in the longitudinal direction among at least one target to be transferred to the position information table, and adding the coordinates of the target to the next reference model as the reference coordinates in the next reference model.

[0194] Step S1304: create a virtual target, and add the coordinates of the virtual target to the next reference model as reference coordinates in the next reference model.

[0195] Specifically, based on the reference coordinates in the reference model and other reference coordinates in the next reference model, the coordinates of the virtual target are determined.

[0196] If the next reference model is located on the right side of the reference model, set the created virtual target as the i-th reference coordinate in the next reference model. The reference coordinate in the reference model is (Xs, Ys), the i-1-th reference coordinate in the next reference model is (X', Y'), the horizontal reference distance is dx, the vertical reference distance is dy, and the coordinates of the determined virtual target are (Xs+dx, Y'+dy).

[0197] If the next reference model is located on the left side of the reference model, set the created virtual target as the i-th reference coordinate in the next reference model. The reference coordinate in the reference model is (Xs, Ys), the i-1-th reference coordinate in the next reference model is (X', Y'), the horizontal reference distance is dx, the vertical reference distance is dy, and the coordinates of the determined virtual target are (Xs-dx, Y'+dy).

[0198] After each next reference model is determined, the next reference model is used as the reference model.

[0199] For example, if Fig.16 As shown, the reference model includes 6 reference coordinates, namely reference coordinate (X1, Y1), reference coordinate (X2, Y2), reference coordinate (X3, Y3), reference coordinate (X4, Y4), reference coordinate (X5, Y5), and reference coordinate (X6, Y6).

[0200] When obtaining the next set of targets to be transferred on the right side of the reference model, the x-coordinate range of the target screening area is determined to be [X1+0.5dx, X1+1.5dx] and the y-coordinate range is [Y1-2.5dy, Y1+2.5dy] with the reference coordinate (X1, Y1) as the center. The target screening area is determined as follows: Fig.17 As shown. There is a target 7 to be transferred in the target screening area, the coordinates of the target 7 to be transferred are added to the position information table, and the coordinates (X7, Y7) of the target 7 to be transferred are added to the next reference model as the reference coordinates in the next reference model. At the same time, the target 7 to be transferred does not participate in the subsequent screening.

[0201] Taking the reference coordinates (X2, Y2) as the center, the x-coordinate range of the target screening area is determined to be [X2+0.5dx, X2+1.5dx], and the y-coordinate range is [Y2-2.5dy, Y2+2.5dy]. The determined target screening area is as follows: Fig.18 As shown. There is no target to be transferred in the target screening area, so a virtual target is created, and the coordinates of the virtual target are (X2+dx,Y7+dy). The coordinates of the virtual target are added to the next reference model as the reference coordinates in the next reference model.

[0202] By analogy, finally, according to the 6 reference coordinates (X1, Y1), (X2, Y2), (X3, Y3), (X4, Y4), (X5, Y5), (X6, Y6) in the reference model, the next group of targets to be transferred are determined as target 7, target 8, target 9, target 10, and target 11, and the corresponding coordinates (X7, Y7), (X8, Y8), (X9, Y9), (X10, Y10), (X11, Y11) are added to the position information table. At the same time, the reference coordinates in the next reference model are determined to be (X7, Y7), (X2+dx, Y7+dy), (X8, Y8), (X9, Y9), (X10, Y10), (X11, Y11).

[0203] Finally, the next reference model is used as the reference model to obtain the next set of targets to be transferred on the right side of the reference model for the next iteration.

[0204] When obtaining the next set of targets to be transferred on the left side of the reference model, the x-coordinate range of the target screening area is determined to be [X1-1.5dx, X1-0.5dx] and the y-coordinate range is [Y1-2.5dy, Y1+2.5dy] with the reference coordinate (X1, Y1) as the center. The target screening area is determined as follows: Fig.19As shown. There is a target 12 to be transferred in the target screening area, the coordinates (X12, Y12) of the target 12 to be transferred are added to the position information table, and the coordinates (X12, Y12) of the target 12 to be transferred are added to the next reference model as the reference coordinates in the next reference model. At the same time, the target 12 to be transferred does not participate in subsequent screening.

[0205] Taking the reference coordinates (X2, Y2) as the center, the x-coordinate range of the target screening area is determined to be [X2-1.5dx, X2-0.5dx], and the y-coordinate range is [Y2-2.5dy, Y2+2.5dy]. The determined target screening area is as follows: Fig. 20 As shown. There is a target 13 to be transferred in the target screening area, the coordinates (X13, Y13) of the target 13 to be transferred are added to the position information table, and the coordinates (X13, Y13) of the target 13 to be transferred are added to the next reference model as the reference coordinates in the next reference model. At the same time, the target 13 to be transferred does not participate in subsequent screening.

[0206] By analogy, finally, according to the 6 reference coordinates (X1, Y1), (X2, Y2), (X3, Y3), (X4, Y4), (X5, Y5), (X6, Y6) in the reference model, the next group of targets to be transferred are determined to be target 12, target 13, target 14, target 15, target 16, and target 17, and the corresponding coordinates (X12, Y12), (X13, Y13), (X14, Y14), (X15, Y15), (X16, Y16), (X17, Y17) are added to the position information table. At the same time, the reference coordinates in the next reference model are determined to be (X12, Y12), (X13, Y13), (X14, Y14), (X15, Y15), (X16, Y16), (X17, Y17).

[0207] Finally, the next reference model is used as the reference model to obtain the next set of targets to be transferred on the left side of the reference model for the next iteration.

[0208] In the embodiment of the present application, the next group of adjacent targets to be transferred is determined by the target screening area corresponding to each reference coordinate in the reference model. Since the target to be transferred that is closest to the reference coordinate in the longitudinal direction is selected from the target screening area corresponding to the reference coordinate, the problem of uneven sorting caused by the Y-direction position deviation between the target to be transferred and the next group of targets to be transferred can be effectively solved, ensuring that the targets to be transferred are sorted correctly, and thus the targets to be transferred will not be lost during the transfer.

[0209] Finally, the targets to be transferred in the obtained multiple target groups to be transferred are transferred. Fig.21As shown, the set position information table includes 3 columns of position information, namely the first column of position information, the second column of position information and the third column of position information. The first column of position information includes the coordinates (X12, Y12), (X13, Y13), (X14, Y14), (X15, Y15), (X16, Y16), (X17, Y17) corresponding to the target 12 to be transferred, the target 13 to be transferred, the target 14 to be transferred, the target 15 to be transferred, the target 16 to be transferred, and the target 17 to be transferred. The second column of position information includes the coordinates (X1, Y1), (X2, Y2), (X3, Y3), (X4, Y4), (X5, Y5) corresponding to the target 1 to be transferred, the target 2 to be transferred, the target 3 to be transferred, the target 4 to be transferred, and the target 5 to be transferred. The third column of location information includes the coordinates (X7, Y7), (X8, Y8), (X9, Y9), (X10, Y10), (X11, Y11) corresponding to the target 7, target 8, target 9, target 10, and target 11, respectively.

[0210] According to the order of the X-axis from small to large in the coordinate system of the transfer device, each target to be transferred in the first column of position information is transferred at one time, then each target to be transferred in the second column of position information is transferred at one time, and finally each target to be transferred in the third column of position information is transferred at one time.

[0211] In an embodiment of the present application, the transfer order of each target to be transferred is determined according to the order from small to large of the X-axis in the coordinate system of the transfer device, and each target to be transferred is transferred according to the order. This solves the problem that when the target to be transferred on the carrier device produces nonlinear stretching or part of the target to be transferred is missing, the transfer device produces violent residual vibration after the transfer instruction movement is completed, thereby causing the chip to deviate from the specified transfer position, thereby ensuring the transfer accuracy.

[0212] The horizontal reference distance dx and the vertical reference distance dy are determined in the following way:

[0213] Selecting N characteristic targets from multiple targets to be transferred; wherein N is an integer greater than 0;

[0214] For N feature targets, perform the following steps respectively:

[0215] Based on the distance between each target and a characteristic target, sort the other targets to be transferred, and select the targets to be transferred that are ranked in the top M, where M is an integer greater than 0. Then, based on the coordinates of a characteristic target and the coordinates of the M targets to be transferred, determine the sub-horizontal distance array and the sub-vertical distance array of a characteristic target, where the sub-horizontal distance array or the sub-vertical distance array is not empty. If the sub-horizontal distance array or the sub-vertical distance array is empty, redetermine the characteristic target.

[0216] For the M targets to be transferred, perform the following steps respectively:

[0217] Based on the coordinates of a feature target and the coordinates of a target to be transferred, determine the horizontal distance and vertical distance between a feature target and a target to be transferred. If the horizontal distance is greater than or equal to the vertical distance, add the horizontal distance to the sub-horizontal distance array; if the horizontal distance is less than the vertical distance, add the vertical distance to the sub-vertical distance array.

[0218] Finally, based on the sub-transverse distance arrays and sub-longitudinal distance arrays corresponding to the N characteristic targets, the transverse reference distance and the longitudinal reference distance are determined.

[0219] Specifically, the sub-lateral distance arrays corresponding to the N characteristic targets are merged to obtain the target lateral distance array, and the lateral distances in the target lateral distance array that are greater than the lateral distance threshold are removed; the average value of each lateral distance retained in the target lateral distance array is used as the lateral reference distance;

[0220] The sub-longitudinal distance arrays corresponding to the N characteristic targets are merged to obtain the target longitudinal distance array, and the longitudinal distances in the target longitudinal distance array that are greater than the longitudinal distance threshold are removed; the average value of each longitudinal distance retained in the target longitudinal distance array is used as the longitudinal reference distance.

[0221] Specifically, the lateral distance threshold is dynamically adjusted according to the lateral distance in the target lateral distance array. For example, the minimum lateral distance in the target lateral distance array is obtained, and then 1.5 times the minimum lateral distance is used as the lateral distance threshold.

[0222] The vertical distance threshold is dynamically adjusted according to the vertical distance in the target vertical distance array. For example, the minimum vertical distance in the target vertical distance array is obtained, and then 1.5 times the minimum vertical distance is used as the vertical distance threshold.

[0223] For example, if Fig. 22 As shown, when the characteristic target is target 2 to be transferred, the four targets to be transferred closest to target 2 to be transferred are target 1 to be transferred, target 3 to be transferred, target 4 to be transferred and target 5 to be transferred.

[0224] Determine that the horizontal distance between target 2 to be transferred and target 1 to be transferred is dx1, and the vertical distance is dy1. Since dx1 is less than dy1, add dy1 to the sub-vertical distance array.

[0225] Determine that the horizontal distance between the target 2 to be transferred and the target 3 to be transferred is dx3, and the vertical distance is dy3. Since dx3 is less than dy3, dy3 is added to the sub-vertical distance array.

[0226] Determine that the horizontal distance between the target 2 to be transferred and the target 4 to be transferred is dx4, and the vertical distance is dy4. Since dx4 is greater than dy4, add dx4 to the sub-horizontal distance array.

[0227] Determine that the horizontal distance between target 2 to be transferred and target 5 to be transferred is dx5, and the vertical distance is dy5. Since dx5 is greater than dy5, add dx5 to the sub-horizontal distance array.

[0228] When the characteristic target is the target 2 to be transferred, the sub-transverse distance array includes dx4 and dx5, and the sub-longitudinal distance array includes dy1 and dy3.

[0229] When the characteristic target is target 7 to be transferred, the four targets to be transferred that are closest to target 7 to be transferred are target 6 to be transferred, target 8 to be transferred, target 9 to be transferred, and target 10 to be transferred.

[0230] Determine the horizontal distance between the target 7 to be transferred and the target 6 to be transferred as dx6 and the vertical distance as dy6. Set dx6 less than dy6 and add dy6 to the sub-vertical distance array.

[0231] Determine the horizontal distance between the target 7 to be transferred and the target 8 to be transferred as dx8 and the vertical distance as dy8. Set dx8 to be less than dy8 and add dy8 to the sub-vertical distance array.

[0232] Determine the horizontal distance between the target 7 to be transferred and the target 9 to be transferred as dx9 and the vertical distance as dy9. Set dx9 to be greater than dy9 and add dx9 to the sub-horizontal distance array.

[0233] Determine the horizontal distance between the target 7 to be transferred and the target 10 to be transferred as dx10 and the vertical distance as dy10. Set dx10 to be greater than dy10 and add dx10 to the sub-horizontal distance array.

[0234] When the characteristic target is the target to be transferred 7, the sub-transverse distance array includes dx9 and dx10, and the sub-longitudinal distance array includes dy6 and dy8.

[0235] The two sub-horizontal distance arrays are combined to obtain the target horizontal distance array, and the results are dx4, dx5, dx9 and dx10. The two sub-vertical distance arrays are combined to obtain the target vertical distance array, and the results are dy1, dy3, dy6 and dy8.

[0236] Set dx4 in the target horizontal distance array as the minimum horizontal distance, and use 1.5*dx4 as the horizontal distance threshold. Set dx10 to be greater than the horizontal distance threshold, and delete dx10 from the target horizontal distance array. If dx5 and dx9 are both less than the horizontal distance threshold, they are retained. At this point, the target horizontal distance array includes dx4, dx5, and dx9. Average dx4, dx5, and dx9 as the horizontal reference distance dx.

[0237] Set dy1 in the target longitudinal distance array as the minimum longitudinal distance, and set 1.5*dy1 as the longitudinal distance threshold. Set dy3, dy6, and dy8 to be smaller than the longitudinal distance threshold and retain them. At this time, the target longitudinal distance array includes dy1, dy3, dy6, and dy8. Average dy1, dy3, dy6, and dy8 as the longitudinal reference distance dy.

[0238] In an embodiment of the present application, N feature targets are randomly determined, and for each feature target, the M targets to be transferred that are closest to the target are selected. Then, the final lateral reference distance and longitudinal reference distance are determined to be closer to the distance between the targets to be transferred on the transfer device through the lateral distance and longitudinal distance between the M targets to be transferred and the corresponding feature targets, thereby providing a basis for subsequent correct sorting.

[0239] Based on the same technical concept, the embodiment of the present application provides a target transfer device, such as Fig.23 As shown, the target transfer device 2300 includes:

[0240] An acquisition module 2301 is used to acquire the coordinates of the relative marks of each of the multiple objects to be transferred in the transfer device coordinate system;

[0241] A sorting module 2302 is used to sort the multiple targets to be transferred based on the coordinates corresponding to the multiple targets to be transferred, and obtain a position information table;

[0242] The transfer module 2303 is used to transfer the multiple targets to be transferred in sequence according to the location information table.

[0243] Optionally, the sorting module 2302 is specifically used for:

[0244] Selecting one target to be transferred from the plurality of targets to be transferred as a reference target;

[0245] Based on the coordinates of the reference target and the coordinates corresponding to the other targets to be transferred, the coordinates of the targets to be transferred that belong to the same group as the reference target are added to the position information table, and a reference model corresponding to the reference target is established;

[0246] Based on the reference model, the next adjacent group of targets to be transferred is determined in sequence, the coordinates of the determined targets to be transferred are added to the position information table, and the next adjacent reference model is determined.

[0247] Optionally, the sorting module 2302 is specifically used for:

[0248] Iterate the following steps until the iteration stop condition is met:

[0249] Taking the coordinates of the reference target as a reference position, determining a target screening area based on a first lateral distance and a first longitudinal distance, wherein the first lateral distance is determined based on a lateral reference distance, and the first longitudinal distance is determined based on a longitudinal reference distance;

[0250] Based on the coordinates corresponding to the other targets to be transferred, respectively, determining whether there is at least one target to be transferred in the target screening area;

[0251] If so, determining the target closest to the reference target from the at least one target to be transferred, adding the coordinates of the target to the position information table, and adding the coordinates of the target to the reference model as reference coordinates in the reference model, and using the target as the reference target;

[0252] Otherwise, a virtual target is created, the coordinates of the virtual target are added to the reference model as reference coordinates in the reference model, and the virtual target is used as the reference target.

[0253] Optionally, the sorting module 2302 is specifically used for:

[0254] Iterate the following steps until the iteration stop condition is met:

[0255] For each reference coordinate in the reference model, the following steps are performed respectively:

[0256] Taking a reference coordinate as a reference position, determining a target screening area based on a second lateral distance and a second longitudinal distance, wherein the second lateral distance is determined based on the lateral reference distance, and the second longitudinal distance is determined based on the longitudinal reference distance;

[0257] Based on the coordinates corresponding to the other targets to be transferred, respectively, determining whether there is at least one target to be transferred in the target screening area;

[0258] If yes, then adding the coordinates of the target that is closest to the one reference coordinate in the longitudinal direction among the at least one target to be transferred to the position information table, and adding the coordinates of the target to the next reference model as the reference coordinates in the next reference model;

[0259] otherwise, creating a virtual target, and adding the coordinates of the virtual target to the next reference model as reference coordinates in the next reference model;

[0260] The next reference model is used as the reference model.

[0261] Optionally, a distance determination module 2304 is further included, and the distance determination module 2304 is specifically used to:

[0262] The horizontal reference distance and the vertical reference distance are determined in the following manner:

[0263] Selecting N characteristic targets from the multiple targets to be transferred; wherein N is an integer greater than 0;

[0264] For the N characteristic targets, the following steps are performed respectively:

[0265] Based on the distance between each target and a characteristic target, the other targets to be transferred are sorted, and the targets to be transferred that are ranked in the top M positions are selected; where M is an integer greater than 0;

[0266] Based on the coordinates of the one characteristic target and the coordinates of the M targets to be transferred, determining a sub-transverse distance array and a sub-longitudinal distance array of the one characteristic target, wherein the sub-transverse distance array or the sub-longitudinal distance array is not empty;

[0267] The horizontal reference distance and the vertical reference distance are determined based on the sub-horizontal distance arrays and the sub-longitudinal distance arrays corresponding to the N characteristic targets.

[0268] Optionally, the distance determination module 2304 is specifically used to:

[0269] For the M targets to be transferred, the following steps are performed respectively:

[0270] Based on the coordinates of the one characteristic target and the coordinates of the one to-be-transferred target, determining the lateral distance and the longitudinal distance between the one characteristic target and the one to-be-transferred target;

[0271] If the horizontal distance is greater than or equal to the vertical distance, then adding the horizontal distance to the sub-horizontal distance array;

[0272] If the horizontal distance is smaller than the vertical distance, the vertical distance is added to the sub-vertical distance array.

[0273] Optionally, the distance determination module 2304 is specifically used to:

[0274] Merging the sub-lateral distance arrays corresponding to the N characteristic targets to obtain a target lateral distance array, and removing the lateral distances in the target lateral distance array that are greater than the lateral distance threshold;

[0275] Taking the average value of each lateral distance retained in the target lateral distance array as the lateral reference distance;

[0276] Merge the sub-longitudinal distance arrays corresponding to the N characteristic targets to obtain a target longitudinal distance array, and remove the longitudinal distances in the target longitudinal distance array that are greater than the longitudinal distance threshold;

[0277] The average value of each longitudinal distance retained in the target longitudinal distance array is used as the longitudinal reference distance.

[0278] Optionally, the acquisition module 2301 is further used to:

[0279] Before obtaining the coordinates of the multiple targets to be transferred respectively in the coordinate system of the transfer device relative to the mark, the carrying device in the transfer device is controlled to perform multiple movements relative to the visual system according to a preset route until the movement stop condition is met, thereby obtaining the coordinates of the multiple targets to be transferred respectively in the coordinate system of the transfer device relative to the mark;

[0280] Obtaining the visual field center of the visual system and the coordinates of the visual field center in the transfer device coordinate system;

[0281] wherein, after each movement, the coordinates of the mark on the carrying device, the mark coordinates in the coordinate system of the transfer device, and the coordinates of each target to be transferred within the field of view of the visual system relative to the center of the field of view are determined;

[0282] Based on the mark coordinates, the field of view center coordinates and the coordinates of each target to be transferred relative to the field of view center, the coordinates of each target to be transferred relative to the mark in the transfer device coordinate system are determined.

[0283] Based on the same technical concept, the embodiment of the present application provides a computer device, which may be a terminal or a server, such as Fig.24 As shown, it includes at least one processor 2401 and a memory 2402 connected to the at least one processor. The specific connection medium between the processor 2401 and the memory 2402 is not limited in the embodiment of the present application. Fig.24 For example, the processor 2401 and the memory 2402 are connected via a bus. The bus can be divided into an address bus, a data bus, a control bus, etc.

[0284] In the embodiment of the present application, the memory 2402 stores instructions that can be executed by at least one processor 2401. The at least one processor 2401 can execute the steps included in the above-mentioned target transfer method by executing the instructions stored in the memory 2402.

[0285] Among them, the processor 2401 is the control center of the computer device, which can use various interfaces and lines to connect various parts of the computer device, and perform target transfer by running or executing instructions stored in the memory 2402 and calling data stored in the memory 2402. Optionally, the processor 2401 may include one or more processing units, and the processor 2401 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 2401. In some embodiments, the processor 2401 and the memory 2402 may be implemented on the same chip, and in some embodiments, they may also be implemented separately on independent chips.

[0286] Processor 2401 can be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit (ASIC), a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware processor for execution, or can be executed by a combination of hardware and software modules in the processor.

[0287] Memory 2402, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules. Memory 2402 may include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card-type memory, random access memory (Random Access Memory, RAM), static random access memory (Static Random Access Memory, SRAM), programmable read-only memory (Programmable Read Only Memory, PROM), read-only memory (Read Only Memory, ROM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), magnetic memory, disk, optical disk, etc. Memory 2402 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 2402 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.

[0288] Based on the same inventive concept, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program executable by a computer device. When the program runs on the computer device, the computer device executes the steps of the above-mentioned target transfer method.

[0289] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0290] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0291] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0292] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0293] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A target transfer method, characterized in that: include: Acquire the coordinates of the relative marks of each of a plurality of targets to be transferred in the coordinate system of the transfer device, wherein the targets to be transferred are chips located on a carrier device of the transfer device; Selecting one target to be transferred from the plurality of targets to be transferred as a reference target; Iterate the following steps until the iteration stop condition is met: Taking the coordinates of the reference target as a reference position, determining a target screening area based on a first lateral distance and a first longitudinal distance, wherein the first lateral distance is determined based on a lateral reference distance, and the first longitudinal distance is determined based on a longitudinal reference distance; Based on the coordinates corresponding to the other targets to be transferred, determine whether there is at least one target to be transferred in the target screening area; If yes, determine the target closest to the reference target from the at least one target to be transferred, add the coordinates of the target to the position information table, add the coordinates of the target to the reference model as the reference coordinates in the reference model, and use the target as the reference target; otherwise, creating a virtual target, adding the coordinates of the virtual target to the reference model as reference coordinates in the reference model, and using the virtual target as the reference target; Iterate the following steps until the iteration stop condition is met: For each reference coordinate in the reference model, the following steps are performed respectively: Taking a reference coordinate as a reference position, determining a target screening area based on a second lateral distance and a second longitudinal distance, wherein the second lateral distance is determined based on the lateral reference distance, and the second longitudinal distance is determined based on the longitudinal reference distance; Based on the coordinates corresponding to the other targets to be transferred, determine whether there is at least one target to be transferred in the target screening area; If yes, then adding the coordinates of the target that is closest to the one reference coordinate in the longitudinal direction among the at least one target to be transferred to the position information table, and adding the coordinates of the target to the next reference model as the reference coordinates in the next reference model; otherwise, creating a virtual target, and adding the coordinates of the virtual target to the next reference model as reference coordinates in the next reference model; using the next reference model as the reference model; The multiple targets to be transferred are transferred in sequence according to the location information table.

2. The method according to claim 1, characterized in that The horizontal reference distance and the vertical reference distance are determined in the following manner: Selecting N characteristic targets from the multiple targets to be transferred; wherein N is an integer greater than 0; For the N characteristic targets, the following steps are performed respectively: Based on the distance between each target and a characteristic target, the other targets to be transferred are sorted, and the targets to be transferred that are ranked in the top M positions are selected; where M is an integer greater than 0; Based on the coordinates of the one characteristic target and the coordinates of the M targets to be transferred, determining a sub-transverse distance array and a sub-longitudinal distance array of the one characteristic target, wherein the sub-transverse distance array or the sub-longitudinal distance array is not empty; The horizontal reference distance and the vertical reference distance are determined based on the sub-horizontal distance arrays and the sub-longitudinal distance arrays corresponding to the N characteristic targets.

3. The method according to claim 2, characterized in that The step of determining the sub-transverse distance array and the sub-longitudinal distance array of the one characteristic target based on the coordinates of the one characteristic target and the coordinates of the M targets to be transferred comprises: For the M targets to be transferred, the following steps are performed respectively: Based on the coordinates of the one characteristic target and the coordinates of the one to-be-transferred target, determining the lateral distance and the longitudinal distance between the one characteristic target and the one to-be-transferred target; If the horizontal distance is greater than or equal to the vertical distance, then adding the horizontal distance to the sub-horizontal distance array; If the horizontal distance is smaller than the vertical distance, the vertical distance is added to the sub-vertical distance array.

4. The method according to claim 2, characterized in that The determining the horizontal reference distance and the vertical reference distance based on the sub-horizontal distance arrays and the sub-longitudinal distance arrays corresponding to the N characteristic targets respectively includes: Merging the sub-lateral distance arrays corresponding to the N characteristic targets to obtain a target lateral distance array, and removing the lateral distances in the target lateral distance array that are greater than the lateral distance threshold; Taking the average value of each lateral distance retained in the target lateral distance array as the lateral reference distance; Merge the sub-longitudinal distance arrays corresponding to the N characteristic targets to obtain a target longitudinal distance array, and remove the longitudinal distances in the target longitudinal distance array that are greater than the longitudinal distance threshold; The average value of each longitudinal distance retained in the target longitudinal distance array is used as the longitudinal reference distance.

5. The method according to claim 1, characterized in that Before obtaining the coordinates of the relative marks of the multiple objects to be transferred in the transfer device coordinate system, the method further includes: Controlling the carrying device in the transfer device to perform multiple movements relative to the visual system along a preset route until a movement stop condition is met, and obtaining the coordinates of each of the multiple objects to be transferred relative to the mark in the transfer device coordinate system; Obtaining the visual field center of the visual system and the coordinates of the visual field center in the transfer device coordinate system; wherein, after each movement, the mark on the carrying device, the coordinates of the mark in the coordinate system of the transfer device, and the coordinates of each target to be transferred within the field of view of the visual system relative to the center of the field of view are determined; Based on the mark coordinates, the field of view center coordinates and the coordinates of each target to be transferred relative to the field of view center, the coordinates of each target to be transferred relative to the mark in the transfer device coordinate system are determined.

6. A target transfer device, characterized in that: The target transfer device is used to implement the steps of the method described in any one of claims 1 to 5.

7. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of the method described in any one of claims 1 to 5 are implemented.

8. A computer-readable storage medium, characterized in that: It stores a computer program executable by a computer device, and when the program is run on the computer device, the computer device executes the steps of any method described in claims 1 to 5.