A real-time manipulation device for microscopic particles

Abstract

A real-time manipulation device for microscopic particles comprises: a first laser, adapted to generate a first laser; an optical tweezers array generating component comprising: a spatial light modulator, adapted to modulate the wavefront of the first laser according to a received intermediate hologram to obtain a first modulated laser, and to modulate the wavefront of the first laser according to a received target hologram to obtain a second modulated laser; a focusing component, adapted to focus the first modulated laser to generate an intermediate optical tweezers array, and adapted to focus the second modulated laser to generate a target optical tweezers array; a real-time processing component, adapted to simultaneously determine a plurality of intermediate holograms according to the initial positions and final positions of a plurality of target microscopic particles, the real-time processing component further adapted to transmit the plurality of intermediate holograms to the optical tweezers array generating component in a time sequence, and the real-time processing component further adapted to transmit the target hologram to the optical tweezers array generating component.

Description

Technical Field

[0001] The present invention relates to the fields of optics and quantum computing, and in particular to a real-time manipulation device for microscopic particles. Background Art

[0002] Neutral atom quantum computing systems based on optical tweezer arrays are strong contenders for large-scale universal quantum computers. One of their key technologies is the use of optoelectronic devices to form a large-scale, rapidly movable optical tweezer array. By moving the optical tweezer array, the atoms trapped in the tweezers can be moved. An important application scenario of this technology in neutral atom quantum computing experiments is the realization of atomic rearrangement. Atomic rearrangement is a process of manipulating the position of atoms using optical tweezers. A camera is used to identify the position distribution of atoms trapped by the optical tweezers, and the optical tweezers that fail to trap atoms are turned off. The optical tweezers that have trapped atoms are then quickly rearranged into the shape required to implement the quantum algorithm, achieving atomic rearrangement.

[0003] The existing steps for achieving atomic rearrangement are as follows: first, a camera is used to capture the fluorescence of trapped atoms to obtain information about the atomic array; then, a field-programmable logic gate array is used to identify the position distribution of the trapped atoms, infer the movement method of the optical tweezers array required to rearrange the trapped atoms, and calculate the waveform; finally, a digital-to-analog converter is used to convert the digital waveform into an analog signal, which is amplified by the analog front end to drive the acousto-optic deflector to move the optical tweezers, completing the optical tweezers manipulation and achieving atomic rearrangement.

[0004] However, the AOD There is only one dimension, which is not enough for the two-dimensional and three-dimensional atomic arrays commonly seen in quantum computing and quantum simulation. The acousto-optic deflector has insufficient degrees of freedom and cannot move all atoms at the same time, resulting in a slow speed in moving large-scale atomic arrays. In addition, due to the limitation of the device bandwidth, the deflection angle range of the acousto-optic deflector is small, which limits the scale of the optical tweezers array it produces. Therefore, it is necessary to find a method that can move the acousto-optic deflector with higher Optoelectronic devices that manipulate larger-scale atomic arrays have become an urgent need in this technology field. Summary of the Invention

[0005] In view of the above problems, the present invention provides a real-time manipulation device for a microscopic particle array, the manipulation device comprising:

[0006] a first laser, adapted to generate a first laser;

[0007] An optical tweezers array generating component is adapted to receive a plurality of intermediate holograms and a target hologram, and to generate an intermediate optical tweezers array according to each intermediate hologram and a target optical tweezers array according to the target hologram, the optical tweezers array generating component comprising:

[0008] a spatial light modulator adapted to modulate the wavefront of the first laser light according to the received intermediate hologram to obtain a first modulated laser light and to modulate the wavefront of the first laser light according to the received target hologram to obtain a second modulated laser light; and

[0009] a focusing assembly, adapted to focus the first modulated laser light to generate the intermediate optical tweezers array, and adapted to focus the second modulated laser light to generate the target optical tweezers array; and

[0010] a real-time processing component adapted to simultaneously determine a plurality of intermediate holograms based on respective initial positions and respective final positions of a plurality of target microscopic particles, the real-time processing component further adapted to transmit the plurality of intermediate holograms to the optical tweezers array generation component in a time sequence, and after the last intermediate hologram is transmitted, the real-time processing component further adapted to transmit the target hologram to the optical tweezers array generation component;

[0011] Each intermediate optical tweezers array is adapted to trap a plurality of target microscopic particles, and under the action of a plurality of consecutive intermediate optical tweezers, the plurality of target microscopic particles gradually move and approach their respective final positions. After the last intermediate optical tweezers array traps the plurality of target microscopic particles, the target optical tweezers array is adapted to trap the plurality of target microscopic particles and move them to their respective final positions.

[0012] According to an embodiment of the present invention, the real-time processing component includes:

[0013] a planning unit adapted to determine parameter information of each intermediate optical tweezers array based on the initial positions and final positions of the plurality of target microscopic particles, wherein the parameter information of the intermediate optical tweezers includes the positions of all intermediate optical tweezers in the intermediate optical tweezers array and the phases at the positions of all intermediate optical tweezers; wherein the parameter information of different intermediate optical tweezers arrays is determined simultaneously;

[0014] a generating unit adapted to obtain an intermediate hologram corresponding to each intermediate optical tweezers array according to the positions of all intermediate optical tweezers and the phases at the positions of all intermediate optical tweezers; and

[0015] a transmission unit, adapted to transmit the plurality of intermediate holograms and the target hologram to the optical tweezers array generation component in a time sequence;

[0016] Among them, each intermediate optical tweezers in the intermediate optical tweezers array is suitable for moving a target microscopic particle one-to-one, and each target optical tweezers in the target optical tweezers array is suitable for moving a target microscopic particle one-to-one, so that the target microscopic particle moves to the final position.

[0017] According to an embodiment of the present invention, the real-time processing component is further adapted to transmit the initial hologram to the optical tweezers array generation component;

[0018] The optical tweezers array generating component is further adapted to obtain an initial optical tweezers array according to the initial hologram; the initial optical tweezers array comprises a plurality of initial optical tweezers, at least a portion of the initial optical tweezers in the initial optical tweezers array is used to trap microscopic particles, and each initial optical tweezer is adapted to trap one microscopic particle; the target microscopic particle is selected from the microscopic particles trapped by the initial optical tweezers array;

[0019] The real-time manipulation device further comprises:

[0020] A receiving component is adapted to provide the microscopic particles, wherein the receiving component allows the initial optical tweezers array, the intermediate optical tweezers array and the target optical tweezers array to enter.

[0021] According to an embodiment of the present invention, the above-mentioned real-time manipulation device further includes: an imaging component, adapted to image the target microscopic particles.

[0022] According to an embodiment of the present invention, the real-time processing component further includes:

[0023] The determining unit is adapted to determine the initial position of the target microscopic particles according to the image formed by the target microscopic particles.

[0024] According to an embodiment of the present invention, the generating unit includes:

[0025] an inference module, adapted to perform bilinear interpolation processing on the positions of all intermediate optical tweezers in each intermediate optical tweezers array and perform nearest neighbor interpolation processing on the phases at the positions of all intermediate optical tweezers in each intermediate optical tweezers array, and input the processing results into a trained convolutional neural network to obtain an output result; and

[0026] The transformation module is adapted to perform Fourier transformation on the output result to obtain a hologram corresponding to the intermediate optical tweezers array.

[0027] According to an embodiment of the present invention, the real-time processing component further includes:

[0028] a hologram determination unit adapted to generate a transition hologram based on a sample of optical tweezer positions using a Geisberg-Saxon algorithm;

[0029] a label acquisition unit, adapted to perform Fourier transform on the target area of ​​the transition hologram to obtain an intensity matrix loaded with interference information of the target area and a phase matrix loaded with interference information of the target area, and use the intensity matrix loaded with interference information of the target area as an intensity matrix label, and use the phase matrix loaded with interference information of the target area as a phase matrix label;

[0030] a phase acquisition unit adapted to perform Fourier transform on the transition hologram and extract the phase at the position of each optical tweezers position sample from the Fourier transform result to obtain an optical tweezers phase sample;

[0031] an interpolation unit adapted to perform bilinear interpolation processing on the optical tweezers position samples to obtain intensity matrix samples; and adapted to perform nearest neighbor interpolation processing on the optical tweezers phase samples to obtain phase matrix samples;

[0032] an input-output unit, adapted to input the intensity matrix samples and the phase matrix samples into the convolutional neural network model, and output an intensity matrix prediction result and a phase matrix prediction result; and

[0033] An adjustment unit adjusts the parameters of the convolutional neural network using the intensity matrix label, the phase matrix label, the intensity matrix prediction result, and the phase matrix prediction result until the loss function of the convolutional neural network meets a preset condition, thereby obtaining the trained convolutional neural network.

[0034] According to an embodiment of the present invention, the positions of all intermediate optical tweezers in each intermediate optical tweezers array and the phases at the positions of all intermediate optical tweezers are configured to satisfy the following conditions:

[0035] When the optical tweezers arrays trapping the plurality of target microscopic particles are switched, the target microscopic particles can move from the first optical tweezers to the second optical tweezers, and the first optical tweezers and the second optical tweezers are the optical tweezers corresponding to the same target microscopic particle in the two optical tweezers arrays before and after the switching respectively;

[0036] When the optical tweezers array that traps the multiple target microscopic particles is switched, any two target microscopic particles and the optical tweezers they are in will not collide with each other during the movement.

[0037] According to an embodiment of the present invention, the target hologram is a hologram generated by the real-time processing component according to the final positions of the plurality of target microscopic particles or is a preset hologram.

[0038] According to an embodiment of the present invention, the planning unit is further adapted to match a plurality of target microscopic particles with a plurality of target positions, wherein each target microscopic particle corresponds to a target position, and the target position matched with the target microscopic particle is used as the final position of the plurality of microscopic particles.

[0039] According to embodiments of the present invention, a real-time processing component can simultaneously determine multiple intermediate holograms based on the initial and final positions of multiple target microparticles. "Real-time" means that after acquiring the initial positions of the multiple target microparticles, multiple intermediate holograms that meet the requirements can be simultaneously determined based on the initial and final positions of the multiple target microparticles. Furthermore, the resulting multiple intermediate holograms are independent, meaning that the determination of subsequent intermediate holograms is independent of previous intermediate holograms.

[0040] A series of optical tweezers arrays are generated using a spatial light modulator and a focusing assembly to sequentially trap target microscopic particles, thereby achieving movement of the target microscopic particles. Since the optical tweezers arrays generated using the spatial light modulator and the focusing assembly can be one-dimensional, two-dimensional, or three-dimensional, each optical tweezers array generated using the spatial light modulator and the focusing assembly can achieve simultaneous movement of multiple target microscopic particles, regardless of whether the microparticle array formed by the multiple target microscopic particles is one-dimensional, two-dimensional, or three-dimensional. Therefore, embodiments of the present invention can achieve simultaneous movement of one-dimensional, two-dimensional, or three-dimensional microparticle arrays. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 A schematic diagram of a real-time manipulation device for microscopic particles according to an embodiment of the present invention is shown;

[0042] Figure 2 A schematic diagram of a real-time manipulation device for microscopic particles according to another embodiment of the present invention is shown;

[0043] Figure 3 A schematic diagram showing the movement of microscopic particles according to an embodiment of the present invention is shown;

[0044] Figure 4 A flowchart of training a convolutional neural network according to a specific embodiment of the present invention is shown;

[0045] Figure 5 A schematic diagram of a real-time manipulation device for microscopic particles according to another embodiment of the present invention is shown.

[0046] Description of Reference Numerals

[0047] 1First Laser

[0048] 2 Optical tweezers array generation components

[0049] 21Spatial Light Modulator

[0050] 22 Focus Components

[0051] 3 Real-time processing components

[0052] 31 transmission units

[0053] 32 planning units

[0054] 33 generation units

[0055] 34 Determine unit

[0056] 341 capture card

[0057] 342 Analysis Module

[0058] 4 Accommodate components

[0059] 5 Imaging components

[0060] 6First lens assembly

[0061] 7Dichroic Mirror

[0062] 8 Second lens assembly

[0063] 9 imaging focusing lens

[0064] 10First adjustable reflector

[0065] 11 Second adjustable reflector

[0066] 12Third adjustable reflector

[0067] 13 Fourth adjustable reflector

[0068] 14 Fifth adjustable reflector DETAILED DESCRIPTION

[0069] In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0070] The terms used herein are only for describing specific embodiments and are not intended to limit the present invention. The terms "comprise", "include", etc. used herein indicate the presence of the features, steps, operations and / or components, but do not exclude the presence or addition of one or more other features, steps, operations or components.

[0071] All terms used herein, including technical and scientific terms, have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0072] When expressions such as “at least one of A, B, and C, etc.” are used, they should generally be interpreted in accordance with the meaning commonly understood by those skilled in the art. For example, “a system having at least one of A, B, and C” should include but is not limited to systems having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, and C, etc. When expressions such as “at least one of A, B, or C, etc.” are used, they should generally be interpreted in accordance with the meaning commonly understood by those skilled in the art. For example, “a system having at least one of A, B, or C” should include but is not limited to systems having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, and C, etc.

[0073] It should also be noted that directional terms such as "upper," "lower," "front," "back," "left," and "right" mentioned in the embodiments are merely references to the directions in the accompanying drawings and are not intended to limit the scope of protection of the present invention. Throughout the drawings, identical elements are represented by identical or similar reference numerals. Conventional structures or configurations will be omitted where they may cause confusion in understanding the present invention.

[0074] Figure 1 A schematic diagram of a real-time manipulation device for microscopic particles according to an embodiment of the present invention is shown.

[0075] like Figure 1 As shown, the manipulation device includes: a first laser 1, an optical tweezers array generating component 2, and a real-time processing component 3.

[0076] A first laser 1 is configured to generate a first laser. An optical tweezers array generation component 2 is configured to receive multiple intermediate holograms and a target hologram, and to generate an intermediate optical tweezers array based on each intermediate hologram and a target optical tweezers array based on the target hologram. The optical tweezers array generation component 2 includes a spatial light modulator 211 and a focusing component 22. The spatial light modulator 211 is configured to modulate the wavefront of the first laser according to the received intermediate hologram to obtain a first modulated laser and to modulate the wavefront of the first laser according to the received target hologram to obtain a second modulated laser. The focusing component 22 is configured to focus the first modulated laser to generate the intermediate optical tweezers array and to focus the second modulated laser to generate the target optical tweezers array. A real-time processing component 3 is configured to simultaneously determine multiple intermediate holograms based on the initial and final positions of multiple microscopic particles. The real-time processing component 3 is further configured to transmit the multiple intermediate holograms to the optical tweezers array generation component in a timed sequence. After the last intermediate hologram is transmitted, the real-time processing component 3 is further configured to transmit the target hologram to the optical tweezers array generation component. Among them, each intermediate optical tweezers array is suitable for imprisoning multiple target microscopic particles. Under the action of multiple intermediate optical tweezers, multiple target microscopic particles gradually move and approach their respective final positions. After the last intermediate optical tweezers array imprisons multiple target microscopic particles, the target optical tweezers array is suitable for imprisoning multiple target microscopic particles to move multiple target microscopic particles to their respective final positions, thereby realizing the movement of multiple target microscopic particles.

[0077] According to an embodiment of the present invention, the target microscopic particles can be cells, particles with a radius of hundreds of microns, such as colloidal particles, nanoparticles, biological samples, molecules (from biological macromolecules to diatomic molecules), or atoms encoding quantum states in the field of quantum computing.

[0078] The spatial light modulator 21 used in the embodiments of the present invention can be a high-speed phase-type liquid crystal spatial light modulator from Meadowlark, which has a resolution of 1024*1024 and a maximum refresh rate of 2000Hz. This spatial light modulator 21 can be replaced with other types of spatial light modulators, such as electro-optical spatial light modulators and optically addressable spatial light modulators. The refresh rate and resolution of the spatial light modulator can also be selected according to specific needs.

[0079] According to an embodiment of the present invention, a hologram is an image that records light field information. If the spatial light modulator 21 used has both amplitude and phase modulation capabilities, a hologram that simultaneously records the light wave amplitude and phase can be used, allowing the spatial light modulator to modulate the laser wavefront based on the hologram that simultaneously records the light wave amplitude and phase. If the spatial light modulator 21 used only has phase modulation capabilities, a hologram that records the light wave phase can be used, allowing the spatial light modulator to modulate the laser wavefront based on the hologram that records the light wave phase. When the hologram is loaded onto the spatial light modulator 21, each pixel on the spatial light modulator 21 will modulate the amplitude and phase of the incident light accordingly based on the information in the hologram. The spatial light modulator 21 is a device that can change the distribution of the light field. When light impinges on the spatial light modulator 21, it modulates the wavefront of the incident light based on the information in the hologram, thereby changing the field distribution of the incident light, for example, the phase distribution of the light field. This modulation effect causes the outgoing light field to have a one-dimensional, two-dimensional, or three-dimensional structure corresponding to the hologram after focusing, thus creating a one-dimensional, two-dimensional, or three-dimensional optical tweezer array. Depending on the resolution of the high-speed spatial light modulator, the number of optical tweezers generated can range from thousands to hundreds of thousands.

[0080] According to an embodiment of the present invention, optical tweezers are three-dimensional optical potential wells formed by a highly focused laser beam. The intensity of the focused laser beam has an approximate Gaussian or Airy distribution. When the laser beam impinges on a target microparticle (such as an atom), the potential energy of the ground-state atom decreases due to the AC Stark effect. The higher the intensity, the greater the decrease in potential energy, thus creating an optical potential well. Because the intensity distribution of the focused beam approximates a Gaussian or Airy distribution, a nearly simple harmonic potential forms near the deepest part of the optical potential well. The atom is confined to the center of the potential well, effectively trapping the target microparticle in the optical tweezers. For other microparticles, the binding force can be the AC Stark effect, or a combination of scattering and gradient forces. The common point is that the target microparticle is confined to the region of highest light intensity. Therefore, when the light intensity decreases, the target microparticle may escape.

[0081] The optical tweezers array generated by the spatial light modulator 21 and the focusing assembly 22 is used to trap the target microparticles. By switching the hologram, the trapped position of the microparticles can be changed, thereby enabling the movement of the target microparticles. Since the optical tweezers array generated by the spatial light modulator 21 and the focusing assembly 22 can be one-dimensional, two-dimensional, or three-dimensional, each optical tweezers array generated by the spatial light modulator and the focusing assembly can achieve simultaneous movement of multiple target microparticles, regardless of whether the microparticle array formed by the multiple target microparticles is one-dimensional, two-dimensional, or three-dimensional. Therefore, the embodiments of the present invention can achieve simultaneous movement of one-dimensional, two-dimensional, and three-dimensional microparticle arrays.

[0082] According to an embodiment of the present invention, the real-time processing component 3 can simultaneously determine multiple intermediate holograms based on the initial and final positions of multiple target microparticles in real time. "Real-time" means that after obtaining the initial positions of multiple target microparticles, multiple intermediate holograms that meet the requirements can be simultaneously determined based on the initial and final positions of the multiple target microparticles. Furthermore, the resulting multiple intermediate holograms are independent, meaning that the determination of subsequent intermediate holograms is independent of previous intermediate holograms.

[0083] Continue to refer Figure 1 The real-time processing component 3 includes: a transmission unit 31, a planning unit 32, and a generation unit 33.

[0084] The planning unit is adapted to determine parameter information for each intermediate optical tweezers array based on the initial positions and final positions of a plurality of target microscopic particles, wherein the parameter information for the intermediate optical tweezers includes the positions of all intermediate optical tweezers in the intermediate optical tweezers array and the phases at the positions of all intermediate optical tweezers; wherein the parameter information for different intermediate optical tweezers arrays is determined simultaneously. The generation unit 33 is adapted to obtain an intermediate hologram corresponding to the intermediate optical tweezers array based on the positions of all intermediate optical tweezers in each intermediate optical tweezers array and the phases at the positions of all intermediate optical tweezers. wherein the intermediate holograms corresponding to different intermediate optical tweezers arrays are generated simultaneously. The transmission unit 31 is adapted to transmit the initial hologram, the plurality of intermediate holograms, and the target hologram to the optical tweezers array generation component in a time sequence. wherein each intermediate optical tweezer in the intermediate optical tweezers array is adapted to move a target microscopic particle in a one-to-one correspondence, and each target optical tweezer in the target optical tweezers array is adapted to move a target microscopic particle in a one-to-one correspondence, so that the target microscopic particle moves to its final position.

[0085] Multiple target microparticles can be identified using an initial hologram, or not using a hologram (only having a determined position). When multiple target microparticles are identified using an initial hologram, the transmission component in the real-time processing component 3 is further adapted to transmit the initial hologram to the optical tweezers array generation component 2. The optical tweezers array generation component 2 is further adapted to obtain an initial optical tweezers array based on the initial hologram. The specific process is as follows: the spatial light modulator 21 performs a third modulation on the wavefront of the first laser light based on the received initial hologram, and the focusing component 22 focuses the third modulated laser light after the third modulation to obtain an initial optical tweezers array. The initial optical tweezers array includes multiple initial optical tweezers, at least a portion of which are used to trap microparticles, each of which is adapted to trap a single microparticle. The target microparticles are selected from the microparticles trapped by the initial optical tweezers array. The selection method can be specified or selected based on the planning unit.

[0086] According to an embodiment of the present invention, the initial optical tweezers array utilizes the confinement effect of optical tweezers on microscopic particles, so that at least a portion of the optical tweezers confine microscopic particles, thereby achieving random loading of microscopic particles. After completing the loading of microscopic particles, the initial optical tweezers array has two states: one is optical tweezers with microscopic particles trapped inside, and the other is empty optical tweezers that fail to confine atoms. The empty optical tweezers can be closed in the intermediate optical tweezers as needed, and the redundant optical tweezers that confine microscopic particles can also be closed in the intermediate optical tweezers as needed. The microscopic particles therein leave the position of the optical tweezers array on their own under the combined action of their own micro-motion speed and gravity, thereby achieving the purpose of cleaning. Multiple intermediate optical tweezers and target optical tweezers utilize the confinement effect on microscopic particles to achieve the movement of the entire array of trapped microscopic particles when switching holograms. The loading of atoms and molecules by the optical tweezers array is random loading. The loading of microscopic particles other than atoms and molecules by the optical tweezers array can be fixed, fully filled, or random loading. Regardless of whether the microscopic particles can be randomly loaded, the movement or position of the microscopic particle array can be quickly and precisely controlled according to the method of this embodiment.

[0087] Figure 2 A schematic diagram of a real-time manipulation device for a microscopic particle array according to another embodiment of the present invention is shown.

[0088] like Figure 1~Figure 2 As shown, the real-time manipulation device further includes a receiving component 4 .

[0089] When the initial optical tweezers array does not exist, the accommodating component 4 is used to accommodate a plurality of target microscopic particles, and the accommodating component 4 allows the intermediate optical tweezers array and the target optical tweezers array to enter.

[0090] According to an embodiment of the present invention, the methods of generating multiple target microscopic particles are different, and the sources of the target holograms are also different. The planning unit 32 uses the initial positions and final positions of the multiple target microscopic particles and the necessary optical tweezers phase information to simultaneously determine the positions of all intermediate optical tweezers in multiple intermediate optical tweezers arrays and the phases of all intermediate optical tweezers at their positions. The methods are also different.

[0091] According to an embodiment of the present invention, if there is a specified initial hologram and / or a specified target hologram, when determining the positions of all intermediate optical tweezers in each intermediate optical tweezers array and the phases at the positions of all intermediate optical tweezers, in addition to using the initial positions and final positions of multiple target microscopic particles, it is also necessary to use the phases at the positions of all initial optical tweezers in the initial optical tweezers array and / or the phases of all target optical tweezers in the target optical tweezers array.

[0092] According to an embodiment of the present invention, if there is no specified initial hologram and / or target hologram, when determining the positions of all intermediate optical tweezers in each intermediate optical tweezers array and the phases at the positions of all intermediate optical tweezers, in addition to using the initial positions and final positions of multiple target microparticles, it is also necessary to randomly assign the phase at each optical tweezer position of the first intermediate optical tweezers array and / or randomly assign the phase at each optical tweezer position of the target optical tweezers array.

[0093] According to an embodiment of the present invention, Figure 1~Figure 2 The above-mentioned operating device also includes

[0094] The imaging component 5 is suitable for imaging target microscopic particles.

[0095] According to an embodiment of the present invention, the real-time processing component 3 further includes a determination unit 34, which is adapted to determine the initial position of the target microparticles based on the image formed by the target microparticles. The determination unit 34 includes an acquisition card 341 and an analysis module 342. The acquisition card can be, for example, an acquisition card from Dalsa, and the analysis module can be implemented, for example, through a GPU server. The GPU model of the server can be, for example, NVIDIA's GeForce RTX4090, and the CPU model can be, for example, AMD's EPYC 7763. The acquisition card is used to acquire images of the target microparticles, and the analysis module is used to analyze the acquired images as the initial position of the target microparticles. Figure 2 In the example, multiple target microparticles are arranged in two layers, namely the first layer and the second layer. The images of the two layers of target microparticles are collected by the acquisition card 341 and transmitted to the analysis module 342. The analysis module 342 analyzes the images to obtain the initial positions of the multiple target microparticles. When multiple target microparticles are determined by the initial optical tweezers array, the analysis module distinguishes the initial optical tweezers by marking the initial optical tweezers array, for example, marking the initial optical tweezers with a 1 and the initial optical tweezers without a 0, thereby distinguishing the initial optical tweezers.

[0096] exist Figure 2 In the example, the position of each intermediate optical tweezers in the first intermediate optical tweezers array outputted from the planning unit 32 and the phase at the position are expressed as 、 、 …, the position of each intermediate optical tweezers of the second intermediate optical tweezers and the phase at that position are expressed as 、 、 …The position of each intermediate optical tweezers of the Nth intermediate optical tweezers and the phase at that position are expressed as 、 ….in 、 … Corresponding to the first target microscopic particle, 、 To correspond to the second target microscopic particle, and so on.

[0097] The generation unit 33 can precisely control the position and phase of each intermediate tweezer in the intermediate optical tweezer array. Furthermore, the calculation of each intermediate hologram is independent and does not depend on any parameters of the previous intermediate hologram. It relies only on the initial and final positions of all target microparticles. Therefore, the generation unit 33 can simultaneously determine all intermediate holograms of the microparticle array's movement process.

[0098] According to an embodiment of the present invention, all optical tweezers positions in each intermediate optical tweezers array and the phase at each optical tweezers position are configured to satisfy the following conditions: the number of intermediate optical tweezers obtained and the phases and positions of all optical tweezers in each intermediate optical tweezers array are configured to satisfy the following two conditions.

[0099] The first condition is that when the optical tweezers array of multiple target microscopic particles is switched, the microscopic particles in the microscopic particle array (composed of multiple target microscopic particles) can move from the first optical tweezer to the second optical tweezer. The first optical tweezer and the second optical tweezer are the optical tweezers corresponding to the same target microscopic particle in the two optical tweezers arrays before and after the switch, respectively. In the switching state, the first optical tweezer and the second optical tweezer are coherently superimposed. To meet the first condition, it is necessary to ensure that the minimum light intensity formed by interference in the optical tweezers in the switching state is not too small. For example, assuming that the light intensities of the first optical tweezer and the second optical tweezer are almost the same, the light intensity of the optical tweezers in the switching state must be greater than or equal to 27% of the light intensity before and after the switch. To meet this light intensity condition, the position change and phase change amplitude of the optical tweezers corresponding to the same microscopic particle in any two consecutive optical tweezers arrays during the switch cannot be too large.

[0100] Figure 3 A schematic diagram illustrating the movement of microscopic particles according to an embodiment of the present invention is shown.

[0101] like Figure 3 As shown in the figure, assuming that the optical tweezers are Gaussian spots, when the hologram is switched, the intensity of the potential wells of the two optical tweezers corresponding to the same microscopic particle in two consecutive optical tweezers arrays will change. Figure 2The plus sign (+) in the shadow represents the potential well of the optical tweezers before switching (the first one), the slash ( / ) in the shadow represents the potential well of the optical tweezers after switching (the second one), the black solid line represents the total potential well intensity of the coherent superposition of the potential wells of the two optical tweezers, and the hollow circle represents the microscopic particle. As can be seen from the time axis, as time goes by, the potential well intensity of the optical tweezers before switching gradually decreases, while the potential well intensity of the optical tweezers after switching gradually increases. Parts (a) to (c) represent different optical tweezers switching distances. (For the position changes of two optical tweezers corresponding to the same microscopic particle in two consecutive optical tweezers arrays) and different optical tweezers switching phases (The phase difference between the two optical tweezers corresponding to the same microscopic particle in two consecutive optical tweezers arrays) produces different effects. In part (a), =w0, From part (a), we can see that the switching distance of the optical tweezers is small before and after switching, the phase change is small, and the trapped microscopic particles are successfully transferred between the optical tweezers potential wells. In part (b), =2.5w0, From part (b), we can see that the distance between the two optical tweezers before and after switching is large, the potential well overlap area is small, and the trapped microscopic particles cannot pass through and are lost. In part (c), =2w0, , the phase changes of the two optical tweezers before and after switching are close to The overlapping region forms a potential barrier, which makes it difficult for the trapped microscopic particles to cross and cause them to be lost. Where w0 represents the Gaussian beam waist radius of the optical tweezers.

[0102] In an embodiment of the invention, it is necessary to ensure that when switching holograms, the position and phase changes of the two optical tweezers corresponding to the same trapped atom in two consecutive optical tweezers arrays are not too large, thereby ensuring that the microparticle is not lost during movement. According to an embodiment of the present invention, for any two consecutive optical tweezers arrays that are approximately Gaussian and have a beam waist radius of approximately 1 micron, the position change of the optical tweezers corresponding to the same trapped microparticle can be, for example, less than or equal to 1 micron. In any two consecutive optical tweezers arrays, the phase difference of the optical tweezers corresponding to the same trapped microparticle can be, for example, less than or equal to 0.5 rad.

[0103] The second condition is that when the optical tweezers array that traps the multiple target microparticles is switched, any two target microparticles in the microparticle array and the optical tweezers in which they are located will not collide with each other during the movement. In order to meet the second condition, it is necessary to ensure that in any optical tweezers array, the distance between any two optical tweezers that trap the target microparticles cannot be less than the resolution limit of the optical tweezers. Each optical tweezer in the optical tweezers array is a superposition of an Airy disk and a Gaussian spot, and the specific superposition method depends on the setting of the optical path. For each determined optical path setting, the criterion for the resolution limit of the optical tweezers can be calculated. The collision of microparticles usually occurs in larger microparticles, and the energy generated by the collision will cause the loss of particles. For small microparticles, due to the small collision cross-section, it is difficult to produce a collision in the usual sense. At this time, the collision of optical tweezers is more destructive. The collision of optical tweezers refers to the situation where the distance between two optical tweezers is too close, so that the microparticles can escape or be redistributed in the optical tweezers potential well. Redistribution means that at least one microparticle is transferred from the optical tweezers where it was originally located to another.

[0104] According to an embodiment of the present invention, the planning unit 32 performs multi-agent path finding for each target microparticle based on the starting position and final position of each target microparticle, that is, performs collision-free (during the movement of microparticles, no two particles will occupy the same position at the same time) shortest path planning for the target microparticles, and obtains parameter information of the intermediate optical tweezers array that satisfies the above two conditions at the same time based on the planning results.

[0105] According to an embodiment of the present invention, the planning unit 32 is further adapted to match a plurality of target microscopic particles with a plurality of target positions, wherein each target microscopic particle corresponds to a target position, and the target position matched with the target microscopic particle is used as the final position of the plurality of microscopic particles.

[0106] In order to match multiple target microscopic particles with multiple target positions, the planning unit 32 adopts the following matching principles for the multiple target microscopic particles: no collision, shortest total path; and minimum maximum value of a single moving path.

[0107] According to an embodiment of the present invention, to match multiple target microparticles with target positions and obtain parameters for multiple intermediate holograms based on the matching results, the planning unit 32 uses an improved block-wise Hungarian matching algorithm to ensure that, as the microparticle array moves from its initial position to the target position, each microparticle's trajectory (path) is a straight line, the paths between any two microparticles do not intersect, and the total travel distance is minimized. The improved block-wise Hungarian matching algorithm specifically includes the following steps: first, the microparticle array is divided into multiple blocks, and the Hungarian algorithm is applied to each block. During the block division, the algorithm ensures that each block has sufficient microparticles to complete the movement. The improved block-wise Hungarian algorithm enables the determination of the microparticle paths in each block to be performed in parallel, accelerating the calculation speed. Second, linear segmentation is used to divide the path into sufficiently small steps, for example, 20 steps, so that the travel distance of each step is less than or equal to 1 micron. The matching algorithm can be other matching algorithms, such as a greedy algorithm. The path planning and segmentation algorithms can also be replaced with other collision-free path planning algorithms, such as the probabilistic path graph method (PRM). These algorithms can work on other computing devices to replace general-purpose computers (servers), such as small embedded devices, etc. Figures 1 and 2 According to an embodiment of the present invention, the generation unit 33 includes: an inference module and a transformation module.

[0108] The inference module is adapted to perform bilinear interpolation on the positions of all intermediate tweezers in each intermediate tweezer array and nearest neighbor interpolation on the phases of all intermediate tweezers in each intermediate tweezer array. The results are then fed into a trained convolutional neural network to generate outputs. The transformation module is adapted to perform a Fourier transform on the outputs, resulting in a complex matrix. For spatial light modulators with adjustable amplitude and phase, this complex matrix is ​​the hologram. For phase-type spatial light modulators, the argument of this complex matrix is ​​used to generate the hologram corresponding to the intermediate tweezer array.

[0109] According to an embodiment of the present invention, the bilinear interpolation process and the nearest neighbor interpolation process are described in detail below using formulas (1) to (4), taking a two-dimensional case as an example.

[0110] The arbitrary optical tweezers position sample and optical tweezers phase sample are expressed as formula (1):

[0111] (1)

[0112] in, is the position coordinate of any point in the optical tweezers position sample, for The phase at .

[0113] Generate intensity matrix samples according to bilinear interpolation method, any element in the intensity matrix sample It is expressed as formula (2).

[0114] (2)

[0115] The phase matrix samples are generated by the nearest neighbor interpolation method. Any element in the phase matrix sample It is expressed as formula (3).

[0116] (3)

[0117] in, is the Gaussian rounding function, is the fractional part function, and Satisfies formula (4).

[0118] (4)

[0119] In formula (4), q is x or y.

[0120] According to the embodiment of the present invention, due to the use of bilinear interpolation and nearest neighbor interpolation processing, the intermediate optical tweezers array can have the characteristics of super resolution.

[0121] According to an embodiment of the present invention, the transmission unit is adapted to transmit the initial hologram, the intermediate hologram and the target hologram to the spatial light modulator 21 in a time sequence.

[0122] According to an embodiment of the present invention, the real-time processing component 3 further includes a hologram sample determination unit, a label acquisition unit, a phase acquisition unit, an interpolation unit, an input and output unit, and an adjustment unit.

[0123] The hologram determination unit is configured to generate a transition hologram based on the optical tweezers position samples using the Gerchberg-Saxton algorithm (GS algorithm). The label acquisition unit is configured to perform a Fourier transform on the target region of the transition hologram to obtain an intensity matrix containing the interference information of the target region and a phase matrix containing the interference information of the target region. The intensity matrix containing the interference information of the target region serves as the intensity matrix label, and the phase matrix containing the interference information of the target region serves as the phase matrix label. The phase acquisition unit is configured to perform a Fourier transform on the transition hologram and extract the phase at each optical tweezers position sample from the Fourier transform result to obtain an optical tweezers phase sample. The interpolation unit is configured to perform bilinear interpolation on the optical tweezers position samples to obtain an intensity matrix sample, and to perform nearest neighbor interpolation on the optical tweezers phase samples to obtain a phase matrix sample. The input / output unit is configured to input the intensity matrix sample and the phase matrix sample into a convolutional neural network model and output an intensity matrix prediction result and a phase matrix prediction result. The adjustment unit adjusts the parameters of the convolutional neural network using the intensity matrix label, the phase matrix label, the intensity matrix prediction result and the phase matrix prediction result until the loss function of the convolutional neural network meets the preset conditions, thereby obtaining a trained convolutional neural network.

[0124] According to an embodiment of the present invention, the convolutional neural network model is parameter optimized using the difference between the predicted intensity matrix and the predicted phase matrix generated by the convolutional neural network and the labels as a loss function. The difference in the intensity matrix in the loss function can be calculated using, for example, the L1 norm, and the difference in the phase matrix can be calculated using, for example, the L2 norm.

[0125] The training and reasoning of the convolutional neural network model (AI model) used in the embodiment of the present invention are run on a GPU server with two NVIDIA GeForce RTX4090 graphics cards. Because the AI ​​model is lightweight, reasoning can also be performed using small embedded hardware such as FPGA. More AI models can be run simultaneously, and each can independently reason about the hologram, improving computing power. Furthermore, the AI ​​model can be replaced by other algorithms as the core algorithm of the phase-controllable hologram calculation module, such as the grating algorithm and the conjugate gradient descent algorithm, as long as the algorithm has the ability to control the position and phase of the generated optical tweezers. Users can choose the appropriate processing method based on comprehensive factors such as light utilization efficiency and computational overhead.

[0126] Figure 4 A flowchart of training a convolutional neural network according to a specific embodiment of the present invention is shown.

[0127] like Figure 4As shown, the process of training the convolutional neural network is completed using the hologram sample determination unit, label acquisition unit, interpolation unit, phase acquisition unit, input and output unit and adjustment unit.

[0128] First, the hologram sample determination unit is used to obtain optical tweezers position samples with a resolution of 8192. The number of optical tweezers position samples is a random value n, which is p1, p2..., p n , p i Represents the three-dimensional coordinates of the optical tweezers position sample, where i = 1, 2, 3…n. The hologram sample determination unit uses the Geisberg-Saxon algorithm (GS algorithm) to obtain a hologram sample based on n optical tweezers position samples, n and p i For example, random sampling can be used, where n can be 3600. A label acquisition unit performs a Fourier transform on the target region of the hologram sample, for example, the middle (1024×1024) region, to obtain an intensity matrix and a phase matrix for the target region. The intensity matrix of the target region is an intensity matrix carrying the interference information of the target region, and the phase matrix of the target region is a phase matrix carrying the interference information of the target region. The intensity matrix carrying the interference information of the target region serves as the intensity matrix label, and the phase matrix carrying the interference information of the target region serves as the phase matrix label.

[0129] The interpolation unit performs bilinear interpolation on the optical tweezers position samples, generating 1024×1024 intensity matrix samples. The hologram generation unit performs a Fourier transform on the transition hologram (8192×8192) to obtain the phase value at each optical tweezers sample position. Nearest neighbor interpolation is used to generate 1024×1024 phase matrix samples. The input and output units input the intensity and phase matrix samples into the convolutional neural network model, outputting the intensity and phase matrix predictions. The adjustment unit uses the intensity and phase matrix labels to adjust the convolutional neural network until the loss function of the convolutional neural network meets the preset conditions, resulting in a trained convolutional neural network.

[0130] According to an embodiment of the present invention, the ability to control the phase at the location of each intermediate optical tweezer in the intermediate optical tweezer array is a unique capability of convolutional neural networks. The GS algorithm cannot control the phase at the location of any intermediate optical tweezer. At most, it can only constrain the absolute phase change between two consecutive intermediate optical tweezers to not exceed a certain range, where the two consecutive intermediate optical tweezers are the optical tweezers corresponding to the same microparticle in the two intermediate optical tweezer arrays before and after the switching when the intermediate optical tweezer array that traps the microparticle is switched. In addition, to achieve the above-mentioned constraint effect, two prerequisites must be met: First, for two consecutive intermediate holograms, the second intermediate hologram must be iterated with the first hologram as the starting point. Second, the number of iterations must be limited to 3-5 rounds to prevent the phase change from being too large, but this limitation will sacrifice the quality of the hologram. In embodiments of the present invention, the movement of microscopic particles requires minimal phase change. Under this premise, using a convolutional neural network offers at least four advantages over directly generating holograms using the GS algorithm: First, the convolutional neural network can control the phase of each intermediate optical tweezer as it changes position, causing the tweezer phase to evolve toward the phase of the optical tweezer array corresponding to the target hologram. However, the GS algorithm's phase change direction is random, constraining only the absolute amount of phase change. Therefore, if a target hologram is specified, the phase of the last intermediate hologram accumulated will differ significantly from the phase of the optical tweezers corresponding to the target hologram (almost completely random), resulting in the loss of microscopic particles. Consequently, the GS algorithm cannot specify the target hologram or target array, requiring only the last intermediate optical tweezer to be used for subsequent operations, which reduces the reproducibility of subsequent experiments. Second, the convolutional neural network does not rely on iteration, allowing all holograms to be calculated simultaneously and independently. Because the GS algorithm relies on the previous hologram as the starting point for iteration, calculations must complete on one hologram before starting on the next. Third, the convolutional neural network can support super-resolution. The resolution of the GS algorithm depends on the size of the computational matrix. Specifically, for a matrix with an N×N computational scale (8192×8192 in this example), the GS algorithm can only generate optical tweezer positions at the intersections of the N×N grid. However, for a super-resolution convolutional neural network with an N×N scale (1024×1024 in this example), the generated optical tweezer positions are continuous and can be selected within or on the grid. Fourthly, under the same computational scale and hardware conditions, the convolutional neural network is at least an order of magnitude faster than the GS algorithm.

[0131] The computational scale of the hologram must also be modified according to the resolution of the spatial light modulator. The computational scale of the GS algorithm is generally taken as an integer multiple of the resolution, and the computational scale of the neural network is generally taken as the same as the resolution.

[0132] According to an embodiment of the present invention, the containing component 4 is further adapted to clean up the microscopic particles that are not trapped by the initial optical tweezers array.

[0133] According to an embodiment of the present invention, at least a portion of the microparticles trapped in the initial optical tweezers array can be selected based on the matching method of the planning module to form a microparticle array, or a portion of the microparticles trapped in the initial optical tweezers array can be actively cleaned up using the real-time processing component 3, so that the remaining microparticles form a microparticle array.

[0134] According to an embodiment of the present invention, when the microscopic particles are atoms, the accommodating component 4 may be, for example, a vacuum component. The vacuum component is adapted to accommodate the microscopic particles. The vacuum component is further adapted to receive an initial optical tweezers array so that at least a portion of the initial optical tweezers array is loaded with microscopic particles, to sequentially receive a plurality of intermediate optical tweezers arrays so that the plurality of intermediate optical tweezers arrays move the microscopic particles loaded by the initial optical tweezers, and to receive a target optical tweezers array so that the target optical tweezers array moves the loaded microscopic particles to a final position.

[0135] Figure 5 A schematic diagram of a real-time manipulation device for a microscopic particle array according to yet another embodiment of the present invention is shown.

[0136] Please refer to Figure 1 、 Figure 2 and Figure 5 The manipulation device further includes a second laser. The second laser is adapted to emit a second laser light, which is used to excite the target microscopic particles so that the target microscopic particles emit fluorescence. The imaging component images the target microscopic particles based on the fluorescence.

[0137] According to an embodiment of the present invention, the first laser 1 is capable of generating a high-power 813 nm laser beam.

[0138] According to an embodiment of the present invention, the focusing assembly 9 is also suitable for collecting fluorescence. The focusing assembly 9 can be, for example, a NA=0.55 focusing assembly from Special Optics.

[0139] According to an embodiment of the present invention, the manipulation device further includes a first lens assembly 6. The first lens assembly 6 is adapted to change the beam size of the laser light output by the spatial light modulator 21. The first lens assembly 6 is composed of two lenses, which can form a 3:1 beam expander, for example.

[0140] According to an embodiment of the present invention, the manipulation device further includes a dichroic mirror 7, which is adapted to transmit the light beam output by the first lens assembly 6 so that it enters the focusing assembly 9, and is adapted to transmit the fluorescence output by the focusing assembly 9 to the imaging assembly 5. The imaging assembly 5 utilizes an electron multiplying charge-coupled device (EMCCD), or electron multiplying CCD camera, such as the Andor iXon Ultra 888. Alternatively, it can be replaced with another camera or detector array, such as a scientific-grade complementary metal oxide semiconductor (sCMOS, or scientific-grade CMOS camera) or an APD array. Depending on the type of image acquisition device and receiving end, the acquisition card or data readout device may need to be replaced accordingly.

[0141] According to an embodiment of the present invention, at least part of the functionality of one or more of the various units of the real-time processing component 3 can be combined with at least part of the functionality of other units and implemented in a single unit. According to an embodiment of the present disclosure, at least one unit in the real-time processing component 3 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or can be implemented in hardware or firmware through any other reasonable means of circuit integration or packaging, or can be implemented in any one of the three implementation methods of software, hardware, and firmware, or in an appropriate combination of any of these. Alternatively, at least one unit in the real-time processing component 3 can be at least partially implemented as a computer program unit that, when executed, can perform the corresponding functionality. The real-time processing component 3 can use small embedded hardware (such as an FPGA), etc.

[0142] According to an embodiment of the present invention, the manipulation device further includes a second lens assembly 8 and an imaging focusing lens 9. The second lens assembly 8 is used to adjust the size of the microparticle array on the imaging plane of the imaging assembly 5. It consists of two lenses, which can, for example, form a 1:1 beam expander. The microparticle fluorescence is collimated by the focusing assembly 22, then reflected from the dichroic mirror 7, scaled by the second lens assembly 8, and finally focused by the imaging focusing lens 9 onto the imaging assembly 5 to complete the imaging of the microparticle array.

[0143] According to an embodiment of the present invention, the manipulation device further includes a plurality of adjustable reflectors arranged along the optical path, the plurality of adjustable reflectors including a first adjustable reflector 10, a second adjustable reflector 11, a third adjustable reflector 12, a fourth adjustable reflector 13, and a fifth adjustable reflector 14, and the plurality of adjustable reflectors are used to change the propagation direction of light.

[0144] Parameters such as the wavelength and power of each laser in the embodiment of the present invention, the magnification of the second lens assembly 8, the placement and mechanical structure of each adjustable reflector, and the field of view of the imaging focusing lens 9 are all designed according to the requirements of the actual optical tweezers system.

[0145] This embodiment of the present invention can control the position and phase of each tweezer in each intermediate optical tweezer array, and calculate the desired hologram based on the desired tweezer position and phase. Furthermore, the calculation of each hologram is independent, requiring no iteration and relying solely on the user-entered tweezer position and phase information. Therefore, the module can simultaneously calculate all holograms during the tweezer movement process.

[0146] Therefore, the target optical tweezers array also does not depend on the last intermediate hologram of the rearrangement process.

[0147] The manipulation device provided in accordance with an embodiment of the present invention can realize the simultaneous movement of a two-dimensional or three-dimensional array of microscopic particles, and the time consumed for the rearrangement of the microscopic particles is independent of the scale of the microscopic particle array. For an acousto-optic deflector with only one-dimensional parallel movement freedom, the time consumed for the rearrangement grows polynomially with the number of atoms in the array. The manipulation device based on the spatial light modulator of the present application has a three-dimensional parallel movement freedom. For a microscopic particle array with a certain number density, the time consumed for the rearrangement does not increase with the scale. In addition, the movement range of the embodiment of the present invention is large. The deflection range of the laser by the spatial light modulator is much larger than the deflection range of the acousto-optic deflector.

[0148] The above describes embodiments of the present invention. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of the present invention. Although each embodiment has been described separately above, this does not mean that the measures in each embodiment cannot be advantageously used in combination. The scope of the present invention is defined by the appended claims and their equivalents. Without departing from the scope of the present invention, those skilled in the art may make various substitutions and modifications, which are intended to fall within the scope of the present invention.

Claims

1. A real-time manipulation device for microscopic particles, comprising: a first laser, adapted to generate a first laser; An optical tweezers array generating component is adapted to receive a plurality of intermediate holograms and a target hologram, and to generate an intermediate optical tweezers array according to each intermediate hologram and a target optical tweezers array according to the target hologram, the optical tweezers array generating component comprising: a spatial light modulator adapted to modulate the wavefront of the first laser light according to the received intermediate hologram to obtain a first modulated laser light and to modulate the wavefront of the first laser light according to the received target hologram to obtain a second modulated laser light; and a focusing assembly, adapted to focus the first modulated laser light to generate the intermediate optical tweezers array, and adapted to focus the second modulated laser light to generate the target optical tweezers array; and a real-time processing component adapted to simultaneously determine a plurality of intermediate holograms based on respective initial positions and respective final positions of a plurality of target microscopic particles, the real-time processing component further adapted to transmit the plurality of intermediate holograms to the optical tweezers array generation component in a time sequence, and after the transmission of the last intermediate hologram is completed, the real-time processing component further adapted to transmit the target hologram to the optical tweezers array generation component; In which, each of the intermediate optical tweezers arrays is suitable for imprisoning the multiple target microscopic particles. Under the action of continuous intermediate optical tweezers arrays, the multiple target microscopic particles gradually move and approach their respective final positions. After the last intermediate optical tweezers array imprisons the multiple target microscopic particles, the target optical tweezers array is suitable for imprisoning the multiple target microscopic particles to move the multiple target microscopic particles to their respective final positions.

2. The real-time manipulation device according to claim 1, wherein: The real-time processing components include: a planning unit adapted to determine parameter information of each intermediate optical tweezers array based on the initial positions and final positions of the plurality of target microscopic particles, wherein the parameter information of the intermediate optical tweezers includes the positions of all intermediate optical tweezers in the intermediate optical tweezers array and the phases at the positions of all intermediate optical tweezers; wherein the parameter information of different intermediate optical tweezers arrays is determined simultaneously; a generating unit adapted to obtain an intermediate hologram corresponding to each intermediate optical tweezers array according to the positions of all intermediate optical tweezers and the phases at the positions of all intermediate optical tweezers; and a transmission unit, adapted to transmit the plurality of intermediate holograms and the target hologram to the optical tweezers array generation component in a time sequence; Among them, each intermediate optical tweezers in the intermediate optical tweezers array is suitable for moving a target microscopic particle one-to-one, and each target optical tweezers in the target optical tweezers array is suitable for moving a target microscopic particle one-to-one, so that the target microscopic particle moves to the final position.

3. The real-time manipulation device according to claim 1, wherein: The real-time processing component is further adapted to transmit the initial hologram to the optical tweezers array generation component; The optical tweezers array generating component is further adapted to obtain an initial optical tweezers array according to the initial hologram; the initial optical tweezers array comprises a plurality of initial optical tweezers, at least a portion of the initial optical tweezers in the initial optical tweezers array is used to trap microscopic particles, and each initial optical tweezer is adapted to trap one microscopic particle; The target microscopic particles are selected from the microscopic particles trapped by the initial optical tweezers array; The real-time manipulation device further comprises: A receiving component is adapted to provide the microscopic particles, wherein the receiving component allows the initial optical tweezers array, the intermediate optical tweezers array and the target optical tweezers array to enter.

4. The real-time manipulation apparatus according to claim 1, further comprising: The imaging component is suitable for imaging the target microscopic particles.

5. The real-time manipulation device according to claim 4, wherein the real-time processing component further comprises: The determining unit is adapted to determine the initial position of the target microscopic particles according to the image formed by the target microscopic particles.

6. The real-time manipulation device according to claim 2, wherein: The generating unit includes: an inference module, adapted to perform bilinear interpolation processing on the positions of all intermediate optical tweezers in each intermediate optical tweezers array and perform nearest neighbor interpolation processing on the phases at the positions of all intermediate optical tweezers in each intermediate optical tweezers array, and input the processing results into a trained convolutional neural network to obtain an output result; and The transformation module is adapted to perform Fourier transformation on the output result to obtain a hologram corresponding to the intermediate optical tweezers array.

7. The real-time manipulation device according to claim 6, wherein: The real-time processing component also includes: a hologram determination unit adapted to generate a transition hologram based on a sample of optical tweezer positions using a Geisberg-Saxon algorithm; a label acquisition unit, adapted to perform Fourier transform on the target area of ​​the transition hologram to obtain an intensity matrix loaded with interference information of the target area and a phase matrix loaded with interference information of the target area, and use the intensity matrix loaded with interference information of the target area as an intensity matrix label, and use the phase matrix loaded with interference information of the target area as a phase matrix label; a phase acquisition unit adapted to perform Fourier transform on the transition hologram and extract the phase at the position of each optical tweezers position sample from the Fourier transform result to obtain an optical tweezers phase sample; an interpolation unit adapted to perform bilinear interpolation processing on the optical tweezers position samples to obtain intensity matrix samples; and adapted to perform nearest neighbor interpolation processing on the optical tweezers phase samples to obtain phase matrix samples; an input-output unit, adapted to input the intensity matrix samples and the phase matrix samples into the convolutional neural network model, and output an intensity matrix prediction result and a phase matrix prediction result; and An adjustment unit adjusts the parameters of the convolutional neural network using the intensity matrix label, the phase matrix label, the intensity matrix prediction result, and the phase matrix prediction result until the loss function of the convolutional neural network meets a preset condition, thereby obtaining the trained convolutional neural network.

8. The real-time manipulation device according to claim 2, wherein: The positions of all intermediate optical tweezers in each intermediate optical tweezers array and the phases at the positions of all intermediate optical tweezers are configured to satisfy the following conditions: When the optical tweezers arrays trapping the plurality of target microscopic particles are switched, the target microscopic particles can move from the first optical tweezers to the second optical tweezers, and the first optical tweezers and the second optical tweezers are the optical tweezers corresponding to the same target microscopic particle in the two optical tweezers arrays before and after the switching respectively; When the optical tweezers array that traps the multiple target microscopic particles is switched, any two target microscopic particles and the optical tweezers they are in will not collide with each other during the movement.

9. The real-time manipulation device according to claim 1, wherein: The target hologram is a hologram generated by the real-time processing component according to the final positions of the plurality of target microscopic particles or is a preset hologram.

10. The real-time manipulation device according to claim 2, wherein: The planning unit is further adapted to match a plurality of target microscopic particles with a plurality of target positions, wherein each target microscopic particle corresponds to a target position, and the target position matched with the target microscopic particle is used as the final position of the plurality of microscopic particles.

Images