Bacterial colony selection system and selection method based on light control technology

By combining optical manipulation technology with an array-type chamber chip, contactless colony picking is achieved, solving the problems of contamination, complex structure, and energy consumption of traditional colony picking instruments, and improving picking efficiency and accuracy.

CN119020134AActive Publication Date: 2024-11-26QINGDAO INST OF BIOENERGY & BIOPROCESS TECH CHINESE ACADEMY OF SCI +1

Patent Information

Application Number
CN202411125913.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-16
Publication Date
2024-11-26
Estimated Expiration
2044-08-16

AI Technical Summary

Technical Problem

Traditional microbial colony selection instruments pose a risk of contamination, have complex structures, are costly, and consume a lot of energy, making them difficult to meet the needs of high-throughput experiments.

Method used

A colony selection system based on light manipulation technology is adopted, which uses an array of chamber chips and photothermal effect to perform contactless colony picking. Combined with an imaging module and an automatic acquisition control module, it can achieve the identification and accurate export of target colonies.

Benefits of technology

It improves the efficiency and accuracy of colony selection, reduces the risk of contamination, simplifies the structure, reduces energy consumption, and adapts to the selection needs of different working conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119020134A_ABST
    Figure CN119020134A_ABST
Patent Text Reader

Abstract

The invention discloses a bacterial colony selection system and selection method based on a light control technology, and the system comprises a chip platform which is provided with a chip placement part used for placing array type cavity chips; the pore plate platform is provided with a pore plate placing part for placing a pore plate; the photo-thermal module is used for emitting a photo-thermal light path and irradiating the photo-induction heating parts on the cavities in any one or more array cavity chips; the imaging module is used for identifying the state of a bacterial colony in a cavity in the array type cavity chip in the current visual field range; and the automatic acquisition control module is used for identifying and calibrating bacterial colonies in a cavity in the array type cavity chip through identification of the imaging module so as to control the photo-thermal module to perform photo-thermal heating on a photo-induction heating part on the identifying and calibrating cavity and adjust the position of the chip platform and / or the pore plate platform. And conveying the target bacterial colony from the array type chamber chip into a collection chamber of the pore plate. Based on the system, target bacterial colony selection in a synchronous mode and an asynchronous mode can be carried out, so that the selection efficiency of the target bacterial colony is greatly improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of colony selection, and in particular relates to a colony selection system and a selection method based on light manipulation technology. Background Art

[0002] At present, in biological experiments such as biological genetic engineering and microbial culture, the picking of microbial colonies is mainly done manually. With the increasing number of applications and the rapid development of synthetic biology, microbial colony picking experiments often require picking thousands or even tens of thousands of cloned colonies. Microbial colony picking faces the following problems:

[0003] 1. The workload is large and the efficiency of manual selection is low;

[0004] 2. Subjective judgment in selecting clone colonies can easily lead to missing target clones.

[0005] Therefore, manual picking of microbial colonies has gradually failed to meet the requirements of high-throughput experiments.

[0006] With the development of biotechnology, the traditional manual picking of microbial colonies has gradually been replaced. Microbial colony picking instruments replace manual automatic picking, which can not only improve the picking efficiency, but also greatly improve the picking accuracy. At present, the microbial colony picking instruments on the market mainly use a 96-pin picking head, which moves on the three rectangular coordinate axes of X, Y, and Z. First, based on machine vision technology, a camera is used to identify and locate the microbial colonies in the culture dish. The 96-pin picking head picks the colonies one by one, and then inoculates them into the inoculation well plate at one time. Finally, the 96 picking needles are cleaned and disinfected. For details, please refer to Chinese invention patents CN113604348A, CN108641903A, and CN113667588A.

[0007] The main disadvantages of the above scheme are:

[0008] 1. Pollution problem: metal picking needles are reused during the work process. Even if there is a disinfection process, there may be a risk of incomplete disinfection, which reduces the reliability and scientificity of the experimental results;

[0009] 2. Complex structure and high cost. The 96-pin picking head structure is a key component, which needs to achieve high-precision movement in the X and Y axes, and each of the 96 pins needs to move independently in the Z (up and down) direction. In addition, the 96 pins need to be resistant to high temperature and have high rigidity. The structural design is complex and the cost is high.

[0010] 3. Increased energy consumption, mainly including high-temperature disinfection of 96 needles and other disinfection links, which consumes a lot of energy; in the 96-needle picking method, the source plate is a commonly used culture dish, but achieving high-throughput selection will involve multiple culture dishes, or even more than a dozen to complete a selection experiment, resulting in a large demand for consumables and increased energy consumption. Summary of the invention

[0011] The details of one or more embodiments of the present invention are set forth in the following drawings and description to make other features, objects, and advantages of the present application more readily apparent.

[0012] Based on the currently existing array chamber chip, the present invention designs a fully automatic colony picking system and picking method based on light manipulation technology, which fundamentally avoids the disadvantages of the transmission colony picking instrument and can greatly improve the sorting efficiency.

[0013] The present invention discloses a colony selection system based on light manipulation technology, comprising:

[0014] A chip platform, provided with a chip placement portion for placing the array chamber chip;

[0015] The orifice plate platform is provided with an orifice plate placement portion for placing the orifice plate;

[0016] A photothermal module, used for emitting a photothermal optical path;

[0017] The number of the photothermal optical path is one and the photosensitive heating portion irradiated on one cavity in the corresponding plurality of array-type cavity chips

[0018] or

[0019] The number of the photothermal optical paths is multiple and the photosensitive heating parts on the multiple cavities in the corresponding multiple array-type cavity chips are irradiated in parallel;

[0020] An imaging module, used to identify the state of the bacterial colonies in the chamber of the array chamber chip within the current field of view;

[0021] The automatic acquisition control module identifies and calibrates the colonies in the chamber of the array chamber chip through the recognition of the imaging module, controls the photothermal module to perform photothermal heating on the light-sensing heating part on the identification and calibration chamber, and adjusts the position of the chip platform and / or the well plate platform to transport the target colonies from the array chamber chip to the collection chamber of the well plate.

[0022] In some embodiments, the level of the chip placement portion is higher than the level of the well plate placement portion.

[0023] In some embodiments, it further comprises:

[0024] The fluorescence detection module is used to emit a fluorescence light path; the emission ends of the photothermal module, the imaging module and the fluorescence detection module share the same microscope objective lens and are fixedly installed above the chip placement portion.

[0025] In some embodiments, the automatic acquisition control module includes:

[0026] The detection and identification module is used to detect the bacterial colonies in the chamber; the detection and identification module is one or any of a fluorescence detection module, a Raman detection module, a laser confocal detection module, and a mass spectrometry detection module.

[0027] In some embodiments, the photothermal module includes a colony picking light source and a beam shaping module; the colony picking light source is a laser light source or an LED light source; the beam shaping module is used to shape the photothermal light path irradiated on the light induction heating part into a single beam or multiple beams and to shrink the beam.

[0028] In some embodiments, the photothermal module includes: a laser, an optical beam expansion system, and a collimating lens;

[0029] The imaging module includes: a relay lens and an image collector;

[0030] The laser is used to emit a photothermal light path, and the photothermal light path is expanded by the optical beam expansion system, and then parallel light is obtained by the collimating lens, and finally reaches the microscope objective lens through reflection by the dichroic mirror;

[0031] The imaging light path collected by the microscope objective lens reaches the relay lens through the transmission of the dichroic mirror and is transmitted to the image collector;

[0032] The fluorescence detection module is arranged between the dichroic mirror and the relay lens.

[0033] In some embodiments, the photothermal module includes: a laser, a half glass slide, an optical beam expansion system, a collimating lens, a spatial light modulator, a quarter glass slide, and a polarization beam splitter prism;

[0034] The imaging module includes: a relay lens and an image collector;

[0035] The laser is used to emit a photothermal light path, and the polarization direction of the photothermal light path is changed by adjusting the rotation angle of the half glass slide, and then the photothermal light path is expanded by the optical beam expansion system, and then parallel light is obtained by the collimating lens, and it is transmitted to the polarization beam splitter prism; through the reflection of the polarization beam splitter prism, it enters the quarter glass slide and the spatial light modulator in sequence; the spatial light modulator loads a hologram formed by collecting the position coordinates of the chamber where multiple target colonies are located, and then modulates multiple photothermal light paths according to the hologram, and the modulated multiple photothermal light paths are then transmitted through the quarter glass slide and the polarization beam splitter prism in sequence, and then reflected by the dichroic mirror and projected into the microscope objective lens, forming an array of multiple photothermal light paths;

[0036] The imaging light path collected by the microscope objective lens reaches the relay lens through the transmission of the dichroic mirror and is transmitted to the image collector;

[0037] The fluorescence detection module is arranged between the dichroic mirror and the relay lens.

[0038] In some embodiments, it further comprises:

[0039] The detection module is used to identify whether the droplets discharged from the array chamber chip contain target colonies, and to determine whether the ends of the droplets discharged from the array chamber chip are aligned with the collection holes corresponding to the well plate.

[0040] In some embodiments, the detection module includes:

[0041] A visual camera is arranged below the orifice plate platform;

[0042] A beam splitter prism is disposed above the visual camera;

[0043] An illumination light source and a reflector are respectively arranged on both sides of the dichroic prism; the illumination light source emits a light beam and divides the light beam into reflected light and transmitted light through the dichroic prism; the reflected light is used to illuminate the collecting holes corresponding to the orifice plate to judge the alignment state between the ends of the droplets discharged from the array chamber chip and the collecting holes corresponding to the orifice plate; the transmitted light is used to illuminate the array chamber chip through the reflector for imaging.

[0044] In some embodiments, the chip platform and the well plate platform move horizontally along the XY axis and move relative to each other in the vertical direction; the visual camera is used to identify whether the end of the discharged droplet contains a target colony, and the target colony is collected by controlling the relative movement of the chip platform and the well plate platform in the vertical direction.

[0045] In some embodiments, it further comprises:

[0046] The chip export tube is used to connect with the export port in the array chamber chip; the chip export tube is vertically arranged at the export port or fixedly arranged between the chip platform and the orifice plate platform and connected with the export port through a flexible connecting tube.

[0047] The present invention also discloses a selection method of a colony selection system based on light manipulation technology according to any one of the above embodiments, wherein the target colony collection method includes: a synchronous mode and an asynchronous mode;

[0048] The synchronization mode is to obtain the information of the target colonies in the array chamber chip within the current field of view, plan the picking path of the target colonies according to the greedy algorithm, and collect according to the planned path until the picking of the target colonies in the entire array chamber chip is completed;

[0049] The asynchronous mode completes the image acquisition of the array chamber chip, identifies and calibrates the colonies according to the image acquisition situation, and plans the paths of all the calibrated target colonies according to the greedy algorithm and completes the picking in sequence.

[0050] In some embodiments, a chip tilt correction method is also included: collecting image information of the array chamber chip after placement and identifying its various chambers, forming a data point column through the center points of each chamber located on the same horizontal reference line, and obtaining the corresponding two-dimensional array coordinates; according to the connection fitting between adjacent arrays on each horizontal reference line, the average slope S l ope is solved, S l ope has positive and negative corresponding, and K is solved according to S l ope, where the K value is the overall tilt distance of each chamber, and the chip platform is moved according to the K value, where the K value is positive for upward movement and negative for downward movement.

[0051] In some embodiments, the method of irradiating the photothermal module on the photosensitive heating portion of the chamber in the array chamber chip is:

[0052] By adjusting the position of the chip platform, the single photothermal light path formed by the laser is irradiated onto the chamber containing the target bacterial colony, and the target bacterial colony is derived by photothermal heating;

[0053] or

[0054] The light beam formed by the laser is expanded and parallelized, and then enters the spatial light modulator. The spatial light modulator forms multiple photothermal light paths within the current field of view according to the position image of the chamber containing the target colonies within the current field of view, and irradiates the corresponding chambers containing the target colonies. Since the distances from each chamber to the exit within the current field of view are different, all the target colonies are exported in sequence by photothermal heating.

[0055] Compared with the prior art, the present invention has the following beneficial effects:

[0056] 1. This device changes the traditional needle-picking method of colony selection. It uses the structure of the array chamber chip and based on the photothermal effect, it realizes the contactless export of the target colony by photothermal means. At the same time, it can also use the chamber characteristics within the structure of the array chamber chip itself to realize the online cultivation of colonies, so as to ensure the success rate and efficiency of colony selection.

[0057] 2. To ensure the accuracy of the picking process, the corresponding detection module is further added, which can not only detect whether the wells are aligned, but also detect whether the exported droplets contain target colonies, thereby ensuring the accuracy of the picking process.

[0058] 3. Based on the above device structure, two modes of synchronous extraction and asynchronous extraction are formed to adapt to different working conditions, thereby improving the efficiency of colony picking.

[0059] 4. The picked photothermal module can realize a single photothermal optical path or a multi-photothermal optical path mode to achieve a single sequential picking or a fast multiple picking. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] The drawings described herein are used to provide further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0061] Figure 1 It is a structural schematic diagram of the present invention.

[0062] Figure 2 It is a structural schematic diagram of the multi-beam optical path module of the present invention.

[0063] Figure 3 It is a structural schematic diagram of the detection module of the present invention.

[0064] Figure 4 It is a schematic diagram of the structure of the array chamber chip of the present invention.

[0065] Figure 5 It is a structural schematic diagram of the machine vision camera alignment imaging of the present invention.

[0066] Figure 6 It is a schematic diagram of the structure of droplet detection by the machine vision camera of the present invention.

[0067] Description of the drawings: optical path module 1; fluorescence detection module 11; photothermal module 12, laser 1201, optical shutter 1202, half glass slide 1203, reflector 1 1204, optical beam expansion system 1205, collimating lens 1206, reflector 2 1207, spatial light modulator 1208, quarter glass slide 1209, polarization beam splitter prism 1210, reflector 3 1211, lens 1 1212, reflector 3 1213, lens 2 1214 ; Imaging module 13, reflector five 1301, microscope objective 1302, relay lens 1303, image collector 1304; dichroic mirror 14; detection module 2, illumination light source 21, collimation and uniform light module 22, machine vision camera 23, telecentric lens 24, dichroic prism 25, reflector 26, orifice plate 27, collecting hole 28, droplet 29; chip platform 3, flexible connecting tube 30, chip fixture 31; orifice plate platform 4, orifice plate fixture 41; pumping module 5. DETAILED DESCRIPTION

[0068] In order to make the purpose, technical scheme and advantages of the present invention more clearly understood, the present invention is described and illustrated below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. Based on the embodiments provided by the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work belong to the scope of protection of the present invention.

[0069] Obviously, the drawings described below are only some examples or embodiments of the present invention. For ordinary technicians in this field, the present invention can also be applied to other similar scenarios based on these drawings without creative work. In addition, it can also be understood that although the efforts made in this development process may be complicated and lengthy, for ordinary technicians in this field related to the content disclosed by the present invention, some changes in design, manufacturing or production based on the technical content disclosed by the present invention are just conventional technical means, and should not be understood as insufficient content disclosed by the present invention.

[0070] Reference to "embodiments" in the present invention means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those of ordinary skill in the art that the embodiments described in the present invention may be combined with other embodiments without conflict.

[0071] The present invention discloses a colony selection system based on light manipulation technology, comprising:

[0072] The chip platform 3 is provided with a chip placement portion for placing the array chamber chip;

[0073] The orifice plate platform 4 is provided with an orifice plate placement portion for placing the orifice plate 27;

[0074] The photothermal module 12 is used to emit a photothermal optical path; the number of the photothermal optical path is one and irradiates the photosensitive heating part on one cavity in the corresponding plurality of array-type cavity chips, or the number of the photothermal optical path is multiple and irradiates the photosensitive heating part on multiple cavities in the corresponding plurality of array-type cavity chips in parallel;

[0075] An imaging module 13, used to identify the state of the bacterial colonies in the chamber of the array chamber chip within the current field of view;

[0076] The automatic acquisition control module identifies and calibrates the colonies in the chamber of the array chamber chip through the recognition of the imaging module 13, controls the photothermal module 12 to perform photothermal heating on the light-sensing heating part on the identification and calibration chamber, and adjusts the position of the chip platform 3 and / or the well plate platform 4, so that the target colonies are transported from the array chamber chip to the collection chamber of the well plate.

[0077] Correspondingly, a pumping module 5 may be integrated to perform sample injection / liquid supply to the array chamber chip.

[0078] Among them, the structure of the array chamber chip is as follows Figure 4 As shown, the chip structure is the existing chip structure form CN112871227B, so it will not be described in detail. This device is a supporting system developed and designed based on the chip structure. The present invention innovatively breaks the needle-pick colony selection mode, injects the colony sample into the chamber of the array chamber chip, and realizes contactless picking through photothermal, thereby completing the picking of the target colony.

[0079] In some embodiments, the horizontal height of the chip placement part is higher than the horizontal height of the orifice plate placement part. The chip placement part and the orifice plate placement part are respectively provided with corresponding chip clamps 31 and orifice plate clamps 41 for clamping and fixing the array chamber chip and the orifice plate 27. The design of the upper and lower height position difference facilitates the extraction of droplets while ensuring the compactness of the device structure.

[0080] In some embodiments, it also includes:

[0081] The fluorescence detection module 11 is used for emitting a fluorescence light path; the photothermal module 12, the imaging module 13, and the emission end of the fluorescence detection module 11 share the same microscope objective lens 1302 and are fixedly installed above the chip placement portion.

[0082] A plurality of fluorescent light cubes may be arranged in the fluorescent detection module 11 for performing different switching operations.

[0083] In some embodiments, the automatic acquisition control module includes:

[0084] The detection and identification module is used to detect the bacterial colonies in the chamber; the detection and identification module is one or any of a fluorescence detection module, a Raman detection module, a laser confocal detection module, and a mass spectrometry detection module.

[0085] In some embodiments, the photothermal module includes a colony picking light source and a beam shaping module; the colony picking light source is a laser light source or an LED light source; the beam shaping module is used to shape the photothermal light path irradiated on the light sensing heating part into a single beam or multiple beams and to shrink the beam.

[0086] There are two structural forms of the photothermal module 12:

[0087] The first one is a more conventional pipeline setting method, which uses a laser to generate laser to form a single-beam photothermal pipeline, so it will not be described in detail.

[0088] The second type Figure 2 As shown, the laser 1201 emits a laser with a wavelength in the near-infrared band, and passes through an optical shutter 1202 to achieve the passage and blocking of the laser. The laser continues to propagate to the half glass slide 1203. The polarization direction of the laser can be changed by rotating the angle of the half glass slide 1203. The laser with changed polarization direction reaches the optical beam expansion system 1205 after reaching the reflector 1204, and the laser is expanded. The expanded laser passes through the collimating lens 1206 to obtain parallel light. At this point, parallel light with a changed polarization direction and expanded 5-10 times is obtained, and the magnification is determined by the cooperation of the optical beam expansion system 1205 and the collimating lens 1206. The parallel light after beam expansion is reflected by the second reflector 1207 and enters the polarization beam splitter prism 1210. The polarization beam splitter prism 1210 cooperates with the half glass slide 1203 to achieve the ratio of laser transmission and reflection. The angle of the half glass slide 1203 can be rotated to achieve the maximum reflected light of the laser in the polarization beam splitter prism 1210. For example, when the phase image of the multi-light point diagram is loaded on the spatial light modulator 1208, the laser emitted by the spatial light modulator 1208 is the phase light field of the multi-light points. The phase light field of the multi-photoelectric corresponds to the multiple photothermal light paths that need to be corresponding. The phase light field of the multi-light points passes through the polarization beam splitter prism 1210 again, and the transmitted light beam is the required light beam. The transmitted light beam enters the 4f system through the reflector three 1211. The 4f system is composed of lens one 1212 and lens two 1214 to achieve beam reduction. The beam reduction ratio is determined by the entrance pupil of the microscope objective. The beam after beam reduction is introduced into the imaging light path through the dichroic mirror 14.

[0089] The imaging module 13 is mainly used for microscopic imaging, including bright field imaging and fluorescence imaging, wherein fluorescence imaging needs to be realized in conjunction with the fluorescence detection module, which mainly includes the reflector 5 1301, the microscope objective lens 1302, the relay lens 1303, and the image collector 1304; the fluorescence detection module 11 is arranged between the dichroic mirror 14 and the relay lens 1303. The dichroic mirror 14 is high-reflection and low-pass, which can reflect long-wavelength light beams and transmit short-wavelength light beams, so the light beam of the photothermal optical path is a long-wavelength light beam that can be reflected into the reflector 5 1301, and then into the microscope objective lens 1302, and the microscope objective lens 1302 focuses the photothermal optical path on the array chamber chip.

[0090] In some embodiments, it also includes:

[0091] The detection module 2 is used to identify whether the droplets 29 discharged from the array chamber chip contain target colonies, and to determine whether the ends of the droplets discharged from the array chamber chip are aligned with the collection holes corresponding to the orifice plate 27 .

[0092] Specifically, the detection module 2 includes:

[0093] A visual camera 23 is disposed below the orifice plate platform 4;

[0094] A beam splitter prism 25 is disposed above the visual camera 23;

[0095] The illumination light source 21 and the reflector 26 are respectively arranged on both sides of the dichroic prism 25; the illumination light source 21 emits a light beam and divides the light beam into reflected light and transmitted light through the dichroic prism 25; the reflected light is used to illuminate the collecting holes corresponding to the orifice plate 27 to determine the alignment state of the ends of the droplets discharged from the array chamber chip and the collecting holes corresponding to the orifice plate 27; the transmitted light is used to illuminate the array chamber chip through the reflector 26 for imaging.

[0096] The chip platform 3 and the well plate platform 4 move horizontally along the XY axis and move relative to each other in the vertical direction; the visual camera 23 is used to identify whether the end of the discharged droplet contains the target colony, and the target colony is collected by controlling the vertical relative movement of the chip platform 3 and the well plate platform 4.

[0097] The chip export tube is used to connect with the export port in the array chamber chip; the chip export tube is vertically arranged at the export port or fixedly arranged between the chip platform 3 and the well plate platform 4 and connected with the export port through a flexible connecting tube 30.

[0098] A vertical fixing method is adopted, that is, the chip export tube and the array chamber chip are set to move. Therefore, it is necessary to continuously adjust the collection holes 28 on the corresponding orifice plate 27 according to the position of the chip export tube. The setting method fixed in between makes the position of the chip export tube fixed, and the chip platform 3 can be compensated by the displacement of the flexible connecting tube 30 during the movement, which makes the adjustment more convenient.

[0099] The main functions of detection module 2 are as follows:

[0100] 1. Check the coaxiality between the end of the chip outlet tube and any initial hole on the orifice plate 27;

[0101] 2. Detect whether the target bacterial colonies are encapsulated in the oil phase night droplets;

[0102] 3. Integrated design: This part not only has detection function, but also provides lighting function, which can illuminate the consumable chips and the detection targets.

[0103] The illumination light source 21 is a white light LED lamp, which emits white light. After passing through the collimation and uniform light module 22, the light source becomes a parallel light beam with uniform light energy distribution. The light beam continues to propagate and reaches the dichroic prism, which divides the light beam into reflected light and transmitted light. The transmittance-reflection ratio of the dichroic prism is 8:2 (or other ratios). The transmitted light is reflected by the reflector and enters the illumination of the consumable chip, which is coaxial with the microscope objective lens 1302, and the microscope objective lens is used for bright field imaging. The reflected light is used to illuminate the collection hole 28 (such as the A1 hole position) of the orifice plate 27, the droplet 29, and the end of the chip outlet tube. The orifice plate 27 is installed on the three-axis displacement platform (orifice plate platform 4), and the orifice plate is moved up, down, left, right, and forward and backward through the movement of the three-axis displacement platform. Then the image is formed by the telecentric lens 24, which has the characteristics of high resolution, ultra-wide depth of field, ultra-low distortion, and unique parallel light design. After imaging, it is displayed on the machine vision camera for detection needs.

[0104] The imaging effect of the end of the chip outlet tube and the A1 hole of the orifice plate 27 on the machine vision camera is as follows: Figure 5 As shown, the black dot is the center position of hole A1, and the gray dot position is the position of the end of the chip export tube. If the target position is detected to be inconsistent with the actual position, the position difference can be calculated. The specific calculation method is: let the black dot position be (x0.y0), and the actual position be (xy), then Δx = x-x0; Δy = y-y0, then the XY axis of the orifice plate 27 moves according to the difference, so that the target position coincides with the actual position. The coaxiality / centering of the A1 hole and the end of the chip export tube is completed.

[0105] There are two states of the droplets 29: unencapsulated target droplets and encapsulated target droplets. The unencapsulated target droplets are oil phase buffer solutions, and the encapsulated target droplets are sample droplets encapsulated in the oil phase buffer solution. The imaging of the two types of droplets in the machine vision camera 23 is also different. Through the recognition algorithm, when the imaging signal is encapsulated with target droplets, a feedback signal is given to start the droplet collection instruction, that is, the orifice plate 27 executes the up and down movement action.

[0106] Based on the system in the above embodiment, a corresponding selection method is also provided, which specifically includes two modes, namely a synchronous mode and an asynchronous mode.

[0107] The synchronization mode is to obtain the information of the target colonies in the array chamber chip within the current field of view, plan the picking path of the target colonies according to the greedy algorithm, and collect according to the planned path until the picking of the target colonies in the entire array chamber chip is completed;

[0108] The asynchronous mode completes the image acquisition of the array chamber chip, identifies and calibrates the colonies according to the image acquisition situation, and plans the paths of all the calibrated target colonies according to the greedy algorithm and completes the picking in sequence.

[0109] In the above-mentioned mode process, one of the links is to calibrate the position of the array chamber chip. Since it cannot be ensured to be in a parallel state every time it is placed, it will be tilted in the microscopic field, and then a corresponding chip tilt correction method is set. Specifically, the image information of the array chamber chip after placement is collected and its various chambers are identified. The center points of each chamber located on the same horizontal reference line are used to form a data point column, and the corresponding two-dimensional array coordinates are obtained; according to the connection fitting between adjacent arrays on each horizontal reference line, the average slope S l ope is solved. S l ope has positive and negative corresponding. According to S l ope, K is solved. The K value is the overall tilt distance of each chamber, and the chip platform 3 is moved according to the K value. The K value is positive upward movement; the K value is negative downward movement.

[0110] Combining the above-mentioned two different structural forms of the photothermal module 12, there are two corresponding heating methods.

[0111] Single photothermal light path: by adjusting the position of the chip platform 3, the single photothermal light path formed by the laser 1201 is irradiated on the chamber containing the target bacterial colony, and the target bacterial colony is derived by photothermal heating;

[0112] Multiple photothermal light paths: By expanding and parallelizing the light beam formed by the laser 1201 and making it enter the spatial light modulator 1208, the spatial light modulator 1208 forms multiple photothermal light paths within the current field of view according to the position image of the chamber containing the target colonies within the current field of view, and irradiates the corresponding chambers containing the target colonies. Since the distances from each chamber to the exit within the current field of view are different, all the target colonies are exported in sequence by photothermal heating.

[0113] Its working principle is:

[0114] Photothermal heating, the thermal effect of light, refers to the phenomenon that heat is generated locally on the surface of an object after a light beam is irradiated on the surface of an object. When the focused near-infrared light is irradiated into the micro-chamber, heat is generated locally, causing the liquid in the chamber to expand, squeezing the droplets out of the channel outside the chamber, where there is flowing liquid, thereby flushing the droplets wrapped with the colonies to the collection position, and starting the collection device to collect the colony droplets.

[0115] The following is an introduction to the entire workflow:

[0116] 1. Sample pretreatment

[0117] 1. Sampling process

[0118] It mainly includes two links: sampling link and cultivation link.

[0119] This step includes spotting, inspection, and sealing, and is mainly used to enable samples to enter the microfluidic chip and be distributed individually into each chamber.

[0120] 2. Training stage

[0121] Place the chip in the incubator, and pay attention to maintaining the chip humidity to prevent the liquid in the chip from evaporating. The incubator temperature is determined according to the sample type.

[0122] 2. Preparation before picking

[0123] The main steps are as follows:

[0124] 1.1. Place the chip: Connect the pipeline, place it in the chip fixture, and place it on the stage;

[0125] 1.2. Oil inlet: Turn on the chip power source and introduce the oil phase. The oil phase introduction time is about 10-60 minutes;

[0126] 1.3. Positioning: Manually / automatically move to the upper left corner of the chip imaging, manually / automatically adjust the focus until the image is clear, and set the chip three-axis platform to the zero position at this time; adjust the three-axis position of the mobile orifice plate so that the chip capillary and the initial hole of the orifice plate are coaxial under human observation, and set the three axes of the orifice plate to the zero position. When setting the coaxiality, the aforementioned detection module 2 can also be used for automatic identification and adjustment to perform automated coaxial adjustment.

[0127] 3. Inspection / Selection

[0128] There are two detection modes: bright field and fluorescence. The selection can be made according to the needs. The selection method refers to the settings of the fluorescence detection module 11 and the imaging module 13 mentioned above.

[0129] Due to the influence of the microscopic imaging field of view, the chip needs to be imaged multiple times to complete the image acquisition of all chambers. Each image acquisition is a screen, and the switching of each screen is achieved by moving the chip platform 3. Therefore, the detection / picking steps are divided into two modes: synchronous mode and asynchronous mode.

[0130] (I) Synchronous mode

[0131] Image acquisition, target recognition, and picking are completed on the same image acquisition screen, that is, while acquiring images and recognizing images, the target colonies are picked. The specific steps are as follows:

[0132] 1. Bright field

[0133] 1.1 Identify the initial position

[0134] Initial screen recognition, based on the preparation before picking -> positioning -> initial screen setting, based on AI technology, the initial screen is recognized. The specific recognition algorithm is as follows (taking the upper left corner of the image as an example):

[0135] S1: Image acquisition;

[0136] S2: Image input, sending the collected image to the model (the model is the model that has been trained and established in the early stage);

[0137] S3: Image discrimination, judging whether the image is an image with a cavity based on the model;

[0138] S4-1: If yes, continue to move the chip to the left to the next screen and repeat steps S1-S3;

[0139] S4-2: If no, return to the previous screen;

[0140] S5: Boundary correction, set the padding value so that the leftmost cavity edge and the left boundary of the image are padding, so that the cavities are symmetrically distributed in the image.

[0141] Similarly, the upper and lower position recognition is completed, and finally the initial screen recognition is realized, and the platform moves to the initial screen position.

[0142] 1.2 Autofocus / Correction

[0143] Perform image autofocus and chip tilt correction, and record the relevant data of the current screen, including position information, focus information and correction parameters. The specific focus / correction method is as follows:

[0144] Autofocus (Hill Climbing Algorithm)

[0145] S1: Image acquisition, set the Z-axis position at this time to the zero position;

[0146] S2: Image input, sending the collected image to the OpenCvSharp algorithm;

[0147] S3: Calculate the image gradient value, using the Tenengrad gradient method: Sobel operator to calculate the image gradient value;

[0148] S4: Image set acquisition, moving up and down at the Z-axis zero position with Step as the interval to acquire the image set, and calculating the image gradient value, drawing a curve of Z-axis position and gradient value, and finding the peak position (as shown in the figure);

[0149] S5: Image focusing. The platform moves to the highest point of the peak. The Z-axis position at this time is the image in-focus position, and the image is focused.

[0150] Chip tilt correction:

[0151] S1: Image acquisition, collecting focused images;

[0152] S2: Image input, the image is fed into the trained model;

[0153] S3: Data point generation, identifying the chamber, and then identifying the center point of the chamber to form a data point column, each point has a coordinate (X, Y), forming a two-dimensional array;

[0154] S4: Solve the K value, connect and fit each row of the array, and solve the average slope S l ope. S l ope has positive and negative signs. Solve K according to the slope S l ope. The K value is the overall tilt distance of the chamber.

[0155] S5: Correct the image and move the chip platform according to K obtained in step S4. If K is positive, it moves upward; if K is negative, it moves downward.

[0156] Complete autofocus and chip tilt correction, and record the current screen position information, focus information and correction parameters.

[0157] 1.3 Image acquisition

[0158] The image acquisition device starts the image capture function to capture the current screen image.

[0159] 1.4 Image Recognition

[0160] 1.4.1 ID information allocation: identify the outer contour of each cavity in the image, mark the identified cavity with a frame, and record the location information of each cavity.

[0161] S1: Image acquisition, collecting focused images;

[0162] S2: Image input, the image is fed into the trained model;

[0163] S3: Data point generation, identifying the chamber, and then identifying the center point of the chamber to form a data point column, each point has a coordinate (X, Y);

[0164] S4: minimum point traversal, traversal of the minimum Y value Min of the center point,

[0165] S5: Cutting line drawing, draw cutting lines with Min±Step respectively;

[0166] S6: Peer discrimination, traverse all center points, if Y is within the range of Min±Step, they are located in the same row, and are sorted from small to large by X value and set to the first row (odd row);

[0167] S7: Repeat the traversal of the next row, set it to the second row (even-numbered row), and sort it by X value from large to small and continue with the previous row:

[0168] S8: The data point sorting information is assigned to each corresponding cavity, completing the cavity ID allocation.

[0169] At this point, the ID information allocation for each chamber is realized, including pixel coordinates, platform coordinates, and sequence information.

[0170] 1.4.2 Colony identification: for each identified chamber, the presence or absence of colonies is identified, and the chamber is marked as 0 / 1, where 0 represents no colonies in the chamber and 1 represents colonies in the chamber;

[0171] 1.4.3 Path planning: Perform the shortest path planning for all the chambers with a value of 1 in the screen image based on the greedy algorithm and mark them with serial numbers 1-N (N≤50).

[0172] 1.5 Picking

[0173] According to the image recognition information in step 1.4, pick the colonies as follows:

[0174] 1.5.1 Chamber positioning: According to step 1.4.3, move the chamber numbered 1 to the photothermal heating point through the chip platform;

[0175] 1.5.2 Turn on the laser 1201 and make its light-heat path shine on the chamber 1;

[0176] 1.5.3 Time setting: dynamically set the colony droplet collection time according to T=t0+Δt*(m-1) (where T is the time to start collecting colony droplets, t0 is the basic time, Δt is the time interval, and m is the number of screens);

[0177] 1.5.4 Start collection, start the receiver (taking 96-well plate as an example) to collect colony droplets. The specific process is that the 96-well plate switches the well position and moves up and down;

[0178] 1.5.5 Repeat steps 1.5.1-1.5.4 to complete the picking of all colony chambers.

[0179] 1.6 Switch screen

[0180] 1.7 Repeat 1.2-1.6 until all images are collected.

[0181] (II) Asynchronous Mode

[0182] First, complete the acquisition of all images, then identify and select them. The specific steps are as follows:

[0183] Brightfield

[0184] 1. Panoramic photography

[0185] 1.1 Initial screen recognition: According to the preparation before picking -> positioning -> initial screen setting, the initial screen is recognized based on AI technology. The specific recognition algorithm is as follows (taking the upper left corner of the image as an example):

[0186] S1: Image acquisition;

[0187] S2: Image input, sending the collected image to the model (the model is the model that has been trained and established in the early stage);

[0188] S3: Image discrimination, judging whether the image is an image with a cavity based on the model;

[0189] S4-1: If yes, continue to move the chip to the left to the next screen and repeat steps S1-S3;

[0190] S4-2: If no, return to the previous screen;

[0191] S5: Boundary correction, set the padding value so that the leftmost cavity edge and the left boundary of the image are padding, so that the cavities are symmetrically distributed in the image.

[0192] Similarly, the upper and lower position recognition is completed, and finally the initial screen recognition is realized, and the platform moves to the initial screen position.

[0193] After the initial screen recognition is completed, the platform moves to the initial screen position.

[0194] 1.2 Perform image auto focus and chip tilt correction, and record the relevant data of the current screen, including position information, focus information and correction parameters. The specific focus / correction method is as follows:

[0195] Autofocus (Hill Climbing Algorithm)

[0196] S1: Image acquisition, set the Z-axis position at this time to the zero position;

[0197] S2: Image input, sending the collected image to the OpenCvSharp algorithm;

[0198] S3: Calculate the image gradient value, using the Tenengrad gradient method: Sobel operator to calculate the image gradient value;

[0199] S4: Image set acquisition, moving up and down at the Z-axis zero position with Step as the interval to acquire the image set, and calculating the image gradient value, drawing a curve of Z-axis position and gradient value, and finding the peak position (as shown in the figure);

[0200] S5: Image focusing. The platform moves to the highest point of the peak. The Z-axis position at this time is the image in-focus position, and the image is focused.

[0201] S1: Image acquisition, collecting focused images;

[0202] S2: Image input, the image is fed into the trained model;

[0203] S3: Data point generation, identifying the chamber, and then identifying the center point of the chamber to form a data point column, each point has a coordinate (X, Y), forming a two-dimensional array;

[0204] S4: Solve the K value, connect and fit each row of the array, and solve the average slope S l ope. S l ope has positive and negative signs. Solve K according to the slope S l ope. The K value is the overall tilt distance of the chamber.

[0205] S5: Correct the image and move the chip platform according to K obtained in step S4. If K is positive, it moves upward; if K is negative, it moves downward.

[0206] Complete autofocus and chip tilt correction, and record the current screen position information, focus information and correction parameters.

[0207] 1.3 Image acquisition - the image collector acquires images and displays them in a panoramic frame. The panoramic view is set to N*M pairs according to the number of chip chambers, where N is the number of rows and M is the number of columns. Image N1 of the first row and the first column is acquired;

[0208] 1.4 Chamber recognition / data analysis: perform image recognition and data analysis on the collected images.

[0209] ID information is assigned, the outer contour of each cavity in the image is identified, the identified cavity is framed and marked, and the location information of each cavity is recorded.

[0210] S1: Image acquisition, collecting focused images;

[0211] S2: Image input, the image is fed into the trained model;

[0212] S3: Data point generation, identifying the chamber, and then identifying the center point of the chamber to form a data point column, each point has a coordinate (X, Y);

[0213] S4: minimum point traversal, traversal of the minimum Y value Min of the center point,

[0214] S5: Cutting line drawing, draw cutting lines with Min±Step respectively;

[0215] S6: Peer discrimination, traverse all center points, if Y is within the range of Min±Step, they are located in the same row, and are sorted from small to large by X value and set to the first row (odd row);

[0216] S7: Repeat the traversal of the next row, set it to the second row (even-numbered row), and sort it by X value from large to small and continue with the previous row:

[0217] S8: The data point sorting information is assigned to each corresponding cavity, completing the cavity ID allocation.

[0218] At this point, the ID information of each chamber is assigned, including pixel coordinates, platform coordinates, and sequence information. Colony identification: the presence or absence of colonies in each identified chamber is determined, and the chamber is marked with 0 / 1, where 0 represents no colonies in the chamber and 1 represents colonies in the chamber;

[0219] Colony identification: If the chamber is marked with 1, the chamber is further identified. Based on the semantic segmentation algorithm, the colony region (ROI) is identified and the contour is obtained. The contour is calculated. OpenCV calculates the area, average grayscale, axis center and other related data of the contour area. The colony area and grayscale are marked on the chamber, and a scatter plot is constructed with the area and grayscale values, and the range values ​​of the area and grayscale are given. This step can be set up as a separate thread and performed simultaneously with the next step.

[0220] 1.5 Switch to the next screen and repeat steps 1.2-1.4 until all images are acquired and the panoramic image is completed.

[0221] 2. Set the picking parameters

[0222] Set the picking conditions, which include the area of ​​the chamber, the grayscale, and the product of two values ​​(concentration). For example, the value range is 0-1 (or 0-255). Select the required value range according to the displayed value.

[0223] 3. Pick

[0224] 3.1 Return to the initial screen and return to the initial position where the panorama was taken;

[0225] 3.2 Path planning: According to the picking parameters set in step 2, the shortest path is planned for each screen image, and the serial numbers NM-1 to NM-P are marked, where N represents the row, M represents the column, and P represents the number of chambers under the screen image, P≤50, and the path is picked according to the marked serial number;

[0226] 3.3 Chamber positioning: According to step 3.2, the chip platform is moved to move the chamber numbered 1 to the photothermal heating point;

[0227] 3.4 Open the optical shutter 1202 so that the photothermal light path is irradiated on the photothermal heating point of chamber 1;

[0228] 3.5 Time setting: dynamically set the colony droplet collection time according to T=t0+Δt*(m-1) (where T is the time to start collecting colony droplets, t0 is the basic time, Δt is the time interval, and m is the number of screens, i.e. the number of columns);

[0229] 3.6 Collect droplets. Start collecting droplets according to the set time;

[0230] 3.7 Continue steps 3.2-3.6 until all colonies in the current screen are picked;

[0231] 3.8 Switch to the next screen and repeat steps 3.2-3.7 until all screens are completed.

[0232] It should be noted that: if a photothermal module 12 with a spatial light modulator 1208 is used, when multiple photothermal light paths are irradiated on a chamber containing target colonies, there is no need to conduct experiments through the mobile chip platform 3. The image information of the chamber containing multiple target colonies can be directly obtained and then converted into a corresponding phase map. Then, through the corresponding holographic calculation formula, the synchronous irradiation of multiple photothermal light paths can be achieved. Moreover, since the position distances of each chamber of the array chamber chip itself from the exit are different, the target colonies can be quickly exported in the corresponding order, thereby greatly improving the selection efficiency.

[0233] Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent substitutions for some of the technical features therein; and these modifications or substitutions do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A colony selection system based on light manipulation technology, characterized in that: include: A chip platform, provided with a chip placement portion for placing the array chamber chip; The orifice plate platform is provided with an orifice plate placement portion for placing the orifice plate; A photothermal module, used for emitting a photothermal optical path; The number of the photothermal optical path is one and the photosensitive heating portion irradiated on one cavity in the corresponding plurality of array-type cavity chips or The number of the photothermal optical paths is multiple and the photosensitive heating parts on the multiple cavities in the corresponding multiple array-type cavity chips are irradiated in parallel; An imaging module, used to identify the state of the bacterial colonies in the chamber of the array chamber chip within the current field of view; The automatic acquisition control module identifies and calibrates the colonies in the chamber of the array chamber chip through the recognition of the imaging module, controls the photothermal module to perform photothermal heating on the light-sensing heating part on the identification and calibration chamber, and adjusts the position of the chip platform and / or the well plate platform to transport the target colonies from the array chamber chip to the collection chamber of the well plate.

2. The colony selection system according to claim 1, characterized in that: The horizontal height of the chip placement portion is higher than the horizontal height of the aperture plate placement portion.

3. The colony selection system according to claim 1, characterized in that: Also includes: The fluorescence detection module is used to emit a fluorescence light path; the emission ends of the photothermal module, the imaging module and the fluorescence detection module share the same microscope objective lens and are fixedly installed above the chip placement portion.

4. The colony selection system according to claim 1, characterized in that: The automatic acquisition control module comprises: The detection and identification module is used to detect the bacterial colonies in the chamber; the detection and identification module is one or any of a fluorescence detection module, a Raman detection module, a laser confocal detection module, and a mass spectrometry detection module.

5. The colony picking system according to claim 1, characterized in that: The photothermal module includes a colony picking light source and a beam shaping module; the colony picking light source is a laser light source or an LED light source; the beam shaping module is used to shape the photothermal light path irradiated on the light induction heating part into a single beam or multiple beams and to shrink the beam.

6. The colony picking system according to claim 3, characterized in that: Also includes: The detection module is used to identify whether the droplets discharged from the array chamber chip contain target colonies, and to determine whether the ends of the droplets discharged from the array chamber chip are aligned with the collection holes corresponding to the well plate.

7. The colony picking system according to claim 6, characterized in that: The detection module comprises: A visual camera is arranged below the orifice plate platform; A beam splitter prism is disposed above the visual camera; An illumination light source and a reflector are respectively arranged on both sides of the dichroic prism; the illumination light source emits a light beam and divides the light beam into reflected light and transmitted light through the dichroic prism; the reflected light is used to illuminate the collecting holes corresponding to the orifice plate to judge the alignment state between the ends of the droplets discharged from the array chamber chip and the collecting holes corresponding to the orifice plate; the transmitted light is used to illuminate the array chamber chip through the reflector for imaging.

8. The colony picking system according to claim 6, characterized in that: The chip platform and the well plate platform move along the XY axis in the horizontal direction and move relative to each other in the vertical direction; the visual camera is used to identify whether the end of the discharged droplet contains the target colony, and the target colony is collected by controlling the relative movement of the chip platform and the well plate platform in the vertical direction.

9. The colony picking system according to claim 8, characterized in that: Also includes: The chip export tube is used to connect with the export port in the array chamber chip; the chip export tube is vertically arranged at the export port or fixedly arranged between the chip platform and the orifice plate platform and connected with the export port through a flexible connecting tube.

10. A selection method based on the colony selection system based on light manipulation technology according to any one of claims 1 to 9, characterized in that: The target colony collection methods include: synchronous mode and asynchronous mode; The synchronization mode is to obtain the information of the target colonies in the array chamber chip within the current field of view, plan the picking path of the target colonies according to the greedy algorithm, and collect according to the planned path until the picking of the target colonies in the entire array chamber chip is completed; The asynchronous mode completes the image acquisition of the array chamber chip, identifies and calibrates the colonies according to the image acquisition situation, and plans the paths of all the calibrated target colonies according to the greedy algorithm and completes the picking in sequence.

11. The selection method according to claim 10, characterized in that: The chip tilt correction method is also included: collecting image information of the array chamber chip after placement and identifying each chamber thereof, forming a data point column through the center point of each chamber located on the same horizontal reference line, and obtaining the corresponding two-dimensional array coordinates; according to the connection fitting between adjacent arrays on each horizontal reference line, the average slope Slope is solved, and the Slope has positive and negative correspondingly, and K is solved according to the Slope, and the K value is the overall tilt distance of each chamber, and the chip platform is moved according to the K value, and the K value is positive and moves upward; The K value is negative and moves downward.

12. The selection method according to claim 10, characterized in that: The method of irradiating the light-heating module on the light-sensing heating part of the cavity in the array-type cavity chip is as follows: By adjusting the position of the chip platform, the single photothermal light path formed by the laser is irradiated onto the chamber containing the target bacterial colony, and the target bacterial colony is derived by photothermal heating; or The light beam formed by the laser is expanded and parallelized, and then enters the spatial light modulator. The spatial light modulator forms multiple photothermal light paths within the current field of view according to the position image of the chamber containing the target colonies within the current field of view, and irradiates the corresponding chambers containing the target colonies. Since the distances from each chamber to the exit within the current field of view are different, all the target colonies are exported in sequence by photothermal heating.

Citation Information

Patent Citations

  • Automatic bacterial colony sorting instrument

    CN108641903A

  • Microfluidic chips and methods for micro-droplet manipulation based on photothermal effect

    CN112871227B

  • Automatic bacterial colony selecting instrument and selecting method

    CN113604348A

  • Automatic teasing needle resetting mechanism and automatic bacterial colony selecting instrument

    CN113667588A

  • Mixed illuminating system applied to automatic bacterial colony selecting instrument

    CN105062878A

Cited By

  • Colony picking system based on optical manipulation technology, and picking method

    WO2025252268A1