Photographing and image analyzing system for culture plate

Abstract

The utility model relates to the technical field of life science, and provides a photographing and image analyzing system for a culture plate, which comprises a support device, an image acquisition device, a moving device and a control device, and is characterized in that the support device is used for placing the culture plate; the moving device is arranged above the supporting device; the image acquisition device is connected with the moving device and is suitable for shooting the culture plate hole by hole under the driving of the moving device so as to acquire an image of a sample in the culture plate; the control device is electrically connected with the image acquisition device and the moving device, the control device is used for controlling the moving device to move so as to drive the image acquisition device to shoot holes one by one, and the control device is further used for analyzing and processing images acquired by the image acquisition device. The photographing and image analyzing system for the culture plate can meet the high-throughput experiment requirement and cannot generate a parallax effect.

Description

Technical Field

[0001] The utility model relates to the technical field of life sciences, and in particular to a photographing and image analysis system for a culture plate. Background Art

[0002] In the fields of life sciences and biomedical research, photographing and image analysis systems for automated cell culture plates are gradually being popularized. These systems typically consist of hardware and software components for automatically collecting and analyzing cell images within a cell culture plate. In the prior art, a multifunctional microscope system is generally used to photograph a cell culture plate. However, due to limitations in operating functions, the existing systems can only perform single-plate shooting, unable to meet the requirements of high-throughput experiments, and the operation convenience is relatively low. In addition, when the existing systems photograph the entire cell culture plate at a relatively high position, parallax effects will occur in the well positions at the edges, resulting in a significant reduction in the shooting effect and accuracy, seriously affecting the experimental results. Summary of the Utility Model

[0003] The utility model provides a photographing and image analysis system for a culture plate to solve the defects in photographing and processing a cell culture plate in the prior art. By driving an image acquisition device to perform hole-by-hole shooting through a moving device, the process of image acquisition is not limited by the specifications and dimensions of the culture plate, nor by the number of single plates or multiple plates, which can meet the requirements of high-throughput experiments and will not produce parallax effects.

[0004] The photographing and image analysis system for a culture plate provided by the utility model includes:

[0005] A support device for placing a culture plate;

[0006] A moving device disposed above the support device;

[0007] An image acquisition device connected to the moving device and adapted to perform hole-by-hole shooting on the culture plate under the drive of the moving device for collecting images of samples within the culture plate;

[0008] A control device electrically connected to the image acquisition device and the moving device respectively. The control device is used to control the movement of the moving device to drive the image acquisition device to perform hole-by-hole shooting, and the control device is also used to analyze and process the images collected by the image acquisition device.

[0009] According to the photographing and image analysis system for a culture plate provided by the utility model, the moving device includes:

[0010] A first lead screw moving assembly connected to the image acquisition device, and the first lead screw moving assembly is used to drive the image acquisition device to move along a first direction;

[0011] A second lead screw moving assembly, connected to the first lead screw moving assembly, for driving the first lead screw moving assembly to move along a second direction;

[0012] A third lead screw moving assembly, connected to the second lead screw moving assembly, for driving the second lead screw moving assembly to move along a third direction;

[0013] Any two of the first direction, the second direction and the third direction are perpendicular to each other.

[0014] According to the photographing and image analysis system for a culture plate provided by the present utility model, the support device includes a frame and a tray, the tray is detachably arranged on the frame, and a plurality of light-transmitting grooves are arranged at the bottom of the tray for placing the culture plate.

[0015] According to the photographing and image analysis system for a culture plate provided by the present utility model, it further includes a first lighting device, the first lighting device is arranged on the frame and is located below the tray, and the emitted light of the first lighting device faces the tray.

[0016] According to the photographing and image analysis system for a culture plate provided by the present utility model, it further includes a second lighting device, the second lighting device is arranged around the tray, and the emitted light of the second lighting device faces the tray.

[0017] According to the photographing and image analysis system for a culture plate provided by the present utility model, the second lighting device includes:

[0018] A plurality of LED light sources, evenly distributed around the tray, and the emitted light of the LED light sources faces the tray;

[0019] Four light diffusing plates, corresponding to the positions of the LED light sources, and arranged on the side of the LED light sources facing the tray.

[0020] According to the photographing and image analysis system for a culture plate provided by the present utility model, it further includes a light-shielding housing, the light-shielding housing covers the outside of the support device, the image acquisition device and the moving device, and the light-shielding housing is used to prevent external light from entering the inside of the light-shielding housing.

[0021] According to the photographing and image analysis system for a culture plate provided by the present utility model, the image acquisition device includes an electron microscope camera or a multispectral camera.

[0022] According to the photographing and image analysis system for a culture plate provided by the present utility model, the control device includes:

[0023] A deep learning working module, electrically connected to the image acquisition device, for analyzing and processing the images acquired by the image acquisition device;

[0024] A mobile control module, electrically connected to the mobile device, for controlling the operation of the mobile device according to a preset command.

[0025] According to the photographing and image analysis system for a culture plate provided by the present utility model, the control device further includes:

[0026] An identification module, electrically connected to the image acquisition device, for identifying and inputting information of the culture plate;

[0027] A data storage module, electrically connected to the identification module, for storing the information identified and input by the identification module; the data storage module is electrically connected to the deep learning working module, and the data storage module is used for recording the analysis and processing results of the images by the deep learning working module.

[0028] In the photographing and image analysis system for a culture plate provided by the present utility model, a mobile device is used to drive the image acquisition device to move. In this way, during the process of the image acquisition device acquiring the sample images in the culture plate, the image acquisition device can realize the hole-by-hole photographing of the culture plate along with the movement of the mobile device; compared with the prior art, in the photographing and image analysis system for a culture plate provided by the present utility model, the image acquisition device can move arbitrarily, and thus the process of image acquisition is not limited by the specification size of the culture plate, nor by the number of single plates or multiple plates, and can meet the high-throughput experimental requirements; in addition, since the image acquisition device can perform hole-by-hole photographing, the images of each hole of the culture plate are directly acquired from directly above the hole. The images acquired in this way can completely observe the situation at the bottom of the hole, without generating a parallax effect, and can effectively improve the accuracy and precision of the photographing effect, and can improve the accuracy of the experimental results. Description of the Drawings

[0029] In order to more clearly illustrate the technical solutions in the present utility model or the prior art, the following will briefly introduce the drawings required to be used in the description of the embodiments or the prior art. Obviously, the following drawings are some embodiments of the present utility model. For those of ordinary skill in the art, other drawings can be obtained according to these drawings without creative efforts.

[0030] Figure 1 It is one of the structural schematic diagrams of the photographing and image analysis system for a culture plate provided by the embodiment of the present utility model.

[0031] Figure 2It is the second schematic structural diagram of the photographing and image analysis system of the culture plate provided by the embodiment of the present utility model.

[0032] Figure 3 It is the schematic structural diagram of the tray provided by the embodiment of the present utility model.

[0033] Reference numerals:

[0034] 100: Support device; 110: Frame; 120: Tray; 121: Translucent groove; 200: Image acquisition device; 300: Moving device; 310: First lead screw moving assembly; 320: Second lead screw moving assembly; 330: Third lead screw moving assembly; 400: First lighting device; 410: Second lighting device; 411: LED light source; 412: Light diffusing plate. Detailed implementation manners

[0035] In order to make the objectives, technical solutions and advantages of the present utility model clearer, the technical solutions in the present utility model will be clearly and completely described below with reference to the accompanying drawings in the present utility model. Apparently, the described embodiments are some but not all of the embodiments of the present utility model. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present utility model without creative efforts shall fall within the protection scope of the present utility model.

[0036] In the description of the embodiments of the present application, it should be noted that unless otherwise clearly defined and limited, the terms "connected" and "coupled" should be understood in a broad sense. For example, it may be a fixed connection, a detachable connection, or an integral connection; it may be a mechanical connection or an electrical connection; it may be directly connected or indirectly connected through an intermediate medium. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments of the present application can be understood according to specific situations.

[0037] In the embodiments of the present application, unless otherwise clearly defined and limited, the first feature being "on" or "under" the second feature may be that the first and second features are in direct contact, or the first and second features are indirectly in contact through an intermediate medium. Moreover, the first feature being "above", "over" and "on" the second feature may be that the first feature is directly above or obliquely above the second feature, or merely indicates that the first feature has a higher horizontal height than the second feature. The first feature being "under", "below" and "beneath" the second feature may be that the first feature is directly below or obliquely below the second feature, or merely indicates that the first feature has a lower horizontal height than the second feature.

[0038] In the description of this specification, the description referring to terms such as "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the embodiments of the present application. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0039] In the fields of life science and biomedical research, automated cell culture plate photography and image analysis systems are becoming increasingly popular. These systems typically consist of hardware and software components for automatically collecting and analyzing cell images in cell culture plates in anti-insect scenarios.

[0040] The following are some of the closest prior arts.

[0041] Multifunctional microscope system: Traditional multifunctional microscope systems are equipped with autofocus, photography, and image processing functions, and generally move the cell culture plate manually for shooting.

[0042] Cell imaging system: Combines a microscope and image analysis software, and can automatically capture and analyze cell images. These systems typically use high-resolution cameras, automated platforms, and built-in image analysis algorithms.

[0043] Robot workstation: Through robotic arms and precision positioning systems, it realizes the automatic processing and image acquisition of cell culture plates. These systems are usually integrated with a Laboratory Information Management System (LIMS) to achieve automated data processing and management.

[0044] Although the prior art has made significant progress in automated cell culture plate photography and image analysis, there are still the following several major drawbacks or deficiencies.

[0045] Low throughput: Existing systems can only take pictures of single plates, with low throughput and low operation convenience.

[0046] Parallax effect: When existing systems take pictures of the entire cell culture plate at a relatively high position, parallax effects will occur in the well positions at the edges (only the well walls can be seen, and the bottom situation cannot be observed).

[0047] High cost and complexity: Existing multi-functional microscope systems and robotic workstations are usually expensive and require professionals for maintenance and operation, increasing the usage cost and technical threshold.

[0048] Lack of flexibility: Existing systems have limited support for the specifications and types of cell culture plates. Even some systems only support one specification of cell culture plate, making it difficult to adapt to different experimental needs, and there are deficiencies in scalability and customization.

[0049] Limited data processing capacity: When existing systems process high-throughput image data, the processing efficiency is often low due to insufficient computing power, especially evident when processing the analysis results of deep learning models.

[0050] Complex user interface: The operation interfaces of some systems are not designed friendly enough, and users need to undergo long-term training to use them proficiently, which affects the popularization and application of the systems.

[0051] Inadequate data management: Existing systems have certain deficiencies in data storage, security, and traceability, making it difficult to meet the high-standard management requirements of scientific research data.

[0052] Poor environmental adaptability: Existing systems have high requirements for external environmental conditions such as light and temperature, and are easily affected by environmental changes, resulting in unstable shooting effects.

[0053] The embodiment of the present utility model provides a photographing and image analysis system for a culture plate, aiming to solve at least one of the above technical problems. The specific structure and usage method of the photographing and image analysis system for the culture plate of the present utility model will be described below in combination with Figures 1 - 3 Describe the specific structure and usage method of the photographing and image analysis system for the culture plate of the present utility model.

[0054] Figure 1 is one of the structural schematic diagrams of the photographing and image analysis system for the culture plate provided by the embodiment of the present utility model; Figure 2 is the second structural schematic diagram of the photographing and image analysis system for the culture plate provided by the embodiment of the present utility model.

[0055] Refer to Figure 1 and Figure 2 The photographing and image analysis system for the culture plate includes a support device 100, an image acquisition device 200, a moving device 300, and a control device. The support device 100 is used to place the culture plate. It should be noted that the culture plate described in the embodiment of the present utility model is not limited to the cell culture plate. In other words, the culture plate can be used to carry samples other than cells, such as insect samples, plant samples, or animal samples, etc. The culture plate can be adaptively adjusted according to actual experimental needs.

[0056] The image acquisition device 200 is located above the support device 100. The lens of the image acquisition device 200 faces the culture plate, and the image acquisition device 200 is used to acquire the sample images in the culture plate. The moving device 300 is also located above the support device 100. At the same time, the moving device 300 is connected to the image acquisition device 200. The moving device 300 is used to drive the image acquisition device 200 to take pictures of each well of the culture plate one by one. It should be noted that the "taking pictures of each well one by one" described in this article means taking pictures one by one directly above each well on the culture plate. This shooting method can clearly and completely capture all the situations inside each well.

[0057] The control device (not shown in the figure) can be arranged on the support device 100 and is electrically connected to the image acquisition device 200 and the moving device 300. The control device can also not be arranged on the support device 100 and is connected to the image acquisition device 200 and the moving device 300 by means of external connection through wires or wireless connection. The control device is used to analyze and process the sample images acquired by the image acquisition device 200 and present the processing results to the operator; the control device is also used to control the operation of the moving device 300, that is, to control the moving device 300 to drive the image acquisition device 200 to take pictures of each well of the culture plate one by one.

[0058] Refer to Figure 1 and Figure 2 , it can be understood that for the photographing and image analysis system of the culture plate provided by the embodiment of the present utility model, the moving device 300 is used to drive the image acquisition device 200 to move. In this way, during the process of the image acquisition device 200 acquiring the sample images in the culture plate, the image acquisition device 200 can realize taking pictures of each well of the culture plate along with the movement of the moving device 300; compared with the prior art, for the photographing and image analysis system of the culture plate provided by the embodiment of the present utility model, the image acquisition device 200 can move arbitrarily, and thus the process of image acquisition is not limited by the specification size of the culture plate, nor by the number of single plates or multiple plates, and can meet the high-throughput experimental requirements; in addition, since the image acquisition device 200 can take pictures of each well one by one, the images of each well of the culture plate are directly acquired from directly above the well. The images acquired in this way can completely observe the situation at the bottom of the well, without generating a parallax effect, and can effectively improve the accuracy and precision of the shooting effect, and can improve the accuracy of the experimental results.

[0059] According to the actual experimental results, the photographing and image analysis system of the culture plate provided by the embodiment of the present utility model supports single-task shooting of 18 culture plates of five specifications (6, 12, 24, 48, 96-well plates). The maximum number of pictures that can be obtained and analyzed in 1728 wells (multiple plates) can be completed in one operation; compared with the prior art devices that can only shoot single plates and can only shoot for one specification, it has significant advantages.

[0060] Continue to refer to Figure 1 and Figure 2 In an alternative embodiment of the present utility model, the mobile device 300 includes a first lead screw moving assembly 310, a second lead screw moving assembly 320, and a third lead screw moving assembly 330. The first lead screw moving assembly 310 is connected to the image acquisition device 200, and the first lead screw moving assembly 310 is used to drive the image acquisition device 200 to move in a first direction; the second lead screw moving assembly 320 is connected to the first lead screw moving assembly 310, and the second lead screw moving assembly 320 is used to drive the first lead screw moving assembly 310 and the image acquisition device 200 to move in a second direction; the third lead screw moving assembly 330 is connected to the second lead screw moving assembly 320, and the third lead screw moving assembly 330 is used to drive the second lead screw moving assembly 320, the first lead screw moving assembly 310, and the image acquisition device 200 to move in a third direction.

[0061] It should be noted that any two of the first direction, the second direction, and the third direction are perpendicular to each other. In other words, the first direction, the second direction, and the third direction can specifically be the three-dimensional coordinate axes in a three-dimensional coordinate space. In this way, the mobile device 300 can drive the image acquisition device 200 to perform arbitrary translational motions in three-dimensional space. Based on this, the image acquisition device 200 can perform hole-by-hole shooting of the culture plate.

[0062] The first lead screw moving assembly 310, the second lead screw moving assembly 320, and the third lead screw moving assembly 330 are similar to each other. Taking the first lead screw moving assembly 310 as an example, the first lead screw moving assembly 310 may include a ball screw, a linear guide rail, a support base, and a driving device (motor), etc. During installation, the image acquisition device 200 can be installed on the slider of the ball screw. In this way, when the driving motor drives the ball screw to rotate, the slider can drive the image acquisition device 200 to move along the length direction of the linear guide rail under the restriction of the linear guide rail; the specific structures of the second lead screw moving assembly 320 and the third lead screw moving assembly 330 are similar to that of the first lead screw moving assembly 310, which will not be elaborated herein. It should be noted that during assembly, the linear guide rails of the first lead screw moving assembly 310, the second lead screw moving assembly 320, and the third lead screw moving assembly 330 need to be set to be perpendicular to each other in pairs to meet the setting that the first direction, the second direction, and the third direction are perpendicular to each other in pairs. In other words, the aforementioned first direction, second direction, and third direction correspond to the length directions of the linear guide rails of the first lead screw moving assembly 310, the second lead screw moving assembly 320, and the third lead screw moving assembly 330, respectively.

[0063] In an alternative embodiment of the present utility model, the mobile device 300 can also directly adopt existing devices such as a three-axis gantry lead screw module, a four-axis gantry lead screw module, a robotic arm, and a parallel robot, etc., to meet the three-dimensional movement requirements of the image acquisition device 200. Specifically, it can be adaptively selected according to the actual situation.

[0064] It should be noted that the movement precision error of the first lead screw moving assembly 310, the second lead screw moving assembly 320, and the third lead screw moving assembly 330 provided in this embodiment needs to be within ±0.01 mm. It can be understood that due to the existence of movement errors, as the number of photographed holes increases, when the image acquisition device 200 photographs the holes with a later position sequence, the accuracy of the photographing position may decrease. By limiting the movement precision within the above range, the problem of the decrease in the photographing precision of the later holes caused by excessive hole-by-hole photographing times can be solved, the parallax effect of the holes with a later position can be avoided, and the photographing precision and the accuracy of the experimental results can be improved.

[0065] Refer to Figure 1 , it can be understood that for the photographing and image analysis system of the culture plate provided by the embodiment of the present utility model, the lead screw mechanism has high-precision positioning ability. By setting the first lead screw moving group, the second lead screw moving assembly 320, and the third lead screw moving assembly 330, it can ensure that the image acquisition device 200 accurately moves above each hole position of the culture plate to achieve precise photographing; in addition, the lead screw drive has good repeat positioning precision and stability, can maintain consistent performance during long-term operation, and reduce the image quality fluctuation caused by mechanical errors; the fast and precise moving ability of the lead screw drive can enable the system to process a large number of culture plates in a short time to meet the requirements of high-throughput experiments. Moreover, the lead screw module usually adopts wear-resistant materials and precision machining, has a long service life, and is suitable for long-term and high-frequency laboratory operations.

[0066] In an alternative embodiment of the present utility model, a limit switch can also be set to limit the movement of the first lead screw moving assembly 310, the second lead screw moving assembly 320, and the third lead screw moving assembly 330 to prevent over-limit operation, which can ensure the safety of the mobile device 300. Specifically, it can be adaptively set according to the actual situation.

[0067] Figure 3 is a schematic structural diagram of the tray provided by the embodiment of the present utility model.

[0068] Refer to Figures 1 to 3, in an alternative embodiment of the present utility model, the support device 100 includes a frame 110 and a tray 120. The tray 120 is detachably disposed on the frame 110. A plurality of hollow light-transmitting grooves 121 are provided at the bottom of the tray 120 for placing culture plates. It can be understood that the detachable connection between the tray 120 and the frame 110, on the one hand, allows for the quick replacement of trays 120 of different specifications to adapt to culture plates of different sizes and types, which can improve the flexibility and versatility of the system. On the other hand, the laboratory may need to conduct various types of experiments. The detachable connection enables the system to easily adapt to different experimental requirements without replacing the entire frame 110. At the same time, the detachable connection also allows the two components to be packaged separately, reducing the transportation volume and lowering the transportation cost and risk.

[0069] In addition, the hollow light-transmitting grooves 121 at the bottom of the tray 120 allow the bottom light source to directly pass through the tray 120 and project onto the bottom of the culture plate, ensuring that the light is evenly distributed over each well, improving the quality of the photographed images. Moreover, the hollow light-transmitting grooves 121 with a hollow design make the tray 120 easier to clean. Liquids and contaminants can flow out more easily from the bottom of the tray 120, reducing residues.

[0070] Continue to refer to Figure 1 and Figure 2 , in an alternative embodiment of the present utility model, the photographing and image analysis system for the culture plate further includes a first lighting device 400. The first lighting device 400 is disposed on the frame 110 and is located below the tray 120. The emitted light of the first lighting device 400 is directed towards the tray 120. It can be understood that by providing the first lighting device 400 below the tray 120, a light source can be provided from the bottom of the tray. The bottom light source can directly irradiate each well of the culture plate, ensuring uniform light distribution, reducing the difference in image quality caused by uneven illumination, helping to enhance the contrast of the image, and making the details of cells or other samples more obvious.

[0071] Continue to refer to Figure 1 and Figure 2, in an alternative embodiment of the present utility model, the photographing and image analysis system of the culture plate further includes a second lighting device 410. The second lighting device 410 is disposed around the tray 120 and is used to provide supplementary light for the image acquisition device 200 in the circumferential direction. It can be understood that by providing the second lighting device 410, the light sources around can provide light rays that irradiate the culture plate from multiple angles, which helps to achieve a more uniform lighting effect and reduce the image quality differences caused by uneven lighting. In addition, since the light sources are distributed around the tray 120, the shadows caused by the structure of the tray 120 or the sample itself can be effectively reduced or eliminated, which can improve the clarity and consistency of the image. Moreover, the light sources around can provide a more three-dimensional and rich lighting, which helps to enhance the three-dimensional sense of the image and make the morphology of cells or other samples more real. Additionally, the light sources around the tray 120 can act as a barrier to reduce the interference of external light sources on the experiment and ensure the accuracy of the experimental results.

[0072] Continue to refer to Figure 1 and Figure 2 , in an alternative embodiment of the present utility model, the second lighting device 410 includes a plurality of LED light sources 411 and four light diffusion plates 412. The plurality of LED light sources 411 are evenly distributed around the tray 120, and the emitted light rays of the LED light sources 411 are directed towards the tray 120. The four light diffusion plates 412 correspond to the positions of the plurality of LED light sources 411 and are disposed on the side of the LED light sources 411 facing the tray 120.

[0073] It can be understood that the LED light sources 411 themselves have a high energy efficiency ratio. Combining with the use of the light diffusion plates 412, it can reduce energy consumption while providing uniform lighting. The uniform light provided by this setting can reduce the reflection and shadow on the surface of the culture plate, making the captured image clearer and facilitating subsequent image analysis. In addition, the light diffusion plates 412 can evenly scatter the light rays emitted by the LED light sources 411 to each well of the entire cell culture plate, ensuring the lighting uniformity of each well and reducing the image quality differences caused by uneven lighting. At the same time, it can also effectively reduce or eliminate the "hot spots" that may be generated by the LED light sources 411, that is, the areas with uneven light intensity, and improve the consistency of the image.

[0074] In an alternative embodiment of the present utility model, the first lighting device 400 can also be set as an LED light source and a light diffusion plate. Specifically, it can be adaptively selected according to the actual situation.

[0075] In an alternative embodiment of the present utility model, multiple LED light sources 411 in the first lighting device 400 and the second lighting device 410 can be individually controlled for switching and brightness, so that the lighting conditions can be adjusted according to different experimental requirements. Additionally, in some alternative examples, by adjusting the brightness and color temperature of the LED light sources 411, different types of culture plates and experimental conditions can be adapted, which can improve the adaptability and flexibility of the system.

[0076] In an alternative embodiment of the present utility model, the light sources of the first lighting device 400 and the second lighting device 410 can also be selected as other light sources such as ultraviolet light sources or lasers. Specifically, they can be adaptively set according to actual experimental requirements.

[0077] In an alternative embodiment of the present utility model, the photographing and image analysis system for the culture plate further includes a light-shielding housing (not shown in the figure). The light-shielding housing is made of light-impermeable material, for example, non-transparent acrylic board. The light-shielding housing covers the outside of the support device 100, the image acquisition device 200, and the moving device 300. The light-shielding housing is used to prevent external light from entering the inside of the light-shielding housing.

[0078] It can be understood that the light-shielding housing blocks external light from entering the system, which can ensure stable lighting conditions during the experiment, not affected by changes in the external environment, can avoid interference of external stray light on the experimental results, and at the same time can reduce the light pollution of the internal light source to the outside world, ensuring the consistency and stability of the shooting effect under various environmental conditions.

[0079] In addition, the light-shielding housing can also provide a physical barrier for the precision components inside the system, preventing damage to the equipment caused by accidental impacts, dust, liquids, etc. At the same time, it can effectively isolate external dust and moisture, reducing the impact on internal electronic components and optical components, and extending the service life of the equipment. Additionally, the light-shielding housing can be part of the electrical isolation, preventing users from directly contacting the internal electrical components, reducing the risk of electric shock. When dealing with biological samples, the housing can also provide a certain degree of biosafety protection, preventing sample leakage or splashing from causing harm to the operator.

[0080] In an alternative embodiment of the present utility model, the image acquisition device 200 includes an electron microscope camera or a multispectral camera. It should be noted that when the image acquisition device 200 is an electron microscope camera, the covered field of view of the electron microscope camera needs to be within the range of 10 mm to 35 mm of the short side to meet the shooting requirements for multi-specification culture plates. It can be understood that the electron microscope camera can maintain stable imaging conditions, improve the quality of image acquisition, and is beneficial to subsequent image analysis and data comparison.

[0081] In an alternative embodiment of the present utility model, the control device includes a deep learning working module and a movement control module. The deep learning working module is electrically connected to the image acquisition device 200. The deep learning working module is used to analyze and process the images acquired by the image acquisition device 200. The deep learning working module has powerful computing capabilities, supports user-defined deep learning algorithm models, can quickly and accurately analyze the captured images. The deep learning working module can also call the GPU for image inference to improve the image processing efficiency and can significantly shorten the data analysis time. The deep learning working module can refer to high-performance computers with artificial intelligence (AI) computing capabilities in the prior art for adaptive design, as long as it meets the functions of image processing and data analysis.

[0082] The movement control module is electrically connected to the mobile device 300. The movement control module is used to control the operation of the mobile device according to a preset command. Specifically, according to different specifications and models of culture plates, a preset command that coincides with the movement path of the image acquisition device 200 can be preset and input into the movement control module. When the device is started, the movement control module can directly control the mobile device 300 to operate according to the preset command. Such a setting can effectively improve the automation of the photographing and image analysis system of the culture plate and can improve the overall experimental efficiency.

[0083] In an alternative embodiment of the present utility model, the deep learning module can also adopt an open-source image processing library or a distributed computing framework, etc., or can also adopt processing methods such as integrating third-party image processing plugins or modules or using cloud computing resources. Specifically, it can be adaptively selected according to the actual situation.

[0084] In an alternative embodiment of the present utility model, the control device further includes an identification module and a data storage module. The identification module is electrically connected to the image acquisition module. The identification module is used to identify and input information for the images acquired by the image acquisition device 200. For example, a two-dimensional code or a bar code is set on the culture plate. In this way, when the image recognition device scans the image of the culture plate, according to the database built in the data storage module, the information of the currently to-be-processed culture plate can be identified and input. It can be understood that by setting the identification module, the system can automatically identify and record the unique identifier of each culture plate or well position, reduce the possibility of manual input errors, and improve the accuracy of the data. In other words, the automatic identification and input reduces human intervention and reduces data errors caused by operation mistakes.

[0085] In addition, the input speed of the recognition module is fast, and it can complete the identification input of a large number of samples in a short time, significantly improving work efficiency. Compared with manual input, the recognition module saves a large amount of data input time, enabling operators to spend more time on other experimental operations. Moreover, the data input by the recognition module can be directly associated with other data in the system, facilitating unified management and query. Additionally, the barcodes or QR codes of each culture plate are unique, which helps to achieve data traceability and audit tracking. Furthermore, the recognition and input of the recognition module follow a standardized operation process, which helps to ensure the consistency of experimental operations and improve the repeatability of experiments. By means of standardized input, variables in the experimental process can be reduced, making the experimental results more reliable.

[0086] In high-throughput experiments, a large number of samples and data need to be processed. By using the recognition module for information recognition and input, the identification information of a large number of samples can be quickly processed to meet the requirements of high-throughput. In the data input link, the recognition module can reduce the bottleneck of manual operations and improve the fluency of the entire experimental process. In addition, the recognition and input operation of the recognition module is simple and intuitive, enhancing the user experience. Due to the simple operation, new users can quickly get started, and it can also reduce training costs and time.

[0087] The data storage module is electrically connected to the recognition module and is used to store the information input by the recognition module. The data storage module is also electrically connected to the deep learning working module and is used to record the analysis and processing results of the deep learning module on images. It can be understood that the control device provided by the embodiment of the present utility model can provide safe and convenient data storage and management functions for experiments by setting the recognition module and the data storage module, ensuring the integrity and traceability of experimental data.

[0088] In an optional embodiment of the present utility model, the control device can also be provided with corresponding modules to support functions such as local data storage, image preview, and data export, which can facilitate users to manage and analyze experimental data. In an optional embodiment of the present utility model, the control device can also reserve expansion interfaces for hardware and software to support future function upgrades and expansions, ensuring the high efficiency and adaptability of the system.

[0089] In an alternative embodiment of the present utility model, an alarm device electrically connected to the control device may also be provided. Specifically, the alarm device may be equipped with an equipment operating status indicator light and a system monitoring component. Correspondingly, a monitoring module and the like may be provided in the control device. Specifically, it can be adaptively designed according to actual requirements and existing technologies. It can be understood that by setting the alarm device, the operating status of the system can be monitored in real time, and abnormal situations can be detected and reported in a timely manner. Specifically, during photographing or movement, in case of abnormal situations (such as position deviation or camera failure), the system can automatically stop and give an alarm. Further, the user can perform fault troubleshooting and handling through the interface prompt to ensure the smooth progress of the experiment.

[0090] In an alternative embodiment of the present utility model, the control device may integrally design the foregoing various modules on a PLC board, and specifically, an existing PLC control system may be used for adaptive design; in an alternative example of the present utility model, the control device may also choose to use an embedded control system, and specifically, it can be adaptively selected according to the actual situation.

[0091] In an alternative embodiment of the present utility model, the photographing and image analysis system of the culture plate may also be provided with a multi-mode imaging device, such as a fluorescence imaging device, an optical coherence tomography (OCT) device, etc., for realizing multi-angle and multi-level analysis of cell samples. In an alternative embodiment of the present utility model, the photographing and image analysis system of the culture plate may also, through the Internet of Things technology, realize remote monitoring and management of the system. In this way, the user can view the operating status of the system and experimental data in real time at any location, improving the convenience of experimental management.

[0092] Another alternative embodiment of the present utility model further provides a software system matching the photographing and image analysis system of the culture plate, and the software system may include the following modules.

[0093] 1. Camera calibration module, which has a visual calibration tool to ensure precise adjustment of the camera's field of view.

[0094] 2. Motion control module, which has the functions of realizing camera photographing, motion control, positioning, and motion planning, and can support random placement and photographing of the culture plate; in addition, it can also calibrate the moving path of the moving device 300 to ensure accurate arrival at the predetermined hole position.

[0095] 3. Automatic photographing management module, which can control the camera to automatically take pictures and crop the pictures, ensure one picture for one hole, and organize and store files according to the designed data structure.

[0096] 4. Batch processing and job management module, which can optimize the execution process of photographing all hole positions of a single cell culture plate and support the function of automatically executing the photographing plan at a specified time interval.

[0097] 5. Image Analysis and Algorithm Management Module, which can manage the addition, modification, deletion, custom requests, and return interfaces of image analysis models, support generating reports by calling model interfaces, and support customizing report templates.

[0098] 6. User Permission Management Module, which can set different user roles and permissions to ensure system security and data protection, support user access control management, and record user operation logs.

[0099] 7. Log Management Module, which can record system operation and event logs for easy troubleshooting and system maintenance, and provide a log query function.

[0100] 8. Application System Update, Maintenance, and Extension Support Module, which can provide application system update functions, support OTA remote updates, be compatible with the Windows operating system for the application system, support offline work without the workstation being connected to the Internet and local area network, and ensure data security.

[0101] 9. Multifunctional Image Analysis and Report Generation Module, which supports the invocation and management of user-defined deep learning models to ensure the accuracy and flexibility of data processing, supports generating reports by calling model interfaces, and provides report export functions in multiple formats such as Excel / CSV for easy data analysis and sharing.

[0102] The following shows the usage process of the photographing and image analysis system for the culture plate provided by the embodiments of the present invention.

[0103] 1. Initialization:

[0104] a. After the system starts, modules such as the deep learning working module and the mobile control module, as well as the electron microscope camera, perform self-checks to ensure that each module is working properly;

[0105] b. The user sets the type of the culture plate and the photographing parameters through the operation interface.

[0106] 2. Culture Plate ID Identification and Placement:

[0107] a. The user places the culture plate at the designated position on the tray 120;

[0108] b. The system scans and identifies the ID of the culture plate through the identification module and records the experimental information.

[0109] 3. Field of View Adjustment of the Electron Microscope Camera:

[0110] a. According to different placement specifications of the culture plate, manually rotate the knob on the electron microscope camera to adjust the shooting field of view.

[0111] 4. Automatic Positioning and Photographing:

[0112] a. The movement control module calculates the specific positions of each hole where it needs to stop according to the preset commands set by the user, and drives the movement device 300 to move the electron microscope camera to the specified hole positions.

[0113] b. After reaching the specified positions, the electron microscope camera automatically takes pictures to avoid parallax effects and transmits the images to the deep learning working module.

[0114] 5. Image processing and analysis:

[0115] a. After receiving the images, the deep learning working module calls the deep learning algorithms preset by the user for image analysis.

[0116] b. The analysis results include but are not limited to the degree of leaf damage, the health of the bugs, etc., and an experimental report is generated.

[0117] 6. Data storage and management:

[0118] a. The system stores all images and analysis results in the data storage module to ensure data security and traceability.

[0119] b. The user can view and export the data through the operation interface to generate reports.

[0120] 7. Exception handling:

[0121] a. During the process of taking pictures or moving, in case of abnormal situations (such as position deviation or camera failure), the system will automatically stop and alarm.

[0122] b. The user conducts troubleshooting and handling according to the interface prompts to ensure the smooth progress of the experiment.

[0123] It should be noted that the technical solutions in the various embodiments of the present utility model can be combined with each other, but the basis for the combination is that those of ordinary skill in the art can implement it; when the combination of technical solutions results in contradictions or cannot be implemented, it should be considered that such a combination of technical solutions does not exist, that is, it does not belong to the protection scope of the present utility model either.

[0124] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present utility model, rather than to limit it; although the present utility model has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present utility model.

Claims

1. A photographing and image analysis system for a culture plate, characterized in that, Comprising: A support device (100) for placing a culture plate; A moving device (300) disposed above the support device (100); An image acquisition device (200) connected to the moving device (300), adapted to take pictures of each well of the culture plate driven by the moving device (300) for acquiring images of samples in the culture plate; A control device electrically connected to the image acquisition device (200) and the moving device (300) respectively. The control device is used to control the movement of the moving device (300) to drive the image acquisition device (200) to take pictures of each well, and the control device is also used to analyze and process the images acquired by the image acquisition device (200).

2. The photographing and image analysis system of the culture plate according to claim 1, characterized in that, The moving device (300) includes: A first lead screw moving assembly (310) connected to the image acquisition device (200), and the first lead screw moving assembly (310) is used to drive the image acquisition device (200) to move in a first direction; A second lead screw moving assembly (320) connected to the first lead screw moving assembly (310), and the second lead screw moving assembly (320) is used to drive the first lead screw moving assembly (310) to move in a second direction; A third lead screw moving assembly (330) connected to the second lead screw moving assembly (320), and the third lead screw moving assembly (330) is used to drive the second lead screw moving assembly (320) to move in a third direction; Any two of the first direction, the second direction and the third direction are perpendicular to each other.

3. The photographing and image analysis system for the culture plate according to claim 1, wherein The support device (100) includes a frame (110) and a tray (120). The tray (120) is detachably disposed on the frame (110). A plurality of light-transmitting grooves (121) are provided at the bottom of the tray (120), and the light-transmitting grooves (121) are used to place a culture plate.

4. The photographing and image analysis system of the culture plate according to claim 3, wherein It further includes a first lighting device (400). The first lighting device (400) is disposed on the frame (110) and located below the tray (120). The outgoing light of the first lighting device (400) faces the tray (120).

5. The photographing and image analysis system of the culture plate according to claim 3, wherein It further includes a second lighting device (410). The second lighting device (410) is disposed around the tray (120). The outgoing light of the second lighting device (410) faces the tray (120).

6. The photographing and image analysis system of the culture plate according to claim 5, wherein The second lighting device (410) includes: A plurality of LED light sources (411) evenly distributed around the tray (120). The outgoing light of the LED light sources (411) faces the tray (120); Four light diffusing plates (412) corresponding to the positions of the LED light sources (411) and disposed on the side of the LED light sources (411) facing the tray (120).

7. The photographing and image analysis system for the culture plate according to any one of claims 1 to 6, characterized in that It further includes a light-shielding housing. The light-shielding housing covers the outside of the support device (100), the image acquisition device (200) and the moving device (300), and the light-shielding housing is used to prevent external light from entering the inside of the light-shielding housing.

8. The photographing and image analysis system for the culture plate according to any one of claims 1 to 6, characterized in that The image acquisition device (200) includes an electron microscope camera or a multispectral camera.

9. The photographing and image analysis system for the culture plate according to any one of claims 1 to 6, characterized in that, The control device includes: A deep learning working module, electrically connected to the image acquisition device (200), for analyzing and processing the images acquired by the image acquisition device (200); A movement control module, electrically connected to the mobile device (300), for controlling the operation of the mobile device (300) according to a preset command.

10. The photographing and image analysis system for the culture plate according to claim 9, wherein The control device further includes: An identification module, electrically connected to the image acquisition device (200), for identifying and inputting information of the culture plate; A data storage module, electrically connected to the identification module, for storing the information identified and input by the identification module; the data storage module is electrically connected to the deep learning working module, and the data storage module is used for recording the analysis and processing results of the images by the deep learning working module.

Images