Microscopic image analyzer

Abstract

The utility model discloses a microscopic image analyzer, and relates to the field of laboratory auxiliary instruments. According to the utility model, the camera module, the visual processing mainboard, the display screen and the battery are arranged, and the visual processing mainboard is provided with the target marking module and the target scoring module, so that microscopic images of a common optical microscope can be shot by means of the camera module; the target marking module automatically marks a cell graph in a microscopic image through a trained model, and the target scoring module automatically scores the similarity between a cell target and the cell graph, so that the analyzer can help students to quickly and accurately identify curriculum target cells. The analyzer provided by the utility model has the advantages of simple structure, convenience in movement, reasonable overall configuration cost and suitability for being popularized in biological experiment classrooms, and can be transferred and used among students, and the similarity score of the found cells and the target cells is given out, so that the biological course teaching of teachers is effectively assisted, and the analyzer provided by the utility model is simple in structure, convenient to move and suitable for being popularized in biological experiment classrooms.

Description

Technical Field

[0001] The utility model relates to the field of microscopic image analyzers, in particular to a microscopic image analyzer which is used in a biological experiment classroom and can shoot and analyze optical microscope images. Background Art

[0002] In biology classes, microscopes are often used in experiments to help students observe and understand various cells. However, for most students who are new to microscopy, it is difficult to find the target cells with clear images. Students tend to confuse target cells with bubbles, impurities, etc., but when there are many students who need help to check, it will take a long time for the teacher to guide them one by one.

[0003] In a well-equipped biological experiment classroom, there may be a microscope with photography, recording and display functions. In this case, students can try to take images of target cells by themselves. Although teachers can quickly confirm whether students' operations and identifications are correct by browsing pictures, they still need help to identify whether the captured images contain target cells. At the same time, it is understandable that microscopes with photography functions are expensive, and most biological laboratories still use ordinary optical microscopes. Therefore, setting up a microscope with a photography function cannot solve the problem of a large number of existing experimental assistance systems that are only equipped with ordinary optical microscopes.

[0004] It can be seen that the current biology classroom lacks suitable products to assist teachers in biology experiment teaching and help students in biology experiment learning. Utility Model Content

[0005] In order to solve the problems existing in the prior art, the main purpose of the utility model is to provide a microscopic image analyzer, which can capture images of an ordinary optical microscope, automatically identify the correct and clear target cells in the captured microscopic images, and automatically score them, thereby helping students to learn biological experiments in a simple and low-cost way, and assisting teachers in biological experiment teaching, greatly increasing the interest, operability and simplicity of microscopic experiments.

[0006] In order to achieve the above purpose, the utility model adopts the following technical solutions:

[0007] A microscopic image analyzer comprises a camera module, a visual processing mainboard, a display screen, a switch button and a battery, wherein the visual processing mainboard comprises: a target marking module, used to mark the cell graphics in a microscopic image according to a trained model of a preset cell target, and mark the cell graphics in the displayed microscopic image; a target scoring module, used to score according to the similarity between the cell target of the trained model and the cell graphics in the microscopic image, and mark the score in the displayed microscopic image; the camera module is electrically connected to the visual processing mainboard, and is used to obtain the microscopic image through the eyepiece of a shooting microscope; the display screen is electrically connected to the visual processing mainboard, and is used to display the obtained microscopic image; the battery is connected to the visual processing mainboard for power supply;

[0008] The camera module comprises a camera head and an eyepiece adapter, wherein the distal end of the eyepiece adapter is used to be sleeved onto the eyepiece of the optical microscope, and the proximal end of the eyepiece adapter is used to be connected to the camera head;

[0009] The eyepiece adapter comprises a first connecting tube, a second connecting tube and a locking nut. The interiors of the first connecting tube and the second connecting tube are through structures respectively. The distal end of the first connecting tube is used to be sleeved onto the eyepiece of the optical microscope, and the proximal end of the second connecting tube is used to be connected to the camera. The distal inner side wall of the first connecting tube is provided with an internal thread, and the distal outer side wall of the second connecting tube is provided with an external thread. The locking nut is matched and connected to the external thread of the second connecting tube, and the internal thread of the first connecting tube is matched and connected to the external thread of the second connecting tube.

[0010] The switch button is electrically connected to the visual processing mainboard, and the visual processing mainboard receives a signal from the switch button to determine the collected microscopic image.

[0011] Optionally, the second connecting tube is provided with an inner sleeve made of elastic material, and the inner diameter of the inner sleeve is installed with the camera in an interference fit.

[0012] Optionally, the inner diameter of the distal end of the first connecting tube is larger than the outer diameter of the eyepiece of the optical microscope.

[0013] Optionally, the camera is electrically connected to a visual processing mainboard via a wire.

[0014] Optionally, the visual processing mainboard also includes a wireless communication module, which is used to establish communication with a host device and send microscopic images of marked cell graphics and scores.

[0015] Optionally, the visual processing mainboard also includes a storage module, which is used to store microscopic images of marked cell graphics and scores.

[0016] Optionally, the visual processing mainboard is one of the Orange Pi5 plus development board, the NVIDIA Jetson Nano development board or the Intel NUC development board.

[0017] Compared with the prior art, the utility model has the following beneficial effects:

[0018] (1) The present invention is provided with a camera module, a visual processing mainboard, a display screen and a battery, wherein the visual processing mainboard is provided with a target marking module and a target scoring module. With the aid of the camera module, a microscopic image of an ordinary optical microscope is captured. The target marking module automatically marks the cell graphics in the microscopic image through a trained model. The target scoring module automatically scores the similarity between the cell target and the cell graphics, so that the analyzer can help students quickly and accurately identify the target cells of the course, and give the similarity score between the found cells and the target cells, etc., effectively assisting teachers in teaching biology courses. At the same time, the analyzer of the present invention has a simple structure and is easy to move. It can be passed between students for use. The overall configuration cost is reasonable and suitable for promotion in biology experiment classrooms. The camera module is provided with an eyepiece adapter, so that the distance between the camera and the eyepiece can be adjusted, thereby facilitating the focusing of the camera, and students can use the analyzer of the present invention more quickly and conveniently. The present invention is provided with a switch button, and the corresponding microscopic image is captured according to the operation of the switch button by the student, so that the student can obtain the experimental work and improve the interest of the experiment.

[0019] (2) The present invention further provides a wireless communication module so that the microscopic images taken by students can be transmitted to the host computer in the classroom and displayed on the public screen through the wireless communication module, thereby greatly increasing the interest of the microscope experiment.

[0020] The utility model is further described below in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A schematic diagram of the circuit structure of the microscopic image analyzer according to the utility model.

[0022] Figure 2 A schematic diagram of the actual three-dimensional structure of the microscopic image analyzer according to the utility model.

[0023] Figure 3 A schematic cross-sectional structure diagram of a portion of a camera module of a microscopic image analyzer according to the utility model.

[0024] Figure 4 A schematic diagram of a microscopic image taken by the microscopic image analyzer according to the utility model.

[0025] Figure numerals: 10, camera module; 11, camera head; 12, eyepiece adapter; 13, wire; 121, first connecting tube; 122, second connecting tube; 123, locking nut; 124, inner sleeve; 20, visual processing main board; 21, target marking module; 22, target scoring module; 23, wireless communication module; 24, storage module; 30, display screen; 40, switch button; 50, battery; 100, microscope eyepiece; 200, microscopic image; 201, cell graphic; 203, identification box; 204, similarity score. DETAILED DESCRIPTION

[0026] In order to better illustrate the purpose, technical solution and advantages of the utility model, the specific implementation of the utility model is further described in detail below in conjunction with the drawings and embodiments. The following embodiments are used to illustrate the utility model, but are not intended to limit the scope of the utility model.

[0027] like Figures 1 to 3 As shown, it is a microscopic image analyzer according to an embodiment of the utility model. The microscopic image analyzer includes a camera module 10, a visual processing mainboard 20, a display screen 30, a switch button 40, a battery 50 and a wire 13. Among them, the camera module 10 is connected to the visual processing mainboard 20 through the wire 13, and is used to obtain a microscopic image 200 by shooting the eyepiece of an ordinary optical microscope. The display screen 30 is electrically connected to the visual processing mainboard 20, and is used to display the acquired microscopic image 200. The switch button 40 is electrically connected to the visual processing mainboard 20, and the visual processing mainboard 20 receives the signal of the switch button 40 to determine the collected microscopic image 200. The battery 50 is installed on the visual processing mainboard 20 and is connected to the visual processing mainboard 20 for power supply, providing power for the operation of the visual processing mainboard 20, the display screen 30, the camera module 10 and the switch button 40.

[0028] In detail, the visual processing mainboard 20 is configured with a target marking module 21, a target scoring module 22, a wireless communication module 23 and a storage module 24. Among them, the target marking module 21 is used to mark the cell graphics 201 in the microscopic image 200 according to the trained model of the preset cell target, and mark the cell graphics 201 in the displayed microscopic image 200. The target scoring module 22 is used to score according to the similarity between the cell target of the trained model and the cell graphics 201 of the microscopic image 200, and mark the score in the displayed microscopic image 200. The wireless communication module is used to establish communication with the upper device and send the microscopic image 200 with the marked cell graphics 201 and the score. The storage module 24 is used to store the microscopic image 200 with the marked cell graphics 201 and the score.

[0029] refer to Figure 3In order to make the camera module 10 better cooperate with the optical microscope, in this embodiment, specifically, the camera module 10 includes a camera head 11 and an eyepiece adapter 12. The eyepiece adapter 12 is composed of a first connecting tube 121, a second connecting tube 122 and a locking nut 123. The interior of the first connecting tube 121 is a cylindrical through structure, which is compatible with the traditional microscope eyepiece 100. The interior of the second connecting tube 122 is a cylindrical or square column through structure, which is compatible with the selected camera head 11. The distal end of the first connecting tube 121 is used to be sleeved onto the microscope eyepiece 100, and the proximal end of the second connecting tube 122 is used to be connected to the camera head 11. The distal inner side wall of the first connecting tube 121 is provided with an internal thread, and the distal outer side wall of the second connecting tube 122 is provided with an external thread. The locking nut 123 is matched and connected to the external thread of the second connecting tube 122, and the internal thread of the first connecting tube 121 is matched and connected with the external thread of the second connecting tube 122. When in use, the first connecting tube 121 and the second connecting tube 122 adjust the distance of the screw thread to adjust the distance between the camera 11 and the microscope eyepiece 100 until the camera 11 is set to shoot a microscopic image 200. After the adjustment is completed, the locking nut 123 is screwed outward so that the locking nut 123 abuts against the proximal end of the first connecting tube 121, thereby preventing the focal length from changing due to accidental touch. Further, the inner diameter of the distal end of the first connecting tube 121 is larger than the outer diameter of the eyepiece of the optical microscope. Students can rotate the first connecting tube 121 so that the microscopic image 200 is upright. Students can move the first connecting tube 121 so that the microscopic image 200 is centered. Further, the second connecting tube 122 is provided with an inner sleeve 124 made of elastic material, and the inner diameter of the inner sleeve 124 is installed with the camera 11 in an interference fit, so that the eyepiece adapter 12 can be quickly and stably fixed to the camera 11.

[0030] refer to Figure 4 In a schematic use case of a microscopic image analyzer, a main body including a visual processing mainboard 20 and a display screen 30 is placed on a laboratory desktop; a camera module 10 is mounted on the eyepiece of an ordinary optical microscope; the camera module 10 captures the image in the microscope eyepiece 100 and displays it on the display; a switch button 40 is used to determine the captured microscopic image 200 with a cell graphic 201 and display it on the display; a target marking module 21 of the visual processing mainboard 20 generates an identification frame 203 at the position of the cell graphic 201 in the microscopic image 200, thereby marking the target cell; a target scoring module 22 of the visual processing mainboard 20 generates a similarity score 204 at the position of the cell graphic 201 in the microscopic image 200.

[0031] It can be seen that the microscopic image analyzer of the utility model can take microscopic images 200 that meet the biological experiment objectives under the operation of students, and can quickly and accurately mark the target cells and give similarity scores, thereby helping students to conduct biological course experiments and assisting teachers in teaching biological courses. At the same time, the microscopic image analyzer can not only be used on any optical microscope, but also is powered by a battery 50 and can be switched to other microscopes in the laboratory at will, which is convenient for transfer and use between students. Each biology class only needs one or several units to meet the needs of the entire class, greatly reducing the teaching cost.

[0032] It is worth noting that the visual processing mainboard 20 can pre-shoot a plurality of microscopic images 200, manually annotate the microscopic images 200, pre-train the model using fastdet on PC Windows, and form a trained model, thereby configuring the target marking module 21 and the target scoring module 22 to achieve target cell recognition, box selection marking of approximate target cell graphics 201, and marking of similarity scores 204.

[0033] The visual processing motherboard 20 of this embodiment is an Orange Pi5 plus development board. The hardware configuration of this development board is relatively complete, and it can have strong visual computing functions, and can achieve low-cost and convenient development. In other embodiments, any one of the NVIDIA Jetson Nano development board or the Intel NUC development board can also be used.

[0034] To facilitate understanding, adaptively, in an epithelial cell biology experiment class: students make slides of human oral epithelial cells, adjust the slide position, the focal length of the objective lens and obtain a clear microscopic image 200, then apply for the microscopic image analyzer of the utility model, install the eyepiece adapter 12 on the microscope eyepiece 100, observe the display and adjust the shooting position, press the switch button 40, and the microscopic image 200 can be determined. The microscopic image analyzer will mark the epithelial cells in the microscopic image 200 with an identification frame 203 and give a similarity score 204 for the epithelial cells. Students can determine on the display screen 30 whether they have correctly found the epithelial cells, rather than bubbles or impurities.

[0035] The above embodiments mainly describe the basic principles, main features and advantages of the utility model. Those skilled in the art should understand that the utility model is not limited by the above embodiments, and the above embodiments and descriptions are only for explaining the principles of the utility model. Without departing from the spirit and scope of the utility model, the utility model may have various changes and improvements, and these changes and improvements fall within the scope of the utility model to be protected.

Claims

1. A microscopic image analyzer, comprising a camera module (10), a visual processing mainboard (20), a display screen (30), a switch button (40) and a battery (50), wherein: The visual processing mainboard (20) comprises: A target marking module (21) is used to mark a cell graphic (201) in the microscopic image (200) according to a trained model of a preset cell target, and mark the cell graphic (201) in the displayed microscopic image (200); The target scoring module (22) is used to score the cell target of the trained model according to the similarity between the cell graphic (201) of the microscopic image (200), and mark the score in the displayed microscopic image (200); characterized in that: The camera module (10) is electrically connected to the visual processing mainboard (20) and is used to obtain a microscopic image (200) by photographing the eyepiece of a microscope; the display screen (30) is electrically connected to the visual processing mainboard (20) and is used to display the obtained microscopic image (200); the battery (50) is connected to the visual processing mainboard (20) for power supply; the camera module (10) comprises a camera head (11) and an eyepiece adapter (12), the distal end of the eyepiece adapter (12) is used to be sleeved onto the eyepiece of an optical microscope, and the proximal end of the eyepiece adapter (12) is used to be connected to the camera head (11); The eyepiece adapter (12) comprises a first connecting tube (121), a second connecting tube (122) and a locking nut (123); the interiors of the first connecting tube (121) and the second connecting tube (122) are through structures respectively; the distal end of the first connecting tube (121) is used to be sleeved onto the eyepiece of the optical microscope; the proximal end of the second connecting tube (122) is used to be connected to the camera (11); the distal inner wall of the first connecting tube (121) is provided with an internal thread; the distal outer wall of the second connecting tube (122) is provided with an external thread; the locking nut (123) is matched and connected to the external thread of the second connecting tube (122); the internal thread of the first connecting tube (121) is matched and connected to the external thread of the second connecting tube (122); The switch button (40) is electrically connected to the visual processing mainboard (20), and the visual processing mainboard (20) receives a signal from the switch button (40) to determine the collected microscopic image (200).

2. A microscopic image analyzer according to claim 1, characterized in that: The second connecting tube (122) is provided with an inner sleeve (124) made of elastic material, and the inner diameter of the inner sleeve (124) is installed with the camera (11) in an interference fit.

3. A microscopic image analyzer according to claim 1, characterized in that: The inner diameter of the distal end of the first connecting tube (121) is larger than the outer diameter of the eyepiece of the optical microscope.

4. A microscopic image analyzer according to claim 1, characterized in that: The camera (11) is electrically connected to the visual processing mainboard (20) via a wire (13).

5. A microscopic image analyzer according to claim 1, characterized in that: The visual processing mainboard (20) further comprises a wireless communication module (23), wherein the wireless communication module (23) is used to establish communication with a host device and transmit a marked cell graphic (201) and a microscopic image (200) of a score.

6. A microscopic image analyzer according to claim 1, characterized in that: The visual processing mainboard (20) further comprises a storage module (24), wherein the storage module (24) is used to store the marked cell graphics (201) and the microscopic images (200) of the fractions.

7. A microscopic image analyzer according to claim 1, characterized in that: The visual processing mainboard (20) is one of an Orange Pi5 plus development board, an NVIDIA Jetson Nano development board, or an Intel NUC development board.

Images