Microscopic image acquisition system based on smart phone

Abstract

The invention relates to the technical field of image acquisition, and provides a microscopic image acquisition system based on a smart phone, and the system comprises an access control module which is used for carrying out the adaptive access of the smart phone and a microscopic photographing interface or a microscope eyepiece at the top of a microscope, so as to achieve the collection of an image through a microscope light path through the smart phone, and obtaining a target image; the adjustment control module is used for adjusting and controlling the process of collecting the target image by the smart phone; the interaction control module is used for interacting the smart phone with a computer so as to display a target image on an electronic large screen such as a computer display; and the processing and analyzing module is used for processing and analyzing the target image based on designed image processing software. According to the invention, the intelligent mobile phone is used, the microscope is combined to collect and store the microscopic image, and the microscopic image is projected to the display screen to be displayed, edited and analyzed, so that the microscopic image can be flexibly, efficiently and conveniently operated, processed and applied, and the image analysis and application efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of image acquisition, and in particular to a microscopic image acquisition system based on a smart phone. Background Art

[0002] Pathologists use pathological sections to diagnose diseases by observing changes in tissue morphology. This is actually a process of comparing the morphological changes of diseased tissue and normal tissue, and a comparison of two images. Pathological images are important materials for pathologists to work, study, and communicate. At present, pathological images are mainly obtained through microscopic image acquisition systems or slice scanning systems. These two systems are usually configured by work units, are expensive, and have some problems that need to be solved in daily application. For example, most of the current image acquisition systems are unit configurations, which are costly and cannot be configured to every physician, making it impossible for every physician to capture images at any time. Once the image acquisition system is installed, the software system cannot be updated in a timely manner, and it is difficult to reconfigure after a hardware failure. The acquired images are stored in the work computer. Due to the security requirements of the medical system, data transfer requires a series of cumbersome steps, and the data cannot be retrieved at any time. Pathological images are also important teaching materials, and timely and convenient access to pathological images is also beneficial to the growth of junior pathologists. When taking pictures with the image acquisition system on top of the microscope, it is necessary to first adjust the microscope's field of view to make it clear and then adjust the microscope to make the image of the image acquisition system clear. Each picture requires at least two adjustments, which is time-consuming and labor-intensive. Smartphones are important tools for daily life. The camera function of smartphones is becoming increasingly powerful, and the image quality is fully capable of capturing pathological images, but there is currently no convenient interface between mobile phones and microscopes.

[0003] Therefore, it is necessary to provide a microscopic image acquisition system based on smartphones. Summary of the invention

[0004] The present invention provides a microscopic image acquisition system based on a smart phone. By utilizing the smart phone in combination with a microscope to acquire and store microscopic images, and projecting the images onto a large electronic screen such as a computer monitor for display, editing and analysis, the microscopic images can be flexibly, efficiently and conveniently operated, processed and applied, thereby improving the efficiency of image analysis and application.

[0005] The present invention provides a microscopic image acquisition system based on a smart phone, comprising:

[0006] An access control module is used to adapt and connect the smartphone to the microscopic camera interface on the top of the microscope or the microscope eyepiece, so as to realize image acquisition through the microscope optical path using the smartphone to obtain the target image;

[0007] An adjustment control module, used for adjusting and controlling the process of the smart phone collecting the target image;

[0008] An interactive control module is used to interact with a smart phone and a computer to display a target image on a large electronic screen such as a computer monitor;

[0009] The processing and analysis module is used to process and analyze the target image based on the designed image processing software.

[0010] Further, the access control module includes a bracket configuration unit and a mobile phone position control unit;

[0011] The support configuration unit is used to configure a mobile phone support at the microscopic camera interface on the top of the microscope, and to configure a telescopic arm on the mobile phone support so as to adapt and connect the smart phone to the microscope; the mobile phone support is used to support and fix the mobile phone, realize the connection of the light path between the smart phone and the camera interface on the top of the microscope, and realize taking pictures at the top of the microscope to meet the demand of taking pictures at the top of the microscope; the telescopic arm is used to adapt and connect the smart phone to the eyepiece of the microscope, and to finely adjust the position of the smart phone to meet the demand of taking pictures from the eyepiece of the microscope;

[0012] The mobile phone position control unit is used to remotely control the specific position of the smart phone according to the image acquisition needs based on the set remote processor.

[0013] Furthermore, the mobile phone holder is a detachable integrated holder.

[0014] Furthermore, based on the remote processor, the rotation angle of the mobile phone is remotely controlled, including:

[0015] A position sensor, a controller and a wireless network communication component are configured on the mobile phone holder;

[0016] Using a position sensor to obtain initial position data of the mobile phone holder and initial angle data of the smart phone, and transmitting the initial position data and initial angle data to a remote processor via a wireless network communication component;

[0017] According to the image acquisition needs, the remote processor obtains the position data to be adjusted and the angle data to be adjusted corresponding to the image acquisition needs from a pre-stored database, generates a number of control commands, and remotely controls the controller based on the control commands. The controller controls the telescopic arm on the mobile phone holder to rotate the smartphone to the position to be adjusted and adjust it to the angle to be adjusted.

[0018] Further, the process of controlling the smart phone to collect the target image includes:

[0019] Perform initial settings on the microscope to obtain initial setting information of the microscope; specifically: adjust the microscope fine focus screw to obtain a clear target image through the microscope eyepiece; adjust the zoom lens built into the interface to achieve the same observation magnification of the zoom lens and the microscope eyepiece;

[0020] Obtain image acquisition requirements, and based on the image acquisition requirements and combined with initial setting information of the microscope, use a remote processor to remotely adjust the smartphone, control the smartphone to rotate to a desired rotation angle, so that the smartphone can acquire a clear target image.

[0021] Furthermore, the smart phone is interacted with the computer to display the target image on the computer monitor, including:

[0022] A signal receiver connected to the computer is configured, and the signal receiver is used to project the target image onto the computer monitor through the wireless screen projection function of the smartphone to display the target image.

[0023] Furthermore, based on the designed image processing software, the target image is processed and analyzed, including:

[0024] Design mobile phone APP and computer version of image processing software respectively. The image processing software includes but is not limited to the functions of image zooming, image measurement, image erasing, image cropping and image analysis.

[0025] Further, the image analysis includes:

[0026] Using a set image analysis model, the target image is matched with a set reference image, and a first image analysis result is obtained according to the matched content;

[0027] Generate an image analysis report according to the first image analysis result using a set report generation model;

[0028] According to the image analysis report, the set image calibration model is used to calibrate the key areas in the image analysis report to obtain multiple calibration images;

[0029] According to the calibration image, the image change trend is predicted and analyzed by using the set image change trend prediction and analysis model to obtain the image change trend prediction and analysis result;

[0030] According to the prediction and analysis results of the image change trend, the set case probability analysis model is used to perform probability analysis on the cases corresponding to the image change trend to obtain the case probability analysis results.

[0031] Furthermore, the reference image is acquired based on a set case image library, and the case image library is retrieved based on a large case database connected to the cloud platform.

[0032] Furthermore, the processing and analysis module also includes performing dust detection on the microscope eyepiece and performing corresponding processing according to the detection result, specifically including:

[0033] Based on the microscope eyepiece, the reference target image is observed under the first observation condition to obtain an initial observation image, wherein the first observation condition is: after dust is cleaned from the microscope eyepiece;

[0034] According to the set period, the reference target image is periodically observed based on the microscope eyepiece to obtain a periodic observation image;

[0035] Using the image comparison analysis model, the pixel values ​​of the initial observation image and the periodic observation image are compared and analyzed to obtain the similarity value between the initial observation image and the periodic observation image;

[0036] If the similarity value is greater than a set first similarity threshold, a detection result is obtained that the microscope eyepiece is not subjected to dust removal treatment;

[0037] If the similarity value is less than a set second similarity threshold, a detection result of dust removal processing on the microscope eyepiece is obtained, and a dust removal reminder is issued based on a set reminder program;

[0038] If the similarity value is greater than the set second similarity threshold and less than the set first similarity threshold, a detection result of performing dust calibration processing is obtained; and dust calibration processing is performed according to the detection result of performing dust calibration processing, specifically including:

[0039] Further performing image similarity comparison analysis on a plurality of pre-defined image regions in the periodic observation image and an image region corresponding to the initial observation image; if the similarity value of the image region is less than a set third similarity threshold, performing dust target detection using a set dust target detection model to obtain a dust target detection result;

[0040] According to the dust target detection result, the dust target is marked in the corresponding image area, and the coordinate position of the dust target in the periodic observation image is obtained;

[0041] Based on the dust target image at the coordinate position, the dust target image is erased by using the image processing software before the target image displayed on the computer monitor is processed and analyzed by using the image processing software.

[0042] Compared with the prior art, the present invention has the following advantages and beneficial effects: by utilizing a smart phone in combination with a microscope to collect and store microscopic images, and projecting the images onto a large electronic screen such as a computer monitor for display, editing and analysis, the microscopic images can be flexibly, efficiently and conveniently processed and applied, thereby improving the efficiency of image analysis and application.

[0043] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0044] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0046] Figure 1 This is a schematic diagram of the structure of the microscopic image acquisition system based on a smartphone;

[0047] Figure 2 This is a schematic diagram of the access control module structure;

[0048] Figure 3 Schematic diagram of the process of collecting target images for regulating and controlling smartphones. DETAILED DESCRIPTION

[0049] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0050] The present invention provides a microscopic image acquisition system based on a smart phone, such as Figure 1 As shown, including:

[0051] An access control module is used to adapt and connect the smartphone to the microscopic camera interface on the top of the microscope or the microscope eyepiece, so as to realize image acquisition through the microscope optical path using the smartphone to obtain the target image;

[0052] An adjustment control module, used for adjusting and controlling the process of the smart phone collecting the target image;

[0053] An interactive control module is used to interact with a smart phone and a computer to display a target image on a large electronic screen such as a computer monitor;

[0054] The processing and analysis module is used to process and analyze the target image based on the designed image processing software.

[0055] The working principle of the above technical solution is: in order to realize a microscopic image acquisition system based on a smartphone, the present invention sets an access control module for adapting and connecting the smartphone to the microscopic camera interface on the top of the microscope or the microscope eyepiece, so as to realize image acquisition through the microscope optical path using the smartphone to obtain the target image; sets an adjustment control module for adjusting and controlling the process of the smartphone acquiring the target image; sets an interactive control module for interacting the smartphone with the computer, so as to realize the display of the target image on a large electronic screen such as a computer monitor; sets a processing and analysis module for processing and analyzing the target image based on the designed image processing software.

[0056] The beneficial effect of the above technical solution is: by adopting the solution provided in this embodiment, by using a smart phone in combination with a microscope to collect and store microscopic images, and projecting the screen to a large electronic screen such as a computer monitor for display, editing and analysis, the microscopic images can be flexibly, efficiently and conveniently operated, processed and applied, thereby improving the efficiency of image analysis and application.

[0057] In one embodiment, Figure 2 As shown, the access control module includes a bracket configuration unit and a mobile phone position control unit;

[0058] The support configuration unit is used to configure a mobile phone support at the microscopic camera interface on the top of the microscope, and to configure a telescopic arm on the mobile phone support so as to adapt and connect the smart phone to the microscope; the mobile phone support is used to support and fix the mobile phone, realize the connection of the light path between the smart phone and the camera interface on the top of the microscope, and realize taking pictures at the top of the microscope to meet the demand of taking pictures at the top of the microscope; the telescopic arm is used to adapt and connect the smart phone to the eyepiece of the microscope, and to finely adjust the position of the smart phone to meet the demand of taking pictures from the eyepiece of the microscope;

[0059] The mobile phone position control unit is used to remotely control the specific position of the smart phone according to the image acquisition needs based on the set remote processor.

[0060] The working principle of the above technical solution is as follows: in order to realize access control of mobile phones, the present invention proposes that the access control module includes a bracket configuration unit and a mobile phone position control unit; currently, when taking pictures at the top of a microscope with an image acquisition system, the field of view under the microscope is first adjusted to be clear, and then the microscope is adjusted to make the image of the image acquisition system clear. Each picture taken requires two adjustments, which is time-consuming and laborious. Through the bracket configuration unit, a mobile phone bracket is configured at the microscope photography interface at the top of the microscope, and a telescopic arm is configured on the mobile phone bracket to adapt the smart phone to the microscope; the mobile phone bracket is used to support and fix the mobile phone, realize the access of the optical path of the smart phone to the photography interface at the top of the microscope, and realize taking pictures at the top of the microscope to meet the photography requirements of the top of the microscope; the telescopic arm is used for the adaptation and access of the smart phone to the eyepiece of the microscope, and the position of the smart phone is finely adjusted to meet the requirements of taking pictures from the eyepiece of the microscope; after realizing an initial setting, the clarity of the microscope and the image acquisition system can be synchronized when taking pictures again, and the image acquisition system can also obtain a clear image while the microscope is clear; through the mobile phone position control unit, based on the set remote processor, the specific position of the smart phone is remotely controlled according to the image acquisition requirements.

[0061] The beneficial effect of the above technical solution is: by adopting the solution provided in this embodiment, the access control of the mobile phone can be realized by configuring the mobile phone holder and controlling the specific position of the mobile phone.

[0062] In one embodiment, the mobile phone holder is a detachable integrated holder.

[0063] The working principle of the above technical solution is: through the detachable integrated bracket, it can be installed and removed at any time without opening the microscope light path.

[0064] The beneficial effect of the above technical solution is: by adopting the solution provided in this embodiment, the function of the bracket can be guaranteed to be realized through the detachable integrated bracket.

[0065] In one embodiment, based on a remote processor, the rotation angle of the mobile phone is remotely controlled, including:

[0066] A position sensor, a controller and a wireless network communication component are configured on the mobile phone holder;

[0067] Using a position sensor to obtain initial position data of the mobile phone holder and initial angle data of the smart phone, and transmitting the initial position data and initial angle data to a remote processor via a wireless network communication component;

[0068] According to the image acquisition needs, the remote processor obtains the position data to be adjusted and the angle data to be adjusted corresponding to the image acquisition needs from a pre-stored database, generates a number of control commands, and remotely controls the controller based on the control commands. The controller controls the telescopic arm on the mobile phone holder to rotate the smartphone to the position to be adjusted and adjust it to the angle to be adjusted.

[0069] The working principle of the above technical solution is: in order to realize remote control of the rotation angle of the mobile phone, the present invention first configures a position sensor, a controller and a wireless network communication component on the mobile phone holder; then uses the position sensor to obtain the initial position data of the mobile phone holder and the initial angle data of the smart phone, and transmits the initial position data and the initial angle data to the remote processor through the wireless network communication component; then, the remote processor obtains the position data to be adjusted and the angle data to be adjusted corresponding to the image acquisition needs in a pre-stored database according to the image acquisition needs, and generates a number of control commands, and based on the control commands, remotely controls the controller, and controls the telescopic arm on the mobile phone holder through the controller to rotate the smart phone to the position to be adjusted and adjust it to the angle to be adjusted.

[0070] The beneficial effect of the above technical solution is: by adopting the solution provided in this embodiment, the rotation angle of the mobile phone is remotely controlled, thereby providing a basis and conditions for the mobile phone to capture the target image.

[0071] In one embodiment, Figure 3 As shown, the process of adjusting and controlling the smartphone to collect the target image includes:

[0072] Perform initial settings on the microscope to obtain initial setting information of the microscope; specifically: adjust the microscope fine focus screw to obtain a clear target image through the microscope eyepiece; adjust the zoom lens built into the interface to achieve the same observation magnification of the zoom lens and the microscope eyepiece;

[0073] Obtain image acquisition requirements, and based on the image acquisition requirements and combined with initial setting information of the microscope, use a remote processor to remotely adjust the smartphone, control the smartphone to rotate to a desired rotation angle, so that the smartphone can acquire a clear target image.

[0074] The working principle of the above technical solution is: in order to realize the process of adjusting and controlling the smartphone to capture the target image, the present invention first performs initial settings on the microscope to obtain the initial setting information of the microscope; specifically: adjust the microscope fine focus screw to obtain a clear target image through the microscope eyepiece; adjust the zoom lens built into the interface to achieve the same observation magnification of the zoom lens and the microscope eyepiece; then obtain the image acquisition needs, and according to the image acquisition needs, combined with the initial setting information of the microscope, use the remote processor to remotely adjust the smartphone, control the smartphone to rotate to the desired rotation angle, so that the smartphone can capture a clear target image.

[0075] The beneficial effect of the above technical solution is: by adopting the solution provided in this embodiment, the efficiency of the mobile phone in acquiring the target image can be guaranteed by adjusting and controlling the process of the smart phone acquiring the target image.

[0076] In one embodiment, the smart phone interacts with the computer to display a target image on the computer display, including:

[0077] A signal receiver connected to the computer is configured, and the signal receiver is used to project the target image onto the computer monitor through the wireless screen projection function of the smartphone to display the target image.

[0078] The working principle of the above technical solution is: in order to realize the interaction between the smart phone and the computer to ensure that the target image is displayed on the computer monitor, the present invention first configures a signal receiver connected to the computer, and uses the signal receiver to project the target image onto the computer monitor through the wireless projection function of the smart phone to display the target image.

[0079] The beneficial effect of the above technical solution is: by adopting the solution provided in this embodiment, by interacting with the smart phone and the computer, it is possible to ensure that the target image is accurately displayed on the computer monitor.

[0080] In one embodiment, based on the designed image processing software, the target image is processed and analyzed, including:

[0081] Design mobile phone APP and computer version of image processing software respectively. The image processing software includes but is not limited to the functions of image zooming, image measurement, image erasing, image cropping and image analysis.

[0082] The working principle of the above technical solution is: in order to realize the designed image processing software and process and analyze the target image, the present invention first designs a mobile phone APP and a computer version of the image processing software, and the image processing software includes but is not limited to the functions of image scaling, image measurement, image erasing, image cropping and image analysis.

[0083] The beneficial effect of the above technical solution is: by adopting the solution provided in this embodiment, the target image is processed and analyzed by the designed image processing software, so that the quality of image analysis can be guaranteed.

[0084] In one embodiment, the image analysis includes:

[0085] Using a set image analysis model, the target image is matched with a set reference image, and a first image analysis result is obtained according to the matched content;

[0086] Generate an image analysis report according to the first image analysis result using a set report generation model;

[0087] According to the image analysis report, the set image calibration model is used to calibrate the key areas in the image analysis report to obtain multiple calibration images;

[0088] According to the calibration image, the image change trend is predicted and analyzed by using the set image change trend prediction and analysis model to obtain the image change trend prediction and analysis result;

[0089] According to the prediction and analysis results of the image change trend, the set case probability analysis model is used to perform probability analysis on the cases corresponding to the image change trend to obtain the case probability analysis results.

[0090] The working principle of the above technical solution is as follows: in order to realize the function of image analysis, the present invention first uses the set image analysis model to match the target image with the set reference image, and obtains the first image analysis result according to the matching content; then, based on the first image analysis result, uses the set report generation model to generate an image analysis report; based on the image analysis report, uses the set image calibration model to perform image calibration on the key focus areas in the image analysis report to obtain multiple calibrated images; based on the calibrated images, uses the set image change trend prediction and analysis model to predict and analyze the image change trend, and obtains the image change trend prediction and analysis results; finally, based on the image change trend prediction and analysis results, uses the set case probability analysis model to perform probability analysis on the cases corresponding to the image change trend, and obtains the case probability analysis results.

[0091] The beneficial effect of the above technical solution is: by adopting the solution provided in this embodiment, flexible and efficient analysis of microscopic images can be achieved through analysis of the images.

[0092] In one embodiment, the reference image is acquired based on a set case image library, and the case image library is retrieved based on a large case database connected to the cloud platform.

[0093] The working principle of the above technical solution is: through the cloud platform and the large case database, it is guaranteed to obtain comprehensive and accurate benchmark images.

[0094] The beneficial effect of the above technical solution is: by adopting the solution provided in this embodiment, by retrieving the reference image based on the large case database, it is possible to ensure that an accurate reference image is obtained to ensure the accuracy of image analysis.

[0095] In one embodiment, the processing and analysis module further includes performing dust detection on the microscope eyepiece and performing corresponding processing according to the detection result, specifically including:

[0096] Based on the microscope eyepiece, the reference target image is observed under the first observation condition to obtain an initial observation image, wherein the first observation condition is: after dust is cleaned from the microscope eyepiece;

[0097] According to the set period, the reference target image is periodically observed based on the microscope eyepiece to obtain a periodic observation image;

[0098] Using the image comparison analysis model, the pixel values ​​of the initial observation image and the periodic observation image are compared and analyzed to obtain the similarity value between the initial observation image and the periodic observation image;

[0099] If the similarity value is greater than a set first similarity threshold, a detection result is obtained that the microscope eyepiece is not subjected to dust removal treatment;

[0100] If the similarity value is less than a set second similarity threshold, a detection result of dust removal processing on the microscope eyepiece is obtained, and a dust removal reminder is issued based on a set reminder program;

[0101] If the similarity value is greater than the set second similarity threshold and less than the set first similarity threshold, a detection result of performing dust calibration processing is obtained; and dust calibration processing is performed according to the detection result of performing dust calibration processing, specifically including:

[0102] Further performing image similarity comparison analysis on a plurality of pre-defined image regions in the periodic observation image and an image region corresponding to the initial observation image; if the similarity value of the image region is less than a set third similarity threshold, performing dust target detection using a set dust target detection model to obtain a dust target detection result;

[0103] According to the dust target detection result, the dust target is marked in the corresponding image area, and the coordinate position of the dust target in the periodic observation image is obtained;

[0104] Based on the dust target image at the coordinate position, the dust target image is erased by using the image processing software before the target image displayed on the computer monitor is processed and analyzed by using the image processing software.

[0105] The working principle of the above technical solution is: during the use of the microscope eyepiece, it is easy for the eyepiece to be contaminated by dust, mold and other substances, which affects the observation of the microscopic image and the accuracy and clarity of the microscopic image. It is necessary to detect dust on the microscope eyepiece and perform corresponding processing according to the detection result. The present invention first observes the reference target image under the first observation condition based on the microscope eyepiece to obtain the initial observation image. The first observation condition is: after cleaning the dust on the microscope eyepiece; then, according to the set period, based on the microscope eyepiece, the reference target image is periodically observed to obtain the periodic observation image; and then the image comparison analysis model is used to compare the initial observation image with the reference target image. The pixel values ​​of the initial observation image and the periodic observation image are compared and analyzed to obtain a similarity value between the initial observation image and the periodic observation image; if the similarity value is greater than a set first similarity threshold, a detection result that the microscope eyepiece is not subjected to dust removal processing is obtained; if the similarity value is less than a set second similarity threshold, a detection result that the microscope eyepiece is subjected to dust removal processing is obtained, and a dust removal reminder is issued based on a set reminder program; if the similarity value is greater than a set second similarity threshold and less than a set first similarity threshold, a detection result of performing dust calibration processing is obtained; and dust calibration processing is performed according to the detection result of performing dust calibration processing, specifically including:

[0106] A comparative analysis of image similarities is further performed on several pre-demarcated image areas in the periodic observation image and the image area corresponding to the initial observation image; if the similarity value of the image area is less than a set third similarity threshold, a set dust target detection model is used to perform dust target detection to obtain a dust target detection result; based on the dust target detection result, dust targets are marked in the corresponding image areas, and the coordinate position of the dust targets in the periodic observation image is obtained; based on the dust target image at the coordinate position, the dust target image is erased using image processing software before the target image displayed on the computer monitor is processed and analyzed using image processing software.

[0107] The beneficial effect of the above technical solution is: by adopting the solution provided in this embodiment, by performing dust detection on the microscope eyepiece and performing corresponding processing based on the detection results, it is possible to ensure the accurate and clear acquisition and effective processing of the target image, thereby ensuring the accuracy of the microscopic image.

[0108] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A microscopic image acquisition system based on a smartphone, characterized in that: include: An access control module is used to adapt and connect the smartphone to the microscopic camera interface on the top of the microscope or the microscope eyepiece, so as to realize image acquisition through the microscope optical path using the smartphone to obtain the target image; An adjustment control module, used for adjusting and controlling the process of the smart phone collecting the target image; An interactive control module is used to interact with a smart phone and a computer to display a target image on a large electronic screen such as a computer monitor; The processing and analysis module is used to process and analyze the target image based on the designed image processing software.

2. The microscopic image acquisition system based on a smart phone according to claim 1, characterized in that: The access control module includes a bracket configuration unit and a mobile phone position control unit; The support configuration unit is used to configure a mobile phone support at the microscopic camera interface on the top of the microscope, and to configure a telescopic arm on the mobile phone support so as to adapt and connect the smart phone to the microscope; the mobile phone support is used to support and fix the mobile phone, realize the connection of the light path between the smart phone and the camera interface on the top of the microscope, and realize taking pictures on the top of the microscope to meet the demand for taking pictures on the top of the microscope; The telescopic arm is used to adapt the smartphone to the microscope eyepiece and finely adjust the position of the smartphone to meet the needs of taking pictures through the microscope eyepiece; The mobile phone position control unit is used to remotely control the specific position of the smart phone according to the image acquisition needs based on the set remote processor.

3. The microscopic image acquisition system based on a smart phone according to claim 2, characterized in that: The mobile phone holder is a detachable integrated holder.

4. The microscopic image acquisition system based on a smart phone according to claim 2, characterized in that: Based on the remote processor set up, remote control of the specific location of the smartphone is performed according to the image acquisition needs, including: A position sensor, a controller and a wireless network communication component are configured on the mobile phone holder; Using a position sensor to obtain initial position data of the mobile phone holder and initial angle data of the smart phone, and transmitting the initial position data and initial angle data to a remote processor via a wireless network communication component; According to the image acquisition needs, the remote processor obtains the position data to be adjusted and the angle data to be adjusted corresponding to the image acquisition needs from a pre-stored database, generates a number of control commands, and remotely controls the controller based on the control commands. The controller controls the telescopic arm on the mobile phone holder to rotate the smartphone to the position to be adjusted and adjust it to the angle to be adjusted.

5. The microscopic image acquisition system based on a smart phone according to claim 4, characterized in that: The process of regulating and controlling the smartphone to acquire the target image includes: Perform initial settings on the microscope to obtain initial setting information of the microscope; specifically: adjust the microscope fine focus screw to obtain a clear target image through the microscope eyepiece; adjust the zoom lens built into the interface to achieve the same observation magnification of the zoom lens and the microscope eyepiece; Obtain image acquisition requirements, and based on the image acquisition requirements and combined with initial setting information of the microscope, use a remote processor to remotely adjust the smartphone, control the smartphone to rotate to a desired rotation angle, so that the smartphone can acquire a clear target image.

6. The microscopic image acquisition system based on a smart phone according to claim 1, characterized in that: Interact with the smartphone and the computer to display the target image on the computer monitor, including: A signal receiver connected to the computer is configured, and the signal receiver is used to project the target image onto a large electronic screen such as a computer monitor through the wireless screen projection function of the smartphone to display the target image.

7. The microscopic image acquisition system based on a smart phone according to claim 1, characterized in that: Based on the designed image processing software, the target image is processed and analyzed, including: Design mobile phone APP and computer version of image processing software respectively. The image processing software includes but is not limited to the functions of image zooming, image measurement, image erasing, image cropping and image analysis.

8. The microscopic image acquisition system based on a smart phone according to claim 7, characterized in that: Image analysis includes: Using a set image analysis model, the target image is matched with a set reference image, and a first image analysis result is obtained according to the matched content; Generate an image analysis report according to the first image analysis result using a set report generation model; According to the image analysis report, the set image calibration model is used to calibrate the key areas in the image analysis report to obtain multiple calibration images; According to the calibration image, the image change trend is predicted and analyzed by using the set image change trend prediction and analysis model to obtain the image change trend prediction and analysis result; According to the prediction and analysis results of the image change trend, the set case probability analysis model is used to perform probability analysis on the cases corresponding to the image change trend to obtain the case probability analysis results.

9. The microscopic image acquisition system based on a smart phone according to claim 8, characterized in that: The reference image is acquired based on the set case image library, and the case image library is retrieved based on the large case database connected to the cloud platform.

10. The microscopic image acquisition system based on a smart phone according to claim 9, characterized in that: The processing and analysis module also includes dust detection on the microscope eyepiece and corresponding processing according to the detection results, including: Based on the microscope eyepiece, the reference target image is observed under the first observation condition to obtain an initial observation image, wherein the first observation condition is: after dust is cleaned from the microscope eyepiece; According to the set period, the reference target image is periodically observed based on the microscope eyepiece to obtain a periodic observation image; Using the image comparison analysis model, the pixel values ​​of the initial observation image and the periodic observation image are compared and analyzed to obtain the similarity value between the initial observation image and the periodic observation image; If the similarity value is greater than a set first similarity threshold, a detection result is obtained that the microscope eyepiece is not subjected to dust removal treatment; If the similarity value is less than a set second similarity threshold, a detection result of dust removal processing on the microscope eyepiece is obtained, and a dust removal reminder is issued based on a set reminder program; If the similarity value is greater than the set second similarity threshold and less than the set first similarity threshold, a detection result of performing dust calibration processing is obtained; and dust calibration processing is performed according to the detection result of performing dust calibration processing, specifically including: Further performing image similarity comparison analysis on a plurality of pre-defined image regions in the periodic observation image and an image region corresponding to the initial observation image; if the similarity value of the image region is less than a set third similarity threshold, performing dust target detection using a set dust target detection model to obtain a dust target detection result; According to the dust target detection result, the dust target is marked in the corresponding image area, and the coordinate position of the dust target in the periodic observation image is obtained; Based on the dust target image at the coordinate position, the dust target image is erased by using the image processing software before the target image displayed on the computer monitor is processed and analyzed by using the image processing software.

Images