A three-dimensional microscopic image processing method and device

By combining the three-dimensional image construction, polarized light image acquisition and dynamic display steps in the three-dimensional microscopic image processing method, the problem of lack of efficient three-dimensional image display technology in the prior art is solved, and efficient display of the surface and internal structure of the object to be measured is achieved, and research efficiency is improved.

CN115147467BActive Publication Date: 2025-04-01PINGHU LEIDEN OPTICAL INSTR MFG CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110717824.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-06-28
Publication Date
2025-04-01
Estimated Expiration
2041-06-28

AI Technical Summary

Technical Problem

The prior art lacks an efficient three-dimensional image display technology based on polarized light dimensions, making it difficult to effectively display the surface structure and internal structure of the object to be tested.

Method used

A three-dimensional microscopic image processing method is provided, including three-dimensional image construction, polarized light image acquisition and dynamic display steps. In the three-dimensional image, the polarized light image of the region of interest is dynamically displayed in a highlighted form. By registering the three-dimensional image and the polarized light image, the three-dimensional image and the polarized light image are realized simultaneously.

Benefits of technology

By registering three-dimensional images and polarized light images, more accurate surface structures of the object to be measured can be displayed, and the internal structure of the object to be measured can be displayed, improving the research efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115147467B_ABST
    Figure CN115147467B_ABST
Patent Text Reader

Abstract

The present invention relates to a three-dimensional microscopic image processing method, which comprises: the processing method comprises: a three-dimensional image construction step, obtaining a three-dimensional microscopic image of a test object; a polarized light image acquisition step, collecting polarized light images of multiple polarization angles of the test object; a dynamic display step, dynamically displaying the polarized light image of an area of ​​interest in a highlighted form within a three-dimensional image. The present invention also relates to a three-dimensional microscopic image processing device and a computer-readable storage medium. The present invention enables a user to obtain a three-dimensional image with more dimensional information by displaying.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of microscopic image processing, and in particular to a three-dimensional microscopic image processing method and device. Background Art

[0002] With the rapid development of computer technology, communication technology and medical imaging technology, image visualization technology has gradually transformed from stand-alone mode to network mode and digital mode. Traditional three-dimensional plane images alone can no longer meet the needs of research. Based on this, the research on three-dimensional and multi-dimensional image technology has also been rapidly carried out. In the fields of medicine, biology, precision industrial testing and neuroscience, it is particularly important to obtain three-dimensional information of samples.

[0003] For example, in the study of oocytes, microscopic imaging technology can achieve good observation of the external structure of oocytes, and polarized light imaging technology can achieve non-invasive observation of the internal structure of cells. The effective combination of the above technologies can greatly reduce or avoid the damage caused by auxiliary technologies; the combination of external and internal information of the zona pellucida can be used to detect the development status of oocytes and achieve high-quality screening of oocytes. If polarized light images are added on the basis of three-dimensional images, the research efficiency of oocytes can be greatly improved.

[0004] However, the prior art lacks an efficient three-dimensional image display technology based on the polarized light dimension. Summary of the invention

[0005] The technical solution adopted by the present invention to solve the technical problem is: to provide a three-dimensional microscopic image processing method, the processing method comprising:

[0006] A three-dimensional image construction step, obtaining a three-dimensional microscopic image of the object to be tested;

[0007] A polarized light image acquisition step, collecting polarized light images of the object to be measured at multiple polarization angles;

[0008] The dynamic display step dynamically displays the polarized light image of the region of interest in a highlighted form within a three-dimensional image.

[0009] A three-dimensional microscopic image processing device, characterized in that the processing device comprises:

[0010] A three-dimensional image construction unit is used to obtain a three-dimensional microscopic image of the object to be tested;

[0011] A polarized light image acquisition unit, which collects polarized light images of the object to be measured at multiple polarization angles;

[0012] The dynamic display unit dynamically displays the polarized light image of the area of ​​interest in a highlighted form within a three-dimensional image.

[0013] A three-dimensional polarizing microscope device comprises a memory and a processor. The memory is used to store a computer program. When the processor executes the computer program, the three-dimensional polarizing microscope processing method is realized.

[0014] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the three-dimensional polarizing microscopic image processing method is implemented.

[0015] Beneficial Effects

[0016] Due to the adoption of the above-mentioned technical scheme, the present invention has the following advantages and positive effects compared with the prior art: the present invention aligns the three-dimensional image and the polarized light image, and simultaneously displays the three-dimensional image and the polarized light image in the same image, which can display more accurate surface structures of the object to be measured, and can also display the internal structure of the object to be measured. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 This is a flowchart of the first embodiment. DETAILED DESCRIPTION

[0018] The present invention will be further described below in conjunction with specific embodiments. It should be understood that these embodiments are only used to illustrate the present invention and are not intended to limit the scope of the present invention. In addition, it should be understood that after reading the content taught by the present invention, those skilled in the art can make various changes or modifications to the present invention, and these equivalent forms fall within the scope limited by the appended claims of the application equally.

[0019] In a typical configuration of the present application, the terminal, the device of the service network and the trusted party all include one or more processors (eg, a central processing unit (CPU)), an input / output interface, a network interface and a memory.

[0020] Memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash memory. Memory is an example of a computer-readable medium.

[0021] Computer readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer readable instructions, data structures, modules of programs or other data. Examples of computer storage media include, but are not limited to, Phase-Change Memory (PCM), Programmable Random Access Memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of random access memory (RAM), Read-Only Memory (ROM), Electrically-Erasable Programmable Read-Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0022] The devices referred to in this application include but are not limited to user devices, network devices, or devices formed by integrating user devices and network devices through a network. The user devices include but are not limited to any mobile electronic products that can interact with users (for example, interact with users through a touchpad), such as smart phones, tablet computers, etc. The mobile electronic products can use any operating system, such as Android operating system, iOS operating system, etc. Among them, the network device includes an electronic device that can automatically perform numerical calculations and information processing according to pre-set or stored instructions, and its hardware includes but is not limited to microprocessors, application specific integrated circuits (Application Specific Integrated Circuit, ASIC), programmable logic devices (Programmable Logic Device, PLD), field programmable gate arrays (Field Programmable Gate Array, FPGA), digital signal processors (Digital Signal Processor, DSP), embedded devices, etc. The network devices include but are not limited to computers, network hosts, single network servers, multiple network server sets or multiple servers. The cloud is composed of a large number of computers or network servers based on cloud computing (Cloud Computing), wherein cloud computing is a type of distributed computing, a virtual supercomputer composed of a group of loosely coupled computer sets. The network includes but is not limited to the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, a wireless self-organizing network (Ad Hoc network), etc. Preferably, the device may also be a program running on the user device, the network device, or a device formed by integrating the user device and the network device, the network device, the touch terminal, or the network device and the touch terminal through a network.

[0023] Of course, those skilled in the art should understand that the above-mentioned devices are only examples, and other existing or future devices that are applicable to the present application should also be included in the scope of protection of the present application and are included here by reference.

[0024] In the description of the present application, “plurality” means two or more, unless otherwise clearly and specifically defined.

[0025] Each embodiment of the present application is mainly implemented based on a computing device. The system includes an input device for obtaining user input information, a data processing device for receiving, processing and sending data, and the corresponding image is collected by a corresponding microscopic device. The microscopic device includes a collection device for collecting sample-related microscopic images, a humidity control device and a humidity sensor for controlling the humidity of the environment in which the sample is located, and a temperature control device and a temperature sensor for controlling the temperature of the environment in which the sample is located. In a non-limiting manner, the computing device is installed with a corresponding microscopic control application, and a communication connection with the microscopic device is established through the microscopic control application, a control instruction is sent to the microscopic device, and image data returned by the microscopic device is received. Among them, the computing device includes but is not limited to user equipment, network equipment, or an integrated device of user equipment and network equipment, etc. The user equipment includes but is not limited to any computing device that can perform human-computer interaction with a user (for example, human-computer interaction through a touchpad), such as a smart phone, a tablet computer, a PC terminal, an e-book reader, etc. The network device includes but is not limited to a computer, a network host, a single network server, a plurality of network server sets or a cloud composed of multiple servers. Based on this application, different researchers can conduct related experiments based on the prior art, and the present invention does not need to repeat them.

[0026] Figure 1 A three-dimensional microscopic image processing method according to a first embodiment of the present application is shown, and the processing method comprises:

[0027] The three-dimensional image construction step is to obtain a three-dimensional microscopic image of the object to be tested; the polarized light image acquisition step is to collect polarized light images of multiple polarization angles of the object to be tested; and the dynamic display step is to dynamically display the polarized light image of the area of ​​interest in a highlighted form within a three-dimensional image.

[0028] The dynamic display step specifically includes the following steps: a change judgment step: judging the position of the object to be measured where changes occur at different polarization angles; and a display step: displaying the changes in a three-dimensional image.

[0029] Three-dimensional imaging technology is a public technology in this field, and conventional three-dimensional imaging methods can be used. Specifically, in terms of the focus evaluation algorithm, as a preferred embodiment, the extreme value algorithm is selected from one or more of the curve fitting method, the Fibonacci search method, the golden section method, and the ransac algorithm. As a preferred embodiment, the focus evaluation algorithm is selected from one or more of the focus evaluation algorithm based on the spatial domain, the focus evaluation algorithm based on the frequency domain, the focus evaluation algorithm based on informatics, and the focus evaluation algorithm based on statistics. As a preferred embodiment, the focus evaluation algorithm based on the spatial domain is the BRENER function, the ROBERTS function, the LAPLACE function, the SOBEL function, the TENENGRAD function, the gradient square function, and the SMD function. As a preferred embodiment, the focus evaluation algorithm based on the frequency domain is the discrete Fourier transform function, the discrete cosine transform function, and the discrete wavelet transform function. As a preferred embodiment, the focus evaluation algorithm based on informatics is the image information entropy function. As a preferred embodiment, the focus evaluation algorithm based on statistics is the VARIANCE function.

[0030] A three-dimensional microscopic image processing method, the processing method comprising: a three-dimensional image construction step, obtaining a three-dimensional microscopic image of an object to be tested; a polarized light image acquisition step, collecting polarized light images of the object to be tested at multiple polarization angles; and a dynamic display step, dynamically displaying the polarized light image of an area of ​​interest in a highlighted form within a three-dimensional image.

[0031] The dynamic display step specifically includes the following steps: a change judgment step: judging the changes of all pixel points of the object to be tested at different polarization angles, and recording the pixels and polarization angles when they change; a display step: displaying all changed pixel points one by one according to the polarization angle, and when a certain pixel point changes to the brightest, the pixel is enlarged or highlighted.

[0032] The dynamic display step includes the following steps: a non-changing area judgment step, in which one or more non-changing areas are determined according to the image change amount between polarized light images at multiple polarization angles in the three-dimensional image of the object to be measured; a changing area judgment step, in which one or more changing areas are determined according to the image change amount between polarized light images at multiple polarization angles in the three-dimensional image of the object to be measured; and a dynamic display step, in which the non-changing areas are not displayed on the three-dimensional image, and the dynamic changes and polarization angles of one or more changing areas are dynamically displayed at corresponding positions of the three-dimensional image.

[0033] By judging the change area and the change area by the change amount between the polarized light images, since the various information of the image will inevitably change under different polarization angles, while the background will not undergo such changes, this method can be used to determine the change area. By displaying the change area on the two-dimensional image without displaying the non-change area or any image of the actual non-change area, the change area can be observed more effectively. In order to reduce the information on the edge of the change image, it is preferred to display any image of the non-change area on the two-dimensional image.

[0034] The processing method comprises the following steps: a region segmentation step, dividing a three-dimensional image into a plurality of regular hexagonal image regions; a depth calculation step, calculating the standard deviation of the depth data in all the regular hexagonal images; a judgment and segmentation step, performing region segmentation on the three-dimensional image according to the standard deviation to obtain a non-changing region and a changing region; the standard deviation of the depth data in all the regular hexagonal images in the non-changing region is smaller than the standard deviation of the depth data in all the regular hexagonal images in the changing region; and a dynamic display step, not displaying the non-changing region on the three-dimensional image, and dynamically displaying the dynamic changes and polarization angles of one or more changing regions at corresponding positions of the three-dimensional image.

[0035] Standard Deviation is most commonly used in probability statistics as a measure of statistical dispersion. The standard deviation is defined as the square root of the arithmetic mean of the squared deviations of the standard values ​​of each unit of the population from its mean. It reflects the degree of dispersion between individuals in the group. The result of measuring the degree of distribution has two properties in principle: it is a non-negative value and has the same unit as the measured data. There is a difference between the standard deviation of a total or a random variable and the standard deviation of a subset of samples.

[0036] In simple terms, standard deviation is a measure of the dispersion of the average value of a set of data. A larger standard deviation means that most of the values ​​are more different from their average value; a smaller standard deviation means that these values ​​are closer to the average value. Standard deviation is the most commonly used quantitative form to reflect the dispersion of a set of data and is an important indicator of accuracy. The present invention uses standard deviation to determine whether the data in the area contains the object to be tested. Specifically, for the background part, the standard deviation is smaller, while for the object to be tested, the standard deviation is larger.

[0037] The amount of change between images is any one of an amount of change in pixel value between images, an amount of change in color difference between images, an amount of change in hue between images, an amount of change in brightness between images, and an amount of change in color ratio between images.

[0038] In the dynamic display step, the first-order derivative or the second-order derivative of the change amount between images of each area is also displayed.

[0039] The three-dimensional image construction step specifically includes the following steps: a two-dimensional microscopic image acquisition step, in which ordinary optical images are collected at different depths of the object to be measured, multiple two-dimensional microscopic images are obtained, and the depth of each two-dimensional image is recorded; a three-dimensional reconstruction step, in which the three-dimensional microscopic image of the object to be measured is reconstructed according to the clearest image of the same measured point and the actual depth corresponding to the clearest image.

[0040] A three-dimensional microscopic image processing device, characterized in that the processing device includes a three-dimensional image construction unit, which obtains a three-dimensional microscopic image of an object to be tested; a polarized light image acquisition unit, which collects polarized light images of multiple polarization angles of the object to be tested; and a dynamic display unit, which dynamically displays the polarized light image of the area of ​​interest in a three-dimensional image in a highlighted form. The dynamic display unit specifically includes the following units: a change judgment unit: which judges the changes of all pixel points of the object to be tested at different polarization angles, and records the pixels and polarization angles when the changes occur; a display unit: which displays all changed pixel points one by one according to the polarization angle, and when a certain pixel point changes to the brightest, the pixel is enlarged or highlighted. The dynamic display unit includes the following units: a non-changing area judgment unit, which determines one or more non-changing areas in the three-dimensional image of the object to be tested according to the image change amount between the polarized light images of multiple polarization angles; a changing area judgment unit, which determines one or more changing areas in the three-dimensional image of the object to be tested according to the image change amount between the polarized light images of multiple polarization angles; and a dynamic display unit, which does not display the non-changing area on the three-dimensional image, and dynamically displays the dynamic changes and polarization angles of one or more changing areas at the corresponding positions of the three-dimensional image. The method comprises the following units: a region segmentation unit, which segments a three-dimensional image into a plurality of regular hexagonal image regions; a depth calculation unit, which calculates the standard deviation of the depth data in all regular hexagonal images; a judgment segmentation unit, which performs region segmentation on the three-dimensional image according to the standard deviation to obtain a non-changing region and a changing region; the standard deviation of the depth data in all regular hexagonal images in the non-changing region is smaller than the standard deviation of the depth data in all regular hexagonal images in the changing region;

[0041] The dynamic display unit does not display the non-changing area on the three-dimensional image, and dynamically displays the dynamic changes and polarization angles of one or more changing areas at the corresponding positions of the three-dimensional image. The image-to-image change amount is any one of the image-to-image pixel value change amount, image-to-image color difference change amount, image-to-image hue change amount, image-to-image brightness change amount, and image-to-image color ratio change amount. In the dynamic display unit, the first-order derivative or second-order derivative of the image-to-image change amount of each area is also displayed.

[0042] The three-dimensional image construction unit specifically includes the following units: a two-dimensional microscopic image acquisition unit, which performs ordinary optical image acquisition on the object to be tested at different depths, obtains multiple two-dimensional microscopic images, and records the depth of each two-dimensional image; a three-dimensional reconstruction unit, which reconstructs the three-dimensional microscopic image of the object to be tested based on the clearest image of the same test point and the actual depth corresponding to the clearest image.

[0043] The third embodiment of the present application relates to a three-dimensional microscopic image processing device, including a memory and a processor, wherein the memory is used to store a computer program; when the processor executes the computer program, the three-dimensional microscopic image processing method described above is implemented. The processor may be a central processing unit, or other general-purpose processors, digital signal processors, application-specific integrated circuits, etc. The aforementioned memory may be a system memory, a random access memory, a flash memory, a hard disk or a solid-state drive, etc. The steps of the method disclosed in each embodiment of the present invention may be directly embodied as being executed by a hardware processor, or may be executed by a combination of hardware and software-based modules in the processor.

[0044] It should be noted that the present application can be implemented in software and / or a combination of software and hardware, for example, can be implemented using an application specific integrated circuit (ASIC), a general purpose computer or any other similar hardware device. In one embodiment, the software program of the present application can be executed by a processor to implement the steps or functions described above. Similarly, the software program of the present application (including relevant data structures) can be stored in a computer-readable recording medium, for example, a RAM memory, a magnetic or optical drive or a floppy disk and similar devices. In addition, some steps or functions of the present application can be implemented using hardware, for example, as a circuit that cooperates with a processor to perform each step or function.

[0045] In addition, a part of the present application may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present application through the operation of the computer. Those skilled in the art should understand that the existence of computer program instructions in computer-readable media includes but is not limited to source files, executable files, installation package files, etc., and accordingly, the way in which computer program instructions are executed by a computer includes but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible to the computer.

[0046] Communication media include media by which communication signals containing, for example, computer readable instructions, data structures, program modules, or other data are transmitted from one system to another. Communication media may include guided transmission media such as cables and wires (e.g., fiber optic, coaxial, etc.) and wireless (unguided transmission) media that can propagate energy waves, such as acoustic, electromagnetic, RF, microwave, and infrared. Computer readable instructions, data structures, program modules, or other data may be embodied as a modulated data signal in, for example, a wireless medium such as a carrier wave or similar mechanism such as embodied as part of spread spectrum technology. The term "modulated data signal" refers to a signal whose one or more characteristics are changed or set in such a manner as to encode information in the signal. Modulation may be analog, digital, or a hybrid modulation technique.

[0047] By way of example and not limitation, computer-readable storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. For example, computer-readable storage media include, but are not limited to, volatile memory, such as random access memory (RAM, DRAM, SRAM); and non-volatile memory, such as flash memory, various read-only memories (ROM, PROM, EPROM, EEPROM), magnetic and ferromagnetic / ferroelectric memories (MRAM, FeRAM); and magnetic and optical storage devices (hard disks, magnetic tapes, CDs, DVDs); or other media now known or later developed that can store computer-readable information / data for use by a computer system.

[0048] Here, according to an embodiment of the present application, a device is included, which includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein, when the computer program instructions are executed by the processor, the device is triggered to run the methods and / or technical solutions based on the aforementioned multiple embodiments of the present application.

[0049] It is obvious to those skilled in the art that the present application is not limited to the details of the above exemplary embodiments, and that the present application can be implemented in other specific forms without departing from the spirit or basic features of the present application. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-restrictive, and the scope of the present application is limited by the attached claims rather than the above description, so it is intended to include all changes that fall within the meaning and scope of the equivalent elements of the claims in the present application. Any figure mark in the claims should not be regarded as limiting the claims involved. In addition, it is obvious that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices stated in the device claim can also be implemented by one unit or device through software or hardware. The words first, second, etc. are used to indicate names, and do not indicate any particular order.

[0050] Accordingly, the fourth embodiment of the present application relates to a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the above-mentioned three-dimensional microscopic image processing method is implemented. Computer-readable storage media include permanent and non-permanent, removable and non-removable media that can implement information storage by any method or technology. The information can be a computer-readable instruction, a data structure, a module of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory, static random access memory, dynamic random access memory, other types of random access memory, read-only memory, electrically erasable programmable read-only memory, flash memory or other memory technology, read-only compact disc read-only memory, digital versatile disc or other optical storage, magnetic cassette, tape disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

Claims

1. A three-dimensional microscopic image processing method, characterized in that: The processing method comprises: A three-dimensional image construction step, obtaining a three-dimensional microscopic image of the object to be tested; A polarized light image acquisition step, collecting polarized light images of the object to be measured at multiple polarization angles; a dynamic display step of dynamically displaying the polarized light image of the region of interest in a highlighted form within a three-dimensional image; The dynamic display step specifically includes the following steps: Change judgment step: judge the changes of all pixels of the object under test at different polarization angles, and record the pixels and polarization angles when they change. Display step: display all changed pixels one by one according to the polarization angle, and when a certain pixel changes to the brightest, the pixel is enlarged or highlighted.

2. A three-dimensional microscopic image processing method according to claim 1, characterized in that: The dynamic display step comprises the following steps: a non-changing region determination step, in which one or more non-changing regions are determined in the three-dimensional image of the object to be tested according to the amount of inter-image change between polarized light images at multiple polarization angles; A change region determination step, in which one or more change regions are determined based on the image change amount between polarized light images at multiple polarization angles in the three-dimensional image of the object to be tested; The dynamic display step does not display the non-changing area on the three-dimensional image, and dynamically displays the dynamic changes and polarization angles of one or more changing areas at corresponding positions of the three-dimensional image.

3. A three-dimensional microscopic image processing method according to claim 1, characterized in that: In the dynamic display step, a two-dimensional image is displayed in the non-changing area; and a three-dimensional image is displayed in the changing area.

4. A three-dimensional microscopic image processing method according to claim 1, characterized in that: The following steps are involved: A region segmentation step, dividing the three-dimensional image into a plurality of regular hexagonal image regions; Depth calculation step, calculating the standard deviation of the depth data in all regular hexagonal images; The step of determining the segmentation is to segment the three-dimensional image into regions according to the standard deviation to obtain a non-changing region and a changing region; the standard deviation of the depth data in all regular hexagonal images in the non-changing region is smaller than the standard deviation of the depth data in all regular hexagonal images in the changing region; The dynamic display step does not display the non-changing area on the three-dimensional image, and dynamically displays the dynamic changes and polarization angles of one or more changing areas at corresponding positions of the three-dimensional image.

5. A three-dimensional microscopic image processing method according to claim 1, characterized in that: The dynamic display step also displays the first-order derivative or second-order derivative of the change between images in each area.

6. A three-dimensional microscopic image processing method according to claim 1, characterized in that: The processing method also includes a region segmentation step including the following specific steps: A pixel selection step, selecting one or more pixels to obtain selected pixels; The segmentation step divides all image pixels in the three-dimensional image into several groups according to a preset height range value, and the spatially continuous pixels in a group form a segmented image.

7. A three-dimensional microscopic image processing method according to claim 1, characterized in that: The processing method further includes a region segmentation step and the following specific steps: The segmentation judgment step analyzes the first-order derivative of the inter-image variation or the second-order derivative of the inter-image variation in the segmented area, determines whether to change the preset height range value, and re-segments the three-dimensional image.

8. A three-dimensional microscopic image processing device, characterized in that: The processing device comprises: A three-dimensional image construction unit for obtaining a three-dimensional microscopic image of the object to be tested; A polarized light image acquisition unit, which collects polarized light images of the object to be measured at multiple polarization angles; A dynamic display unit dynamically displays the polarized light image of the region of interest in a highlighted form within a three-dimensional image; The dynamic display unit specifically includes the following units: Change judgment unit: judges the changes of all pixels of the object under test at different polarization angles, and records the pixels and polarization angles when they change. Display unit: displays all changing pixels one by one according to the polarization angle, and when a certain pixel changes to the brightest, the pixel is enlarged or highlighted.

9. A three-dimensional microscopic image processing device according to claim 8, characterized in that: The dynamic display unit includes the following units: A non-changing region determination unit, in the three-dimensional image of the object to be measured, determines one or more non-changing regions according to the amount of inter-image change between polarized light images at multiple polarization angles; A change region determination unit, in the three-dimensional image of the object to be measured, determines one or more change regions based on the amount of image change between polarized light images at multiple polarization angles; The dynamic display unit does not display the non-changing area on the three-dimensional image, and dynamically displays the dynamic change and polarization angle of one or more changing areas at the corresponding position of the three-dimensional image.

10. The three-dimensional microscopic image processing device according to claim 8, characterized in that: It includes the following units: a region segmentation unit, which segments the three-dimensional image into a plurality of regular hexagonal image regions; A depth calculation unit, which calculates the standard deviation of the depth data in all regular hexagonal images; The judging segmentation unit performs region segmentation on the three-dimensional image according to the standard deviation to obtain a non-changing region and a changing region; the standard deviation of the depth data in all regular hexagonal images in the non-changing region is smaller than the standard deviation of the depth data in all regular hexagonal images in the changing region; The dynamic display unit does not display the non-changing area on the three-dimensional image, and dynamically displays the dynamic change and polarization angle of one or more changing areas at the corresponding position of the three-dimensional image.

11. A three-dimensional microscopic image processing device according to claim 9, characterized in that: The amount of change between images is any one of an amount of change in pixel value between images, an amount of change in color difference between images, an amount of change in hue between images, an amount of change in brightness between images, and an amount of change in color ratio between images.

12. The three-dimensional microscopic image processing device according to claim 8, characterized in that: In the dynamic display unit, the first-order derivative or the second-order derivative of the change amount between images in each area is also displayed in the dynamic display unit.

13. The three-dimensional microscopic image processing device according to claim 8, characterized in that: The three-dimensional image construction unit specifically includes the following units: The two-dimensional microscopic image acquisition unit performs ordinary optical image acquisition on the object to be tested at different depths, obtains multiple two-dimensional microscopic images, and records the depth of each two-dimensional image; The three-dimensional reconstruction unit reconstructs a three-dimensional microscopic image of the object to be measured based on the clearest image of the same measured point and the actual depth corresponding to the clearest image.

14. A three-dimensional microscope device, comprising a memory and a processor, wherein the memory is used to store a computer program; when the processor executes the computer program, the three-dimensional microscope image processing method described in any one of claims 1 to 7 is implemented.

15. A computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the three-dimensional microscopic image processing method according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Digital holographic three dimensional (3D) microscopic system and colored microscopic image texture obtaining method

    CN109855529A

  • Method and device for three-dimensional display

    JP2002156603A