Image processing method, image processing device and image processing system

By adjusting the filter intensity according to the focus degree of medical images, the problem of low image quality in digital microscope equipment is solved, high-quality cell tissue image acquisition is achieved, and the efficiency and accuracy of pathological diagnosis is improved.

CN114730070BInactive Publication Date: 2024-11-05SONY GROUP CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202080079048.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-11-22
Filing Date
2020-09-30
Publication Date
2024-11-05
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In digital microscope devices, it is difficult to obtain high-quality cell tissue images, and the captured images are different from those of optical microscope images, which affects the efficiency and accuracy of pathological diagnosis.

Method used

Adjust the intensity of the filter by obtaining the medical image captured by the imaging device and determining the intensity of the filter based on the focus degree of the image, and calculate the focus degree using the fuzzy feature quantity and the Lorentz function to approximate the sum of the squares of the adjacent difference values, thereby adjusting the intensity of the filter , approximate optical microscope images to improve image quality.

Benefits of technology

Improves the image quality of medical images, enhances the clarity of the focused area, reduces the clarity of the unfocused area and noise, improves the diagnosis speed and accuracy of pathologists, reduces fatigue, and ensures high compression efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114730070B_ABST
    Figure CN114730070B_ABST
Patent Text Reader

Abstract

In the image processing method according to the present application, a medical image captured by an image capturing device is acquired, and the strength of a filter applied to the medical image is determined according to the focusing degree of the medical image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an image processing method, an image processing device and an image processing system. Background Art

[0002] There is a digital microscope apparatus and an image display apparatus that captures an image of a cell tissue using a microscope apparatus for observing a cell tissue, saves the image as a medical image, and performs pathological diagnosis, etc. using image data of the medical image. In the digital microscope apparatus, in order to observe the entire sample, a small area on a slide that divides an area including the sample is imaged by a magnifying imaging system, and a plurality of images of each small area are connected to create one huge medical image.

[0003] As a focusing method, automatic focusing (AF) is adopted, in which the focus of the objective lens of the magnifying imaging system is adjusted to the cell tissue to be imaged. For example, a focusing method has been proposed, in which the focus position of the objective lens of the magnifying imaging system is moved at predetermined intervals in the optical axis direction, imaging is performed at each moved position, and the position when the image with the highest contrast in the captured image is captured is detected as the focus position (for example, refer to Patent Document 1). This focusing method is called "contrast AF".

[0004] Cell tissue images captured in this way have relatively high focus accuracy, but the appearance of the images is different compared to optical microscope images observed by a doctor or other observer through an optical microscope.

[0005] Reference List

[0006] Patent Literature

[0007] Patent Document 1: JP 2011-197283 A Summary of the invention

[0008] Technical issues

[0009] As described above, in digital microscopy equipment, it is necessary to acquire images of cell tissues with high quality, but a sufficient solution has not yet been achieved.

[0010] In view of the above circumstances, the present technology aims to provide a digital microscope device, an imaging method and a program thereof that can acquire cell tissue images with high quality.

[0011] Solution to the problem

[0012] The image processing method according to the present application includes: acquiring a medical image captured by an imaging device; and determining the strength of a filter to be applied to the medical image according to a focusing degree of the medical image. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a diagram showing an example of characteristics of a medical image according to an embodiment;

[0014] Figure 2 is a diagram showing an example of characteristics of a slide glass according to the embodiment;

[0015] Figure 3 is a diagram showing a configuration example of an image processing system according to an embodiment;

[0016] Figure 4 is a diagram showing an example of a function indicating a blur feature amount according to an embodiment;

[0017] Figure 5 is a diagram showing an example of a function indicating the inverse of a blur feature amount according to an embodiment;

[0018] Figure 6 is a diagram showing an example of a pixel range for calculating a blur feature amount according to an embodiment;

[0019] Figure 7 is a diagram showing an example of a focus position according to an embodiment;

[0020] Figure 8 is a diagram showing an example of a pixel range for calculating a blur feature amount according to an embodiment;

[0021] Fig. 9 is a diagram showing a configuration example of an imaging device according to an embodiment;

[0022] Fig.10 is a diagram showing a configuration example of an image processing apparatus according to an embodiment;

[0023] Fig.11 is a diagram showing an example of a medical image storage unit according to an embodiment;

[0024] Fig.12 is a diagram showing an example of an enhancement filter storage unit according to an embodiment;

[0025] Fig.13 is a flowchart illustrating an example of information processing according to an embodiment;

[0026] Fig.14 is a diagram showing an example of the effect of an enhancement filter according to an embodiment;

[0027] Fig.15 is a diagram showing an example of the effect of an enhancement filter according to an embodiment;

[0028] Fig.16is a hardware configuration diagram showing an example of a computer for realizing the function of the image processing apparatus. DETAILED DESCRIPTION

[0029] A mode for implementing the image processing method, image processing device, and image processing system according to the present application (hereinafter referred to as an "embodiment") will be described in detail below with reference to the accompanying drawings. Note that the image processing method, image processing device, and image processing system according to the present application are not limited to the embodiments. In each of the following embodiments, the same parts are represented by the same reference numerals, and redundant descriptions will be omitted.

[0030] The present disclosure will be described in the following order of items.

[0031] 1. Characteristics of optical microscope

[0032] 2. Configuration of image processing system

[0033] 3. Information Processing Examples

[0034] 4. Dealing with Change

[0035] 4-1.Tap range

[0036] 4-2. Number of layers

[0037] 4-3. Filter type

[0038] 4-4. Forming a block with multiple pixels

[0039] 4-5. Subject

[0040] 4-6. Imaging equipment

[0041] 4-7. Focus position

[0042] 4-8. Method for calculating feature quantity

[0043] 4-9. Equipment Integration

[0044] 5. Configuration of imaging equipment

[0045] 6. Configuration of image processing equipment

[0046] 7. Information Processing Procedure

[0047] 8. Modifications

[0048] 9. Hardware Configuration

[0049] 10. Others

[0050] Example

[0051] 1. Characteristics of optical microscope

[0052] Figure 1The characteristics of optical microscope images are shown. Optical microscope images have different characteristics from images observed by digital microscope equipment. Figure 1 As shown in Figure 2, there are several metrics related to image quality of optical microscopy images. Figure 1 The characteristics of the optical microscope image are described by the indexes shown. For example, there is an index indicating the brightness of the image quality (sometimes expressed as "sparkle" in this embodiment). For example, there is an index indicating the edge degree of the image quality (sometimes expressed as "sharpness" in this embodiment). Figure 1 In the present invention, the index indicating the characteristics of the optical microscope image is, for example, "stereo / flat", "transparent / dark" or "clear / blurred".

[0053] The blur (unsharpness) according to the embodiment indicates a state in which the image is not clear. Specifically, the blur according to the embodiment indicates a state in which the image is out of focus and is not clear outside the depth of field range. The focus according to the embodiment indicates a focus state within the depth of field range. The focus degree according to the embodiment is a value obtained by scoring the degree of adjusting the focus.

[0054] like Figure 1 As shown, the optical microscope image is stereoscopic. The term "stereoscopic" according to this embodiment refers to a quality related to the visual contrast (contrast) between blur and focus.

[0055] The optical microscope image has a sense of transparency. The sense of transparency according to the embodiment indicates a quality related to noise. The noise according to the embodiment is unnecessary information other than the subject. Specifically, since the optical microscope image is not digitized, there is no enhancement of noise, and the image has a sense of transparency.

[0056] The optical microscope image has a sense of glitter. The sense of glitter according to the embodiment refers to a quality related to brightness caused by interference fringes generated by scattered light when light is applied to a subject. Specifically, the light emitted by the optical microscope image is brighter than the light applied to the object through the interference fringes, and thus has a sense of glitter.

[0057] An optical microscope image has a sense of clarity. The sense of clarity according to an embodiment indicates a quality related to clarity.

[0058] An optical microscope image is three-dimensional, bright, and highly clear, and therefore has a high ability to recognize a target (hereinafter appropriately referred to as "target recognition performance").

[0059] An optical microscope image is three-dimensional, bright, and highly clear, and therefore has a high ability to recognize a target (hereinafter appropriately referred to as "target recognition performance").

[0060] A method for approximating an image acquired by a digital microscope device to an optical microscope image will be described below. A sample is placed on a glass slide. In the sample, cells and the like are distributed in the Z-axis direction (hereinafter appropriately referred to as the "Z direction"), the Z-axis direction indicating the thickness direction of the glass slide, and the medical image acquired by the digital microscope device has a mixture of focused areas and unfocused areas. For example, when a high-range enhancement filter is applied to the entire medical image, the low-frequency part (for example, noise) is also enhanced, and the clarity of the unfocused area is also improved. The image has many high-frequency components, and the target recognition performance deteriorates. When the strength of the filter decreases, the enhancement of the area to be enhanced is also weakened.

[0061] An image similar to an optical microscope image is one with Figure 1 The image of the features shown is an image formed by images with different degrees of focus. The effect of approaching an optical microscope image will be described below.

[0062] For example, approximating a medical image acquired by a digital microscope device to an optical microscope image allows the structure of the cell to be easily seen. Therefore, utilization for diagnosis can be facilitated. For example, approximating a medical image to an optical microscope image allows the location of the cell to be easily discerned. Therefore, the diagnosis speed of the pathologist is improved and fatigue can be reduced. For example, approximating a medical image to an optical microscopic image increases the visibility of overlapping cells. Therefore, diagnosis of disease types can be performed, in which the identification of overlapping cells is important. For example, approximating a medical image to an optical microscopic image allows pathologists to easily adapt to diagnosis using medical images. For example, approaching an optical microscope image can prevent small objects such as Helicobacter pylori from hiding in noise. For example, approaching an optical microscope image can ensure high compression efficiency due to enhanced regional restrictions.

[0063] Figure 2 An example of a slide used for imaging is shown. Figure 2 is a diagram of a slide used for imaging, viewed from a vertical direction. Figure 2 As shown, the Z direction is the direction of the thickness of the slide. In other words, the Z direction is the direction of the thickness of the object. Since the subject is imaged from above the slide, the Z direction is perpendicular to the medical image. The Z direction is the direction of the optical axis during imaging. Figure 2 The case where the object is placed on a slide glass and covered with a cover glass is shown. Figure 2 The case where the object is a tissue section is shown. Figure 2 The case of imaging samples such as lymphocytes and macrophages contained in tissue is shown.

[0064] like Figure 2As shown, the lymphocytes are thick because the lymphocytes overlap. Below the lymphocytes are macrophages. Since the depth of field to be imaged is shallow, it is not possible to image, for example, the entire lymphocyte or macrophage at the focus. The information processing of the image processing device 100 will be described below as a process for correcting the reduction in visibility due to digitization.

[0065] 2. Configuration of image processing system

[0066] Reference Figure 3 The configuration of the image processing system 1 is described. Figure 3 1 is a diagram showing a configuration example of an image processing system according to an embodiment. Figure 3 As shown, the image processing system 1 includes an imaging device 10 and an image processing device 100. The imaging device 10 and the image processing device 100 are connected via a predetermined communication network (network N) so as to be able to communicate with each other in a wired or wireless manner. Figure 3 is a diagram showing a configuration example of an image processing system according to an embodiment. Figure 3 The illustrated image processing system 1 may include a plurality of imaging devices 10 and a plurality of image processing devices 100 .

[0067] The imaging device 10 is an imaging device such as a microscope, and is used to image a sample.

[0068] The image processing device 100 is used to determine information related to the filter according to the focusing degree of the subject. The image processing device 100 is, for example, an information processing device such as a PC or a workstation (WS), and performs processing based on information sent from the imaging device 10 via the network N, for example.

[0069] 3. Information Processing Examples

[0070] A case where the image processing apparatus 100 determines the strength of the filter according to the focusing degree of the subject will be described below. A sample (eg, a cell) will be described below as an example of the subject.

[0071] The filter according to the embodiment is a filter for improving the image quality of a medical image. The filter according to the embodiment is applied to a medical image obtained by imaging a subject. The filter according to the embodiment may be any type of filter. In other words, it is assumed that there is no restriction on the area enhanced by the filter according to the embodiment. For example, the filter according to the embodiment includes filters such as a high range enhancement filter, a mid-range enhancement filter, a low range enhancement filter, a negative enhancement filter, i.e., a smoothing filter.

[0072] The image processing apparatus 100 calculates the degree of focus using a blur function (hereinafter appropriately referred to as a "blur determination function" or a "blur amount determination function"). A process in which the image processing apparatus 100 generates a blur function will be described below.

[0073] The inverse is calculated by approximating the square sum of adjacent differences by the Lorentzian function, generating a blur function. The approximation according to the embodiment is the fitting of a graph (curve fitting). Expression (1) shows the square sum of adjacent differences according to the embodiment.

[0074]

[0075] Figure 4 A graph GR1 of the sum of squares of adjacent difference values ​​is shown. Figure 4 A graph GR1 is shown in which the total value of the difference between a predetermined pixel and a pixel having a predetermined relationship with respect to all pixels in a medical image is used as a feature amount, and a value in the Z direction (hereinafter appropriately referred to as a "Z value") is plotted as a variable. This feature amount is appropriately referred to as a "fuzzy feature amount". The pixel having a predetermined relationship is a pixel adjacent to the predetermined pixel. In this case, Figure 4 A graph is shown in which the total value of the difference between a predetermined pixel and adjacent pixels is plotted for all pixels in a medical image. Figure 4 In the graph GR1, the horizontal axis (X axis) is the Z value of the slide. The vertical axis (Y axis) of the graph GR1 represents the feature quantity. Figure 4 In , the output value of the sum of squares of adjacent differences is represented by s(z). Figure 4 In , the mapping is performed so that the Z value at which the feature amount becomes maximum becomes 0. In other words, the mapping is performed so that the maximum value of the output value of the sum of squares of adjacent difference values ​​is s(0). Figure 4 It is shown that the larger the feature amount is, the higher the degree of focusing is.

[0076] Figure 4 A graph in which the sum of squares of adjacent difference values ​​is approximated by a Lorentz function may be shown. Expression (2) shows a Lorentz function according to an embodiment.

[0077]

[0078] in this case, Figure 4 The Y axis of the graph GR1 in FIG. 1 may be f(z). In other words, Figure 4 The Y-axis of the graph GR1 in FIG. 4 can be represented by f(z) as the output value of the Lorentz function.

[0079] Figure 5 A graph GR2 is shown which is the inverse of the Lorentzian function f(z). Figure 5A graph GR2 obtained by plotting the inverse of the Lorentzian function f(z) is shown. The graph GR2 is a quadratic curve. Expression (3) shows a quadratic curve according to the embodiment.

[0080]

[0081] The apex in the graph GR2 indicates a focus position. The focus position according to the embodiment is a Z value at which the degree of focus becomes maximum.

[0082] The image processing device 100 acquires image information about a predetermined focused image. The image processing device 100 uses the predetermined focused image as a reference and acquires a predetermined amount of image information, the image information including the predetermined focused image and images focused on positions having different Z values. For example, the image processing device 100 acquires image information focused on a position that differs by several micrometers in the Z direction from the Z value of the predetermined focused image. As a specific example, the image processing device 100 acquires a total of three pieces of image information, including the predetermined focused image and two images focused on positions that differ by several micrometers in the Z direction from the Z value of the predetermined focused image.

[0083] The image processing apparatus 100 calculates the blur feature amount of the acquired image information by using the sum of squares of adjacent differences. Specifically, the image processing apparatus 100 calculates the blur feature amount of the acquired image information by approximating the sum of squares of adjacent differences to a Lorentz function.

[0084] The image processing apparatus 100 calculates the inverse of the calculated blur feature amount. The image processing apparatus 100 performs fitting of a quadratic curve based on the calculated blur feature amount. The image processing apparatus 100 estimates the focus position based on the fitted quadratic curve. Specifically, the image processing apparatus 100 estimates the vertex of the fitted quadratic curve as the focus position of the entire image.

[0085] The image processing apparatus 100 calculates the focusing degree of the acquired image information based on the estimated focusing position. Specifically, the image processing apparatus 100 calculates the focusing degree of the acquired image information based on the difference between the estimated focusing position and the Z value for the blur function.

[0086] The image processing apparatus 100 determines the strength of the filter according to the calculated focusing degree.

[0087] The following will refer to Figure 6 A process in which the image processing apparatus 100 calculates the blur feature amount is described.

[0088] The image processing device 100 uses a predetermined pixel in a medical image as a reference to arrange taps centered on a predetermined pixel, and calculates a fuzzy feature quantity by using the sum of squares of adjacent difference values. The tap according to the embodiment indicates a pixel range centered on a predetermined pixel. In other words, the tap according to the embodiment indicates a range of peripheral pixels of a pixel of interest. For example, the tap according to the embodiment indicates a range of peripheral pixels of a pixel of interest to which a filter is applied. For example, a 3×3 tap indicates a range of a total of nine pixels, where the vertical and horizontal pixels of the image are three pixels each. The image processing device 100 arranges the same taps on each image acquired at different Z values, and calculates the sum of squares of adjacent difference values ​​as a fuzzy feature quantity. Figure 6 An example is shown in which the image processing device 100 arranges 3×3 taps TA1. Figure 6 In , the image processing device 100 uses S0 as a predetermined pixel to calculate the blur feature amount centered on S0. In this case, the image processing device 100 calculates the blur feature amount based on Expression (4).

[0089] Fuzzy feature quantity (in the case of 3x3 = (s0-s1) 2 +(s0-s2) 2 +(s0-s3) 2 +(s0-s4) 2 +(s0-s5) 2 +(s0-s6) 2 +(s0-s7) 2 +(s0-s8) 2 (4)

[0091] Specifically, when the image processing device 100 acquires a total of three pieces of image information including a predetermined focused image and two images focused on positions different from the Z value of the predetermined focused image in the Z direction, the image processing device 100 arranges 3×3 taps from each of the three pieces, and calculates the blur feature amount by using the sum of squares of adjacent differences from the center. In this case, the image processing device 100 calculates the blur feature amount based on Expression (5).

[0092] Fuzzy feature quantity F2(upper) = (s0[2]-s1[2]) 2 +(s0[2]-s2[2]) 2 +(s0[2]-s3[2]) 2 +(s0[2]-s4[2]) 2 +(s0[2]-s5[2]) 2 +(s0[2]-s6[2]) 2 +(s0[2]-s7[2]) 2+(s0[2]-s8[2]) 2

[0093] Fuzzy feature F2(middle) = (s0[1]-s1[1]) 2 +(s0[1]-s2[1]) 2 +(s0[1]-s3[1]) 2 +(s0[1]-s4[1]) 2 +(s0[1]-s5[1]) 2 +(s0[1]-s6[1]) 2 +(s0[1]-s7[1]) 2 +(s0[1]-s8[1]) 2

[0094] Fuzzy feature quantity F2(lower) = (s0[0] - s1[0]) 2 +(s0[0]-s2[0]) 2 +(s0[0]-s3[0]) 2 +(s0[0]-s4[0]) 2 +(s0[0]-s5[0]) 2 +(s0[0]-s6[0]) 2 +(s0[0]-s7[0]) 2 +(s0[0]-s8[0]) 2 (5)

[0096] The image processing apparatus 100 calculates the blur feature quantity by using the image information on the layer located at the predetermined Z value in the acquired image information. For example, the image processing apparatus 100 calculates the blur feature quantity F2 by using the image information of the upper layer in the three acquired image information. For example, the image processing apparatus 100 calculates the blur feature quantity F1 by using the image information about the middle layer in the three acquired image information. For example, the image processing apparatus 100 calculates the blur feature quantity F0 by using the image information of the lower layer in the three acquired image information.

[0097] Figure 7 A graph GR3 is shown in which the inverses of the three values ​​calculated by the image processing device 100 are fitted to a quadratic curve. The image processing device 100 estimates the focus position based on the fitting. The image processing device 100 estimates the vertex of the fitted quadratic curve as the focus position. Figure 7 In , Zc is the focus position. Figure 7 In , Zc is the focus position estimated by the blur feature quantity. Figure 7 In , Z1 is the most focused position in the entire image. Figure 7, Z1 closest to Zc is the most focused position in the entire image. The image processing device 100 may apply to Z1 a filter having a strength equal to the result obtained by applying the filter to be applied to Zc. When Z1 is within a predetermined range that is considered equal to Zc, the image processing device 100 may apply a filter having a strength equal to Zc to Z1.

[0098] The image processing apparatus 100 calculates the focusing degree according to the distance from the focusing position. Figure 7 , the image processing apparatus 100 calculates the focusing degree according to the distance from Zc.

[0099] The image processing device 100 determines the strength of the filter to be applied according to the calculated focusing degree. The image processing device 100 applies the filter according to the determined strength. Specifically, the image processing device 100 determines the filter strength for each pixel and performs the filtering process on the pixel. Therefore, the image processing device 100 performs the filtering process most suitable for the image by repeating the process for each pixel.

[0100] Therefore, the image processing device 100 can change the strength of the filter according to the degree of focus. Therefore, the image processing device 100 can apply a filter with a strength equal to 100% only to the focused area of ​​the image. Applying a filter with a strength of 100% to the entire image also increases the clarity of the unfocused area and the noise. However, since the image processing device 100 applies the filter only to the focused area, the clarity is improved only in the focused area. Since the clarity of the unfocused area is not enhanced, the depth sense of the image is not reduced, and the overlap of cells is easily recognized. Since the clarity of the noise is not enhanced, it is possible to suppress fine subjects such as Helicobacter pylori from being hidden in the noise. Therefore, the image processing device 100 can adjust the local contrast. Therefore, the image processing device 100 can correct the image whose contrast is reduced by the imaging optical system. Therefore, the image processing device 100 can partially adjust the contrast. Therefore, even when mucus or other substances are mixed in the cell nucleus and the gene information is not present in the center of the cell nucleus, the image processing device 100 can confirm the situation and improve the accuracy of the diagnosis.

[0101] 4. Dealing with Change

[0102] 4-1.Tap range

[0103] Although in the above example, the image processing device 100 selects a square tap centered on a predetermined pixel, the selected tap range is not limited to a square such as 3×3, and any range may be selected as the tap. Figure 8As shown, the image processing device 100 can select a cross-shaped tap range centered on S0. The number of vertical and horizontal pixels in the selected range may not be limited to three pixels. The image processing device 100 can select an 11×11 range as a tap, where each of the vertical and horizontal pixels is 11 pixels.

[0104] 4-2. Number of layers

[0105] Although in the above example, the image processing apparatus 100 estimates the focus position by using the reciprocals of three values ​​calculated using three pieces of image information having different Z directions, it is assumed that the number of image information used to estimate the focus position is not limited as long as the number is three or more. For example, the image processing apparatus 100 can estimate the focus position by using the reciprocals of four values ​​calculated using four pieces of image information having different Z directions.

[0106] 4-3. Filter type

[0107] Although in the above example, the image processing device 100 determines the strength of the filter according to the degree of focus, the image processing device 100 may determine the type of the filter according to the degree of focus. For example, the image processing device 100 determines the type of the filter according to the estimated focus position. For example, if the degree of focus satisfies a predetermined condition, the image processing device 100 determines the type of the corresponding specific filter. For example, if the degree of focus satisfies a predetermined condition, the image processing device 100 determines the type of filter used to enhance the corresponding predetermined area. For example, if the degree of focus is greater than or equal to a predetermined threshold, the image processing device 100 determines to apply a mid-range enhancement filter. For example, if the degree of focus is less than a predetermined threshold, the image processing device 100 determines to apply a high-range enhancement filter. Alternatively, the image processing device 100 determines to apply a negative enhancement filter, i.e., a smoothing filter.

[0108] The image processing apparatus 100 may determine the strength and type of the filter according to the degree of focus. The image processing apparatus 100 may simultaneously determine the strength and type of the filter according to the degree of focus. In this case, the image processing apparatus 100 may apply the filter of the determined strength and type to the medical image. Therefore, the image processing apparatus 100 may apply the best filter with the best strength according to the degree of focus.

[0109] 4-4. Forming a block with multiple pixels

[0110] Although in the above example, the image processing device 100 determines the strength and type of the filter for each pixel, the image processing device 100 may form a block with a plurality of pixels and determine the strength and type of the filter for each block. In this case, the image processing device 100 determines a plurality of pixels for forming a block. The image processing device 100 may determine a plurality of pixels for forming a block in any manner. For example, the image processing device 100 forms a block with a plurality of adjacent pixels. For example, the image processing device 100 forms a block with a plurality of predetermined pixels.

[0111] 4-5. Subject

[0112] Although in the above example, the image processing apparatus 100 uses a sample (e.g., a cell) as a subject to acquire a medical image, the image processing apparatus may use a living body or any object collected from a living body as a subject to acquire an image. For example, the image processing apparatus 100 uses a sample related to a living body, a living body, a material, a pathology, etc. in the medical field as a subject to acquire an image.

[0113] 4-6. Imaging equipment

[0114] It is assumed that the imaging device according to the embodiment may be any device capable of imaging a subject. For example, the imaging device according to the embodiment is a microscope. If the imaging device according to the embodiment is a microscope, any microscope may be used.

[0115] 4-7. Focus position

[0116] Although the image processing apparatus 100 estimates the vertices of the fitted quadratic curve as the focus position of the entire image in the above example, the image processing apparatus may estimate the position within a predetermined range from the vertices of the fitted quadratic curve as the focus position of the entire image.

[0117] 4-8. Method for calculating feature quantity

[0118] Although in the above-described embodiment, the pixels having a predetermined relationship are pixels adjacent to the predetermined pixel, the pixels are not limited to this example. In other words, the pixels having a predetermined relationship are not necessarily limited to adjacent pixels. For example, the pixels having a predetermined relationship may be pixels every other pixel or every two pixels. For example, the image processing device 100 may calculate the degree of focus by using the total value of the difference between the predetermined pixel and the pixels every other pixel as a feature amount. In this case, the image processing device 100 determines the strength of the filter to be applied to the medical image based on the degree of focus calculated by using the total value of the difference between the predetermined pixel and the pixels every other pixel as a feature amount.

[0119] 4-9. Equipment Integration

[0120] Although the imaging device 10 and the image processing device 100 are separate devices in the above-described embodiment, the imaging device 10 and the image processing device 100 may be integrated. For example, the function of the image processing device 100 may be implemented in a computer that controls the operation of the imaging device 10, or may be implemented in any computer provided within the housing of the imaging device 10. The function of the image processing device 100 may be downloaded to a computer that controls the operation of the imaging device 10, or may be downloaded to any computer provided within the housing of the imaging device 10. Therefore, the imaging device 10 having the function of the image processing device 100 may be sold.

[0121] 5. Configuration of imaging equipment

[0122] Then refer to Fig. 9 The configuration of the imaging device 10 according to the embodiment is described. Fig. 9 1 is a diagram showing a configuration example of an imaging device 10 according to an embodiment. Fig. 9 As shown, the imaging device 10 includes a communication unit 11, a storage unit 12, and a control unit 13. The imaging device 10 may have an input unit (e.g., a keyboard or a mouse) for receiving various operations from an administrator of the imaging device 10 and a display unit (e.g., a liquid crystal display) for displaying various types of information.

[0123] Communication unit 11

[0124] The communication unit 11 is realized by, for example, a network interface card (NIC). The communication unit 11 is connected to a predetermined network N in a wired or wireless manner, and transmits and receives information to and from, for example, the image processing apparatus 100 via the predetermined network N.

[0125] Storage unit 12

[0126] The storage unit 12 is implemented by, for example, a semiconductor storage element such as a RAM or a flash memory or a storage device such as a hard disk or an optical disk. The storage unit 12 stores information related to medical images. Specifically, the storage unit 12 stores information related to medical images of imaging subjects.

[0127] Control unit 13

[0128] The control unit 13 is a controller and is realized by, for example, a CPU or MPU executing various programs stored in a storage device inside the imaging apparatus 10 using a RAM as a work area. The control unit 13 is a controller and is realized by, for example, an integrated circuit such as an ASIC or an FPGA.

[0129] like Fig. 9As shown, the control unit 13 includes an imaging unit 141, and implements or performs the operation of information processing to be described below. The internal configuration of the control unit 13 is not limited to Fig. 9 The configuration shown, and other configurations may be used as long as the information processing to be described below is performed.

[0130] Imaging unit 141

[0131] The imaging unit 141 images various types of information. The imaging unit 141 images a subject on a slide. The imaging unit 141 acquires various types of information. The imaging unit 141 acquires an imaged medical image.

[0132] 6. Configuration of image processing equipment

[0133] Then refer to Fig.10 The configuration of the image processing apparatus 100 according to the embodiment is described. Fig.10 1 is a diagram showing a configuration example of an image processing apparatus 100 according to an embodiment. Fig.10 As shown, the image processing apparatus 100 includes a communication unit 110, a storage unit 120, and a control unit 130. The image processing apparatus 100 may have an input unit (e.g., a keyboard or a mouse) for receiving various operations from an administrator of the image processing apparatus 100 and a display unit (e.g., a liquid crystal display) for displaying various types of information.

[0134] Communication unit 110

[0135] The communication unit 110 is realized by, for example, a NIC. The communication unit 110 is connected to the network N in a wired or wireless manner, and transmits and receives information to and from the imaging device 10 via the network N, for example.

[0136] Storage unit 120

[0137] The storage unit 120 is implemented by, for example, a semiconductor storage element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. Fig.10 As shown, the storage unit 120 includes a medical image storage unit 121 and an enhancement filter storage unit 122 .

[0138] The medical image storage unit 121 stores information related to medical images. Fig.11 FIG. 2 shows an example of the medical image storage unit 121 according to an embodiment. Fig.11 As shown, the medical image storage unit 121 has items such as “medical image ID” and “medical image”.

[0139] "Medical image ID" means identification information for identifying a medical image. "Medical image" means a medical image obtained by imaging a subject. For example, "Medical image" means a medical image captured by the imaging device 10. Fig.11 In the example shown, conceptual information such as "medical image #11" and "medical image #12" is stored in "medical image", but, for example, still images or moving images are actually stored. The still images or moving images may be saved in a server or cloud different from the image processing device, and "medical image" may store, for example, a uniform resource locator (URL) where the contents of the medical image are located or a file path name indicating a storage location.

[0140] The enhancement filter storage unit 122 stores information related to the enhancement filter to be applied to the medical image. Fig.12 FIG. 2 shows an example of the enhancement filter storage unit 122 according to an embodiment. Fig.12 As shown, the enhancement filter storage unit 122 has items such as “enhancement filter ID” and “enhancement filter”.

[0141] "Enhancement filter ID" indicates identification information for identifying an enhancement filter. "Enhancement filter" indicates information related to the enhancement filter. Fig.12 In the example shown, conceptual information such as “enhancement filter #11” and “enhancement filter #12” is stored in “enhancement filter”, but for example, the strength and type of the enhancement filter and the pixel range to which the enhancement filter is applied are actually stored.

[0142] Control unit 130

[0143] The control unit 130 is a controller and is implemented by, for example, a CPU or MPU executing various programs stored in a storage device inside the image processing apparatus 100 using a RAM as a work area. The control unit 130 is a controller and is implemented by, for example, an integrated circuit such as an ASIC or an FPGA.

[0144] like Fig.10 As shown, the control unit 130 includes an acquisition unit 131, a calculation unit 132, and a determination unit 133, and implements or executes the operation of information processing to be described below. The internal configuration of the control unit 130 is not limited to Fig.10 The configuration shown, and other configurations may be used as long as the information processing to be described below is performed.

[0145] Acquisition unit 131

[0146] The acquisition unit 131 acquires various types of information. The acquisition unit 131 acquires various types of information from an external information processing device. The acquisition unit 131 acquires various types of information from another information processing device such as the imaging device 10.

[0147] The acquisition unit 131 acquires various types of information from the storage unit 120. The acquisition unit 131 acquires various types of information from the medical image storage unit 121 and the enhancement filter storage unit 122.

[0148] The acquisition unit 131 stores the acquired various types of information in the storage unit 120. The acquisition unit 131 stores the various types of information in the medical image storage unit 121 and the enhancement filter storage unit 122.

[0149] The acquisition unit 131 acquires various types of information calculated and determined by other functional configurations.

[0150] The acquisition unit 131 acquires a medical image of a subject. For example, the acquisition unit 131 acquires a medical image of a subject captured by the imaging device 10. For example, the acquisition unit 131 acquires a medical image of a subject related to a living body, an organism, a material, or a pathology in the medical field. For example, the acquisition unit 131 acquires a medical image captured by a microscope.

[0151] Computing unit 132

[0152] The calculation unit 132 calculates various types of information. The calculation unit 132 calculates various types of information from the storage unit 120. The calculation unit 132 calculates various types of information from the medical image storage unit 121 and the enhancement filter storage unit 122.

[0153] The calculation unit 132 stores the calculated various types of information in the storage unit 120. The calculation unit 132 stores the various types of information in the medical image storage unit 121 and the enhancement filter storage unit 122.

[0154] The calculation unit 132 calculates various types of information acquired and determined by other functional configurations. The calculation unit 132 calculates various types of information based on various types of information acquired and determined by other functional configurations.

[0155] The calculation unit 132 calculates the sum of squares of adjacent differences by using the acquired image information. The calculation unit 132 calculates the sum of squares of adjacent differences in the determined tap range centered on a predetermined pixel. For example, the calculation unit 132 calculates the sum of squares of adjacent differences based on a feature amount obtained by summing the differences between a predetermined pixel and adjacent pixels in a medical image.

[0156] The calculation unit 132 calculates the Lorentz function according to the calculated sum of squares of adjacent differences. The calculation unit 132 calculates the approximate value of the Lorentz function according to the calculated sum of squares of adjacent differences. The calculation unit 132 approximates the calculated sum of squares of adjacent differences to the Lorentz function.

[0157] The calculation unit 132 calculates the inverse of the Lorentz function based on the calculated Lorentz function. The calculation unit 132 estimates the focus position based on the inverse of the Lorentz function. The calculation unit 132 estimates the vertex of the inverse of the Lorentz function as the focus position.

[0158] The calculation unit 132 calculates the focusing degree. The calculation unit 132 calculates the focusing degree by using the estimated focusing position. The calculation unit 132 calculates the focusing degree according to the distance from the estimated focusing position. The calculation unit 132 calculates the focusing degree according to the distance between the Z value corresponding to the calculated inverse of the Lorentz function and the estimated focusing position.

[0159] Determination unit 133

[0160] The determination unit 133 determines various types of information. The determination unit 133 determines various types of information from the storage unit 120. The determination unit 133 determines various types of information from the medical image storage unit 121 and the enhancement filter storage unit 122.

[0161] The determination unit 133 stores the determined various types of information in the storage unit 120. The determination unit 133 stores the various types of information in the medical image storage unit 121 and the enhancement filter storage unit 122.

[0162] The determination unit 133 determines various types of information acquired and calculated by other functional configurations. The determination unit 133 determines various types of information based on various types of information acquired and calculated by other functional configurations.

[0163] The determination unit 133 selects the pixel to which the filter is applied. The determination unit 133 selects the first pixel to which the filter is applied. For example, the determination unit 133 selects the next pixel after applying the filter to a predetermined pixel. For example, the determination unit 133 selects the pixel to which the filter is applied based on a predetermined algorithm.

[0164] The determination unit 133 determines the strength of the filter to be applied to the medical image according to the calculated focus degree. The determination unit 133 determines a synthesis ratio indicating a synthesis ratio of the medical image according to a plurality of filters having different strengths according to the calculated focus degree. The determination unit 133 selectively determines a plurality of filters to be applied to the medical image according to the calculated focus degree.

[0165] The determination unit 133 determines the type of filter to be applied to the medical image according to the calculated focusing degree. The determination unit 133 determines a synthesis rate indicating a synthesis ratio of the medical image according to a plurality of filters having different types according to the calculated focusing degree.

[0166] The determining unit 133 applies a filter of a determined strength to the medical image. The determining unit 133 applies a filter of a determined type to the medical image.

[0167] The determination unit 133 applies a filter of a strength determined for a plurality of medical images having different Z values ​​to each medical image according to the calculated focus degree. Then, the determination unit 133 determines a synthesis ratio indicating a synthesis ratio of each medical image to which the filter is applied according to the calculated focus degree. Then, the determination unit 133 synthesizes each medical image based on the synthesis ratio determined according to the calculated focus degree.

[0168] The determination unit 133 determines whether the filter has been applied to all pixels. The determination unit 133 determines whether the filter process has been performed on all pixels in the medical image. The determination unit 133 determines whether the filter process has been performed on all pixels included in a predetermined range in the medical image.

[0169] 7. Information Processing Procedure

[0170] Then refer to Fig.13 An information processing procedure of the image processing system 1 according to the embodiment is described. Fig.13 : is a flowchart showing an information processing procedure of the image processing system 1 according to the embodiment.

[0171] like Fig.13 As shown, the image processing device 100 acquires a medical image (step S101). The image processing device 100 selects predetermined pixels for performing filtering processing (step S102). The image processing device 100 uses a blur function to estimate the degree of focus (step S103). The image processing device 100 determines the type and strength of the filter according to the estimated degree of focus (step S104). The image processing device 100 applies a filter of a determined type and strength (step S105). The image processing device 100 determines whether the filtering process has been performed on all pixels (step S106). If it is determined that the filtering process has not been performed on all pixels (step S106 No), the image processing device 100 returns to the process of step S102. For example, the image processing device 100 returns to the process of step S102 and selects pixels other than the previously selected pixels. On the other hand, if it is determined that the filtering process has been performed on all pixels (step S106 Yes), the image processing device 100 ends the information processing.

[0172] 8. Modifications

[0173] The image processing system 1 according to the above-described embodiment can be implemented in various different forms from the above-described embodiment. Therefore, another embodiment of the image processing system 1 will be described below.

[0174] The above embodiment has described the process of applying the optimal filter to a plurality of medical images having different Z values ​​for each pixel. Fig.14 and Fig.15 , a description will be given of a process capable of obtaining an effect equivalent to a process of applying an optimal filter to a plurality of medical images having different Z values ​​for each pixel.

[0175] Fig.14 FIG. 1 shows a case where the image processing apparatus 100 applies an enhancement filter to an acquired medical image. Fig.14 In , image KG1 represents the image before the filter is applied, and image KG2 represents the image after the filter is applied. In this case, an image is generated with improved contrast and resolution of the entire image, including objects other than the object of interest.

[0176] The image processing apparatus 100 may apply a plurality of enhancement filters to the acquired medical image. The image processing apparatus 100 may generate a composite image obtained by applying a plurality of filters having different strengths according to the degree of focus.

[0177] Fig.15 FIG. 1 shows a case where the image processing apparatus 100 applies a plurality of enhancement filters to an image obtained by synthesizing a medical image. Fig.15 In FIG. 1 , image KG11 represents an image obtained by applying a first filter, and image KG22 represents an image obtained by applying a second filter having a strength different from that of the first filter. Fig.15 As shown, image KG11 is more blurred than image KG22. Image KG33 represents a composite image obtained by combining image KG11 and image KG22. Fig.15 In the figure, the target SJ11 is a first region indicating a region of interest of the image, and the target SJ22 is a second region which is not a region of interest. For example, the target SJ22 is a part of noise in the medical image.

[0178] The image processing apparatus 100 may determine a synthesis ratio indicating a synthesis ratio of the medical image. For example, the image processing apparatus 100 may determine a synthesis ratio of the first region and the second region. Fig.15 In , the image processing device 100 synthesizes the image KG11 and the image KG12 at a synthesis ratio of 1:9 with respect to the area of ​​the target SJ11. The ratio of the synthesis ratio to the target area SJ11 may be any ratio as long as the ratio of the image KG22 is higher than that of the image KG11. Fig.15 , the image processing device 100 synthesizes the image KG11 and the image KJ22 at a synthesis ratio of 9: 1 with respect to the area of ​​the target SJ22. The ratio of the synthesis ratio to the target area SJ22 may be any ratio as long as the ratio of the image KG11 is higher than that of the image KJ22.

[0179] Despite Fig.15 In the embodiment, two images obtained by applying the enhancement filter are synthesized, but it is assumed that the number of images to be synthesized by the image processing device 100 is not limited. The image processing device 100 may selectively determine the number of images to be synthesized, or may selectively determine the images to be synthesized. For example, when there is an indistinguishable area in the image obtained by applying the first filter, the image processing device 100 selectively synthesizes a plurality of images obtained by applying other filters and the image obtained by applying the first filter, thereby generating an image having improved visibility and recognizability compared to the image obtained by applying only the first filter.

[0180] Therefore, the image processing apparatus 100 can adjust the local contrast by synthesizing the processed images with the enhancement filters of different strengths. Therefore, the image processing apparatus 100 can adjust the global and local contrast by adaptively applying the optimal filter and improve the visibility like an optical microscope.

[0181] Fig.15 An example of synthesizing images obtained by applying a plurality of different filters to one image is shown. As described above, the image processing apparatus 100 can generate a synthesized image by synthesizing images obtained by applying a plurality of different filters to one image. As in the above-described embodiment, the image processing apparatus 100 can generate a synthesized image by synthesizing images obtained by applying optimal filters to a plurality of medical images having different Z values ​​according to the corresponding focusing degrees according to the focusing degrees.

[0182] 9. Hardware Configuration

[0183] The imaging device 10 and the image processing device 100 according to the above-described embodiment are composed of, for example, Fig.16 The illustrated configuration is implemented by a computer 1000 . Fig.16 1 is a hardware configuration diagram showing an example of a computer that realizes the functions of the imaging device 10 and the image processing device 100. The computer 1000 includes a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0184] The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400 and controls each unit. The ROM 1300 stores, for example, a boot program executed by the CPU 1100 when the computer 1000 is activated and a program depending on the hardware of the computer 1000.

[0185] For example, HDD 1400 stores programs to be executed by CPU 1100 and data to be used by the programs. Communication interface 1500 receives data from other devices via a predetermined communication network, transmits data to CPU 1100, and transmits data generated by CPU 1100 to other devices via a predetermined communication network.

[0186] The CPU 1100 controls an output device such as a display or a printer and an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 acquires data from the input device via the input / output interface 1600. The CPU 1100 outputs generated data to the output device via the input / output interface 1600.

[0187] The media interface 1700 reads a program or data stored in the recording medium 1800, and provides the read program or data to the CPU 1100 via the RAM 1200. The CPU 1100 loads a program from the recording medium 1800 to the RAM 1200 via the media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a digital versatile disk (DVD) or a phase-change rewritable disk (PD), a magneto-optical recording medium such as a magneto-optical disk (MO), a magnetic tape medium, a magnetic recording medium, or a semiconductor memory.

[0188] For example, when the computer 1000 is used as the imaging device 10 and the image processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes the programs loaded on the RAM 1200 to realize the functions of the control units 13 and 130. The CPU 1100 of the computer 1000 reads these programs from the recording medium 1800 and executes them, but as another example, these programs may be acquired from another device via a predetermined communication network.

[0189] 10. Others

[0190] In the processes described in the above embodiments and modifications, all or some of the processes described as being automatically performed may be performed manually, or all or some of the processes described as being manually performed may be performed automatically by known methods. In addition, unless otherwise specified, the processing procedures, specific names, and information including various types of data and parameters shown in the above description and drawings may be changed arbitrarily. For example, the various types of information shown in each figure are not limited to the information shown.

[0191] Each component of each device shown in the drawings is conceptual in function and does not necessarily need to be physically configured as shown in the drawings. In other words, the specific forms of distribution and integration of the devices are not limited to those shown in the drawings, and all or some of the devices may be configured by being functionally or physically distributed or integrated in any unit according to, for example, various loads or usage conditions.

[0192] The above-described embodiments and modifications can be appropriately combined within the range not inconsistent with the processing contents.

[0193] Although some embodiments of the present application have been described in detail with reference to the accompanying drawings, these embodiments are merely examples, and the present invention may be implemented in other forms with various modifications and improvements based on the knowledge of those skilled in the art, including the aspects described in the disclosure of the present invention.

[0194] For example, the above-mentioned “parts (parts, modules and units)” may be replaced by “devices” or “circuits”. For example, the acquisition unit may be replaced by an acquisition device or an acquisition circuit.

[0195] Note that the present technology may also have the following configurations.

[0196] (1) An image processing method comprising:

[0197] acquiring a medical image captured by an imaging device; and

[0198] The strength of the filter to be applied to the medical image is determined according to the degree of focus of the medical image.

[0199] (2) The image processing method according to (1), comprising:

[0200] The strength of a filter to be applied to the medical image is determined according to a focusing degree calculated by a blur function indicating a blur degree of the medical image.

[0201] (3) The image processing method according to (1) or (2), comprising:

[0202] The strength of the filter to be applied to the medical image is determined according to the focusing degree calculated by the blur function according to the thickness direction of the object in the direction perpendicular to the medical image.

[0203] (4) The image processing method according to any one of (1) to (3), comprising:

[0204] The strength of a filter to be applied to the medical image is determined according to a focusing degree calculated by a feature amount obtained by summing differences between predetermined pixels and peripheral pixels in the medical image.

[0205] (5) The image processing method according to any one of (1) to (4), comprising:

[0206] The strength of a filter to be applied to the medical image is determined based on the focus degree estimated from the blur function and the focus degree calculated by a feature amount obtained by summing the differences between a predetermined pixel and peripheral pixels in the medical image.

[0207] (6) The image processing method according to any one of (1) to (5), comprising:

[0208] According to the focusing degree of the subject, a synthesis ratio indicating a synthesis ratio of a synthesized image generated by applying a plurality of different filters to the medical image is determined.

[0209] (7) The image processing method according to any one of (1) to (6), comprising:

[0210] A synthesis rate of a synthesized image generated by applying a plurality of filters having different strengths to a predetermined medical image is determined.

[0211] (8) The image processing method according to any one of (1) to (7), comprising:

[0212] The synthesis rate of a synthesized image generated by applying the filter is determined according to the degree of focusing of the subject on a plurality of medical images having different Z values.

[0213] (9) The image processing method according to any one of (1) to (8), comprising:

[0214] A plurality of filters to be applied to a medical image to generate a composite image are selectively determined according to the degree of focus of the subject.

[0215] (10) The image processing method according to any one of (1) to (9), comprising:

[0216] According to the focusing degree of the subject, a high range enhancement filter, a middle range enhancement filter, a low range enhancement filter, or a negative enhancement filter (ie, a smoothing filter) is determined as the type of the area enhanced by the filter.

[0217] (11) The image processing method according to any one of (1) to (10), comprising:

[0218] Acquire medical images of subjects related to living bodies, organisms, materials or pathologies in the medical field.

[0219] (12) The image processing method according to any one of (1) to (11), including acquiring a medical image captured by a microscope as an imaging device.

[0220] (13) An image processing device comprising:

[0221] an acquisition unit configured to acquire a medical image of a subject captured by a microscope; and

[0222] A determination unit is configured to determine a strength of a filter to be applied to the medical image according to a focusing degree of the subject, the filter improving an image quality of the medical image.

[0223] (14) An image processing system comprising:

[0224] an imaging device configured to image a subject; and

[0225] an image processing device configured to include software for processing a medical image corresponding to an object to be imaged by the imaging device,

[0226] Therein, the software determines the strength of a filter to be applied to a medical image captured by an imaging device based on the degree of focus of the subject.

[0227] Reference numerals list

[0228] 1 Image Processing System

[0229] 10 Imaging equipment

[0230] 100 Image processing equipment

[0231] 110 Communication unit

[0232] 120 storage units

[0233] 121 Medical Image Storage Unit

[0234] 122 Enhanced filter storage unit

[0235] 130 Control unit

[0236] 131 Get Unit

[0237] 132 computing units

[0238] 133 Determine unit

[0239] N Network

Claims

1. An image processing method, comprising: By computer acquiring a medical image captured by an imaging device; determining a strength of a filter to be applied to the medical image according to a degree of focus of the medical image; as well as According to the focusing degree of the subject, a synthesis rate indicating a synthesis ratio of a synthesized image generated by applying a plurality of different filters to the medical image is determined.

2. The image processing method according to claim 1, comprising: The strength of a filter to be applied to the medical image is determined according to a focusing degree calculated by a blur function indicating a blur degree of the medical image.

3. The image processing method according to claim 2, comprising: The strength of a filter to be applied to the medical image is determined according to a focusing degree calculated by the blur function according to a thickness direction of the object in a direction perpendicular to the medical image.

4. The image processing method according to claim 3, comprising: The strength of a filter to be applied to the medical image is determined according to a focusing degree calculated by a feature amount obtained by summing differences between a predetermined pixel and peripheral pixels in the medical image.

5. The image processing method according to claim 4, comprising: The strength of a filter to be applied to the medical image is determined based on an estimated focusing degree estimated from the blur function and a focusing degree calculated by a feature amount obtained by summing differences between predetermined pixels and peripheral pixels in the medical image.

6. The image processing method according to claim 1, comprising: A synthesis rate of the synthesized image generated by applying a plurality of filters having different strengths to a predetermined medical image is determined.

7. The image processing method according to claim 1, comprising: A synthesis rate of the synthesized image generated by applying a filter is determined according to a degree of focusing of the subject on the plurality of medical images having different Z values.

8. The image processing method according to claim 1, comprising: A plurality of filters to be applied to a medical image for generating the composite image are selectively determined according to the focusing degree of the subject.

9. The image processing method according to claim 8, comprising: According to the focusing degree of the subject, a high range enhancement filter, a medium range enhancement filter, a low range enhancement filter or a negative enhancement filter is determined as the type of the area enhanced by the filter, the negative enhancement filter being a smoothing filter.

10. The image processing method according to claim 9, comprising: Acquire medical images of subjects related to living bodies, organisms, materials or pathologies in the medical field.

11. The image processing method according to claim 10, comprising: A medical image captured by a microscope as the imaging device is acquired.

12. An image processing device, comprising: an acquisition unit configured to acquire a medical image of a subject captured by a microscope; as well as a determining unit configured to determine a strength of a filter to be applied to the medical image according to a focusing degree of the subject, the filter improving an image quality of the medical image; The determination unit determines a synthesis ratio according to a focusing degree of the subject, the synthesis ratio indicating a synthesis ratio of a synthesized image generated by applying a plurality of different filters to the medical image.

13. An image processing system, comprising: An imaging device configured to image a subject; as well as an image processing device configured to include software for processing a medical image corresponding to an object to be imaged by said imaging device, wherein the software determines the strength of a filter to be applied to a medical image captured by the imaging device based on the degree of focus of the subject; and According to the focusing degree of the subject, a synthesis ratio is determined, the synthesis ratio indicating a synthesis ratio of a synthesized image generated by applying a plurality of different filters to the medical image.