A medical image processing method and system for otitis media

Abstract

The present invention relates to the technical field of otoscopes, and discloses a method and system for processing medical images of otitis media. The system comprises an acquisition module and a processing module; the acquisition module is used to: acquire the operating parameters of the otoscope, and acquire the tympanic membrane image collected by the otoscope after adjusting the otoscope according to the operating parameters; the processing module is used to: establish a two-dimensional first coordinate system in the tympanic membrane image; construct a healthy tympanic membrane simulation image with the same position of the tympanic membrane physiological structure according to the coordinate points of the tympanic membrane image in the first coordinate system; establish a three-dimensional coordinate of the local abnormal image in the ear scanning image according to the local abnormal image of the tympanic membrane image and the healthy tympanic membrane simulation image, and the two-dimensional coordinates of the local abnormal image in the first coordinate system, so as to output a three-dimensional image processing result. The present invention is conducive to forming a complete image analysis result using the otoscope image.

Description

Technical Field

[0001] The present invention relates to the technical field of otoscopes, and in particular to a method and system for processing medical images of otitis media. Background Art

[0002] An otoscope, also known as an ear endoscope or an otoscope examination system, is a medical device used to examine the internal structure of the ear, especially the external auditory canal and the middle ear. It is an important technology in modern otolaryngology diagnosis and treatment. Compared with traditional otoscopes, otoscopes provide a more detailed and in-depth way of observation.

[0003] Otitis media is an inflammatory disease that occurs in the middle ear, usually involving the tympanic cavity and Eustachian tube, and may affect the ossicular chain. Depending on the severity and nature of the disease, otitis media can be divided into several types, mainly including acute otitis media, chronic otitis media, secretory otitis media, etc.

[0004] The diagnosis of otitis media is usually based on medical history, clinical symptoms and physical examination, and sometimes requires otoscopy, audiometry or imaging studies (such as temporal bone CT) to assist in the diagnosis.

[0005] Otoscopy is one of the important means to diagnose otitis media. By directly observing the characteristics of the external auditory canal and tympanic membrane, the doctor can assess whether there is middle ear inflammation.

[0006] The following are some key points for otoscopy to determine otitis media:

[0007] First, the appearance of the tympanic membrane:

[0008] Color changes: Normally, the eardrum should be translucent and grayish. In otitis media, the eardrum may appear red or congested. Transparency: If the eardrum becomes cloudy or opaque due to fluid in the middle ear, this may be a sign of secretory otitis media. Position and shape: Fluid or inflammation in the middle ear may cause the eardrum to sag outward or inward (recessed), or appear strained by pressure. Abnormal structures: Granulation tissue, perforations, or foreign bodies are direct evidence of otitis media.

[0009] Second, tympanic membrane mobility:

[0010] During otoscopy, the doctor may gently tap the person's head or near the ear to observe the eardrum's vibration response (a "tympanic membrane movement test"). Fluid or inflammation in the middle ear can reduce the normal vibration of the eardrum.

[0011] Third, ear canal condition:

[0012] Inspect the ear canal for redness, swelling, discharge, or foreign matter, which may also be associated with otitis media, particularly if inflammation spreads from the ear canal to the middle ear.

[0013] However, as a diagnostic method for directly observing the condition of the external auditory canal and tympanic membrane, otoscopy can sometimes only observe part of the ear, and the image observed is a flat image, which cannot fully evaluate the three-dimensional situation in the entire ear canal. The doctor's otoscope operation skills, experience, and familiarity with the anatomical structure of the ear will affect the accuracy of the examination. Inappropriate angles, improper light adjustment, or failure to fully expose the observation area may lead to misjudgment; obstruction of the external auditory canal (such as earwax, foreign matter, swelling caused by inflammation) or tympanic membrane problems (such as perforation, turbidity) may hinder clear observation and lead to misdiagnosis; the interpretation of changes in the color, position, shape, etc. of the tympanic membrane is somewhat subjective, and different doctors may have different interpretations of the same phenomenon, especially in the judgment of minor abnormalities.

[0014] The disadvantage of the existing technology is that the traditional otoscope examination scheme either obtains flat image data or the condition of the external auditory canal prevents a clear image of the ear from being obtained. Therefore, it is impossible to use the otoscope image to form a complete image analysis result. Therefore, there is an urgent need to propose a medical image processing method and system for otitis media. Summary of the invention

[0015] The main purpose of the present invention is to provide a medical image processing method for otitis media, aiming to form a complete image analysis result using otoscope images.

[0016] To achieve the above-mentioned purpose, the present invention proposes a medical image processing system for otitis media, comprising an acquisition module and a processing module;

[0017] The acquisition module is used to: acquire the operating parameters of the otoscope, and acquire the tympanic membrane image collected by the otoscope after adjusting the otoscope according to the operating parameters, wherein the operating parameters of the otoscope include brightness and focal length;

[0018] The processing module is used for:

[0019] Establishing a two-dimensional first coordinate system in the tympanic membrane image;

[0020] According to the coordinate points of the physiological structure in the ear in the first coordinate system of the tympanic membrane image, a simulated image of a healthy tympanic membrane with the same position of the physiological structure in the ear is constructed;

[0021] According to the local abnormal image of the tympanic membrane image and the healthy tympanic membrane simulation image, and the two-dimensional coordinates of the local abnormal image in the first coordinate system, the three-dimensional coordinates of the local abnormal image are established in the ear scanning image, thereby outputting a three-dimensional image processing result.

[0022] Preferably, the processing module comprises:

[0023] an identification unit, for identifying the tympanic membrane boundary, the anterior wall attachment point, the posterior wall attachment point, the light cone, the tympanic membrane umbilicus, the handle of the malleus, the short process of the malleus, and the anterior and posterior folds, and identifying the pars flaccida and the pars tense from the tympanic membrane image;

[0024] A calculation unit, used for establishing a two-dimensional first coordinate system on the tympanic membrane image;

[0025] a marking unit, used for marking the coordinates of the tympanic membrane boundary, the anterior wall attachment point, the posterior wall attachment point, the light cone, the tympanic membrane umbilicus, the handle of the malleus, the short process of the malleus, the anterior and posterior folds, the pars flaccida and the pars tense of the tympanic membrane image in the first coordinate system;

[0026] A modeling unit is used to construct a healthy tympanic membrane simulation image corresponding to the tympanic membrane image according to the tympanic membrane boundary, anterior wall attachment point, posterior wall attachment point, light cone, tympanic membrane umbilicus, handle of malleus, short process of malleus, anterior and posterior folds, pars flaccida and pars tense of the tympanic membrane image;

[0027] An extraction unit, used for comparing the eardrum image with the healthy eardrum simulated image, to extract a local abnormal image where the eardrum image is different from the healthy eardrum simulated image, and to obtain the coordinates of the local abnormal image;

[0028] The output unit is used to output the two-dimensional coordinates of the local abnormal image in the first coordinate system according to the local abnormal image and the coordinates corresponding to the local abnormal image in the first coordinate system.

[0029] Preferably, the calculation unit is further used to: calculate the correspondence between the tympanic membrane image and the ear scan image, and establish a second coordinate system in the ear scan image; determine the coordinates of the local abnormal image in the second coordinate system according to the coordinates of the local abnormal image in the first coordinate system;

[0030] The output unit is specifically used to output the three-dimensional coordinates corresponding to the local abnormal image according to the coordinates of the local abnormal image in the first coordinate system and the coordinates of the local abnormal image in the second coordinate system.

[0031] Preferably, the computing unit is specifically used for:

[0032] Identify the location of the front wall attachment point, the back wall attachment point and the umbilicus of the tympanic membrane from the ear scan image;

[0033] According to the position of the front wall attachment point, the position of the back wall attachment point and the position of the tympanic membrane umbilicus, a second coordinate system related to the first coordinate system in the tympanic membrane image is established in the ear scanning image.

[0034] Preferably, the calculation unit establishes the first coordinate system in the following manner:

[0035] Acquire the tympanic membrane umbilicus and the light cone in the tympanic membrane image, and identify the center of the tympanic membrane umbilicus;

[0036] Acquire the handle of the malleus in the tympanic membrane image, and draw a second coordinate axis passing through the center of the umbilicus of the tympanic membrane along the direction of the handle of the malleus;

[0037] Draw a first coordinate axis perpendicular to the second coordinate axis and passing through the center of the umbilicus of the tympanic membrane;

[0038] A first coordinate system is established with the center of the tympanic membrane navel as the origin, the first coordinate axis and the second coordinate axis as coordinate axes, the first coordinate axis takes the direction of the light cone as the positive direction, and the second coordinate axis takes the direction of the light cone as the negative direction.

[0039] Preferably, the extraction unit obtains the local abnormal image in the following manner:

[0040] Scanning the tympanic membrane image and the healthy tympanic membrane simulated image respectively using an observation window to extract a first scan image of each scan position on the tympanic membrane image and a corresponding second scan image on the healthy tympanic membrane simulated image, and calculating a color distance between each first scan image and the corresponding second scan image;

[0041] Determine a first local abnormal image belonging to congestion and a second local abnormal image belonging to inflammation according to the color distance between each first scan image and the corresponding second scan image and the RGB value of each pixel in the first scan image;

[0042] Comparing the length of the light cone on the tympanic membrane image with the length of the light cone on the healthy tympanic membrane simulated image, when the difference in the light cone length exceeds a preset length difference, taking the light cone on the tympanic membrane image as a third local abnormal image;

[0043] If at least one of perforation, secretion and tumor is identified in the tympanic membrane image, a corresponding image is extracted from the tympanic membrane image, and the coordinate position, size and shape of the corresponding image are calculated, and the perforation image is used as the fourth local abnormal image.

[0044] Preferably, the extraction unit is specifically used for:

[0045] The tympanic membrane image is traversed with the observation window, and the RGB value of each pixel in each traversed position is calculated. The pixel points corresponding to the RGB value that meets the color conditions are counted into the corresponding color set. The specific method is as follows:

[0046] Then P ij ∈Φ iP

[0047]

[0048] when When , the i-th traversal position belongs to the congested area;

[0049] when When , the i-th traversal position belongs to the inflammation area;

[0050] Among them, R ij1 is the R channel value of the jth pixel in the i-th traversal position of the tympanic membrane image, G ij1 is the G channel value of the jth pixel in the i-th traversal position of the tympanic membrane image, B ij1 is the B channel value of the jth pixel in the i-th traversal position of the tympanic membrane image; 1≤i≤I, I is the total number of traversal positions, 1≤j≤J, J is the total number of pixels in each traversal position;

[0051] R ij2 is the R channel value of the jth pixel in the ith traversal position of the healthy tympanic membrane simulated image, G ij2 is the G channel value of the jth pixel in the ith traversal position of the healthy tympanic membrane simulated image, B ij2 is the B channel value of the jth pixel in the i-th traversal position of the healthy tympanic membrane simulated image;

[0052] d ij is the color distance between the jth pixel in the ith traversal position of the tympanic membrane image and the jth pixel in the ith traversal position of the healthy tympanic membrane simulated image, and C is a constant greater than 0;

[0053] P ij is the jth pixel point in the ith traversal position of the tympanic membrane image, Φ iR is the set of red pixels at the ith traversal position of the tympanic membrane image, Φ iY is the set of yellow pixels at the ith traversal position of the tympanic membrane image, Φ iW is the set of white pixels at the ith traversal position of the tympanic membrane image, Φ iP is the set of pink pixels at the i-th traversal position of the tympanic membrane image;

[0054] N iR is the number of red pixels at the ith traversal position of the tympanic membrane image, N iY is the number of yellow pixels at the ith traversal position of the tympanic membrane image, N iW is the number of white pixels at the i-th traversal position of the tympanic membrane image, S is a set constant, S>5.

[0055] Preferably, the calculation unit establishes the second coordinate system in the following manner:

[0056] In the ear scan image, a two-dimensional initial coordinate system is established, wherein the initial coordinate system includes a third coordinate axis and a fourth coordinate axis;

[0057] Calculate the first inclination angle of the second coordinate axis of the first coordinate system, set the third coordinate axis in the direction of the first coordinate axis, and set the fourth coordinate axis in the direction of the second coordinate axis; calculate the second inclination angle of the tympanic membrane in the ear scanning image, take the tympanic membrane navel as the coordinate origin, tilt the plane determined by the third coordinate axis and the fourth coordinate axis according to the second inclination angle, and construct a fifth coordinate axis perpendicular to the third coordinate axis and the fourth coordinate axis respectively on the inclined plane to form a second coordinate system.

[0058] Preferably, the computing unit is specifically used for:

[0059] Marking the two-dimensional coordinates of the local abnormal image on the third coordinate axis and the fourth coordinate axis according to the coordinates of the local abnormal image in the first coordinate system;

[0060] In the ear scan image, an image of a region associated with the two-dimensional coordinates of the local abnormal image is identified to determine whether the image is associated with the two-dimensional coordinates of the local abnormal image;

[0061] If so, the coordinate values ​​associated with the two-dimensional coordinates of the local abnormal image are marked on the fifth coordinate axis.

[0062] The present invention further provides an image processing method, which uses the otitis media medical image processing system to perform image processing; the method comprises the following steps:

[0063] Acquiring operating parameters of the otoscope, and acquiring an image of the eardrum collected by the otoscope after adjusting the otoscope according to the operating parameters, wherein the operating parameters of the otoscope include brightness and focal length;

[0064] Establishing a two-dimensional first coordinate system in the tympanic membrane image;

[0065] According to the coordinate points of the physiological structure in the ear in the first coordinate system of the tympanic membrane image, a simulated image of a healthy tympanic membrane with the same position of the physiological structure in the ear is constructed;

[0066] According to the local abnormal image of the tympanic membrane image and the healthy tympanic membrane simulation image, and the two-dimensional coordinates of the local abnormal image in the first coordinate system, the three-dimensional coordinates of the local abnormal image are established in the ear scanning image, thereby outputting a three-dimensional image processing result.

[0067] The technical solution of the present invention is a medical image processing system for otitis media. Since otitis media is generally judged by the tympanic membrane image and the external auditory canal condition, in the present invention, after adjusting the otoscope according to the otoscope operation parameters, the tympanic membrane image is collected by the otoscope, and a two-dimensional first coordinate system is established in the tympanic membrane image. According to the coordinate points of each physiological result in the ear extracted from the tympanic membrane image, a healthy tympanic membrane simulation image with the same position of the physiological structure in the ear is constructed; then, the tympanic membrane image is compared with the healthy tympanic membrane simulation image to extract a local abnormal image, so that the two-dimensional coordinate system of the local abnormal image can be determined in the two-dimensional first coordinate system. Coordinates, but the two-dimensional coordinates cannot feedback the three-dimensional situation of the local abnormal image. For example, if the tympanic membrane is partially blocked by cerumen or abscess, the three-dimensional blockage position of the cerumen or abscess, or the ear situation around the three dimensions cannot be determined. Therefore, ear scanning images (such as CT images) are used to mark the three-dimensional coordinates of the local abnormal image. The image situation of the local abnormal image in three directions can be detected, which is conducive to using otoscope images to form a complete image analysis result, which is conducive to enabling doctors to form a complete and accurate diagnosis based on the three-dimensional image analysis results. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying creative work.

[0069] Figure 1 A schematic diagram for establishing a first coordinate system in the tympanic membrane image;

[0070] Figure 2 A schematic diagram of establishing a second coordinate system for scanning images of the ear;

[0071] Figure 3 This is an image of a healthy tympanic membrane;

[0072] Figure 4 This is the image of a congested tympanic membrane;

[0073] Figure 5 A schematic diagram for determining the coordinate value of the fifth coordinate axis in the second coordinate system;

[0074] Figure 6 It is a framework diagram of the otitis media medical image processing system of the present invention. DETAILED DESCRIPTION

[0075] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0076] See also Figures 1 to 6 To achieve the above objectives, the present invention proposes a medical image processing system for otitis media. Figure 6 , the system includes an acquisition module and a processing module, the acquisition module is used to communicate with an otoscope for acquiring tympanic membrane images, and is also used to communicate with an ear scanning device for acquiring supplementary ear images;

[0077] The acquisition module is used to: acquire the operating parameters of the otoscope, and acquire the tympanic membrane image collected by the otoscope after adjusting the otoscope according to the operating parameters, wherein the operating parameters of the otoscope include brightness and focal length;

[0078] The processing module is used for:

[0079] Establishing a two-dimensional first coordinate system in the tympanic membrane image;

[0080] According to the coordinate points of the physiological structure in the ear in the first coordinate system of the tympanic membrane image, a simulated image of a healthy tympanic membrane with the same position of the physiological structure in the ear is constructed;

[0081] According to the local abnormal image of the tympanic membrane image and the healthy tympanic membrane simulation image, and the two-dimensional coordinates of the local abnormal image in the first coordinate system, the three-dimensional coordinates of the local abnormal image are established in the ear scanning image, thereby outputting a three-dimensional image processing result.

[0082] The technical solution of the present invention is a medical image processing system for otitis media. Since otitis media is generally judged by the tympanic membrane image and the external auditory canal condition, in the present invention, after adjusting the otoscope according to the otoscope operation parameters, the tympanic membrane image is collected by the otoscope, and a two-dimensional first coordinate system is established in the tympanic membrane image. According to the coordinate points of each physiological result in the ear extracted from the tympanic membrane image, a healthy tympanic membrane simulation image with the same position of the physiological structure in the ear is constructed; then, the tympanic membrane image is compared with the healthy tympanic membrane simulation image to extract a local abnormal image, so that the two-dimensional coordinate system of the local abnormal image can be determined in the two-dimensional first coordinate system. Coordinates, but the two-dimensional coordinates cannot feedback the three-dimensional situation of the local abnormal image. For example, if the tympanic membrane is partially blocked by cerumen or abscess, the three-dimensional blockage position of the cerumen or abscess, or the ear situation around the three dimensions cannot be determined. Therefore, ear scanning images (such as CT images) are used to mark the three-dimensional coordinates of the local abnormal image. The image situation of the local abnormal image in three directions can be detected, which is conducive to using otoscope images to form a complete image analysis result, which is conducive to enabling doctors to form a complete and accurate diagnosis based on the three-dimensional image analysis results.

[0083] Specifically, the operating parameters of the otoscope include at least brightness and focal length. Acquiring the operating parameters of the otoscope refers to acquiring the preset operating parameters of the otoscope. If the operator adjusts the preset operating parameters of the otoscope, the parameters acquired are those after the operator adjusts the parameters of the otoscope.

[0084] The tympanic membrane image and the operation parameters corresponding to the tympanic membrane image are stored in the system.

[0085] Since the image collected under the otoscope is a two-dimensional image, in the present invention, a two-dimensional first coordinate system is also established in the tympanic membrane image; the role of the first coordinate system is reflected in two aspects:

[0086] In the first aspect, the first coordinate system is used to mark the two-dimensional coordinates of each physiological structure in the ear identified from the eardrum image, so that a healthy eardrum simulation image with the same position of each physiological structure in the ear as that in the eardrum image can be constructed by modeling according to the coordinates of each marked physiological structure in the ear;

[0087] Secondly, by comparing the tympanic membrane image with the healthy tympanic membrane simulated image, the local abnormal image of the tympanic membrane image relative to the healthy tympanic membrane simulated image can be found, thereby marking the two-dimensional coordinates of the local abnormal image, that is, it can be used to locate the size and position of the local abnormal image in a two-dimensional scale;

[0088] Thirdly, in the ear scanning image, the position of the local abnormal image can be quickly located according to the size and position of the local abnormal image in the two-dimensional scale, and the ear scanning image can be used to construct the three-dimensional coordinates corresponding to the local abnormal image, thereby converting the local abnormal image in the two-dimensional scale into the local abnormal image in the three-dimensional size, which is conducive to the complete observation of the abnormal situation in the ear.

[0089] Optionally, the processing module includes:

[0090] an identification unit, for identifying the tympanic membrane boundary, the anterior wall attachment point, the posterior wall attachment point, the light cone, the tympanic membrane umbilicus, the handle of the malleus, the short process of the malleus, and the anterior and posterior folds, and identifying the pars flaccida and the pars tense from the tympanic membrane image;

[0091] A calculation unit, used for establishing a two-dimensional first coordinate system on the tympanic membrane image;

[0092] a marking unit, used for marking the coordinates of the tympanic membrane boundary, the anterior wall attachment point, the posterior wall attachment point, the light cone, the tympanic membrane umbilicus, the handle of the malleus, the short process of the malleus, the anterior and posterior folds, the pars flaccida and the pars tense of the tympanic membrane image in the first coordinate system;

[0093] A modeling unit is used to construct a healthy tympanic membrane simulation image corresponding to the tympanic membrane image according to the tympanic membrane boundary, anterior wall attachment point, posterior wall attachment point, light cone, tympanic membrane umbilicus, handle of malleus, short process of malleus, anterior and posterior folds, pars flaccida and pars tense of the tympanic membrane image;

[0094] An extraction unit, used for comparing the eardrum image with the healthy eardrum simulated image, to extract a local abnormal image where the eardrum image is different from the healthy eardrum simulated image, and to obtain the coordinates of the local abnormal image;

[0095] The output unit is used to output the two-dimensional coordinates of the local abnormal image in the first coordinate system according to the local abnormal image and the coordinates corresponding to the local abnormal image in the first coordinate system.

[0096] In this embodiment, the physiological structures in the ear include the tympanic membrane border, the anterior wall attachment point, the posterior wall attachment point, the light cone, the tympanic membrane umbilicus, the handle of the malleus, the short process of the malleus, the anterior and posterior folds, and the pars flaccida and the pars tense;

[0097] After the two-dimensional first coordinate system is established, the coordinates of each physiological structure in the ear in the two-dimensional tympanic membrane image are also marked, so that the contour of the physiological structure around the tympanic membrane has been marked. Therefore, when constructing a healthy tympanic membrane simulation image, according to the type and position of each physiological structure in the ear, it is colored in a preset manner to form a healthy tympanic membrane simulation image.

[0098] By comparing the tympanic membrane image with the simulated image of a healthy tympanic membrane, the local abnormal image is determined, and the coordinates of the local abnormal image are marked, which is conducive to quickly locating the abnormal area in the ear.

[0099] Furthermore, by identifying the color of the local abnormal image, the type of the local abnormal image can be determined, and by identifying the boundary of the local abnormal image, the number and size of the local abnormal image can be determined.

[0100] In this embodiment, the coordinates of the upper boundary point, the lower boundary point, the left boundary point, and the right boundary point of each local abnormal image are used to mark the boundary position of each local abnormal image. Wherein, the first coordinate system includes a horizontal x-axis and a vertical y-axis, and the coordinates of the upper boundary point of the kth local abnormal image are: The coordinates of the lower boundary point of the kth local abnormal image are: The coordinates of the left boundary point of the kth local abnormal image are: The coordinates of the right boundary point of the kth local abnormal image are: 1≤k≤K, K is the number of local abnormal images.

[0101] Optionally, the calculation unit is further used to: calculate the correspondence between the tympanic membrane image and the ear scan image, and establish a second coordinate system in the ear scan image; determine the coordinates of the local abnormal image in the second coordinate system according to the coordinates of the local abnormal image in the first coordinate system;

[0102] The output unit is specifically used to output the three-dimensional coordinates corresponding to the local abnormal image according to the coordinates of the local abnormal image in the first coordinate system and the coordinates of the local abnormal image in the second coordinate system.

[0103] In this embodiment, the ear scanning image can be a nuclear magnetic resonance image or a high-resolution CT scan of the temporal bone, and a cross-section is taken. The cross-section is scanned layer by layer with the line connecting the upper edge of the external auditory canal opening and the apex of the upper orbital margin as the baseline. Computer tomography can observe some conditions of the eardrum, especially in high-resolution CT images. The eardrum is a thin membrane located between the end of the external auditory canal and the middle ear, with a specific density, which allows it to show a clear boundary on the CT image. When the eardrum is intact, it will appear as a continuous boundary; when the eardrum is perforated, this boundary may be interrupted or show different shapes, which can be identified on the CT image.

[0104] Furthermore, since the images inside the ear are in pairs and each person has two ears, when using the tympanic membrane image and the ear scanning image, the ear image on the same side should be used.

[0105] In the tympanic membrane image, the tympanic membrane and the surrounding physiological structures are in a plane, which is equivalent to displaying the image of the tympanic membrane and the surrounding physiological structures in the plane determined by the first coordinate axis (x-axis) and the second coordinate axis (y-axis) in the first coordinate system; while in the ear scan image, what is seen is the side of the tympanic membrane image, that is, the image observed from the side of the plane determined by the x-axis and the y-axis, that is, the effect of observing in a direction perpendicular to the plane determined by the x-axis and the y-axis. Therefore, the fourth coordinate axis y' axis (corresponding to the y-axis in the first coordinate system) and the fifth coordinate axis z' axis are established in the ear scan image, and the second coordinate system is established based on the fourth coordinate axis y' axis and the fifth coordinate axis z' axis.

[0106] At this time, the tympanic membrane coordinates in the tympanic membrane image need to be matched with the tympanic membrane coordinates in the ear scan image.

[0107] In this embodiment, the coordinate values ​​in the direction of the fourth coordinate axis are determined according to the coordinate values ​​corresponding to the first coordinate axis and the second coordinate axis of each local abnormal image in the tympanic membrane image, and then the coordinate values ​​in the direction of the fourth coordinate axis are searched for the coordinate values ​​in the fifth coordinate axis of the corresponding local abnormal image on the ear scan image according to the coordinate values ​​in the direction of the fourth coordinate axis, so as to determine the three-dimensional coordinates corresponding to the local abnormal image. In addition, when scanning the ear, tomographic images at different positions can be formed along the direction of the first coordinate axis to obtain multiple tomographic images along the direction of the first coordinate axis, so that the coordinate values ​​of the third coordinate axis corresponding to the same ear scan image are the same. When obtaining tympanic membrane images corresponding to different third coordinate values, the ear scan image at the corresponding tomographic position can be checked.

[0108] Optionally, the output unit is specifically used for:

[0109] Determine whether the local abnormal image belongs to a preset disease image;

[0110] If so, calculate the intra-ear position area corresponding to the local abnormal image and the size of the local abnormal image in the ear based on the coordinates corresponding to the local abnormal image in the first coordinate system and the coordinates of each intra-ear physiological structure in the tympanic membrane image; and output the intra-ear position area and size corresponding to the local abnormal image.

[0111] Optionally, the computing unit is specifically used for:

[0112] Identify the location of the front wall attachment point, the back wall attachment point and the umbilicus of the tympanic membrane from the ear scan image;

[0113] According to the position of the front wall attachment point, the position of the back wall attachment point and the position of the tympanic membrane umbilicus, a second coordinate system related to the first coordinate system in the tympanic membrane image is established in the ear scanning image.

[0114] Please refer to Figure 2Specifically, the anterior wall attachment point of the tympanic membrane refers to the position where the anterior lower part of the tympanic membrane is attached to the anterior lower wall of the external auditory canal ( Figure 2 The posterior attachment point of the tympanic membrane refers to the position where the posterior superior part of the tympanic membrane is attached to the posterior superior wall of the external auditory canal ( Figure 2 The umbilicus is located at the turning point between the upper and lower parts of the tympanic membrane ( Figure 2 o' point position).

[0115] The umbilicus of the tympanic membrane is taken as the origin of the second coordinate system. The fourth coordinate axis y' in the second coordinate system is parallel to the direction of the line connecting the front wall attachment point and the back wall attachment point and passes through the origin of the second coordinate system. The positive direction of the fourth coordinate axis y' points to the upper boundary of the tympanic membrane.

[0116] The fifth coordinate axis z' in the second coordinate system is perpendicular to the fourth coordinate axis y' and passes through the origin of the second coordinate system, wherein the positive direction of the fifth coordinate axis z' points to the external auditory canal;

[0117] The x'-axis direction of the third coordinate axis in the second coordinate system is perpendicular to the scanning plane of the ear scan image and passes through the origin in the second coordinate system. At the same time, the third coordinate axis is perpendicular to the fourth coordinate axis and the fifth coordinate axis in the second coordinate system respectively. The positive direction of the third coordinate axis points to the direction of the ear scan image close to the reader. Figure 2 is a tomographic image with a fixed coordinate value of the third coordinate axis, that is, Figure 2 In the ear scan image shown, the coordinate values ​​of the third coordinate axis are equal.

[0118] Optionally, the calculation unit establishes the first coordinate system according to the following method:

[0119] Acquire the tympanic membrane umbilicus and the light cone in the tympanic membrane image, and identify the center of the tympanic membrane umbilicus;

[0120] Acquire the handle of the malleus in the tympanic membrane image, and draw a second coordinate axis y-axis passing through the center of the umbilicus of the tympanic membrane along the direction of the handle of the malleus;

[0121] Draw a first coordinate axis x-axis perpendicular to the second coordinate axis y-axis and passing through the center point o of the umbilicus of the tympanic membrane;

[0122] A first coordinate system is established with the center of the tympanic membrane navel as the origin, the first coordinate axis and the second coordinate axis as coordinate axes, the first coordinate axis takes the direction of the light cone as the positive direction, and the second coordinate axis takes the direction of the light cone as the negative direction.

[0123] Please refer to Figure 1After the first coordinate system is established, the four quadrants of the tympanic membrane are also divided, including: the front upper quadrant located in the positive direction of the first coordinate axis and the positive direction of the second coordinate axis, the back upper quadrant located in the negative direction of the first coordinate axis and the positive direction of the second coordinate axis, the front lower quadrant located in the positive direction of the first coordinate axis and the negative direction of the second coordinate axis, and the back lower quadrant located in the negative direction of the first coordinate axis and the negative direction of the second coordinate axis. The establishment of these four quadrants is of great significance for the positioning of local abnormal images on the tympanic membrane.

[0124] Furthermore, the extraction unit obtains the local abnormal image by referring to the following method:

[0125] Scanning the tympanic membrane image and the healthy tympanic membrane simulated image respectively using an observation window to extract a first scan image of each scan position on the tympanic membrane image and a corresponding second scan image on the healthy tympanic membrane simulated image, and calculating a color distance between each first scan image and the corresponding second scan image;

[0126] Determine a first local abnormal image belonging to congestion and a second local abnormal image belonging to inflammation according to the color distance between each first scan image and the corresponding second scan image and the RGB value of each pixel in the first scan image;

[0127] Comparing the length of the light cone on the tympanic membrane image with the length of the light cone on the healthy tympanic membrane simulated image, when the difference in the light cone length exceeds a preset length difference, taking the light cone on the tympanic membrane image as a third local abnormal image;

[0128] If at least one of perforation, secretion and tumor is identified in the tympanic membrane image, a corresponding image is extracted from the tympanic membrane image, and the coordinate position, size and shape of the corresponding image are calculated, and the perforation image is used as the fourth local abnormal image.

[0129] Specifically, when the observation window is scanned within the tympanic membrane image range, the scanning is performed in four quadrants, first scanning the anterior upper quadrant, then scanning the posterior upper quadrant, then scanning the posterior lower quadrant, and finally scanning the anterior lower quadrant.

[0130] The eardrum conditions corresponding to otitis media include the following:

[0131] Congestion: Mild congestion is only seen in stripes at the handle of the malleus, or radiates from the umbilicus to the surrounding areas. Severe congestion is diffuse bright red and is often caused by acute inflammation of the external auditory canal or middle ear.

[0132] Invagination: manifested as shortening, dispersion or disappearance of the light cone, obvious protrusion of the short process of the malleus, and displacement of the handle of the malleus toward the back and top, seemingly shortened and transverse, mostly caused by Eustachian tube obstruction or adhesions in the tympanic cavity.

[0133] Opacity: The eardrum thickens and loses its luster, the surface markings are unclear, and it presents local or widespread white turbidity or localized whitish and thickened scars. Sometimes, clearly defined yellow or white calcification spots can be seen. This is caused by the sequelae of middle ear inflammation.

[0134] Perforation: Attention should be paid to the location, size, shape, amount and nature of secretions of the perforation, and whether there is swelling, granulation, polyp or cholesteatoma secretion in the tympanic cavity mucosa within the perforation.

[0135] Specifically, the observation window is a square window, and the length of the observation window is determined by the length of the handle of the malleus.

[0136]

[0137] Wherein, l is the length of the observation window, A is a set constant, A>10, and y0 is the y-axis length corresponding to the handle of the malleus.

[0138] For further information, see Figure 3 , a healthy eardrum is a relatively balanced light pink color, see Figure 4 The congested eardrum shows blood-colored lines, and the more severe the congestion, the larger the range of the blood color. Other inflammatory areas appear white or yellow. Therefore, the RGB values ​​of congested or inflammatory areas are clearly different from the normal light pink RGB values.

[0139] In this embodiment, the extraction unit is specifically used for:

[0140] The tympanic membrane image is traversed with the observation window, and the RGB value of each pixel in each traversed position is calculated. The pixel points corresponding to the RGB value that meets the color conditions are counted into the corresponding color set. The specific method is as follows:

[0141] Then P ij ∈Φ iP

[0142]

[0143] when When , the i-th traversal position belongs to the congested area;

[0144] when When , the i-th traversal position belongs to the inflammation area;

[0145] Among them, R ij1 is the R channel value of the jth pixel in the i-th traversal position of the tympanic membrane image, G ij1 is the G channel value of the jth pixel in the i-th traversal position of the tympanic membrane image, B ij1is the B channel value of the jth pixel in the i-th traversal position of the tympanic membrane image; 1≤i≤I, I is the total number of traversal positions, 1≤j≤J, J is the total number of pixels in each traversal position;

[0146] R ij2 is the R channel value of the jth pixel in the ith traversal position of the healthy tympanic membrane simulated image, G ij2 is the G channel value of the jth pixel in the ith traversal position of the healthy tympanic membrane simulated image, B ij2 is the B channel value of the jth pixel in the i-th traversal position of the healthy tympanic membrane simulated image;

[0147] d ij is the color distance between the jth pixel in the ith traversal position of the tympanic membrane image and the jth pixel in the ith traversal position of the healthy tympanic membrane simulated image, and C is a constant greater than 0;

[0148] P ij is the jth pixel point in the ith traversal position of the tympanic membrane image, Φ iR is the set of red pixels at the ith traversal position of the tympanic membrane image, Φ iY is the set of yellow pixels at the ith traversal position of the tympanic membrane image, Φ iW is the set of white pixels at the ith traversal position of the tympanic membrane image, Φ iP is the set of pink pixels at the i-th traversal position of the tympanic membrane image;

[0149] N iR is the number of red pixels at the ith traversal position of the tympanic membrane image, N iY is the number of yellow pixels at the ith traversal position of the tympanic membrane image, N iW is the number of white pixels at the i-th traversal position of the tympanic membrane image, S is a set constant, S>5.

[0150] Optionally, the calculation unit establishes the second coordinate system in the following manner:

[0151] In the ear scan image, a two-dimensional initial coordinate system is established, wherein the initial coordinate system includes a third coordinate axis and a fourth coordinate axis;

[0152] Calculate the first inclination angle of the second coordinate axis of the first coordinate system, set the third coordinate axis in the direction of the first coordinate axis, and set the fourth coordinate axis in the direction of the second coordinate axis; calculate the second inclination angle of the tympanic membrane in the ear scanning image, take the tympanic membrane navel as the coordinate origin, tilt the plane determined by the third coordinate axis and the fourth coordinate axis according to the second inclination angle, and construct a fifth coordinate axis perpendicular to the third coordinate axis and the fourth coordinate axis respectively on the inclined plane to form a second coordinate system.

[0153] See also Figure 1 The first coordinate system is established based on the two-dimensional tympanic membrane image, and the second coordinate axis (y-axis) is set along the length direction of the handle of the hammer, and the first coordinate axis (x-axis) is established perpendicular to the second coordinate axis. Therefore, the second coordinate axis has a first inclination angle with the vertical direction.

[0154] Furthermore, the eardrum is actually set at an angle in the ear canal (see Figure 2 ), therefore, the second tilt angle of the eardrum refers to the tilt angle of the eardrum in the ear canal.

[0155] Therefore, according to the first tilt angle, the fourth coordinate axis (y' axis) is tilted with the vertical direction by the first tilt angle, and then the third coordinate axis (x' axis) is established perpendicularly. Then, the origin of the second coordinate system is coincident with the tympanic membrane navel in the ear scan image, and then according to the second tilt angle, the plane established by the third coordinate axis and the fourth coordinate axis is tilted, and then the fifth coordinate axis (z' axis) perpendicular to the third coordinate axis and the fourth coordinate axis is respectively made. At this time, it can be obtained Figure 2 The second coordinate system shown, wherein the third coordinate axis x' axis in the second coordinate system is Figure 2 The image plane is vertical, so Figure 2 The third coordinate axis x' is not labeled.

[0156] Furthermore, the computing unit is specifically used for:

[0157] Marking the two-dimensional coordinates of the local abnormal image on the third coordinate axis and the fourth coordinate axis according to the coordinates of the local abnormal image in the first coordinate system;

[0158] In the ear scan image, an image of a region associated with the two-dimensional coordinates of the local abnormal image is identified to determine whether the image is associated with the two-dimensional coordinates of the local abnormal image;

[0159] If so, the coordinate values ​​associated with the two-dimensional coordinates of the local abnormal image are marked on the fifth coordinate axis.

[0160] The coordinate value of the hth coordinate point of the kth local abnormal image in the first coordinate system is (x kh ,y kh ). When marking the coordinates of the kth local abnormal image in the third and fourth coordinate axes, see Figure 5 , now according to the coordinate value x of the first coordinate axis in the first coordinate system kh , determine the coordinate value x' in the third coordinate axis kh , so that it can be determined which section of the ear scan image to select. Further, in the selected ear scan image, the fourth coordinate axis is marked with (x kh ,y kh ) corresponds to the coordinate point y' on the fourth coordinate axiskh location.

[0161] According to y' on the fourth coordinate axis kh Position, the eardrum image in the second coordinate system corresponds to the boundary point E of the fifth coordinate axis, and the corresponding boundary point coordinate z' on the fifth coordinate axis can be determined kh Thus, the position of the kth local abnormal image on the fifth coordinate axis can be determined according to the ear scanning image, so that the two-dimensional local abnormal image is transformed into a three-dimensional local abnormal image with a three-dimensional directional scale (x' kh ,y' kh ,z' kh ).

[0162] Furthermore, since the ear scanning image in the present invention is a tomographic CT image, the inter-layer stacking direction of the tomographic scan here is the direction of the fourth coordinate axis. Therefore, through the tomographic ear scanning images at different positions, the boundary point coordinates corresponding to each local abnormal image at different tomographic scanning positions can be determined.

[0163] In addition, to achieve the above-mentioned purpose, the present invention further proposes an image processing system, wherein the image processing method uses any one of the above-mentioned medical image processing systems for otitis media to perform image processing; the method comprises the following steps:

[0164] Step S10, obtaining operating parameters of the otoscope, and obtaining an image of the eardrum collected by the otoscope after adjusting the otoscope according to the operating parameters, wherein the operating parameters of the otoscope include brightness and focal length;

[0165] Step S20, establishing a two-dimensional first coordinate system in the tympanic membrane image;

[0166] Step S30, constructing a simulated image of a healthy tympanic membrane with the same position of the physiological structure in the ear according to the coordinate points of the physiological structure in the ear in the first coordinate system of the tympanic membrane image;

[0167] Step S40, based on the local abnormal image of the tympanic membrane image and the healthy tympanic membrane simulation image, and the two-dimensional coordinates of the local abnormal image in the first coordinate system, establish the three-dimensional coordinates of the local abnormal image in the ear scanning image, thereby outputting a three-dimensional image processing result.

[0168] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. All equivalent structural changes made using the contents of the present invention's specification and drawings, or directly / indirectly applied in other related technical fields, are included in the patent protection scope of the present invention.

Claims

1. A medical image processing system for otitis media, characterized in that: The system includes an acquisition module and a processing module, wherein the acquisition module is used to communicate with an otoscope for acquiring tympanic membrane images and is used to communicate with an ear scanning device for acquiring supplementary ear images; The acquisition module is used to: acquire the operating parameters of the otoscope, and acquire the tympanic membrane image collected by the otoscope after adjusting the otoscope according to the operating parameters, wherein the operating parameters of the otoscope include brightness and focal length; The processing module is used for: Establishing a two-dimensional first coordinate system in the tympanic membrane image; According to the coordinate points of the physiological structure of the ear in the first coordinate system of the eardrum image, a simulated image of a healthy eardrum with the same position of the physiological structure of the ear is constructed; The tympanic membrane image is compared with the healthy tympanic membrane simulated image to obtain a local abnormal image in which the tympanic membrane image is different from the healthy tympanic membrane simulated image; based on the local abnormal image and the two-dimensional coordinates of the local abnormal image in the first coordinate system, the three-dimensional coordinates of the local abnormal image are established in the ear scanning image, thereby outputting a three-dimensional image processing result.

2. The otitis media medical image processing system according to claim 1, characterized in that: The processing module comprises: an identification unit, for identifying the tympanic membrane boundary, the anterior wall attachment point, the posterior wall attachment point, the light cone, the tympanic membrane umbilicus, the handle of the malleus, the short process of the malleus, and the anterior and posterior folds, and identifying the pars flaccida and the pars tense from the tympanic membrane image; A calculation unit, used for establishing a two-dimensional first coordinate system on the tympanic membrane image; a marking unit, used for marking the coordinates of the tympanic membrane boundary, the anterior wall attachment point, the posterior wall attachment point, the light cone, the tympanic membrane umbilicus, the handle of the malleus, the short process of the malleus, the anterior and posterior folds, the pars flaccida and the pars tense of the tympanic membrane image in the first coordinate system; A modeling unit is used to construct a healthy tympanic membrane simulation image corresponding to the tympanic membrane image according to the tympanic membrane boundary, anterior wall attachment point, posterior wall attachment point, light cone, tympanic membrane umbilicus, handle of malleus, short process of malleus, anterior and posterior folds, pars flaccida and pars tense of the tympanic membrane image; An extraction unit, used for comparing the eardrum image with the healthy eardrum simulated image, to extract a local abnormal image where the eardrum image is different from the healthy eardrum simulated image, and to obtain the coordinates of the local abnormal image; The output unit is used to output the two-dimensional coordinates of the local abnormal image in the first coordinate system according to the local abnormal image and the coordinates corresponding to the local abnormal image in the first coordinate system.

3. The otitis media medical image processing system according to claim 2, characterized in that: The calculation unit is further used to: calculate the correspondence between the tympanic membrane image and the ear scan image, and establish a second coordinate system in the ear scan image; determine the coordinates of the local abnormal image in the second coordinate system according to the coordinates of the local abnormal image in the first coordinate system; The output unit is specifically used to output the three-dimensional coordinates corresponding to the local abnormal image according to the coordinates of the local abnormal image in the first coordinate system and the coordinates of the local abnormal image in the second coordinate system.

4. The otitis media medical image processing system according to claim 3, characterized in that: The computing unit is specifically used for: Identify the location of the front wall attachment point, the back wall attachment point and the umbilicus of the tympanic membrane from the ear scan image; According to the position of the front wall attachment point, the position of the back wall attachment point and the position of the tympanic membrane umbilicus, a second coordinate system related to the first coordinate system in the tympanic membrane image is established in the ear scanning image.

5. The otitis media medical image processing system according to claim 4, characterized in that: The calculation unit establishes the first coordinate system according to the following method: Acquire the tympanic membrane umbilicus and the light cone in the tympanic membrane image, and identify the center of the tympanic membrane umbilicus; Acquire the handle of the malleus in the tympanic membrane image, and draw a second coordinate axis passing through the center of the umbilicus of the tympanic membrane along the direction of the handle of the malleus; Draw a first coordinate axis perpendicular to the second coordinate axis and passing through the center of the umbilicus of the tympanic membrane; A first coordinate system is established with the center of the tympanic membrane navel as the origin, the first coordinate axis and the second coordinate axis as coordinate axes, the first coordinate axis takes the direction of the light cone as the positive direction, and the second coordinate axis takes the direction of the light cone as the negative direction.

6. The otitis media medical image processing system according to claim 5, characterized in that: The extraction unit obtains the local abnormal image in the following manner: Scanning the tympanic membrane image and the healthy tympanic membrane simulated image respectively using an observation window to extract a first scan image of each scan position on the tympanic membrane image and a corresponding second scan image on the healthy tympanic membrane simulated image, and calculating a color distance between each first scan image and the corresponding second scan image; Determine a first local abnormal image belonging to congestion and a second local abnormal image belonging to inflammation according to the color distance between each first scan image and the corresponding second scan image and the RGB value of each pixel in the first scan image; Comparing the length of the light cone on the tympanic membrane image with the length of the light cone on the healthy tympanic membrane simulated image, when the difference in the light cone length exceeds a preset length difference, taking the light cone on the tympanic membrane image as a third local abnormal image; If at least one of perforation, secretion and tumor is identified in the tympanic membrane image, a corresponding image is extracted from the tympanic membrane image, and the coordinate position, size and shape of the corresponding image are calculated, and the perforation image is used as the fourth local abnormal image.

7. The otitis media medical image processing system according to claim 6, characterized in that: The extraction unit is specifically used for: The tympanic membrane image is traversed with the observation window, and the RGB value of each pixel in each traversed position is calculated. The pixel points corresponding to the RGB value that meets the color conditions are counted into the corresponding color set. The specific method is as follows: when When , the i-th traversal position belongs to the congested area; when When , the i-th traversal position belongs to the inflammation area; Among them, R ij1 is the R channel value of the jth pixel in the i-th traversal position of the tympanic membrane image, G ij1 is the G channel value of the jth pixel in the i-th traversal position of the tympanic membrane image, B ij1 is the B channel value of the jth pixel in the i-th traversal position of the tympanic membrane image; 1≤i≤I, I is the total number of traversal positions, 1≤j≤J, J is the total number of pixels in each traversal position; R ij2 is the R channel value of the jth pixel in the ith traversal position of the healthy tympanic membrane simulated image, G ij2 is the G channel value of the jth pixel in the ith traversal position of the healthy tympanic membrane simulated image, B ij2 is the B channel value of the jth pixel in the i-th traversal position of the healthy tympanic membrane simulated image; d ij is the color distance between the jth pixel point in the i-th traversal position of the tympanic membrane image and the jth pixel point in the i-th traversal position of the healthy tympanic membrane simulated image, and C is a constant greater than 0; P ij is the jth pixel point in the ith traversal position of the tympanic membrane image, Φ iR is the set of red pixels at the ith traversal position of the tympanic membrane image, Φ iY is the set of yellow pixels at the ith traversal position of the tympanic membrane image, Φ iW is the set of white pixels at the ith traversal position of the tympanic membrane image, Φ iP is the set of pink pixels at the i-th traversal position of the tympanic membrane image; N iR is the number of red pixels at the ith traversal position of the tympanic membrane image, N iY is the number of yellow pixels at the ith traversal position of the tympanic membrane image, N iW is the number of white pixels at the i-th traversal position of the tympanic membrane image, S is a set constant, S>5.

8. The otitis media medical image processing system according to claim 6, characterized in that: The calculation unit establishes the second coordinate system in the following manner: In the ear scan image, a two-dimensional initial coordinate system is established, wherein the initial coordinate system includes a third coordinate axis and a fourth coordinate axis; Calculate the first inclination angle of the second coordinate axis of the first coordinate system, set the third coordinate axis in the direction of the first coordinate axis, and set the fourth coordinate axis in the direction of the second coordinate axis; calculate the second inclination angle of the tympanic membrane in the ear scanning image, take the tympanic membrane navel as the coordinate origin, tilt the plane determined by the third coordinate axis and the fourth coordinate axis according to the second inclination angle, and construct a fifth coordinate axis perpendicular to the third coordinate axis and the fourth coordinate axis respectively on the inclined plane to form a second coordinate system.

9. The otitis media medical image processing system according to claim 8, characterized in that: The computing unit is specifically used for: Marking the two-dimensional coordinates of the local abnormal image on the third coordinate axis and the fourth coordinate axis according to the coordinates of the local abnormal image in the first coordinate system; In the ear scan image, an image of a region associated with the two-dimensional coordinates of the local abnormal image is identified to determine whether the image is associated with the two-dimensional coordinates of the local abnormal image; If so, the coordinate values ​​associated with the two-dimensional coordinates of the local abnormal image are marked on the fifth coordinate axis.

10. An image processing method, characterized in that: The image processing method uses the otitis media medical image processing system as described in any one of claims 1 to 9 to perform image processing; the method comprises the following steps: The operating parameters of the otoscope are obtained, and the tympanic membrane image collected by the otoscope after the otoscope is adjusted according to the operating parameters is obtained, wherein: The operating parameters of the otoscope include brightness and focus; Establishing a two-dimensional first coordinate system in the tympanic membrane image; According to the coordinate points of the physiological structure of the ear in the first coordinate system of the eardrum image, a simulated image of a healthy eardrum with the same position of the physiological structure of the ear is constructed; The tympanic membrane image is compared with the healthy tympanic membrane simulated image to obtain a local abnormal image in which the tympanic membrane image is different from the healthy tympanic membrane simulated image; based on the local abnormal image and the two-dimensional coordinates of the local abnormal image in the first coordinate system, the three-dimensional coordinates of the local abnormal image are established in the ear scanning image, thereby outputting a three-dimensional image processing result.

Images